Skip to content

Add edge case tests for out-of-range token id decoding in Qwen2 tokenizer#45191

Closed
saslifat-gif wants to merge 2 commits intohuggingface:mainfrom
saslifat-gif:test/qwen2-decode-out-of-range-ids
Closed

Add edge case tests for out-of-range token id decoding in Qwen2 tokenizer#45191
saslifat-gif wants to merge 2 commits intohuggingface:mainfrom
saslifat-gif:test/qwen2-decode-out-of-range-ids

Commits

Commits on Apr 2, 2026