[release/4.0] Moved SpecialTokens assignment after the modification to avoid "Collection Modified" error#7330

Merged

ericstj merged 8 commits intorelease/4.0from

backport/pr-7328-to-release/4.0

Dec 9, 2024

Commits on Dec 5, 2024

Moved special tokens assignment below so the collection won't be modified

shaltielshmid
authored and
github-actions
committed
Added safe dictionary inversion

shaltielshmid
authored and
github-actions
committed
Added storing the not-normalized special tokens

shaltielshmid
authored and
github-actions
committed
Added support for net standard

shaltielshmid
authored and
github-actions
committed
Added and updated tests

shaltielshmid
authored and
github-actions
committed
Updated without additional memory allocation

shaltielshmid
authored and
github-actions
committed
Apply suggestions from code review

tarekgh
and
Copilot
authored
Fix copilot changes
tarekgh
committed