Refactor tokenizer test and add to cmake#8450

facebook-github-bot merged 1 commit intomainpytorch/executorch:mainfrom

lfq.cmake-tokenizer-testpytorch/executorch:lfq.cmake-tokenizer-testCopy head branch name to clipboard