[AMD][ROCM] Fix benchmark_serving Rust Tokenizer Crash via Direct transformers AutoTokenizer#1253

Draft

ChangLiu0709 wants to merge 1 commit intomainfrom

chang/fix-bench-serving-rust-tokenizer-crash

Commits on May 1, 2026

fix(bench_serving): replace vllm get_tokenizer with direct transformers AutoTokenizer

ChangLiu0709
and
claude
committed