Fix generate() when tokenizer is unset and add regression tests#1267

Open

DityaChawla wants to merge 1 commit intoTransformerLensOrg:devfrom

DityaChawla:fix/generate-no-tokenizer-483

Commits on May 2, 2026

Fix tokenizer-free generate() and add regression tests
DityaChawla
committed