Skip to content

[Auto] Add Mistral regex patch regression test (cluster-45081-3): merged 1 of 2 PRs#27

Closed
evalstate wants to merge 3 commits intomainfrom
merge-cluster-cluster-45081-3-20260424093717
Closed

[Auto] Add Mistral regex patch regression test (cluster-45081-3): merged 1 of 2 PRs#27
evalstate wants to merge 3 commits intomainfrom
merge-cluster-cluster-45081-3-20260424093717

Conversation

@evalstate
Copy link
Copy Markdown
Owner

Cluster: cluster-45081-3

Merged:

Skipped:

Failed:

  • None

Notes:

Validation:

  • Attempted: pytest tests/models/auto/test_tokenization_auto.py::AutoTokenizerTest::test_auto_tokenizer_mistral_patching_applies_pretokenizer -q
  • Result: did not run because local environment is missing safetensors (ModuleNotFoundError: No module named 'safetensors').

Next steps:

  • Install missing test dependency safetensors before rerunning the targeted pytest command.
  • Rerun pytest tests/models/auto/test_tokenization_auto.py::AutoTokenizerTest::test_auto_tokenizer_mistral_patching_applies_pretokenizer -q.

Mohd Faour and others added 3 commits April 8, 2026 16:26
The existing test only checks that passing fix_mistral_regex=True doesn't
error, but the hub model's config version causes early return so the
patching logic is never exercised. This new test creates a local config
with an old transformers_version to force the patching code path, verifying
that the pre_tokenizer is correctly patched to a Sequence without
AttributeError.
@evalstate
Copy link
Copy Markdown
Owner Author

@evalstate evalstate closed this Apr 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant