Skip to content

Fix validation checks order in benchmark_v2#42280

Merged
remi-or merged 2 commits intohuggingface:mainfrom
Abdennacer-Badaoui:fix/benchmark_v2
Nov 19, 2025
Merged

Fix validation checks order in benchmark_v2#42280
remi-or merged 2 commits intohuggingface:mainfrom
Abdennacer-Badaoui:fix/benchmark_v2

Conversation

@Abdennacer-Badaoui
Copy link
Copy Markdown
Member

@Abdennacer-Badaoui Abdennacer-Badaoui commented Nov 19, 2025

  • Reorder the validation checks in the benchmarker to avoid TypeError when required arguments are missing.
  • Fix adapt_configs() preserving old benchmark names (e.g., s128_n128) when parameters are changed via command-line arguments. Remove the name field from the config dict so it gets re-inferred with the updated sequence length and token generation values.

@remi-or

@HuggingFaceDocBuilderDev
Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Copy link
Copy Markdown
Collaborator

@remi-or remi-or left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

config["num_tokens_to_generate"] = ntok
config["gpu_monitoring"] = monitor
# Remove the old name so it gets re-inferred with the updated values
config.pop("name", None)
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

good catch

@remi-or remi-or merged commit ea30d82 into huggingface:main Nov 19, 2025
14 checks passed
HichTala added a commit to HichTala/transformers that referenced this pull request Dec 8, 2025
SangbumChoi pushed a commit to SangbumChoi/transformers that referenced this pull request Jan 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants