Skip to content

remove suites from serbian_eval.py#1044

Merged
NathanHB merged 1 commit intohuggingface:mainfrom
S-Y-A-N:remove-suite-from-serbian-eval
Nov 12, 2025
Merged

remove suites from serbian_eval.py#1044
NathanHB merged 1 commit intohuggingface:mainfrom
S-Y-A-N:remove-suite-from-serbian-eval

Conversation

@S-Y-A-N
Copy link
Copy Markdown
Contributor

@S-Y-A-N S-Y-A-N commented Nov 9, 2025

this used to cause the following error when using the multilingual extra, specifically through the python API when specifying load_tasks_multilingual=True in PipelineParameters:

.../lighteval/tasks/multilingual/tasks/serbian_eval.py in create_task_config(task_name, prompt_function, hf_repo, hf_subset, metrics, evaluation_splits, suite, hf_avail_splits, few_shots_split, generation_size)
TypeError: LightevalTaskConfig.__init__() got an unexpected keyword argument 'suite'

@NathanHB
Copy link
Copy Markdown
Member

hey ! Thanks for the contrib ❤️

@HuggingFaceDocBuilderDev
Copy link
Copy Markdown
Collaborator

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@NathanHB NathanHB merged commit d04e4f9 into huggingface:main Nov 12, 2025
4 checks passed
@S-Y-A-N S-Y-A-N deleted the remove-suite-from-serbian-eval branch November 12, 2025 13:19
@NathanHB NathanHB added the bug label Nov 24, 2025
rolshoven pushed a commit to rolshoven/lighteval that referenced this pull request Mar 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants