Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion community_tasks/german_rag_evals.py
Original file line number Diff line number Diff line change
Expand Up @@ -186,7 +186,7 @@ def prompt_fn_context_question_match(line, task_name: str = None):

# Task 3: Question-answer match.
# Given is a question and an answer.
# The task is to decide whether the answer actualy answers the question.
# The task is to decide whether the answer actually answers the question.
task3 = LightevalTaskConfig(
name="german_rag_eval:question_answer_match",
prompt_function=prompt_fn_question_answer_match,
Expand Down
2 changes: 1 addition & 1 deletion docs/source/saving-and-reading-results.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -103,7 +103,7 @@ The detail file contains the following columns:
- `gold_index`: The index of the gold answer in the choices list.
- `cont_tokens`: The continuation tokens.
- `example`: The input in text form.
- `full_prompt`: The full prompt, that will be inputed to the model.
- `full_prompt`: The full prompt, that will be inputted to the model.
- `input_tokens`: The tokens of the full prompt.
- `instruction`: The instruction given to the model.
- `metrics`: The metrics computed for the example.
Expand Down
Loading