Skip to content

[atom-vllm] use aiter greedy sampler#622

Draft
zejunchen-zejun wants to merge 2 commits intomainfrom
zejun/use_aiter_sampler_for_atom_vllm_0421
Draft

[atom-vllm] use aiter greedy sampler#622
zejunchen-zejun wants to merge 2 commits intomainfrom
zejun/use_aiter_sampler_for_atom_vllm_0421

Conversation

@zejunchen-zejun
Copy link
Copy Markdown
Collaborator

@zejunchen-zejun zejunchen-zejun commented Apr 21, 2026

use aiter greedy sampler to replace the vLLM original greedy sampler
accuracy status:

Tasks Version Filter n-shot Metric Value Stderr
gsm8k 3 flexible-extract 3 exact_match 0.9242 ± 0.0073
strict-match 3 exact_match 0.9234 ± 0.0073

with aiter sampler(1k1k con8):
image

without aiter sampler(1k1k con 8):
image

with aiter sampler(1k1k con32):
image

without aiter sampler(1k1k con 32):
image

Signed-off-by: zejunchen-zejun <zejun.chen@amd.com>
Signed-off-by: zejunchen-zejun <zejun.chen@amd.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant