Skip to content

PAL-1217 heatlhbench original#10

Open
pratacosmin wants to merge 1 commit intomainfrom
PAL-1217
Open

PAL-1217 heatlhbench original#10
pratacosmin wants to merge 1 commit intomainfrom
PAL-1217

Conversation

@pratacosmin
Copy link
Copy Markdown

this can be run like so
define in config the model_deployments.yaml
and run

 helm-run --run-entries "health_bench:model=jsl/medical-visual-lm-30b,jury_config_path=<PATH>/judges.yaml" --max-eval-instances 4 --suite my-suite --local-path ./config
helm-summarize --suite my-suite -o ./benchmark_output --schema-path  <PATH>/schema_medhelm.yaml
 helm-server --suite my-suite -o ./benchmark_output --port 8000

Copy link
Copy Markdown

@chakravarthik27 chakravarthik27 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@pratacosmin pratacosmin force-pushed the PAL-1217 branch 3 times, most recently from e3f7fa8 to 7f7b20a Compare April 29, 2026 13:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants