Skip to content

[core] Add node affinity for benchmark job pod#428

Merged
slin1237 merged 1 commit into
ome-projects:mainfrom
XinyueZhang369:xinyue/benchmark-node-affinity
Dec 13, 2025
Merged

[core] Add node affinity for benchmark job pod#428
slin1237 merged 1 commit into
ome-projects:mainfrom
XinyueZhang369:xinyue/benchmark-node-affinity

Conversation

@XinyueZhang369
Copy link
Copy Markdown
Collaborator

@XinyueZhang369 XinyueZhang369 commented Dec 12, 2025

What this PR does

Add node affinity from base model for benchmark job pod if inference service is specified.

Why we need it

In order to ensure the benchmark job pod is scheduled on the node that has the base model.

Fixes #408

How to test

Deployed to mle cluster. now benchmark job pod is scheduled on the right node without hard coded node selector
Screenshot 2025-12-12 at 10 01 21 AM

Checklist

  • Tests added/updated (if applicable)
  • Docs updated (if applicable)
  • make test passes locally

@gemini-code-assist
Copy link
Copy Markdown
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@github-actions github-actions Bot added benchmark Benchmark related changes inferenceservice InferenceService controller changes controller Controller changes tests Test changes labels Dec 12, 2025
@slin1237 slin1237 merged commit b990c51 into ome-projects:main Dec 13, 2025
24 checks passed
@XinyueZhang369 XinyueZhang369 deleted the xinyue/benchmark-node-affinity branch December 15, 2025 01:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

benchmark Benchmark related changes controller Controller changes inferenceservice InferenceService controller changes tests Test changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[BUG] Ensure benchmark job pod to be scheduled on right node

2 participants