Skip to content

[BugFix] fix mtp reschedule#5164

Merged
Jiang-Jia-Jun merged 1 commit intoPaddlePaddle:feature/experimental_feature_20250908from
Deleter-D:exp_fix_mtp_reschedule
Nov 21, 2025
Merged

[BugFix] fix mtp reschedule#5164
Jiang-Jia-Jun merged 1 commit intoPaddlePaddle:feature/experimental_feature_20250908from
Deleter-D:exp_fix_mtp_reschedule

Conversation

@Deleter-D
Copy link
Collaborator

@Deleter-D Deleter-D commented Nov 21, 2025

Motivation

The rescheduling logic will not be executed when MTP and Logprob are enabled.

Modifications

Move the rescheduling logic to the correct position.

Usage or Command

Accuracy Tests

Checklist

  • Add at least a tag in the PR title.
    • Tag list: [[FDConfig],[APIServer],[Engine], [Scheduler], [PD Disaggregation], [Executor], [Graph Optimization], [Speculative Decoding], [RL], [Models], [Quantization], [Loader], [OP], [KVCache], [DataProcessor], [BugFix], [Docs], [CI], [Optimization], [Feature], [Benchmark], [Others], [XPU], [HPU], [GCU], [DCU], [Iluvatar], [Metax]]
    • You can add new tags based on the PR content, but the semantics must be clear.
  • Format your code, run pre-commit before commit.
  • Add unit tests. Please write the reason in this PR if no unit tests.
  • Provide accuracy results.
  • If the current PR is submitting to the release branch, make sure the PR has been submitted to the develop branch, then cherry-pick it to the release branch with the [Cherry-Pick] PR tag.

@paddle-bot
Copy link

paddle-bot bot commented Nov 21, 2025

Thanks for your contribution!

@Jiang-Jia-Jun Jiang-Jia-Jun merged commit fde827f into PaddlePaddle:feature/experimental_feature_20250908 Nov 21, 2025
12 of 14 checks passed
Deleter-D added a commit to Deleter-D/FastDeploy that referenced this pull request Nov 26, 2025
@Deleter-D Deleter-D deleted the exp_fix_mtp_reschedule branch November 26, 2025 03:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants