[MTP]Merge support attn #4591
Merged
[MTP]Merge support attn #4591
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Thanks for your contribution! |
freeliuzc
force-pushed
the
merge_support_attn
branch
4 times, most recently
from
652f256 to
e4576e1
Compare
freeliuzc
force-pushed
the
merge_support_attn
branch
from
e4576e1 to
ced9c87
Compare
lizhenyun01
previously approved these changes
Oct 27, 2025
DDDivano
approved these changes
Oct 27, 2025
qingqing01
approved these changes
Oct 27, 2025
Jiang-Jia-Jun
merged commit c9be876
into
PaddlePaddle:feature/experimental_feature_20250908
14 of 16 checks passed
freeliuzc
added a commit
to freeliuzc/FastDeploy
that referenced
this pull request
Oct 29, 2025
* support mask_offset in speculate decoding * fix dummpy run output * add unit test * fix unit test import
freeliuzc
added a commit
to freeliuzc/FastDeploy
that referenced
this pull request
Oct 29, 2025
* support mask_offset in speculate decoding * fix dummpy run output * add unit test * fix unit test import
qingqing01
pushed a commit
that referenced
this pull request
Nov 3, 2025
* [MTP]Merge support attn (#4591) * support mask_offset in speculate decoding * fix dummpy run output * add unit test * fix unit test import * support attn_mask_offset in mtp mode * add update_attn_mask op * fix unit test && fix code-style
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
6 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Motivation
Modifications
Usage or Command
Accuracy Tests
Checklist
[FDConfig],[APIServer],[Engine],[Scheduler],[PD Disaggregation],[Executor],[Graph Optimization],[Speculative Decoding],[RL],[Models],[Quantization],[Loader],[OP],[KVCache],[DataProcessor],[BugFix],[Docs],[CI],[Optimization],[Feature],[Benchmark],[Others],[XPU],[HPU],[GCU],[DCU],[Iluvatar],[Metax]]pre-commitbefore commit.releasebranch, make sure the PR has been submitted to thedevelopbranch, then cherry-pick it to thereleasebranch with the[Cherry-Pick]PR tag.