Skip to content

[Enhancement] support online quantization#653

Draft
haoyangli0109 wants to merge 1 commit intoROCm:mainfrom
haoyangli0109:lhy/online_quantization
Draft

[Enhancement] support online quantization#653
haoyangli0109 wants to merge 1 commit intoROCm:mainfrom
haoyangli0109:lhy/online_quantization

Conversation

@haoyangli0109
Copy link
Copy Markdown
Contributor

Done:

  1. support linear mixed mxfp4 and ptpc_fp8
  2. support moe mixed mxfp4 and ptpc_fp8
  3. suport dpsk DQ and Q

TODO:

  1. solove EP mode
  2. fix fmt
    ...
    ACC and PerfoRmance test

Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
@haoyangli0109 haoyangli0109 force-pushed the lhy/online_quantization branch from efba94e to e8fca54 Compare April 28, 2026 05:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant