Skip to content

Conversation

@kevincheng2
Copy link
Collaborator

  • only gpu and not mtp and splitwise_role == "mixed" default enable chunked prefill
  • use export FD_DISENABLE_CHUNKED_PREFILL=1 disenable chunked prefill

Copy link
Collaborator

@Jiang-Jia-Jun Jiang-Jia-Jun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

改一下错别字

Copy link
Collaborator

@rainyfly rainyfly left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

#3725 中,和 V1 有关的环境变量对于不支持的场景会重置 0,需要从 envs 模块里读,否则不能感知。

@kevincheng2
Copy link
Collaborator Author

改一下错别字

done

@Jiang-Jia-Jun Jiang-Jia-Jun merged commit a86b35a into PaddlePaddle:release/2.2 Sep 2, 2025
14 of 16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants