Skip to content

Conversation

@luukunn
Copy link
Collaborator

@luukunn luukunn commented Aug 15, 2025

功能说明: chat_template_kwargs 下所有参数将透传到数据处理模块, 提供给 chat_template 进行拼接。

请求示例:
curl 请求, 直接增加 chat_template_kwargs 参数,如下:
"chat_template_kwargs": {"enable_thinking": false}
"chat_template_kwargs": {"enable_thinking": false, "optinos":{"parallel_tool_calls":false}}

openai client 请求,增加到 extra_body 中,如下:
extra_body={"chat_template_kwargs": {"enable_thinking": False}}

@paddle-bot
Copy link

paddle-bot bot commented Aug 15, 2025

Thanks for your contribution!

@paddle-bot paddle-bot bot added the contributor External developers label Aug 15, 2025
LiqinruiG
LiqinruiG previously approved these changes Aug 15, 2025
@CLAassistant
Copy link

CLAassistant commented Aug 15, 2025

CLA assistant check
All committers have signed the CLA.

@gzy19990617
Copy link
Collaborator

辛苦能否规范一下PR,并提供一下使用方法和示例~

@luukunn
Copy link
Collaborator Author

luukunn commented Aug 18, 2025

修复chat_template_kwargs中参数未透传问题:
1.透传chat_template_kwargs所有参数,并将所有参数解包塞到request中去进行拼接。
2.设置enable_thinking默认值为True。
3.修改多模关思考断言。
使用方式:
1.所有拼接相关参数都可以放进chat_template_kwargs参数中,例如{"chat_template_kwargs": "enable_thinking": true}
2.使用openai client可以将参数放入extra_body中

@LiqinruiG LiqinruiG changed the title fix chat_template_args [Feature] Pass through the chat_template_kwargs to the data processing module Aug 18, 2025
@Jiang-Jia-Jun Jiang-Jia-Jun merged commit 3a7a20d into PaddlePaddle:develop Aug 19, 2025
12 of 15 checks passed
luukunn added a commit to luukunn/FastDeploy that referenced this pull request Aug 19, 2025
…ing module (PaddlePaddle#3421)

* fix chat_template_args

* fix args

* add offline

* add offline

* fix

* fix

* fix default enable_thinking value

* fix default enable_thinking value

* modify condition

* Revert "modify condition"

This reverts commit 26430bd.

* fix unit test
Jiang-Jia-Jun pushed a commit that referenced this pull request Aug 19, 2025
…ing module (#3421) (#3469)

* fix chat_template_args

* fix args

* add offline

* add offline

* fix

* fix

* fix default enable_thinking value

* fix default enable_thinking value

* modify condition

* Revert "modify condition"

This reverts commit 26430bd.

* fix unit test
Jiang-Jia-Jun pushed a commit that referenced this pull request Aug 22, 2025
* [Feature] Pass through the `chat_template_kwargs` to the data processing module (#3421)

* fix chat_template_args

* fix args

* add offline

* add offline

* fix

* fix

* fix default enable_thinking value

* fix default enable_thinking value

* modify condition

* Revert "modify condition"

This reverts commit 26430bd.

* fix unit test

* add Tool Parser (#3272)

* add tool-parser

* add tool-parser

* add tool parser

* add tool parser

* fix

* add offline

* add offline

* fix

* parsers:tool&reasoning

* 修改tool parser名称·

* update

* fix reasoning-parser

* add requirements

* fix finish reason

* fix

* fix reasoning-parser

* fix

* fix

* fix

* fix

* fix

---------

Co-authored-by: zhuzixuan <zhuzixuan@baidu.com>

* [Feature] add tool parser (#3483)

* add tool parser

* add x1 enable_thinking

* restart ci

* fix vl reasoning parser

* modify call style

* modify call style

* add offline enablethinking

* fix completion

* fix

* fix unit test

* fix unit test

* fix unit test

* fix vl reasoning parser

* fix vl reasoning parser

* fix unit test

---------

Co-authored-by: zhuzixuan <zhuzixuan@baidu.com>
@luukunn luukunn deleted the chat_template_fix branch September 9, 2025 10:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

contributor External developers

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants