feat: add chat template to existed gguf file#6156
feat: add chat template to existed gguf file#6156bruceunx wants to merge 1 commit intoggml-org:masterfrom bruceunx:feat-add-template-guff
Conversation
feat: add chat template to existed gguf file
|
Thanks for the contribution. However, I'm quite doubt if this file may be confused for new users. Some users may misunderstand that this script allow them to use which ever templates they want, without not knowing that llama.cp can only support a predefine set of templates I think it would be nice to include some kind of warning. And would be even nicer if you can take time to allow the script to change other attributes in metadata. |
|
the chat template actually trained in the model, and normally included in the |
|
Maybe I can add predefined chat templates for known popular open source llms models, which maybe solve this concern |
feat: add chat template to existed gguf file
follow the issue 5897
add
gguf_add_chat_template.pyto gguf-py/scripts