Add feature: Support for multiple models on Azure and Azure model mapper#3344
Add feature: Support for multiple models on Azure and Azure model mapper#3344shendongming wants to merge 8 commits intoChatGPTNextWeb:mainfrom
Conversation
|
|
||
| export const KnowledgeCutOffDate: Record<string, string> = { | ||
| default: "2021-09", | ||
| default: "2023-04", |
There was a problem hiding this comment.
this default: "2023-04", must made separate for azure as example, because it will affected for openai and become bad hallucination. if force default: "2023-04", for all service provider
|
Warning The |
|
Thank you |
|
Someone is attempting to deploy a commit to the NextChat Team on Vercel. A member of the Team first needs to authorize it. |
|
Your build has completed! |
|
|
||
| ### `AZURE_OPENAI_MODEL_MAPPER` (optional) | ||
| > Default: Empty | ||
| > Example: `gpt-3.5-turbo=gpt-35-turbo` 意思是 `gpt-3.5-turbo` 映射到 `gpt-35-turbo` |
| > Example: `gpt-3.5-turbo=gpt-35-turbo` 意思是 `gpt-3.5-turbo` 映射到 `gpt-35-turbo` | ||
|
|
||
| 如果你使用azure openai 来部署的chatgpt,建议设定AZURE_OPENAI_MODEL_MAPPER . | ||
| 会话摘要功能依赖gpt-3.5-turbo 这个model,除非你的azure deployment的名字和它相同 |
There was a problem hiding this comment.
可以直接使用CUSTOM_MODELS中配置gpt-4-1106-preview=gpt-4-turbo的方式,等于后面既作为展示名称,也作为deploy_name使用
There was a problem hiding this comment.
你好,这个最新 readme 文档有了吗?使用 azure 部署的遇到一些麻烦。
Added support for multiple models on Azure; in practice, we will deploy several models on Azure, such as gpt-4, gpt-3.5, etc.
Two changes:
The changes are as follows:
AZURE_URL(optional)Azure deploy url.
If
{deploy-name}is using the template mode, then it will automatically replace the path based on the model selected by the client.If your model name is different from the deployment name, then you need to set the
AZURE_OPENAI_MODEL_MAPPERparameter.AZURE_OPENAI_MODEL_MAPPER(optional)If you are deploying ChatGPT using Azure OpenAI, it is recommended to set the
AZURE_OPENAI_MODEL_MAPPER.The session summarization feature relies on the
gpt-3.5-turbomodel, unless the name of your Azure deployment is the same as it.