Skip to content

[Feature] Chat UI for quick testing after selecting a model #73

@pescn

Description

@pescn

目前 NexusGate 将与 Trio 进行集成,@ShaohonChen 的需求为在初步微调模型后,需要和模型快速进行聊天,以方便测试,同时过程最好被有效记录,方便进行后续多个微调模型在同样提示词和场景下的对比测试

同时这个能力也可以认为是通用的,因为与模型对话进行测试,以及使用同样的基本的测试 Case 在多个模型上进行测试是一个可复用的能力和效果

因此我们将增加两个界面:

  1. 对话界面,用户选择模型后可以进行对话;对话过程中可以在右侧侧边栏中编辑 System Prompt 和其他模型的配置参数(如 topK/topP/temperature/重复惩罚/截止 Token/最大 Token 等参数)
  2. 样例保存与对比测试,可以增加一个单轮或多轮的对话测试配置,可选择多个模型进行对比测试

Currently, NexusGate will be integrated with Trio. @ShaohonChen's requirement is to quickly chat with the model after initial fine-tuning for convenient testing, while the process should be effectively recorded for subsequent comparative testing of multiple fine-tuned models using the same prompts and scenarios.

This capability can also be considered universal, as testing through model conversation and using the same basic test cases across multiple models is a reusable capability and effect.

Therefore, we will add two interfaces:

  1. A chat interface where users can select a model and then engage in conversation; during the conversation, users can edit the System Prompt and other model configuration parameters (such as topK/topP/temperature/repetition penalty/stop token/max tokens, etc.) in the right sidebar.
  2. Sample saving and comparison testing, can add a single-round or multi-round conversation test configuration, and select multiple models for comparison testing

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions