[Feature] 支持多模态对话功能：对话的问题和回复都支持文本、图片、音频

[easeaico]

你想要什么功能或者有什么建议？
支持多模态对话功能：对话的问题和回复都支持文本、图片、音频。
随着官方 ChatGPT 多模态的推出，期待未来 ChatGPT-Next-Web 有计划支持多模态的对话输入输出。

有没有可以参考的同类竞品？
官方 ChatGPT 多模态的功能

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Title: [Feature] Support multi-modal dialogue function: dialogue questions and replies support text, pictures, and audio

**What features do you want or have any suggestions? **
Support multi-modal dialogue function: dialogue questions and replies support text, pictures, and audio.
With the launch of official ChatGPT multi-modality, we look forward to ChatGPT-Next-Web planning to support multi-modal conversation input and output in the future.

**Are there any similar competing products that we can refer to? **
Official ChatGPT multi-modal functionality

[chenminmin4]

希望支持多模态对话功能：对话的问题和回复都支持文本、图片、音频。

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Hope to support multi-modal dialogue function: dialogue questions and replies support text, pictures, and audio.

[super999]

希望支持生成图片，语音，

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Hope to support generating pictures, voices,

[gutenye]

GPT-4 Turbo with vision
https://openai.com/blog/new-models-and-developer-products-announced-at-devday

[xiaosatai]

希望支持多模态对话功能：对话的问题和回复都支持文本、图片、音频。同时支持文件上传，服务器缓存文件功能。

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Hope to support multi-modal dialogue function: dialogue questions and replies support text, pictures, and audio. It also supports file upload and server caching file functions.

[mountainguan]

github许愿池

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

github wishing pool

[DirkSchlossmacher]

@Yidadaa would you appreciate any work on this (e.g. PoC) that you can leverage? Or are you in the middle of a major refactoring of the related app architecture?

[Jengro777]

多模态太重要了, 会带来无限可能.