Project Name

Navbot.RealtimeApi.Dotnet.SDK

Youtube playlist

https://www.youtube.com/playlist?list=PLtan4ax5Sz-1ckWzZWx872rFFuAukihNE

Project Introduction

The Realtime control is a component for real-time speech recognition and speech synthesis. It can convert speech input into text and generate speech responses from text. This control can be used in desktop applications, integrating OpenAI and other related services, providing a seamless speech interaction experience.

This control is suitable for applications requiring voice interaction, such as virtual assistants, speech recognition systems, and intelligent customer service.

Table of Contents

• Feature Overview
• Installation and Configuration
• Usage
• Feature Demonstration
• License

Feature Overview

The Realtime control provides the following key features:

• Real-time Speech Recognition: Converts user speech into text in real time, supporting continuous speech input and feedback.
• Text-to-Speech: Converts AI or other text information into speech and plays it.
• Multi-language Support: Supports speech recognition in multiple languages.
• OpenAI Integration: Integrates the OpenAI API, supporting intelligent conversation and natural language processing.
• Custom Features: Allows developers to customize API calls and speech-related functionalities.

Installation and Configuration

System Requirements

List the basic environment requirements needed to run the project:

• Operating System: Windows 10 or higher
• .NET Version: .NET 6.0 or higher
• Other Dependencies: OpenAI API key, NAudio, etc.

NuGet Package Installation

To use the Realtime control, you need to install the following NuGet packages:

Navbot.RealtimeApi.Dotnet.SDK.Core
Navbot.RealtimeApi.Dotnet.SDK.WinForm
Navbot.RealtimeApi.Dotnet.SDK.WPF

You can install these packages by running the following commands in the NuGet Package Manager Console:

Install-Package Navbot.RealtimeApi.Dotnet.SDK.Core
Install-Package Navbot.RealtimeApi.Dotnet.SDK.WinForm
Install-Package Navbot.RealtimeApi.Dotnet.SDK.WPF

Alternatively, you can add them via the Package Manager UI by searching for each package.

Usage

Initialize the Control

In a Windows Forms application, you can initialize the control and start using it as follows:

using Realtime.API.Dotnet.SDK.Core.Model;

    public partial class MainForm : Form
    {
        public MainForm()
        {
            InitializeComponent();
        }

        private void MainForm_Load(object sender, EventArgs e)
        {
            string openAiApiKey = Environment.GetEnvironmentVariable("OPENAI_API_KEY") ?? "";
            realtimeApiWinFormControl1.OpenAiApiKey = openAiApiKey;
        }

        private void btnStart_Click(object sender, EventArgs e)
        {
            realtimeApiWinFormControl1.StartSpeechRecognition();
        }

        private void btnStop_Click(object sender, EventArgs e)
        {
            realtimeApiWinFormControl1.StopSpeechRecognition();
        }
    }

Feature Demonstration

1. Speech Recognition: Click the "Start" button to begin listening to the user's speech and convert it into text in real time.
2. Speech Text: By hooking up RealtimeApiDesktopControl.PlaybackTextAvailable event, the output text information of the AI speech will be displayed.
3. 

License

This project is licensed under the MIT License.