Skip to content

Add the dotnet binding info.#1409

Merged
ggerganov merged 1 commit intoggml-org:masterfrom
SanftMonster:add_dotnet_binding
May 12, 2023
Merged

Add the dotnet binding info.#1409
ggerganov merged 1 commit intoggml-org:masterfrom
SanftMonster:add_dotnet_binding

Conversation

@SanftMonster
Copy link
Copy Markdown
Contributor

Hi, SciSharp STACK has made a C#/.NET Binding of llama.cpp, named LLamaSharp. May I kindly ask if it can be added to readme to let more dotnet users know it?

Currently it has provided the following features:

  1. Basic APIs, including getting the embeddings, tokenization and detokenization, loading and inferring the model, etc.
  2. Chat session, providing easy-to-use APIs to make a chat bot.
  3. Quantization, providing an API to quantize the model in C#.
  4. Integration of ASP.NET core, making it easy to deploy the chat service.
  5. One-click installation, without compiling llama.cpp or other manipulations.

SciSharp STACK developers will maintain it and follow up llama.cpp. I believe we can make this .NET Binding better with the great works of llama.cpp! :)

@ggerganov ggerganov merged commit 089b1c9 into ggml-org:master May 12, 2023
Seunghhon pushed a commit to Seunghhon/llama.cpp that referenced this pull request Apr 26, 2026
phuongncn pushed a commit to phuongncn/llama.cpp-gx10-dgx-sparks-deepseekv4 that referenced this pull request Apr 28, 2026
ljubomirj pushed a commit to ljubomirj/llama.cpp that referenced this pull request May 6, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants