Friendly interface to chat with an Ollama instance.

The Natural Language Shell integrates OpenAI's GPTs, Anthropic's Claude, or local GGUF-formatted LLMs directly into the terminal experience, allowing operators to describe their tasks in either POSIX commands or fluent human language

Modular Rust transformer/LLM library using Candle

A fullstack Rust + React chat app using open-source Llama language models

Actor based multi-llm registry + runner.

Yet another `llama.cpp` Rust wrapper

LLaMA2 + Rust

Generic persona (Ollama discord bot) but in Rust.

Portable LLM - A rust library for LLM inference

Attempt to summarize text from `stdin`, using a large language model (locally and offline), to `stdout`

Simple large language model playground app

ChatFlameBackend is an innovative backend solution for chat applications, leveraging the power of the Candle AI framework with a focus on the Mistral model

llama2-wasm using rust

AI chatbot using Llama 2

AIonic: A unified, user-friendly Rust library for seamless integration with various public Large Language Model APIs, such as openAI or Bard

Inference Llama 2 in Rust