Self-hosted AI coding assistant
-
Updated
Nov 27, 2025 - Rust
#
llms
A large language model (LLM) is a type of machine learning model designed for understanding, generating, and interacting with human language. These models are trained on extensive datasets containing text from books, articles, websites, and other sources to learn patterns, context, and semantics in language. LLMs are widely used in applications like chatbots, code generation, translation, summarization, and more. They are often built using transformer architectures and are central to the field of generative AI.
Here are 60 public repositories matching this topic...
Open-source search and retrieval database for AI applications.
-
Updated
Dec 6, 2025 - Rust
TensorZero is an open-source stack for industrial-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluation, and experimentation.
python rust machine-learning ai deep-learning ml artificial-intelligence openai llama gpt mlops ml-engineering ai-engineering large-language-models llm llms generative-ai llmops anthropic genai
-
Updated
Dec 6, 2025 - Rust
Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
python rust data-science machine-learning computer-vision deep-learning embeddings dataops data-analytics data-analysis data-format apache-arrow data-centric mlops duckdb llms
-
Updated
Dec 5, 2025 - Rust
Delivery infrastructure for agents. Arch is a models-native proxy server that handles the plumbing work in AI: agent routing & orchestration, guardrails, zero-code logs and traces, unified access to LLMs from OpenAI, Anthropic, Ollama, etc. Build agents faster, and deliver them reliably to production.
proxy routing gateway prompt proxy-server openai envoy envoyproxy llms generative-ai llmops llm-inference llm-proxy ai-gateway llm-gateway llm-routing ai-gateway-support
-
Updated
Dec 4, 2025 - Rust
Bionic is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality
-
Updated
Nov 22, 2025 - Rust
The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced.
-
Updated
Nov 21, 2025 - Rust
Govern & Secure your AI
-
Updated
Dec 6, 2025 - Rust
Faster structured generation
-
Updated
Nov 2, 2025 - Rust
OramaCore is the complete runtime you need for your projects, answer engines, copilots, and search. It includes a fully-fledged full-text search engine, vector database, LLM interface, and many more utilities.
-
Updated
Dec 3, 2025 - Rust
The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework in Rust
python rust finance ai async ml multithreading multi-process rust-lang swarms agents multi-agent-systems rust-crate agora llms multi-agent-collaboration agents-sdk rust-agents llm-agents-rust llm-rust
-
Updated
Nov 24, 2025 - Rust
CLI tool – estimates LLM tokens/costs and runs provider-aware load tests for OpenAI, Anthropic, OpenRouter, or custom endpoints.
-
Updated
Dec 3, 2025 - Rust
open source tooling for AI search and understanding
rust machine-learning ai webassembly ml embeddings rust-lang neural-networks semantic-search neural-search large-language-models llms
-
Updated
Jun 7, 2023 - Rust
Constrained Decoding of Diffusion LLMs with Context-Free Grammars.
diffusion diffusion-model constrained-decoding llm llms fill-in-the-middle llms-benchmarking multi-region-infilling
-
Updated
Nov 12, 2025 - Rust
Rust library for indexing and quickly searching large pretraining corpora
-
Updated
Oct 30, 2025 - Rust
- Followers
- 1.4k followers
- Website
- github.com/topics/llm
- Wikipedia
- Wikipedia