Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

AIConfig is a config-based framework to build generative AI applications.

Python SDK for running evaluations on LLM generated responses

An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer

[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI

Deployment of RAG + LLM model serving on multiple K8s cloud clusters

Streamlit-based chatbot leveraging Ollama via LangChain and PostHog-LLM for advanced logging and monitoring

Lightweight Agent Framework for building AI apps with any LLM

A Python package for tracking and analyzing LLM usage across different models and applications. It is primarily designed as a library for integration into development process of LLM-based agentic workflow tooling, providing robust tracking capabilities.

Self-Evolving RAG System with ChromaDB for continuous knowledge updates (6x daily), designed to overcome Large Language Model data cutoff limitations.

📦 dify-dsl exporter 轻量化的dify dsl批量导出工具 - 支持批量导出应用DSL文件、支持导出应用的所有历史版本 | 支持存储：本地指定文件目录、阿里云 OSS、AWS S3、MinIO (S3兼容)、腾讯云 COS、火山云 TOS | Python/Docker 双模式部署 | 支持定时任务 | MIT 开源

A lightweight CLI for exploring OpenRouter AI models, listing provider endpoints with supported model parameters, and benchmarking endpoint latency and throughput.

An AI Agent IaC tool that aims to make developing and deploying AI Agents easier.

HTTP middleware for injecting compressed SF-V2 context into OpenAI-compatible API calls.

Production-ready Enterprise RAG Platform. Features Agentic Intent Routing (LangGraph), Strict Citation Governance, and Asynchronous Vector Ingestion. Built on a Microservices Architecture (FastAPI + React + PostgreSQL) and fully containerized with Docker.

Automatically extracts JSON from markdown/text, repairs common AI mistakes, validates structure. Returns clean data when successful, detailed feedback for retries when not.