LLM

LLM service for managing providers, models, and proxying responses over gRPC and HTTP.

Architecture: LLM

Local Development

Full setup: Local Development

Prepare environment

git clone https://github.com/agynio/bootstrap.git
cd bootstrap
chmod +x apply.sh
./apply.sh -y

See bootstrap for details.

Run from sources

# Deploy once (exit when healthy)
devspace dev

# Watch mode (streams logs, re-syncs on changes)
devspace dev -w

Run tests

devspace run test:e2e

See E2E Testing.