LLM Proxy

LLM Proxy service that exposes the OpenAI Responses API, resolves models, authorizes access, and forwards requests to external providers.

Architecture: LLM Proxy

Local Development

Full setup: Local Development

Prepare environment

git clone https://github.com/agynio/bootstrap.git
cd bootstrap
chmod +x apply.sh
./apply.sh -y

See bootstrap for details.

Run from sources

# Deploy once (exit when healthy)
devspace dev

# Watch mode (streams logs, re-syncs on changes)
devspace dev -w

Run tests

devspace run test-e2e

See E2E Testing.