We generate evals for you!

[chelojimenez]

Note

Adds automated eval test-case generation from selected MCP server tools with a new backend endpoint and UI integration.

• Frontend (Eval Runner UI):
  • Add automated test generation: new "Generate Tests" action calling POST /api/mcp/evals/generate-tests, populates testCases from response and shows loading state/spinner.
  • State additions: isGenerating; disables button when busy/servers unselected.
  • API key handling tweak: allow meta provider without key; typed getToken usage.
• Backend (Routes):
  • New endpoint POST /mcp/evals/generate-tests: validates input, filters tools by selected servers via mcpJamClientManager, and returns generated tests.
• Service:
  • Add server/services/eval-agent.ts: backend LLM agent builds prompts from discovered tools and returns parsed, validated test cases.

^{Written by Cursor Bugbot for commit 8f34607. This will update automatically on new commits. Configure here.}