-
Notifications
You must be signed in to change notification settings - Fork 322
Closed
Description
Problem
The docker agent model provider currently does not treat HTTP 429 (Too Many Requests) or HTTP 500 (Internal Server Error) responses as retryable errors, causing requests to fail immediately when these transient conditions occur.
Desired Behavior
HTTP 429 (Too Many Requests)
- Treat as a retryable error only when there is no fallback model configured
- Respect any
Retry-Afterheader sent by the server in the response to determine how long to wait before retrying - If no
Retry-Afterheader is present, use the existing backoff logic
HTTP 500 (Internal Server Error)
- Treat as a retryable error unconditionally
- Use the same backoff logic as other existing retryable errors (no
Retry-Aftersupport needed)
Context
Discovered from agentic platform work where rate-limiting and transient server errors cause unnecessary failures that could be recovered automatically.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels