-
Notifications
You must be signed in to change notification settings - Fork 10.5k
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
Description
prompt caching on aws bedrock doesnt work
this makes running opencode thru Opus on AWS Bedrock like 10x more expensive than running it on Anthropic API.
AI diagnosis:
Evidence
Before fix:
| Turn | Input | Cache Read | Cache Write |
|---|---|---|---|
| 1 | ~11k | ~13k | ~11k |
| 2 | ~11k | ~13k | 0 |
Plugins
n/a
OpenCode version
1.1.48
Steps to reproduce
use any claude model on aws bedrock in opencode
only the system prompt (e.g. the first ~13k tokens) is read from cache
this means that its like 10x more expensive than running opencode thru official anthropic API
Screenshot and/or share link
No response
Operating System
No response
Terminal
No response
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working