This should be user-defined as there's a cost trade-off we shouldn't centrally mandate: https://github.com/coder/cmux/blob/c8589ed2d64d1a89caa4d7eb88122d0760f2406b/src/utils/ai/cacheStrategy.ts#L22-L36
