Improving User Experience with Gemini in Roo Code

[HahaBill]

What specific problem does this solve?

This is the part of the large proposal #4483

This proposal aims to improve user experience with using Gemini as an API provider in to Roo Code.

Summary

• Token count decreasing Gemini experience: Gemini/Anthropic: Stop using remote token count APIs #3666
  - Thinking cannot be turned off in new Gemini models, which leads to confusion: Add option for Gemini 0605 to enable reasoning but not set manual max-output-tokens and max-thinking-tokens #4407

How should this be solved?

Increase Experience with Gemini

• Removing token counting via APIs - using local token counting
  - fix to rename the 'Enable reasoning' checkbox to a better option and function of 'Set Reasoning/Thinking Budget' for new Gemini models. Or come up with better UX to decrease confusion.

How will we know it works? (Acceptance Criteria)

Case 1: Set Thinking Budget

1. Users click on the Roo Code's setting button
2. Users create new profile and select Gemini as an API provider
3. Users selects newest Gemini 2.5 Pro Review
4. Instead of seeing Enable Reasoning, users see Set Thinking Budget
But it is still confusing? Why do I have to enable reasoning if the new Gemini already has reasoning?

Case 2: Local Accurate Token Count

1. Users make an API request
2. Instead of sending another API request to get token count, it will be computed locally on user's machines
3. Users are happier because the waiting time is reduced :)
   But I am waiting forever for the request...

Estimated effort and complexity

Size: Medium (1 week)
Reasoning: Minor UI/UX, token-counting should not be difficult
Main Challenges: token-counting libraries not working
Dependencies: maybe more optimal token-counting libraries, could have some dependencies with this: #4375

Technical considerations (optional but helpful)

No response

Trade-offs and risks (optional)

No response

Additional context (optional)

No response

Proposal checklist

• I've searched existing Issues and Discussions for duplicates
• This is a specific, actionable proposal with clear problem and solution
• I've included concrete acceptance criteria
• I understand this needs approval before implementation begins

Interested in implementing this?

• Yes, I'd like to help implement this feature

[hannesrudolph]

Sounds good! Touch base with me on discord to to discuss details.

[HahaBill]

Starting working on this one issue