fix(search): removed full text param from built-in search, anthropic provider streaming fix, gemini/vertex consolidation#2542
Merged
waleedlatif1 merged 8 commits intostagingfrom Dec 23, 2025
Merged
Conversation
…provider streaming fix
|
The latest updates on your projects. Learn more about Vercel for GitHub. |
Contributor
Greptile SummaryThis PR fixes two distinct issues: (1) updates the Exa search integration to use Key Changes:
The Anthropic streaming fix ensures that when Confidence Score: 4/5
Important Files Changed
Sequence DiagramsequenceDiagram
participant Client
participant SearchAPI as Search API Route
participant ExaTool as Exa Search Tool
participant ExaAPI as Exa AI API
participant AnthropicProvider as Anthropic Provider
participant AnthropicAPI as Anthropic API
participant ToolExecutor as Tool Executor
participant GroqProvider as Groq Provider
participant GroqAPI as Groq API
Note over SearchAPI,ExaAPI: Search Route Changes
Client->>SearchAPI: POST /api/tools/search
SearchAPI->>ExaTool: executeTool('exa_search', {highlights: true})
ExaTool->>ExaAPI: POST with highlights=true
ExaAPI-->>ExaTool: results with highlights array
ExaTool-->>SearchAPI: results.highlights
SearchAPI->>SearchAPI: map highlights to snippet
SearchAPI-->>Client: results with joined highlights
Note over AnthropicProvider,ToolExecutor: Anthropic Streaming Fix
Client->>AnthropicProvider: request with stream=true, tools
AnthropicProvider->>AnthropicAPI: messages.create (non-streaming)
AnthropicAPI-->>AnthropicProvider: response with tool_use
AnthropicProvider->>ToolExecutor: execute tools
ToolExecutor-->>AnthropicProvider: tool results
AnthropicProvider->>AnthropicProvider: accumulate tokens & cost
AnthropicProvider->>AnthropicAPI: messages.create with stream=true
AnthropicAPI-->>AnthropicProvider: streaming response
AnthropicProvider->>AnthropicProvider: update tokens & cost in callback
AnthropicProvider-->>Client: StreamingExecution
Note over GroqProvider,GroqAPI: Groq Tool Choice Fix
Client->>GroqProvider: request with stream=true, tool_choice, tools
GroqProvider->>GroqProvider: save originalToolChoice
GroqProvider->>GroqAPI: chat.completions.create (non-streaming)
GroqAPI-->>GroqProvider: response with tool calls
GroqProvider->>ToolExecutor: execute tools
ToolExecutor-->>GroqProvider: tool results
GroqProvider->>GroqAPI: create with tool_choice=originalToolChoice
GroqAPI-->>GroqProvider: streaming response
GroqProvider-->>Client: StreamingExecution
|
waleedlatif1
added a commit
that referenced
this pull request
Dec 23, 2025
…provider streaming fix (#2542) * fix(search): removed full text param from built-in search, anthropic provider streaming fix * rewrite gemini provider with official sdk + add thinking capability * vertex gemini consolidation * never silently use different model * pass oauth client through the googleAuthOptions param directly * make server side provider registry * remove comments * take oauth selector below model selector --------- Co-authored-by: Vikhyath Mondreti <vikhyath@simstudio.ai>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Type of Change
Testing
Tested manually
Checklist