Skip to content

Adapter/groq #289

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
dhamivibez wants to merge 16 commits into
base: main
Choose a base branch
from
Open

Adapter/groq #289

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
d8e813f
feat(ai-groq): add Groq adapter package
dhamivibez Feb 9, 2026
ad9c161
feat(vitest): add Vitest configuration for ai-groq package
dhamivibez Feb 9, 2026
2ce45a7
feat: add Groq SDK as dependency and client utilities
dhamivibez Feb 9, 2026
70dfc54
feat: opus 4.6 model & additional config for provider clients (#278)
dhamivibez Feb 11, 2026
ffba47d
ci: Version Packages (#279)
github-actions[bot] Feb 9, 2026
9602b14
fix: anthropic tool call issues (#275)
jherr Feb 10, 2026
4ab9636
feat: Add new Groq AI adapter package, including Groq-specific messag…
dhamivibez Feb 12, 2026
bb04270
feat: opus 4.6 model & additional config for provider clients (#278)
AlemTuzlak Feb 9, 2026
a598393
ci: Version Packages (#283)
github-actions[bot] Feb 12, 2026
b47c8d2
docs: regenerate API documentation (#288)
github-actions[bot] Feb 12, 2026
b50a67c
feat(ai-groq): add Groq adapter package
dhamivibez Feb 9, 2026
1580c73
feat: opus 4.6 model & additional config for provider clients (#278)
dhamivibez Feb 11, 2026
decc53f
chore: remove unwanted groq-sdk package dependencies in root
dhamivibez Feb 12, 2026
55db3b1
feat(ai-groq): add Groq adapter package
dhamivibez Feb 12, 2026
5c56dff
feat: opus 4.6 model & additional config for provider clients (#278)
dhamivibez Feb 11, 2026
2a6a1a3
Add groq-sdk dependency to ai-groq package
dhamivibez Feb 12, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions .changeset/slimy-ways-wave.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
---
'@tanstack/ai-anthropic': patch
'@tanstack/ai-gemini': patch
'@tanstack/ai-grok': patch
---

Add in opus 4.6 and enhance acceptable config options by providers
Comment on lines +1 to +7
Copy link
Contributor

@coderabbitai coderabbitai bot Feb 12, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue | 🟠 Major

Missing @tanstack/ai from the changeset — the delta field was made required in TextMessageContentEvent and StepFinishedEvent.

The types.ts change in @tanstack/ai makes delta a required field on two public event interfaces (TextMessageContentEvent and StepFinishedEvent). This is a breaking change for any downstream consumer that constructs these event objects without delta. This changeset only bumps the adapter packages (ai-anthropic, ai-gemini, ai-grok) but omits @tanstack/ai itself.

Consider adding @tanstack/ai to this changeset (at minimum as a minor bump, or major depending on the project's semver policy for type-level breaking changes).

🤖 Prompt for AI Agents 
In @.changeset/slimy-ways-wave.md around lines 1 - 7, The changeset forgot to
include `@tanstack/ai` even though types.ts made the delta field required on
TextMessageContentEvent and StepFinishedEvent; update the .changeset to add
'@tanstack/ai' with an appropriate version bump (at least minor, or major if
your semver policy treats type-level breaking changes as major) so downstream
consumers are alerted, and mention in the changeset message that delta was made
required on TextMessageContentEvent and StepFinishedEvent to clarify the
breaking change.

4 changes: 3 additions & 1 deletion .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -56,4 +56,6 @@ test-traces

# Playwright
playwright-report
test-results
test-results

STATUS_*.md
122 changes: 90 additions & 32 deletions docs/reference/classes/StreamProcessor.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,23 +5,25 @@ title: StreamProcessor

# Class: StreamProcessor

Defined in: [activities/chat/stream/processor.ts:117](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L117)
Defined in: [activities/chat/stream/processor.ts:120](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L120)

StreamProcessor - State machine for processing AI response streams

Manages the full UIMessage[] conversation and emits events on changes.
Trusts the adapter contract: adapters emit clean AG-UI events in the
correct order.

State tracking:
- Full message array
- Current assistant message being streamed
- Text content accumulation
- Text content accumulation (reset on TEXT_MESSAGE_START)
- Multiple parallel tool calls
- Tool call completion detection
- Tool call completion via TOOL_CALL_END events

Tool call completion is detected when:
1. A new tool call starts at a different index
2. Text content arrives
3. Stream ends
## See

- docs/chat-architecture.md#streamprocessor-internal-state — State field reference
- docs/chat-architecture.md#adapter-contract — What this class expects from adapters

## Constructors

Expand All @@ -31,7 +33,7 @@ Tool call completion is detected when:
new StreamProcessor(options): StreamProcessor;
```

Defined in: [activities/chat/stream/processor.ts:145](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L145)
Defined in: [activities/chat/stream/processor.ts:147](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L147)

#### Parameters

Expand All @@ -51,7 +53,7 @@ Defined in: [activities/chat/stream/processor.ts:145](https://github.com/TanStac
addToolApprovalResponse(approvalId, approved): void;
```

Defined in: [activities/chat/stream/processor.ts:287](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L287)
Defined in: [activities/chat/stream/processor.ts:329](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L329)

Add an approval response (called by client after handling onApprovalRequest)

Expand Down Expand Up @@ -80,7 +82,7 @@ addToolResult(
error?): void;
```

Defined in: [activities/chat/stream/processor.ts:243](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L243)
Defined in: [activities/chat/stream/processor.ts:285](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L285)

Add a tool result (called by client after handling onToolCall)

Expand Down Expand Up @@ -110,7 +112,7 @@ Add a tool result (called by client after handling onToolCall)
addUserMessage(content, id?): UIMessage;
```

Defined in: [activities/chat/stream/processor.ts:192](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L192)
Defined in: [activities/chat/stream/processor.ts:194](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L194)

Add a user message to the conversation.
Supports both simple string content and multimodal content arrays.
Expand Down Expand Up @@ -159,7 +161,7 @@ processor.addUserMessage('Hello!', 'custom-id-123')
areAllToolsComplete(): boolean;
```

Defined in: [activities/chat/stream/processor.ts:318](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L318)
Defined in: [activities/chat/stream/processor.ts:360](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L360)

Check if all tool calls in the last assistant message are complete
Useful for auto-continue logic
Expand All @@ -176,7 +178,7 @@ Useful for auto-continue logic
clearMessages(): void;
```

Defined in: [activities/chat/stream/processor.ts:362](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L362)
Defined in: [activities/chat/stream/processor.ts:404](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L404)

Clear all messages

Expand All @@ -192,14 +194,40 @@ Clear all messages
finalizeStream(): void;
```

Defined in: [activities/chat/stream/processor.ts:859](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L859)
Defined in: [activities/chat/stream/processor.ts:954](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L954)

Finalize the stream — complete all pending operations.

Finalize the stream - complete all pending operations
Called when the async iterable ends (stream closed). Acts as the final
safety net: completes any remaining tool calls, flushes un-emitted text,
and fires onStreamEnd.

#### Returns

`void`

#### See

docs/chat-architecture.md#single-shot-text-response — Finalization step

***

### getCurrentAssistantMessageId()

```ts
getCurrentAssistantMessageId(): string | null;
```

Defined in: [activities/chat/stream/processor.ts:246](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L246)

Get the current assistant message ID (if one has been created).
Returns null if prepareAssistantMessage() was called but no content
has arrived yet.

#### Returns

`string` \| `null`

***

### getMessages()
Expand All @@ -208,7 +236,7 @@ Finalize the stream - complete all pending operations
getMessages(): UIMessage[];
```

Defined in: [activities/chat/stream/processor.ts:310](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L310)
Defined in: [activities/chat/stream/processor.ts:352](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L352)

Get current messages

Expand All @@ -224,7 +252,7 @@ Get current messages
getRecording(): ChunkRecording | null;
```

Defined in: [activities/chat/stream/processor.ts:938](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L938)
Defined in: [activities/chat/stream/processor.ts:1051](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L1051)

Get the current recording

Expand All @@ -240,7 +268,7 @@ Get the current recording
getState(): ProcessorState;
```

Defined in: [activities/chat/stream/processor.ts:911](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L911)
Defined in: [activities/chat/stream/processor.ts:1024](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L1024)

Get current processor state

Expand All @@ -250,13 +278,33 @@ Get current processor state

***

### prepareAssistantMessage()

```ts
prepareAssistantMessage(): void;
```

Defined in: [activities/chat/stream/processor.ts:224](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L224)

Prepare for a new assistant message stream.
Does NOT create the message immediately -- the message is created lazily
when the first content-bearing chunk arrives via ensureAssistantMessage().
This prevents empty assistant messages from flickering in the UI when
auto-continuation produces no content.

#### Returns

`void`

***

### process()

```ts
process(stream): Promise<ProcessorResult>;
```

Defined in: [activities/chat/stream/processor.ts:375](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L375)
Defined in: [activities/chat/stream/processor.ts:417](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L417)

Process a stream and emit events through handlers

Expand All @@ -278,9 +326,13 @@ Process a stream and emit events through handlers
processChunk(chunk): void;
```

Defined in: [activities/chat/stream/processor.ts:403](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L403)
Defined in: [activities/chat/stream/processor.ts:451](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L451)

Process a single chunk from the stream
Process a single chunk from the stream.

Central dispatch for all AG-UI events. Each event type maps to a specific
handler. Events not listed in the switch are intentionally ignored
(RUN_STARTED, TEXT_MESSAGE_END, STEP_STARTED, STATE_SNAPSHOT, STATE_DELTA).

#### Parameters

Expand All @@ -292,6 +344,10 @@ Process a single chunk from the stream

`void`

#### See

docs/chat-architecture.md#adapter-contract — Expected event types and ordering

***

### removeMessagesAfter()
Expand All @@ -300,7 +356,7 @@ Process a single chunk from the stream
removeMessagesAfter(index): void;
```

Defined in: [activities/chat/stream/processor.ts:354](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L354)
Defined in: [activities/chat/stream/processor.ts:396](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L396)

Remove messages after a certain index (for reload/retry)

Expand All @@ -322,7 +378,7 @@ Remove messages after a certain index (for reload/retry)
reset(): void;
```

Defined in: [activities/chat/stream/processor.ts:961](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L961)
Defined in: [activities/chat/stream/processor.ts:1074](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L1074)

Full reset (including messages)

Expand All @@ -338,7 +394,7 @@ Full reset (including messages)
setMessages(messages): void;
```

Defined in: [activities/chat/stream/processor.ts:164](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L164)
Defined in: [activities/chat/stream/processor.ts:166](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L166)

Set the messages array (e.g., from persisted state)

Expand All @@ -354,21 +410,23 @@ Set the messages array (e.g., from persisted state)

***

### startAssistantMessage()
### ~~startAssistantMessage()~~

```ts
startAssistantMessage(): string;
```

Defined in: [activities/chat/stream/processor.ts:219](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L219)

Start streaming a new assistant message
Returns the message ID
Defined in: [activities/chat/stream/processor.ts:236](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L236)

#### Returns

`string`

#### Deprecated

Use prepareAssistantMessage() instead. This eagerly creates
an assistant message which can cause empty message flicker.

***

### startRecording()
Expand All @@ -377,7 +435,7 @@ Returns the message ID
startRecording(): void;
```

Defined in: [activities/chat/stream/processor.ts:925](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L925)
Defined in: [activities/chat/stream/processor.ts:1038](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L1038)

Start recording chunks

Expand All @@ -396,7 +454,7 @@ toModelMessages(): ModelMessage<
| null>[];
```

Defined in: [activities/chat/stream/processor.ts:299](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L299)
Defined in: [activities/chat/stream/processor.ts:341](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L341)

Get the conversation as ModelMessages (for sending to LLM)

Expand All @@ -415,7 +473,7 @@ Get the conversation as ModelMessages (for sending to LLM)
static replay(recording, options?): Promise<ProcessorResult>;
```

Defined in: [activities/chat/stream/processor.ts:970](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L970)
Defined in: [activities/chat/stream/processor.ts:1094](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L1094)

Replay a recording through the processor

Expand Down
2 changes: 1 addition & 1 deletion docs/reference/functions/chat.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ title: chat
function chat<TAdapter, TSchema, TStream>(options): TextActivityResult<TSchema, TStream>;
```

Defined in: [activities/chat/index.ts:1122](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/index.ts#L1122)
Defined in: [activities/chat/index.ts:1125](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/index.ts#L1125)

Text activity - handles agentic text generation, one-shot text generation, and agentic structured output.

Expand Down
2 changes: 1 addition & 1 deletion docs/reference/functions/convertMessagesToModelMessages.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ function convertMessagesToModelMessages(messages): ModelMessage<
| null>[];
```

Defined in: [activities/chat/messages.ts:53](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/messages.ts#L53)
Defined in: [activities/chat/messages.ts:63](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/messages.ts#L63)

Convert UIMessages or ModelMessages to ModelMessages

Expand Down
2 changes: 1 addition & 1 deletion docs/reference/functions/createReplayStream.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ title: createReplayStream
function createReplayStream(recording): AsyncIterable<AGUIEvent>;
```

Defined in: [activities/chat/stream/processor.ts:982](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L982)
Defined in: [activities/chat/stream/processor.ts:1106](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/stream/processor.ts#L1106)

Create an async iterable from a recording

Expand Down
2 changes: 1 addition & 1 deletion docs/reference/functions/generateMessageId.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ title: generateMessageId
function generateMessageId(): string;
```

Defined in: [activities/chat/messages.ts:363](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/messages.ts#L363)
Defined in: [activities/chat/messages.ts:436](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/messages.ts#L436)

Generate a unique message ID

Expand Down
2 changes: 1 addition & 1 deletion docs/reference/functions/modelMessageToUIMessage.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ title: modelMessageToUIMessage
function modelMessageToUIMessage(modelMessage, id?): UIMessage;
```

Defined in: [activities/chat/messages.ts:238](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/messages.ts#L238)
Defined in: [activities/chat/messages.ts:305](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/messages.ts#L305)

Convert a ModelMessage to UIMessage

Expand Down
2 changes: 1 addition & 1 deletion docs/reference/functions/modelMessagesToUIMessages.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ title: modelMessagesToUIMessages
function modelMessagesToUIMessages(modelMessages): UIMessage[];
```

Defined in: [activities/chat/messages.ts:291](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/messages.ts#L291)
Defined in: [activities/chat/messages.ts:364](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/messages.ts#L364)

Convert an array of ModelMessages to UIMessages

Expand Down
2 changes: 1 addition & 1 deletion docs/reference/functions/normalizeToUIMessage.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ title: normalizeToUIMessage
function normalizeToUIMessage(message, generateId): UIMessage;
```

Defined in: [activities/chat/messages.ts:340](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/messages.ts#L340)
Defined in: [activities/chat/messages.ts:413](https://github.com/TanStack/ai/blob/main/packages/typescript/ai/src/activities/chat/messages.ts#L413)

Normalize a message (UIMessage or ModelMessage) to a UIMessage
Ensures the message has an ID and createdAt timestamp
Expand Down
Loading