Skip to content

[stack 4/4] Reduce realtime self-interruptions during playback#14827

Merged
aibrahim-oai merged 17 commits intomainfrom
fix/realtime-playback-barge-in
Mar 17, 2026
Merged

[stack 4/4] Reduce realtime self-interruptions during playback#14827
aibrahim-oai merged 17 commits intomainfrom
fix/realtime-playback-barge-in

Conversation

@aibrahim-oai
Copy link
Copy Markdown
Collaborator

@aibrahim-oai aibrahim-oai commented Mar 16, 2026

Stack Position

4/4. Top-of-stack sibling built on #14830.

Base

Sibling

Scope

  • Gate low-level mic chunks while speaker playback is active, while still allowing spoken barge-in.

@aibrahim-oai aibrahim-oai changed the title Reduce realtime self-interruptions during playback [4/4] Reduce realtime self-interruptions during playback Mar 16, 2026
@aibrahim-oai aibrahim-oai force-pushed the fix/realtime-playback-barge-in branch from 6f14fe6 to dcba042 Compare March 16, 2026 18:29
@aibrahim-oai aibrahim-oai force-pushed the feat/realtime-v2-wire-runtime-parity branch from 8173070 to a567cc8 Compare March 16, 2026 18:29
@aibrahim-oai aibrahim-oai changed the title [4/4] Reduce realtime self-interruptions during playback [stack 4/4] Reduce realtime self-interruptions during playback Mar 16, 2026
@aibrahim-oai aibrahim-oai force-pushed the fix/realtime-playback-barge-in branch from dcba042 to cba632b Compare March 16, 2026 19:27
@aibrahim-oai aibrahim-oai force-pushed the feat/realtime-v2-wire-runtime-parity branch from e7f9aeb to eacca86 Compare March 16, 2026 19:58
@aibrahim-oai aibrahim-oai force-pushed the fix/realtime-playback-barge-in branch from cba632b to 39dbe70 Compare March 16, 2026 19:58
aibrahim-oai added a commit that referenced this pull request Mar 16, 2026
Co-authored-by: Codex <noreply@openai.com>
@aibrahim-oai aibrahim-oai force-pushed the fix/realtime-playback-barge-in branch 4 times, most recently from aa5c38c to 6647d84 Compare March 16, 2026 23:16
aibrahim-oai and others added 8 commits March 16, 2026 16:24
Keep the rebased realtime stack compiling on current main by rendering the Interrupted multi-agent status in tui_app_server.

Co-authored-by: Codex <noreply@openai.com>
Port the realtime v2 session, parser, app-server, and conversation runtime behavior onto the split websocket-method base without pulling in the startup-context or TUI playback slices.

Co-authored-by: Codex <noreply@openai.com>
Add the new realtime event cases needed by the wire/runtime parity PR and fill the new audio frame field so the stack compiles cleanly on current main.

Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Codex <noreply@openai.com>
@aibrahim-oai aibrahim-oai force-pushed the feat/realtime-v2-wire-runtime-parity branch from 0fc8d7d to 062857c Compare March 16, 2026 23:24
@aibrahim-oai aibrahim-oai force-pushed the fix/realtime-playback-barge-in branch from 6647d84 to 49d0a78 Compare March 16, 2026 23:24
Co-authored-by: Codex <noreply@openai.com>
@aibrahim-oai aibrahim-oai force-pushed the fix/realtime-playback-barge-in branch from 49d0a78 to 7e84cf5 Compare March 16, 2026 23:28
Co-authored-by: Codex <noreply@openai.com>
@aibrahim-oai aibrahim-oai force-pushed the fix/realtime-playback-barge-in branch from 7e84cf5 to a8a1452 Compare March 16, 2026 23:39
Co-authored-by: Codex <noreply@openai.com>
@aibrahim-oai aibrahim-oai force-pushed the fix/realtime-playback-barge-in branch from a8a1452 to 7b843e7 Compare March 16, 2026 23:50
Co-authored-by: Codex <noreply@openai.com>
@aibrahim-oai aibrahim-oai force-pushed the fix/realtime-playback-barge-in branch from 7b843e7 to 7be7290 Compare March 16, 2026 23:58
aibrahim-oai and others added 3 commits March 16, 2026 19:47
Co-authored-by: Codex <noreply@openai.com>
Improve local playback gating so assistant audio does not constantly interrupt itself while still allowing spoken barge-in.

Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Codex <noreply@openai.com>
@aibrahim-oai aibrahim-oai force-pushed the fix/realtime-playback-barge-in branch from 7be7290 to 5fe8863 Compare March 17, 2026 02:47
Co-authored-by: Codex <noreply@openai.com>
aibrahim-oai added a commit that referenced this pull request Mar 17, 2026
## Stack Position
2/4. Built on top of #14828.

## Base
- #14828

## Unblocks
- #14829
- #14827

## Scope
- Port the realtime v2 wire parsing, session, app-server, and
conversation runtime behavior onto the split websocket-method base.
- Branch runtime behavior directly on the current realtime session kind
instead of parser-derived flow flags.
- Keep regression coverage in the existing e2e suites.

---------

Co-authored-by: Codex <noreply@openai.com>
Base automatically changed from feat/realtime-v2-wire-runtime-parity to main March 17, 2026 04:38
Resolve the realtime playback conflict in chatwidget/realtime.rs by keeping the branch's buffer clearing when speech starts or a response is cancelled.

Co-authored-by: Codex <noreply@openai.com>
@aibrahim-oai aibrahim-oai enabled auto-merge (squash) March 17, 2026 04:57
aibrahim-oai added a commit that referenced this pull request Mar 17, 2026
## Stack Position
3/4. Top-of-stack sibling built on #14830.

## Base
- #14830

## Sibling
- #14827

## Scope
- Extend the realtime startup context with a bounded summary of the
latest thread turns for continuity.

---------

Co-authored-by: Codex <noreply@openai.com>
@aibrahim-oai aibrahim-oai merged commit 32e4a5d into main Mar 17, 2026
33 checks passed
@aibrahim-oai aibrahim-oai deleted the fix/realtime-playback-barge-in branch March 17, 2026 05:19
@github-actions github-actions bot locked and limited conversation to collaborators Mar 17, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants