Skip to content

fix(logs): use channel-based aggregator#879

Merged
shreyamalpani merged 12 commits intomainfrom
shreya.malpani/remove-lock-on-logs
Oct 1, 2025
Merged

fix(logs): use channel-based aggregator#879
shreyamalpani merged 12 commits intomainfrom
shreya.malpani/remove-lock-on-logs

Conversation

@shreyamalpani
Copy link
Copy Markdown
Contributor

@shreyamalpani shreyamalpani commented Sep 30, 2025

Use a channel-based aggregator for logs to avoid locking on aggregation. Adds an aggregator service which receives incoming commands on a channel. Commands can be flush requests, inserts, or shutdowns.

Follows a similar pattern as DataDog/serverless-components#32

Tested that dual shipping still works as well.

SVLS-7646

@shreyamalpani shreyamalpani marked this pull request as ready for review October 1, 2025 15:03
@shreyamalpani shreyamalpani requested a review from a team as a code owner October 1, 2025 15:03
Comment thread bottlecap/src/bin/bottlecap/main.rs Outdated
Comment thread bottlecap/src/logs/aggregator_service.rs Outdated
Copy link
Copy Markdown
Contributor

@duncanista duncanista left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM – left some comments, and we also talked about some other improvements which I expect to be there before merging, so this can unblock you :shipit:

@shreyamalpani shreyamalpani merged commit 924bb09 into main Oct 1, 2025
46 checks passed
@shreyamalpani shreyamalpani deleted the shreya.malpani/remove-lock-on-logs branch October 1, 2025 19:25
shreyamalpani added a commit that referenced this pull request Oct 28, 2025
Use a channel-based aggregator for traces to avoid locking on
aggregation. Adds an aggregator service which receives incoming commands
on a channel. Commands can be to insert payloads, get batches, and
shutdown.

Follows a similar pattern as #879. Tested with self-monitoring and
tested that dual shipping still works as well.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants