Skip to content

Implement file chunking for report.file in Eldritch#1887

Merged
KCarretto merged 3 commits intomainfrom
eldritch-file-chunking-15820419166954838064
Feb 25, 2026
Merged

Implement file chunking for report.file in Eldritch#1887
KCarretto merged 3 commits intomainfrom
eldritch-file-chunking-15820419166954838064

Conversation

@KCarretto
Copy link
Copy Markdown
Collaborator

Implement file chunking for report.file in Eldritch to prevent memory issues with large files.

Updated Agent trait in eldritch-agent to support streaming via Iterator. Implement FileChunkIterator in eldritch-libreport with 1MB chunk size. Update ImixAgent to stream chunks to transport using a background thread. Update mocks and fake implementations in eldritch-libagent, eldritch-libassets, eldritch-libpivot, and tests. Add integration test test_report_large_file_via_eldritch in imix to verify 100MB file upload behavior.

If we fail to upload for any reason, report the error.


PR created automatically by Jules for task 15820419166954838064 started by @KCarretto

Updated `Agent` trait to support streaming file upload using `Iterator`.
Implemented `FileChunkIterator` in `eldritch-libreport` to read files in 1MB chunks.
Updated `ImixAgent` to stream chunks to transport using a background thread and bounded channel.
Updated mock and fake agents to match the new `Agent` trait signature.
Added integration test `test_report_large_file_via_eldritch` to verify 100MB file upload behavior.
This prevents memory issues when uploading large files.

Co-authored-by: KCarretto <16250309+KCarretto@users.noreply.github.com>
@google-labs-jules
Copy link
Copy Markdown
Contributor

👋 Jules, reporting for duty! I'm here to lend a hand with this pull request.

When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down.

I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job!

For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with @jules. You can find this option in the Pull Request section of your global Jules UI settings. You can always switch back!

New to Jules? Learn more at jules.google/docs.


For security, I will only act on instructions from the user who triggered this task.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Feb 24, 2026

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
2661    ±0 2661    ±0 0    ±0 0    ±0 0    ±0 0    ±0 1ms    ±0

Previous Results

Build 🏗️ Result 🧪 Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
#1232 2661 2661 0 0 0 0 37.2s

Insights

Average Tests per Run Total Flaky Tests Total Failed Slowest Test (p95)
2661 0 0 5.5s

Slowest Tests

Test 📝 Results 📊 Duration (avg) ⏱️ Duration (p95) ⏱️
TestDockerExecutor_Build_ContextCancellation 1 5.5s 5.5s
eldritch-libsys: std::dll_inject_impl::tests::test_dll_inject_simple 1 5.1s 5.1s
TestInteractiveShell 1 5.0s 5.0s
TestOtherStreamOutput 1 5.0s 5.0s
imix::bin/imix: install::tests::test_install_execution 3 1.6s 4.6s
imix::bin/imix: install::tests::test_install_execution 3 1.6s 4.6s
imix::bin/imix: install::tests::test_install_execution 3 1.6s 4.6s
TestDockerExecutor_Build_SimpleEcho 1 3.2s 3.2s
imix::bin/imix: tests::task_tests::test_task_streaming_output 3 3.0s 3.0s
imix::bin/imix: tests::task_tests::test_task_streaming_output 3 3.0s 3.0s

🎉 No failed tests in this run. | 🍂 No flaky tests in this run.

Github Test Reporter by CTRF 💚

🔄 This comment has been updated

Ran `cargo fmt` in `implants/` directory to fix CI failure.
Also verified that the new test `test_report_large_file_via_eldritch` still passes.

Co-authored-by: KCarretto <16250309+KCarretto@users.noreply.github.com>
@KCarretto KCarretto requested a review from hulto February 25, 2026 01:03
@KCarretto KCarretto marked this pull request as ready for review February 25, 2026 01:03
Changed `Agent::report_file` to accept `std::sync::mpsc::Receiver` instead of `Iterator`.
Updated `eldritch-libreport` to spawn a thread and feed the channel.
Updated `ImixAgent` to pass the receiver to transport.
Updated tests and mocks.

Co-authored-by: KCarretto <16250309+KCarretto@users.noreply.github.com>
@KCarretto KCarretto added this pull request to the merge queue Feb 25, 2026
Merged via the queue into main with commit 40f787a Feb 25, 2026
9 checks passed
@KCarretto KCarretto deleted the eldritch-file-chunking-15820419166954838064 branch February 25, 2026 01:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants