[backend/worker] handle too large items (#12816)

[JeremyCloarec]

Proposed changes

• add new internal queue too-large-bundle
• add objects_max_refs config to worker.py
• in worker, if item has too many dependencies, it is sent to the too-large-bundle queue instead of being ingested

client PR: OpenCTI-Platform/client-python#982
doc PR: OpenCTI-Platform/docs#360

Related issues

• Add a way to send objects from bundles with too many refs to a dead letter queue #12816

Checklist

• I consider the submitted work as finished
• I tested the code for its functionality
• I wrote test cases for the relevant uses case (coverage and e2e)
• I added/update the relevant documentation (either on github or on notion)
• Where necessary I refactored code to improve the overall quality

Further comments

[codecov]

Codecov Report

❌ Patch coverage is 66.66667% with 1 line in your changes missing coverage. Please review.
✅ Project coverage is 66.87%. Comparing base (a2cdb90) to head (3c76cf8).
⚠️ Report is 11 commits behind head on master.

Files with missing lines	Patch %	Lines
...-platform/opencti-graphql/src/database/rabbitmq.js	66.66%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master   #12632      +/-   ##
==========================================
+ Coverage   66.53%   66.87%   +0.34%     
==========================================
  Files         752      752              
  Lines       79741    79847     +106     
  Branches     8557     9021     +464     
==========================================
+ Hits        53056    53400     +344     
+ Misses      26685    26447     -238     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[xfournet]

did you manage to find a good default value to be used in Filigran SaaS ?

[JeremyCloarec]

Not yet, haven't tested enough to have a clear guideline on the value to set