Skip to content

feat: benchmarking via synergy (+cleansing)#55

Merged
Intrinsical-AI merged 7 commits intodevelopfrom
bench/repogpt-ragp-v1
Mar 19, 2026
Merged

feat: benchmarking via synergy (+cleansing)#55
Intrinsical-AI merged 7 commits intodevelopfrom
bench/repogpt-ragp-v1

Conversation

@Intrinsical-AI
Copy link
Owner

feat(eval): add --run-out option to write ranked run as JSONL
@Intrinsical-AI
@claude
Intrinsical-AI and claude committed yesterday

[fix(sync): add dense-st extra to default sync target](https://github.com/Intrinsical-AI/rag-prototype/commit/30ede04604059e21bc46bebae814042e10330ed1)
@[Intrinsical-AI](https://github.com/Intrinsical-AI/rag-prototype/commits?author=Intrinsical-AI)
@[claude](https://github.com/Intrinsical-AI/rag-prototype/commits?author=claude)
Intrinsical-AI and claude committed yesterday

[fix(settings): settings was passed twice via kwargs, leading to errors](https://github.com/Intrinsical-AI/rag-prototype/commit/455e11ddbeb584056f29df974367e20cda459d07)
@[Intrinsical-AI](https://github.com/Intrinsical-AI/rag-prototype/commits?author=Intrinsical-AI)
Intrinsical-AI committed 6 hours ago

Commits on Mar 19, 2026

[fix(import-canonical): reject invalid documents before scope sync](https://github.com/Intrinsical-AI/rag-prototype/commit/14f6077af2dc3c007184da80c317b09cfc98189f)
@[Intrinsical-AI](https://github.com/Intrinsical-AI/rag-prototype/commits?author=Intrinsical-AI)
Intrinsical-AI committed 2 minutes ago

[fix(health): degrade index drift verification failure to actionable w…](https://github.com/Intrinsical-AI/rag-prototype/commit/682740b66b7c938ced839ffcdbef645a55d9d7e0)
@[Intrinsical-AI](https://github.com/Intrinsical-AI/rag-prototype/commits?author=Intrinsical-AI)
Intrinsical-AI committed 2 minutes ago

[docs: add technical debt register and docs nav entry](https://github.com/Intrinsical-AI/rag-prototype/commit/d4536376a005f662660dfac1dd40dc45d8fdc822)
@[Intrinsical-AI](https://github.com/Intrinsical-AI/rag-prototype/commits?author=Intrinsical-AI)
Intrinsical-AI committed 2 minutes ago

[docs: remove legacy changelog](https://github.com/Intrinsical-AI/rag-prototype/commit/32c34f28e9ca36fadbe0d64e0b92d947fe05d3bf)
@[Intrinsical-AI](https://github.com/Intrinsical-AI/rag-prototype/commits?author=Intrinsical-AI)
Intrinsical-AI committed 2 minutes ago

Intrinsical-AI and others added 7 commits March 18, 2026 03:28
New CLI flag --run-out writes the full ranked retrieval output (one line
per query) to a JSONL file. Enables post-hoc multi-run pooling and
deeper result inspection without re-running retrieval.

These changes reflect the exact working tree state at benchmark execution
time (synergy/repogpt-ragp benchmark v1, 2026-03-18).

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
dense-st (SentenceTransformers) is required for dense/hybrid retrieval
in the local_split profile. Without it, benchmark re-runs fail at eval
points 2, 3, 5, 6, 8, 9, 11, 12, 14, 15, 17, 18 with "embeddings
backend not configured".

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@Intrinsical-AI Intrinsical-AI merged commit ebe4797 into develop Mar 19, 2026
10 checks passed
@Intrinsical-AI Intrinsical-AI deleted the bench/repogpt-ragp-v1 branch March 19, 2026 03:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant