Skip to content

ci(llmobs): add evaluation metric assertion helper using node:assert#7227

Merged
sabrenner merged 3 commits intomasterfrom
sabrenner/llmobs-eval-metrics-node-assert
Jan 13, 2026
Merged

ci(llmobs): add evaluation metric assertion helper using node:assert#7227
sabrenner merged 3 commits intomasterfrom
sabrenner/llmobs-eval-metrics-node-assert

Conversation

@sabrenner
Copy link
Copy Markdown
Collaborator

What does this PR do?

Follow-up on #6709 to re-enable an evaluation metrics test with a new assertion helper

Motivation

Re-enable test, use node:assert instead of mocha where possible

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jan 13, 2026

Overall package size

Self size: 4.39 MB
Deduped: 5.21 MB
No deduping: 5.21 MB

Dependency sizes | name | version | self size | total size | |------|---------|-----------|------------| | import-in-the-middle | 2.0.0 | 68.46 kB | 797.03 kB | | dc-polyfill | 0.1.10 | 26.73 kB | 26.73 kB |

🤖 This report was automatically generated by heaviest-objects-in-the-universe

@codecov
Copy link
Copy Markdown

codecov Bot commented Jan 13, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 84.56%. Comparing base (61f0b12) to head (05cc6ae).
⚠️ Report is 2 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #7227      +/-   ##
==========================================
+ Coverage   84.37%   84.56%   +0.18%     
==========================================
  Files         522      532      +10     
  Lines       22167    22651     +484     
==========================================
+ Hits        18704    19154     +450     
- Misses       3463     3497      +34     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@datadog-official

This comment has been minimized.

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Jan 13, 2026

Benchmarks

Benchmark execution time: 2026-01-13 15:15:57

Comparing candidate commit 05cc6ae in PR branch sabrenner/llmobs-eval-metrics-node-assert with baseline commit 61f0b12 in branch master.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 291 metrics, 29 unstable metrics.

@sabrenner sabrenner marked this pull request as ready for review January 13, 2026 13:55
@sabrenner sabrenner requested review from a team as code owners January 13, 2026 13:55
@sabrenner sabrenner enabled auto-merge (squash) January 13, 2026 14:30
@sabrenner sabrenner merged commit 05e6e69 into master Jan 13, 2026
795 of 796 checks passed
@sabrenner sabrenner deleted the sabrenner/llmobs-eval-metrics-node-assert branch January 13, 2026 16:22
dd-octo-sts Bot pushed a commit that referenced this pull request Jan 14, 2026
…7227)

* add evaluation metrics assertion helper

* remove .only
@dd-octo-sts dd-octo-sts Bot mentioned this pull request Jan 14, 2026
nina9753 pushed a commit that referenced this pull request Jan 15, 2026
…7227)

* add evaluation metrics assertion helper

* remove .only
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants