Skip to content

Draft: feat: add chat_id to metrics#130

Open
noahpodgurski wants to merge 3 commits intomainfrom
add-chat-id-to-metrics
Open

Draft: feat: add chat_id to metrics#130
noahpodgurski wants to merge 3 commits intomainfrom
add-chat-id-to-metrics

Conversation

@noahpodgurski
Copy link
Copy Markdown
Collaborator

@noahpodgurski noahpodgurski commented Mar 26, 2026

What's new

  • Add passed chat-id header to prometheus metrics

TODO: Research glean vs sink https://mozilla-hub.atlassian.net/browse/GENAI-3967

https://mozilla.slack.com/archives/C09KKBSD0SG/p1769005992138379

"mlpa_chat_completion_latency_seconds",
"Chat completion latency in seconds.",
["result", "model", "service_type", "purpose"],
["result", "model", "service_type", "purpose", "chat_id"],
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a critical thing, we should not push high cardinality filters to Prometheus

This should be tracked through logging -> log sink -> BigQuery or with server side Glean

@noahpodgurski noahpodgurski changed the title feat: add chat_id to metrics Draft: feat: add chat_id to metrics Mar 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants