-
Notifications
You must be signed in to change notification settings - Fork 19
Premium request usage data reports oddly from intellij plugin when viewed from Github APIs #1442
Description
Feedback source
Internal Enterprise Feedback
GitHub Copilot plugin version
1.5.65-243
JetBrains IDE and version
253.30387.85
Platform
No response
Steps to reproduce
- Have users make premium requests in intellij github copilot plugin
- Run github daily usage api (https://api.github.com/orgs/ORG_NAME/copilot/metrics/reports/users-1-day?day=2026-02-18) the day after to grab latest logs
- See that user's premium request usage will not match actual, often user_initiated_interaction_count will be 0
Logs (optional)
No response
Expected behavior
Premium request count would match actual usage when using intellij github copilot plugin
Actual behavior
Premium request count is often 0 or far less than expected when the intellij github copilot plugin is used.
Additional information
Not really sure where to log this but its an inconsistency I have been seeing with https://docs.github.com/en/enterprise-cloud@latest/rest/copilot/copilot-usage-metrics?apiVersion=2022-11-28#get-copilot-organization-usage-metrics-for-a-specific-day so I am not sure if this is a bug with the API or the way data is being collected from the plugin.
Users that primarily use intellij as their copilot IDE have very low premium request usage numbers when in reality they have used many requests. Example users data over a month in a summary:
Interactions for most days (using just intellij) are almost nothing even though the user is using premium requests through agents.