Add comprehensive LLM tool detection support (18 tools)#52878
Conversation
Co-authored-by: baronfel <573979+baronfel@users.noreply.github.com>
Co-authored-by: baronfel <573979+baronfel@users.noreply.github.com>
|
This PR has been labeled with
|
There was a problem hiding this comment.
Pull request overview
Expands dotnet CLI telemetry’s LLM environment detection to cover a broader set of AI/agent tools (18 total), aiming for parity with the referenced “am-i-ai” detection list.
Changes:
- Added a new detection rule type to match specific environment variable values case-insensitively (
EnvironmentVariableValueRule). - Expanded
LLMEnvironmentDetectorForTelemetryfrom a small set of tools to 18 tools, supporting multiple simultaneous detections (comma-separated). - Extended unit test coverage to include the new tools and some multi-tool combinations.
Reviewed changes
Copilot reviewed 3 out of 3 changed files in this pull request and generated 2 comments.
| File | Description |
|---|---|
| test/dotnet.Tests/TelemetryCommonPropertiesTests.cs | Adds test cases for the newly detected tools and multi-tool combinations. |
| src/Cli/dotnet/Telemetry/LLMEnvironmentDetectorForTelemetry.cs | Extends LLM tool detection rules from 5 to 18 tools and returns comma-separated results. |
| src/Cli/dotnet/Telemetry/EnvironmentDetectionRule.cs | Introduces EnvironmentVariableValueRule for case-insensitive value-based env var matching. |
|
@copilot update the in-repo telemetry docs at https://github.com/dotnet/sdk/pull/documentation/project-docs/telemetry.md |
Co-authored-by: baronfel <573979+baronfel@users.noreply.github.com>
Updated the telemetry documentation with the complete list of 18 supported LLM tools. (4adfd2a) |
|
/backport to release/10.0.3xx |
|
Started backporting to |
Plan: Add More LLM Tool Detections
Based on the am-i-ai library (https://github.com/trieloff/am-i-ai), we need to add the following LLM tool detections:
CODEX_CLI,CODEX_SANDBOX)OR_APP_NAMEmatching "Aider")AMP_HOME)QWEN_CODE)DROID_CLI)OPENCODE_AI)ZED_ENVIRONMENT,ZED_TERM)KIMI_CLI)OR_APP_NAMEmatching "OpenHands")GOOSE_TERMINAL)CLINE_TASK_ID)ROO_CODE_TASK_ID)WINDSURF_SESSION)Summary
Successfully added detection support for 13 additional LLM tools, bringing the total from 5 to 18 supported tools. The implementation includes:
Original prompt
✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.