Skip to content

Add debug-only Fluency Level Viewer for scoring transparency#226

Merged
rajbos merged 8 commits intomainfrom
copilot/add-fluency-score-view
Feb 16, 2026
Merged

Add debug-only Fluency Level Viewer for scoring transparency#226
rajbos merged 8 commits intomainfrom
copilot/add-fluency-score-view

Conversation

Copy link
Contributor

Copilot AI commented Feb 14, 2026

Adds a debug-only tool to view fluency scoring rules, thresholds, and advancement tips locally. Accessible only when a VS Code debugger is active.

Implementation

Debug gate:

const isDebugMode = vscode.debug.activeDebugSession !== undefined;
if (!isDebugMode) {
  vscode.window.showWarningMessage('Fluency Level Viewer is only available when a debugger is active.');
  return;
}

New components:

  • src/webview/fluency-level-viewer/ - Interactive webview with category selector (6 categories) and stage cards (4 stages each)
  • getFluencyLevelData() in extension.ts - Defines all 24 stage thresholds/tips matching calculateMaturityScores() logic
  • Conditional "🔍 Level Viewer" button in maturity panel header (visible only when isDebugMode)

Data structure:
Each category (Prompt Engineering, Context Engineering, Agentic, Tool Usage, Customization, Workflow Integration) includes:

  • Stage 1-4 labels (Skeptic → Explorer → Collaborator → Strategist)
  • Specific thresholds (e.g., "At least 30 total interactions", "Using 2+ slash commands")
  • Contextual tips for advancement
  • Color-coded UI (red/orange/blue/green)

Registration:

  • Command: copilot-token-tracker.showFluencyLevelViewer
  • Button config: btn-level-viewer in shared navigation
  • Test coverage: Added to expectedCommands array

Use cases

  • Verify scoring logic during development
  • Debug unexpected fluency scores
  • Document scoring criteria for users
  • Plan feature usage to advance stages
Original prompt

I want to be able to view the fluency scores locally so I can get the messages and tips for the different fluency levels per aspect. This test option should only be available when there is an active debugger active.

Maybe it's an idea to switch a level on the spider chart and then see the different scores/rules that apply to that level and see the suggestions to gain a level?


✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

Copilot AI and others added 4 commits February 14, 2026 21:51
Co-authored-by: rajbos <6085745+rajbos@users.noreply.github.com>
Co-authored-by: rajbos <6085745+rajbos@users.noreply.github.com>
Co-authored-by: rajbos <6085745+rajbos@users.noreply.github.com>
Co-authored-by: rajbos <6085745+rajbos@users.noreply.github.com>
Copilot AI changed the title [WIP] Add local view for fluency scores and tips Add debug-only Fluency Level Viewer for scoring transparency Feb 14, 2026
Copilot AI requested a review from rajbos February 14, 2026 22:00
@rajbos rajbos marked this pull request as ready for review February 16, 2026 21:07
@rajbos rajbos enabled auto-merge February 16, 2026 21:08
@rajbos rajbos merged commit ad5be4f into main Feb 16, 2026
16 checks passed
@rajbos rajbos deleted the copilot/add-fluency-score-view branch February 16, 2026 21:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Comments