Context window chart

[tevanburen]

Description

Add a context window for users to visualize memory usage via tokens used / tokens max.

Changes Made

• Added pie chart to visualize % of memory usage
• Added a new HoverCard component to the library
• Enabled information display (HoverCard) for users to learn more about their memory usage.
• Parse response of GetPlaygroundMessages to read # of tokens used on each message
• Fetch and store # of tokens available for each model in chat.store
• Context Window only shows if above 12.5% usage of memory

How to Test

To View Context Window: <12.5% Context Usage

1. Go to Playground, choose an AI model of choice and send a chat (Ex. "hi")
2. Since the context window only shows when a user uses more than 12.5%, your message should not trigger the context window component.

To View Context Window: >12.5% Context Usage

1. To quickly view context window, lower token count (ex. 2000) within your AI model of choice via the .smss file in semoss/model. Find the command line CONTEXT_WINDOW and change the token count manually there.
2. Restart your Eclipse server, then enable the same AI model of choice in Playground.
3. Write a task to give your AI that would prompt it to use a larger token response (Ex. "Write a very long poem").
4. Verify that Context Window component is visible and accurately displays amount of tokens used by hovering over pie chart graphic.

To View Context Window: >75% Context Usage

1. Have your AI write another high-token output response (Ex. "Write an even longer poem") until your context window reaches above 75% usage.
2. The Context Window component should turn colors to our destructive color (red) and accurately displays amount of tokens used by hovering over pie chart graphic.

Notes

hi doshi

[tevanburen]

TODO:

• Style the component correctly in context-chart.tsx (font, chart, logic for destructive)
• Calculate the percentage correctly in room.tsx using Ryan's reactor
• Have the chart only appear when >10%
• Round numbers using ceil function
• Add tooltip

[rithvik-doshi]

lgtm

[github-actions]

@CodiumAI-Agent /update_changelog