emit metrics on token counts#382

saiatmakuri merged 3 commits intomainscaleapi/llm-engine:mainfrom

saiatmakuri/emit-token-count-metricsscaleapi/llm-engine:saiatmakuri/emit-token-count-metricsCopy head branch name to clipboard