feat: Add LLM token usage tracking to Application Insights by Prachig-Microsoft · Pull Request #586 · microsoft/content-processing-solution-accelerator

feat: Add LLM token usage tracking to Application Insights

Prachig-Microsoft

and

Copilot

committed

fix: Handle UsageDetails object and add missing dependencies

Prachig-Microsoft

and

Copilot

committed

feat: Add portable Azure Workbook template for token usage dashboard

Prachig-Microsoft

and

Copilot

committed

fix: Update workbook template format for Advanced Editor import

Prachig-Microsoft

and

Copilot

committed

fix: Replace tiles visualization with table to fix workbook import error

Prachig-Microsoft

and

Copilot

committed

revert: Remove enableMonitoring from main.parameters.json

Prachig-Microsoft

and

Copilot

committed

fix: Deduplicate KQL queries in workbook to prevent double-counting events

Prachig-Microsoft

and

Copilot

committed

feat: Update workbook with grid layout and add deploy-workbook.bicep

Prachig-Microsoft

and

Copilot

committed

feat: Change Token Usage by File Type to grid visualization

Prachig-Microsoft

and

Copilot

committed

fix: derive overall token totals from per-agent events instead of broken summary event

Prachig-Microsoft

and

Copilot

committed

feat: add processing time queries per pipeline step and per document

Prachig-Microsoft

and

Copilot

committed

fix: rewrite processing time queries to use customEvents timestamps

Prachig-Microsoft

and

Copilot

committed

chore: remove appi-pgcpfeatuw333 from workbook, keep only appi-cptoken1kbxf2

Prachig-Microsoft

and

Copilot

committed

Fix token usage workbook: dedup events, time range params, portable resource IDs

Prachig-Microsoft

and

Copilot

committed

Enable monitoring (Application Insights) for non-WAF deployment

Prachig-Microsoft

and

Copilot

committed

Fix workbook cross-resource queries for separate RG deployment

Prachig-Microsoft

and

Copilot

committed

fix: workbook queries - dedup tokens, MapHandler-only doc count, inner join for file types

Prachig-Microsoft

and

Copilot

committed

refactor: replace workbook-specific token tracking with generic telemetry logging

Prachig-Microsoft

and

Copilot

committed

fix: remove unused import and trailing blank line in test_token_usage_utils

Prachig-Microsoft

and

Copilot

committed

fix: add file_name and file_mime_type to token usage telemetry events

Prachig-Microsoft

and

Copilot

committed

feat: add deterministic event_id for deduplication in telemetry events

Prachig-Microsoft

and

Copilot

committed

Address PR #586 review comments

Prachig-Microsoft

and

Copilot

committed

fix: exclude telemetry module from Workflow coverage (tested in ContentProcessor)

Prachig-Microsoft

and

Copilot

committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: Add LLM token usage tracking to Application Insights#586

feat: Add LLM token usage tracking to Application Insights#586
Prachig-Microsoft wants to merge 23 commits into
devfrom
feature/token-usage-tracking

Commits on Jun 2, 2026

feat: Add LLM token usage tracking to Application Insights

fix: Handle UsageDetails object and add missing dependencies

feat: Add portable Azure Workbook template for token usage dashboard

fix: Update workbook template format for Advanced Editor import

fix: Replace tiles visualization with table to fix workbook import error

revert: Remove enableMonitoring from main.parameters.json

fix: Deduplicate KQL queries in workbook to prevent double-counting events

feat: Update workbook with grid layout and add deploy-workbook.bicep

feat: Change Token Usage by File Type to grid visualization

fix: derive overall token totals from per-agent events instead of broken summary event

feat: add processing time queries per pipeline step and per document

fix: rewrite processing time queries to use customEvents timestamps

chore: remove appi-pgcpfeatuw333 from workbook, keep only appi-cptoken1kbxf2

Fix token usage workbook: dedup events, time range params, portable resource IDs

Enable monitoring (Application Insights) for non-WAF deployment

Fix workbook cross-resource queries for separate RG deployment

fix: workbook queries - dedup tokens, MapHandler-only doc count, inner join for file types

refactor: replace workbook-specific token tracking with generic telemetry logging

fix: remove unused import and trailing blank line in test_token_usage_utils

fix: add file_name and file_mime_type to token usage telemetry events

feat: add deterministic event_id for deduplication in telemetry events

Address PR #586 review comments

fix: exclude telemetry module from Workflow coverage (tested in ContentProcessor)