Skip to content

feat(catalog): mode-aware pricing and litellm-model-catalog-api integration#26

Open
Sameerlite wants to merge 3 commits into
fastrepl:mainfrom
Sameerlite:feat/catalog-api-pricing
Open

feat(catalog): mode-aware pricing and litellm-model-catalog-api integration#26
Sameerlite wants to merge 3 commits into
fastrepl:mainfrom
Sameerlite:feat/catalog-api-pricing

Conversation

@Sameerlite
Copy link
Copy Markdown

@Sameerlite Sameerlite commented May 20, 2026

Summary

  • Integrate with litellm-model-catalog-api (optional via VITE_USE_LOCAL_CATALOG_API + Vite proxy)
  • Show exact catalog pricing for chat, embedding, image gen, audio transcription, and TTS models
  • Use the same 2×2 pricing grid for all modes; hide chat-only Features for image/audio models
  • Add mode-specific LiteLLM SDK and proxy quick-start snippets

Depends on BerriAI/litellm-model-catalog-api#1 for pricing_slots in API responses.
Fixes LIT-2904

Image Gen
Before
image

After
image

Embedding
Before
image
After
image

Transcription
Before
image
After
image

Audio Speech
Before
image
After
image

Sameerlite and others added 3 commits May 20, 2026 12:49
…ration

Load from the catalog API with Vite proxy support, show exact pricing for chat,
image, audio transcription, and TTS models, and render mode-specific quick start snippets.

Co-authored-by: Cursor <cursoragent@cursor.com>
Highlight SDK/proxy code via :global CSS for {@html} snippets. Add audio
transcription and TTS proxy curl examples alongside existing mode-specific SDK samples.

Co-authored-by: Cursor <cursoragent@cursor.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant