Skip to content

add btx implementation to execute span spec tests#173

Open
Andrew Kent (realark) wants to merge 2 commits into
mainfrom
ark/btx
Open

add btx implementation to execute span spec tests#173
Andrew Kent (realark) wants to merge 2 commits into
mainfrom
ark/btx

Conversation

@realark
Copy link
Copy Markdown
Contributor

@realark Andrew Kent (realark) commented Jun 1, 2026

Needed this to test gzip compression and attachment processors. Breaking out into a separate PR for ease of review.

Adds btx test execution framework.

PRODUCT CHANGES MADE

NEW FEATURES

  • When Anthropic returns the per-TTL cache_creation breakdown, the SDK now emits prompt_cache_creation_5m_tokens / prompt_cache_creation_1h_tokens and drops the aggregate prompt_cache_creation_tokens (to avoid double-counting). Previously only the aggregate was emitted.
  • tag openai spans as llm spans

MINOR BREAKING CHANGES

To bring the ruby sdk in line with the specs, a few changes to the anthropic tags were made

  • output is now a single object {role, content} instead of a one-element array [{role, content}]
  • The system prompt is now appended last ([user…, system]) instead of first ([system, user…]).
  • Streaming now produces a span named anthropic.messages.stream instead of anthropic.messages.create

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant