Skip to content

Fix Virtual GenAI e2e test failure by pinning Python dependencies#13810

Merged
wu-sheng merged 1 commit intomasterfrom
fix/genai-e2e-pinned-deps
Apr 10, 2026
Merged

Fix Virtual GenAI e2e test failure by pinning Python dependencies#13810
wu-sheng merged 1 commit intomasterfrom
fix/genai-e2e-pinned-deps

Conversation

@wu-sheng
Copy link
Copy Markdown
Member

Fix Virtual GenAI e2e test broken on master since April 9

  • Explain briefly why the bug exists and how to fix it.

Root cause: On April 9, opentelemetry-sdk updated to 1.41.0. The opentelemetry-bootstrap --action=install step in the Dockerfile auto-installs opentelemetry-instrumentation-openai-v2==2.3b0 (the official OTel package), which is incompatible with OTel SDK 1.41.0 — it crashes with TypeError: wrap_function_wrapper() got an unexpected keyword argument 'module'. This silently kills all GenAI span attribute generation at runtime, so no VIRTUAL_GENAI service is ever created.

Fix:

  1. Remove opentelemetry-bootstrap --action=install — it auto-installs the broken official package that conflicts with the working Traceloop instrumentation.
  2. Pin all Python dependency versions — prevents future breakage from upstream releases.

Verified locally that Traceloop opentelemetry-instrumentation-openai==0.58.0 with OTel SDK 1.41.0 produces all required span attributes:

  • gen_ai.response.model
  • gen_ai.provider.name
  • gen_ai.usage.input_tokens
  • gen_ai.usage.output_tokens

Also includes a minor indentation fix in pom.xml (gpg-plugin closing tags).

Pin Python dependencies in the OpenAI e2e test Dockerfile and remove
`opentelemetry-bootstrap --action=install` which auto-installs the
official `opentelemetry-instrumentation-openai-v2` package that is
incompatible with OTel SDK 1.41.0, crashing GenAI instrumentation
at runtime.

Also fix indentation in pom.xml gpg-plugin closing tags.
@wu-sheng wu-sheng added this to the 10.5.0 milestone Apr 10, 2026
@wu-sheng wu-sheng added the test Test requirements about performance, feature or before release. label Apr 10, 2026
@wu-sheng wu-sheng merged commit 7e93bab into master Apr 10, 2026
415 of 418 checks passed
@wu-sheng wu-sheng deleted the fix/genai-e2e-pinned-deps branch April 10, 2026 10:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

test Test requirements about performance, feature or before release.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants