test: add SDK benchmarks e2e workflow by giortzisg · Pull Request #5479 · getsentry/sentry-python

giortzisg · 2026-02-18T15:25:50Z

Summary

Test PR to validate the reusable e2e benchmark workflow from getsentry/sdk-benchmarks
Calls e2e.yml@main which auto-discovers Python apps (django) and runs benchmarks

Test plan

Verify the benchmark workflow triggers on this PR
Verify benchmark results are posted as a PR comment

Note: This is a test PR — do not merge.

🤖 Generated with Claude Code

Calls the reusable e2e benchmark workflow from getsentry/sdk-benchmarks which auto-discovers Python apps (django) and runs benchmarks. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

github-actions · 2026-02-18T15:26:14Z

Semver Impact of This PR

🟢 Patch (bug fixes)

📋 Changelog Preview

This is how your changes will appear in the changelog.
Entries from this PR are highlighted with a left border (blockquote style).

Internal Changes 🔧

(openai-agents) Expect new tool fields by alexander-alderman-webb in #5471
(repo) Add .serena to .gitignore by ericapisani in #5464

Add SDK benchmarks e2e workflow by giortzisg in #5479

🤖 Update test matrix with new releases (02/18) by github-actions in #5475

_{🤖 This preview updates automatically when you update the PR.}

github-actions · 2026-02-18T15:27:30Z

Codecov Results 📊

✅ 12 passed | Total: 12 | Pass Rate: 100% | Execution Time: 1.99s

All tests are passing successfully.

✅ Patch coverage is 100.00%. Project has 13736 uncovered lines.

Files with missing lines (181)

File	Patch %	Lines
`langchain.py`	3.28%	⚠️ 590 Missing
`openai.py`	5.57%	⚠️ 492 Missing
`utils.py`	54.93%	⚠️ 411 Missing and 75 partials
`utils.py`	0.00%	⚠️ 479 Missing
`__init__.py`	5.08%	⚠️ 374 Missing
`starlette.py`	5.34%	⚠️ 337 Missing
`tracing_utils.py`	54.90%	⚠️ 267 Missing and 42 partials
`transport.py`	23.54%	⚠️ 302 Missing and 2 partials
`scope.py`	72.35%	⚠️ 227 Missing and 65 partials
`client.py`	61.95%	⚠️ 191 Missing and 69 partials
`mcp.py`	5.24%	⚠️ 253 Missing
`anthropic.py`	9.16%	⚠️ 248 Missing
`transaction_profiler.py`	35.52%	⚠️ 216 Missing and 10 partials
`__init__.py`	3.91%	⚠️ 221 Missing
`langgraph.py`	5.29%	⚠️ 215 Missing
`utils.py`	16.08%	⚠️ 214 Missing
`span_processor.py`	0.00%	⚠️ 205 Missing
`__init__.py`	5.14%	⚠️ 203 Missing
`continuous_profiler.py`	43.45%	⚠️ 177 Missing and 17 partials
`strawberry.py`	8.54%	⚠️ 182 Missing
`aws_lambda.py`	16.50%	⚠️ 167 Missing
`spark_driver.py`	0.00%	⚠️ 166 Missing
`huggingface_hub.py`	8.89%	⚠️ 164 Missing
`sanic.py`	9.60%	⚠️ 160 Missing
`tracing.py`	76.00%	⚠️ 114 Missing and 44 partials
`cloud_resource_context.py`	0.00%	⚠️ 145 Missing
`ai_client.py`	0.00%	⚠️ 145 Missing
`rust_tracing.py`	0.00%	⚠️ 143 Missing
`litellm.py`	0.00%	⚠️ 138 Missing
`starlite.py`	8.33%	⚠️ 132 Missing
`envelope.py`	44.90%	⚠️ 108 Missing and 13 partials
`flask.py`	12.50%	⚠️ 112 Missing
`spotlight.py`	28.47%	⚠️ 103 Missing and 8 partials
`cohere.py`	12.70%	⚠️ 110 Missing
`dramatiq.py`	0.00%	⚠️ 110 Missing
`arq.py`	9.92%	⚠️ 109 Missing
`asgi.py`	0.00%	⚠️ 109 Missing
`hub.py`	45.60%	⚠️ 105 Missing and 3 partials
`pymongo.py`	10.17%	⚠️ 106 Missing
`beat.py`	8.62%	⚠️ 106 Missing
`caching.py`	0.00%	⚠️ 106 Missing
`utils.py`	0.00%	⚠️ 103 Missing
`templates.py`	0.00%	⚠️ 100 Missing
`asyncpg.py`	11.61%	⚠️ 99 Missing
`quart.py`	16.10%	⚠️ 99 Missing
`gcp.py`	0.00%	⚠️ 98 Missing
`otlp.py`	0.00%	⚠️ 97 Missing
`utils.py`	13.39%	⚠️ 97 Missing
`agent_run.py`	0.00%	⚠️ 97 Missing
`models.py`	4.95%	⚠️ 96 Missing
`pyramid.py`	13.76%	⚠️ 94 Missing
`__init__.py`	0.00%	⚠️ 93 Missing
`middleware.py`	0.00%	⚠️ 90 Missing
`agent_run.py`	0.00%	⚠️ 90 Missing
`runner.py`	0.00%	⚠️ 87 Missing
`beam.py`	0.00%	⚠️ 84 Missing
`loguru.py`	11.58%	⚠️ 84 Missing
`ray.py`	0.00%	⚠️ 84 Missing
`__init__.py`	4.65%	⚠️ 82 Missing
`asyncio.py`	0.00%	⚠️ 80 Missing
`invoke_agent.py`	0.00%	⚠️ 79 Missing
`clickhouse_driver.py`	17.58%	⚠️ 75 Missing
`pure_eval.py`	0.00%	⚠️ 73 Missing
`worker.py`	22.58%	⚠️ 72 Missing
`ariadne.py`	14.46%	⚠️ 71 Missing
`gql.py`	10.13%	⚠️ 71 Missing
`sqlalchemy.py`	10.26%	⚠️ 70 Missing
`fastapi.py`	15.85%	⚠️ 69 Missing
`monitoring.py`	17.07%	⚠️ 68 Missing
`graphene.py`	12.82%	⚠️ 68 Missing
`transactions.py`	0.00%	⚠️ 67 Missing
`_queue.py`	26.67%	⚠️ 66 Missing
`rq.py`	15.38%	⚠️ 66 Missing
`huey.py`	17.72%	⚠️ 65 Missing
`boto3.py`	14.86%	⚠️ 63 Missing
`logging.py`	68.63%	⚠️ 48 Missing and 15 partials
`utils.py`	16.00%	⚠️ 63 Missing
`streaming.py`	0.00%	⚠️ 62 Missing
`stdlib.py`	61.19%	⚠️ 52 Missing and 8 partials
`api.py`	61.74%	⚠️ 57 Missing
`chalice.py`	16.18%	⚠️ 57 Missing
`propagator.py`	0.00%	⚠️ 57 Missing
`server.py`	0.00%	⚠️ 56 Missing
`spark_worker.py`	0.00%	⚠️ 56 Missing
`graph_nodes.py`	0.00%	⚠️ 52 Missing
`gnu_backtrace.py`	0.00%	⚠️ 51 Missing
`_async_common.py`	0.00%	⚠️ 51 Missing
`socket.py`	0.00%	⚠️ 50 Missing
`views.py`	0.00%	⚠️ 50 Missing
`sessions.py`	70.68%	⚠️ 39 Missing and 10 partials
`tools.py`	0.00%	⚠️ 49 Missing
`caches.py`	16.95%	⚠️ 49 Missing
`invoke_agent.py`	0.00%	⚠️ 46 Missing
`traces.py`	47.06%	⚠️ 45 Missing
`signals_handlers.py`	0.00%	⚠️ 44 Missing
`_batcher.py`	47.50%	⚠️ 42 Missing and 1 partials
`utils.py`	22.22%	⚠️ 42 Missing and 1 partials
`_wsgi_common.py`	70.87%	⚠️ 37 Missing and 5 partials
`client.py`	0.00%	⚠️ 40 Missing
`_sync_common.py`	22.00%	⚠️ 39 Missing
`executing.py`	0.00%	⚠️ 38 Missing
`client.py`	0.00%	⚠️ 38 Missing
`_span_batcher.py`	35.71%	⚠️ 36 Missing
`serverless.py`	0.00%	⚠️ 36 Missing
`server.py`	0.00%	⚠️ 35 Missing
`threading.py`	74.74%	⚠️ 24 Missing and 10 partials
`serializer.py`	87.63%	⚠️ 23 Missing and 9 partials
`session.py`	78.89%	⚠️ 19 Missing and 13 partials
`sys_exit.py`	0.00%	⚠️ 32 Missing
`launchdarkly.py`	0.00%	⚠️ 31 Missing
`trytond.py`	0.00%	⚠️ 30 Missing
`integration.py`	0.00%	⚠️ 30 Missing
`error_tracing.py`	0.00%	⚠️ 29 Missing
`tools.py`	0.00%	⚠️ 27 Missing
`ai_client.py`	13.33%	⚠️ 26 Missing
`execute_tool.py`	0.00%	⚠️ 26 Missing
`_openai_completions_api.py`	19.35%	⚠️ 25 Missing
`httpx.py`	68.49%	⚠️ 23 Missing and 2 partials
`redis_cluster.py`	26.47%	⚠️ 25 Missing
`asgi.py`	91.43%	⚠️ 12 Missing and 12 partials
`typer.py`	0.00%	⚠️ 24 Missing
`tasks.py`	0.00%	⚠️ 24 Missing
`_compat.py`	41.03%	⚠️ 23 Missing
`__init__.py`	84.78%	⚠️ 14 Missing and 9 partials
`aiohttp.py`	92.77%	⚠️ 12 Missing and 11 partials
`statsig.py`	0.00%	⚠️ 23 Missing
`queries.py`	25.81%	⚠️ 23 Missing
`logger.py`	43.59%	⚠️ 22 Missing
`decorator.py`	37.14%	⚠️ 22 Missing
`_log_batcher.py`	0.00%	⚠️ 21 Missing
`attachments.py`	27.59%	⚠️ 21 Missing
`monitor.py`	68.85%	⚠️ 19 Missing and 2 partials
`unraisablehook.py`	0.00%	⚠️ 21 Missing
`openfeature.py`	0.00%	⚠️ 20 Missing
`execute_tool.py`	0.00%	⚠️ 20 Missing
`litestar.py`	92.47%	⚠️ 11 Missing and 8 partials
`unleash.py`	0.00%	⚠️ 19 Missing
`_lru_cache.py`	43.33%	⚠️ 17 Missing and 1 partials
`model_request.py`	0.00%	⚠️ 18 Missing
`tornado.py`	89.09%	⚠️ 12 Missing and 5 partials
`_werkzeug.py`	55.56%	⚠️ 12 Missing and 4 partials
`falcon.py`	91.87%	⚠️ 10 Missing and 6 partials
`wsgi.py`	92.97%	⚠️ 9 Missing and 7 partials
`utils.py`	0.00%	⚠️ 16 Missing
`atexit.py`	56.25%	⚠️ 14 Missing and 1 partials
`excepthook.py`	56.25%	⚠️ 14 Missing and 1 partials
`redis.py`	25.00%	⚠️ 15 Missing
`feature_flags.py`	56.25%	⚠️ 14 Missing
`scrubber.py`	89.86%	⚠️ 7 Missing and 7 partials
`_init_implementation.py`	45.83%	⚠️ 13 Missing
`__init__.py`	27.78%	⚠️ 13 Missing
`types.py`	0.00%	⚠️ 12 Missing
`bottle.py`	92.23%	⚠️ 8 Missing and 3 partials
`redis_py_cluster_legacy.py`	26.67%	⚠️ 11 Missing
`api.py`	37.50%	⚠️ 10 Missing
`utils.py`	41.18%	⚠️ 10 Missing
`handoff.py`	0.00%	⚠️ 10 Missing
`metrics.py`	47.06%	⚠️ 9 Missing
`__init__.py`	72.41%	⚠️ 8 Missing and 1 partials
`dedupe.py`	85.00%	⚠️ 6 Missing and 2 partials
`_metrics_batcher.py`	65.00%	⚠️ 7 Missing
`_types.py`	76.67%	⚠️ 7 Missing
`consts.py`	0.00%	⚠️ 7 Missing
`rb.py`	30.00%	⚠️ 7 Missing
`_openai_responses_api.py`	33.33%	⚠️ 6 Missing
`debug.py`	91.30%	⚠️ 2 Missing and 2 partials
`consts.py`	0.00%	⚠️ 4 Missing
`__init__.py`	20.00%	⚠️ 4 Missing
`__init__.py`	0.00%	⚠️ 4 Missing
`_asgi_common.py`	98.15%	⚠️ 1 Missing and 2 partials
`__init__.py`	0.00%	⚠️ 3 Missing
`__init__.py`	40.00%	⚠️ 3 Missing
`__init__.py`	0.00%	⚠️ 3 Missing
`__init__.py`	0.00%	⚠️ 3 Missing
`__init__.py`	0.00%	⚠️ 3 Missing
`consts.py`	99.43%	⚠️ 2 Missing
`argv.py`	100.00%	⚠️ 2 partials
`modules.py`	94.12%	⚠️ 1 Missing and 1 partials
`agent_workflow.py`	71.43%	⚠️ 2 Missing
`consts.py`	0.00%	⚠️ 1 Missing
`consts.py`	0.00%	⚠️ 1 Missing

Generated by Codecov Action

github-actions · 2026-02-18T15:28:44Z

SDK Benchmark Results — `python/django`

SDK version: 2.53.0
Status: Regression detected

Latency Overhead

Metric	Overhead
p50	+31.37%
p90	+35.66%
p95	+36.44%
p99	+40.83%
mean	+38.95%

Details

Iterations: 20
RPS: 100
Duration: 30s

Single iterations are too noisy and can flag false regressions. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

test: add SDK benchmarks e2e workflow

f5541a0

Calls the reusable e2e benchmark workflow from getsentry/sdk-benchmarks which auto-discovers Python apps (django) and runs benchmarks. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

fix: increase benchmark iterations to 10 for stable results

6c99b4f

Single iterations are too noisy and can flag false regressions. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

test: add SDK benchmarks e2e workflow#5479

test: add SDK benchmarks e2e workflow#5479
giortzisg wants to merge 2 commits intomasterfrom
test/sdk-benchmarks

giortzisg commented Feb 18, 2026

Uh oh!

github-actions bot commented Feb 18, 2026 •

edited

Loading

Internal Changes 🔧

Uh oh!

github-actions bot commented Feb 18, 2026 •

edited

Loading

Uh oh!

github-actions bot commented Feb 18, 2026 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Comments

Conversation

giortzisg commented Feb 18, 2026

Summary

Test plan

Uh oh!

github-actions bot commented Feb 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Semver Impact of This PR

Internal Changes 🔧

Uh oh!

github-actions bot commented Feb 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Results 📊

Uh oh!

github-actions bot commented Feb 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

SDK Benchmark Results — python/django

Latency Overhead

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Comments

github-actions bot commented Feb 18, 2026 •

edited

Loading

github-actions bot commented Feb 18, 2026 •

edited

Loading

github-actions bot commented Feb 18, 2026 •

edited

Loading

SDK Benchmark Results — `python/django`