Skip to content

[Minor] Add --simulate-latency / SIMULATE_LATENCY option to dfbench / ./bench.sh#20954

Open
Dandandan wants to merge 5 commits intoapache:mainfrom
Dandandan:throttle_dfbench
Open

[Minor] Add --simulate-latency / SIMULATE_LATENCY option to dfbench / ./bench.sh#20954
Dandandan wants to merge 5 commits intoapache:mainfrom
Dandandan:throttle_dfbench

Conversation

@Dandandan
Copy link
Contributor

Which issue does this PR close?

  • Closes #.

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

Dandandan and others added 3 commits March 15, 2026 22:03
…tore latency

Wraps the local filesystem with ThrottledStore (100ms get, 200ms list) when enabled,
allowing benchmarks to measure performance under realistic remote storage conditions.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Passes --simulate-latency to all dfbench/imdb benchmark invocations when
SIMULATE_LATENCY=true, e.g.: SIMULATE_LATENCY=true ./bench.sh run tpch

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Copy link
Contributor

@adriangb adriangb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pending CI fixes and successful test w/ benchmark runner

Dandandan and others added 2 commits March 15, 2026 22:35
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
…upport

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@Dandandan
Copy link
Contributor Author

Hmm seems throttledobjectstore doesn't support files yet

@adriangb
Copy link
Contributor

We could vendor + submit a patch to arrow-rs?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants