Skip to content

Pull requests: OpenHands/benchmarks

New pull request New
19 Open 321 Closed
19 Open 321 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat: three-phase image build with local docker for 4x speedup
#555 opened Mar 23, 2026 by simonrosenberg Loading…
1 of 4 tasks
1
8
build(deps): bump the version-all group across 1 directory with 23 updates dependencies Pull requests that update a dependency file python:uv Pull requests that update python:uv code
#554 opened Mar 23, 2026 by dependabot bot Loading…
Make build throughput ignore skipped images
#552 opened Mar 22, 2026 by simonrosenberg Loading…
6
Optimize SWT-bench build throughput: cache-mode=off, raise prune threshold
#551 opened Mar 22, 2026 by simonrosenberg Loading…
3 tasks
4
feat: split base image from SDK layer for faster SWE-bench rebuilds
#550 opened Mar 20, 2026 by simonrosenberg Loading…
3 tasks
1
5
feat: build lightweight benchmark images by default
#548 opened Mar 20, 2026 by simonrosenberg Loading…
4 tasks
1
5
fix(ci): restore SWT-Bench build parallelism and disable cache export
#525 opened Mar 17, 2026 by simonrosenberg Loading…
3 tasks
1
@simonrosenberg
11
Add benchmark-side Apptainer workspace support
#509 opened Mar 12, 2026 by neubig • Draft
1
build(deps): bump the version-all group across 1 directory with 5 updates dependencies Pull requests that update a dependency file github_actions Pull requests that update GitHub Actions code
#492 opened Mar 9, 2026 by dependabot bot Loading…
Enable terminalbench CI smoke runs
#491 opened Mar 8, 2026 by neubig • Draft
6 tasks done
4
Add background BuildKit pruning for completed batches
#489 opened Mar 8, 2026 by neubig • Draft
6 tasks done
7
Add deadlock detection with no-progress timeout
#458 opened Feb 26, 2026 by neubig • Draft
53
NeMo Evaluator Integration
#455 opened Feb 26, 2026 by simonrosenberg Loading…
1
@simonrosenberg
27
refactor: Replace ProcessPoolExecutor with asyncio for evaluation
#446 opened Feb 25, 2026 by simonrosenberg Loading…
1
@simonrosenberg
52
Recycle worker processes to prevent OOM from heap fragmentation
#442 opened Feb 24, 2026 by simonrosenberg Loading…
3 tasks
1
feat(swesmith): add SWE-Smith benchmark evaluation scaffold
#428 opened Feb 18, 2026 by mkaramuk • Draft
Fix: laminar trace timeline to account for idle wait time
#415 opened Feb 13, 2026 by Rainhunter13 Loading…
7
Add security benchmark with ASTRA
#361 opened Jan 26, 2026 by XZ-X • Draft
1
Agentic code search
#141 opened Dec 8, 2025 by adityasoni9998 Loading…
5
ProTip! Follow long discussions with comments:>50.