Search results

Commit0: bug 526 impact on old results

Status: Open.

#545 In OpenHands/benchmarks;

· juanmichelini opened on Mar 20, 2026

Split base image from SDK layer to avoid full 9h+ rebuilds on SDK changes

enhancementNew feature or requestNew feature or request

Status: Open.

#538 In OpenHands/benchmarks;

· VascoSch92 opened on Mar 19, 2026

Grid search: find optimal SWT-bench image build parameters

Status: Open.

#535 In OpenHands/benchmarks;

· simonrosenberg opened on Mar 18, 2026

SWT-Bench image building slowness: root cause analysis and fix plan

Status: Open.

#531 In OpenHands/benchmarks;

· simonrosenberg opened on Mar 18, 2026

SWT-bench image build throughput tracker (historical source of truth)

Status: Open.

#530 In OpenHands/benchmarks;

· simonrosenberg opened on Mar 18, 2026

Investigate and improve terminalbench results

Status: Open.

#529 In OpenHands/benchmarks;

· neubig opened on Mar 17, 2026

swebenchmultimodal ACP evaluation: Low submission rate (35%) with claude-opus-4-6

Status: Open.

#523 In OpenHands/benchmarks;

· simonrosenberg opened on Mar 17, 2026

SWE-CI Benchmark

Status: Open.

#508 In OpenHands/benchmarks;

· neubig opened on Mar 12, 2026

ACP Claude: 3 GAIA instances consistently fail with UsagePolicyRefusal

Status: Open.

#501 In OpenHands/benchmarks;

· simonrosenberg opened on Mar 11, 2026

Console logs on stdout corrupt JSON output in benchmark scripts

Status: Open.

#498 In OpenHands/benchmarks;

· juanmichelini opened on Mar 10, 2026

ACP agent errors: Usage Policy refusals and 1800s prompt timeouts cause all 14 failures

Status: Open.

#494 In OpenHands/benchmarks;

· simonrosenberg opened on Mar 9, 2026

Commit0 report undercounts error instances (reports 0 instead of actual 6)

Status: Open.

#493 In OpenHands/benchmarks;

· simonrosenberg opened on Mar 9, 2026