bench: 3-config SWE-bench harness (baseline/lsp/code_graph_mcp)#693

Open

DvirDukhan wants to merge 55 commits into

dvirdukhan/bench-combined

Commits on Mar 14, 2026

Merge pull request #618 from FalkorDB/staging
gkorland
authored

Commits on May 26, 2026

Add benchmark workstream scaffold + CONTEXT.md
Copilot
committed
Consolidate grill decisions (Q1-Q11)
Copilot
committed
Upgrade graphrag-sdk 0.8 -> 1.1.1

DvirDukhan
and
Copilot
committed
Add benchmark metrics + report aggregation modules

DvirDukhan
and
Copilot
committed
Add code-graph HTTP adapter for the benchmark agent

DvirDukhan
and
Copilot
committed
Add indexing-cache registry for benchmark runner

DvirDukhan
and
Copilot
committed
Add LSP adapter (multilspy + jedi) with end-to-end shim tests

DvirDukhan
and
Copilot
committed
Add mini-swe-agent benchmark runner with dry-run mode

DvirDukhan
and
Copilot
committed
Add --real-run mode with synthetic smoke task and outcome verification

DvirDukhan
and
Copilot
committed
Add SWE-bench Verified dataset loader and --swe-bench runner mode

DvirDukhan
and
Copilot
committed
Add report CLI and SWE-bench Docker verify adapter

DvirDukhan
and
Copilot
committed

Commits on May 27, 2026

Commits on May 28, 2026

Commits on May 29, 2026

Commits on Jun 8, 2026

Merge origin/staging into bench-combined; resolve conflicts

DvirDukhan
and
Copilot
committed

Commits on Jun 9, 2026