Research notebook

A patch needs two test partitions notebook

Edit a Python cell and run it here. Your code runs in this browser tab; the notebook runtime and packages are served by this site.

Python starts when you choose Run.

A patch needs two test partitions

Fixing the reported issue and preserving ordinary behavior are separate obligations. Fifteen repairs make the difference visible.

Synthetic reproduction of F2P/P2P acceptance logic; not a SWE-bench result.

Python · cell 1
absolute 0 F2P=0/2 P2P=3/3 resolved=False
absolute 1 F2P=1/2 P2P=1/3 resolved=False
absolute 2 F2P=2/2 P2P=1/3 resolved=False
absolute 3 F2P=1/2 P2P=3/3 resolved=False
absolute 4 F2P=2/2 P2P=3/3 resolved=True
clamp 0 F2P=0/2 P2P=4/4 resolved=False
clamp 1 F2P=2/2 P2P=1/4 resolved=False
clamp 2 F2P=2/2 P2P=3/4 resolved=False
clamp 3 F2P=1/2 P2P=4/4 resolved=False
clamp 4 F2P=2/2 P2P=4/4 resolved=True
average 0 F2P=0/1 P2P=3/3 resolved=False
average 1 F2P=1/1 P2P=0/3 resolved=False
average 2 F2P=1/1 P2P=1/3 resolved=False
average 3 F2P=1/1 P2P=1/3 resolved=False
average 4 F2P=1/1 P2P=3/3 resolved=True
resolved_candidates 3 of 15
Held-out boundary checks: 5 passed
Python · cell 2

Python runs locally in this page. Saved results and figures are visible before execution.

Download full experiment notebook