PaperCI
· reviews
CI for arXiv: every fresh paper with code gets its claims re-run in a fresh sandbox and checked by an independent verifier.
34
runs reviewed
142
claims sealed
23
measured offline
2
reproduced
5
runs caught by integrity checks
!
Paper P-e61c0f
P-e61c0f · run review · 0 of 3 claims reproduced, 2 measured · $0.15
✗
Paper P-750a18
P-750a18 · run heldout-v2 · Blocked: evaluation data not released · $0.12
✗
Paper P-750a18
P-750a18 · run heldout-v1 · Blocked: evaluation data not released · $0.20
✗
Paper P-ac9a98
P-ac9a98 · run heldout-v2 · Build ran, but the run failed integrity checks; no claim is trusted · $0.14
✗
Paper P-ac9a98
P-ac9a98 · run heldout-v1 · Build ran, but the run failed integrity checks; no claim is trusted · $0.20
✗
Paper P-d7ab15
P-d7ab15 · run heldout-v2 · Not runnable within the agent budget (18 turns) · $0.18
✗
Paper P-d7ab15
P-d7ab15 · run heldout-v1 · Not runnable within the agent budget (18 turns) · $0.20
✗
Paper P-90ab35
P-90ab35 · run heldout-v2 · Blocked: needs API credentials · $0.19
✗
Paper P-90ab35
P-90ab35 · run heldout-v1 · Not runnable within the agent budget (18 turns) · $0.25
!
Paper P-397155
P-397155 · run heldout-v2 · 0 of 5 claims reproduced, 1 measured · $0.24
✗
Paper P-397155
P-397155 · run heldout-v1 · Not runnable within the agent budget (18 turns) · $0.25
✗
Paper P-13d4e4
P-13d4e4 · run dev-chaos2 · Blocked: evaluation data not released · $0.22
✗
Paper P-646513
P-646513 · run dev-chaos · Blocked: evaluation data not released · $0.09
✗
Paper P-51cee1
P-51cee1 · run heldout-v1 · Not runnable within the agent budget (18 turns) · $0.32
✗
Paper P-51cee1
P-51cee1 · run heldout-v2 · Not runnable within the agent budget (18 turns) · $0.29
✗
Paper P-83da0c
P-83da0c · run heldout-v1 · Blocked: needs API credentials · $0.19
✗
Paper P-6a2f64
P-6a2f64 · run heldout-v1 · Build ran, but the run failed integrity checks; no claim is trusted · $0.17
✗
Paper P-83da0c
P-83da0c · run heldout-v2 · Blocked: needs API credentials · $0.09
✗
Paper P-6a2f64
P-6a2f64 · run heldout-v2 · Build ran, but the run failed integrity checks; no claim is trusted · $0.15
!
Paper P-d73559
P-d73559 · run heldout-v1 · 0 of 5 claims reproduced, 1 measured · $0.34
✓
Paper P-d73559
P-d73559 · run heldout-v2 · 2 of 5 claims reproduced at reduced scale, 3 measured · $0.25
✗
Paper P-73e4a2
P-73e4a2 · run heldout-v2 · Build ran, but the run failed integrity checks; no claim is trusted · $0.13
✗
Paper P-73e4a2
P-73e4a2 · run heldout-v1 · Not runnable within the agent budget (18 turns) · $0.25
!
Paper P-4509b9
P-4509b9 · run dev-g2 · 0 of 5 claims reproduced, 4 measured · $0.31
✗
Paper P-554af5
P-554af5 · run dev-g2 · Not runnable within the agent budget (18 turns) · $0.16
✗
Paper P-4509b9
P-4509b9 · run dev-v2 · Not runnable within the agent budget (18 turns) · $0.28
✗
Paper P-554af5
P-554af5 · run dev-v2 · Not runnable within the agent budget (18 turns) · $0.18
✗
Paper P-ed47ca
P-ed47ca · run dev-v1 · Blocked: agent stopped early · $0.19
✗
Paper P-8facce
P-8facce · run dev-v1 · Not runnable within the agent budget (18 turns) · $0.28
✗
Paper P-53ad3e
P-53ad3e · run dev-v1 · Blocked: needs API credentials · $0.25
✗
Paper P-e51503
P-e51503 · run dev-v1 · Not runnable within the agent budget (18 turns) · $0.19
✗
Paper P-646513
P-646513 · run dev-v1 · Blocked: evaluation data not released · $0.31
✗
Paper P-13d4e4
P-13d4e4 · run dev-v1 · Blocked: evaluation data not released · $0.17
✗
Paper P-554af5
P-554af5 · run dev-v1 · Not runnable within the agent budget (18 turns) · $0.19