✗ Not runnable within the agent budget (18 turns)P-e51503 · repository hidden · run dev-v1
PCI
papercibot reviewed this paper's code · 2026-10-11 11:11
Pipeline
✓Triage2s
✓Claims sealed6s
✗Build4.2m
–Offline run0s
–Reruns0s
!Verdict0s
–Package
–Oracle
–Trainability
Walkthrough
PaperCI fetched the paper's repository into a fresh CPU sandbox. A builder agent (claude-sonnet-4.6) worked for 18 turns (4.2 min), installed 13 package(s) (2, aeon, huggingface_hub, iisignature, matplotlib, numpy, pandas, pyarrow), but did not reach a runnable state (max_turns)
4claims sealed
0reproduced
0measured
0offline reruns
18agent turns
$0.19total cost
Claims vs measured
Claim (from the paper)
Paper
PaperCI measured
Tolerance
Status
c1 test accuracy · UEA time series classification
64.7%
–
-
Blocked
c2 average rank · Physiome-ODE regression benchmark
2.4
–
-
Blocked
c3 masked MSE · Physiome-ODE benchmark
2.62
–
-
Blocked
c4 average rank · Physiome-ODE benchmark
16
–
-
Blocked
Checks
✓SandboxFresh Docker container: non-root, all capabilities dropped, egress only via an allowlist proxy
✓Claims sealed4 headline claims extracted from the paper text and sealed (sha256 e7ebce9ae221) before the builder started; the builder never saw the values
✗Buildmax_turns after 18 agent turns, 4.2 min
✓No hardcoded answersno sealed claim value appears in anything the builder wrote
✓No copied resultsno output file is a byte-identical copy of a result file in the repo
✓Computed, not replayedthe run computes its numbers instead of loading stored results
✓Uses the paper's codethe run script executes the repository's own code
Suggestions for the authors
1. Add a one-command reproduction entry pointGetting this repository to produce the headline numbers took more than 18 agent steps. A reproduce.sh (or a README section) that prints each table number would make it checkable.
2. Missing moduleImports failed for a module that is not declared as a dependency; add it to requirements.
Pipeline
Walkthrough
PaperCI fetched the paper's repository into a fresh CPU sandbox. A builder agent (claude-sonnet-4.6) worked for 18 turns (4.2 min), installed 13 package(s) (2, aeon, huggingface_hub, iisignature, matplotlib, numpy, pandas, pyarrow), but did not reach a runnable state (max_turns)
Claims vs measured
Checks
Suggestions for the authors
reproduce.sh(or a README section) that prints each table number would make it checkable.Verdict blocked-infra (medium):