reproducibility-check — independently scanned and version-tracked by SaferSkills.
SaferSkills independently audited reproducibility-check (Agent Skill) and scored it 96/100 (green). The audit ran 55 deterministic rules across Security, Supply Chain, Maintenance, Transparency, and Community; it found 0 high-severity and 1 lower-severity findings. The full rule-by-rule trace and per-finding evidence are below. Free, methodology-open.
Findings & checks · 1 flagged
The text {match} tells the agent to skip the normal "ask the user first" gate. Used adversarially it removes the human-in-the-loop check before destructive or sensitive actions, turning a normally-gated agent into a fire-and-forget executor.
Every scanned point with the score it earned and what moved between them.
First recorded scan — no prior version to compare against.
The primary manifest — the file an agent reads to learn what this artifact does.
Verify that every numerical result reported in a manuscript can be reproduced by running the corresponding code.
rigorous repro-check path/to/paper.tex --code path/to/src/rigorous repro-check path/to/paper.tex --target "Table 2"
rigorous repro-check path/to/paper.tex --target "Figure 3a"rigorous repro-check path/to/paper.tex --code path/to/src/ --tolerance 0.01Use the rigorous.repro_check tool with parameters:
paper: path to manuscriptcode_dir: path to source code directorytarget: optional specific table or figuretolerance: numerical tolerance for comparison (default 0.001)PASS Table 1, Row 3: "mean = 4.72" -- code produces 4.7183, rounds to 4.72
FAIL Section 3.2: "period = 28.1 days" -- code produces 26.8 days (delta = 1.3)
WARN Figure 2a: cannot locate generating script -- add path annotation
PASS Abstract: "r = 0.94" -- code produces r = 0.9412, rounds to 0.940 -- all numbers reproduced within tolerance1 -- warnings (missing scripts, rounding ambiguity)2 -- failures (numbers do not match code output)~30 seconds. Free. No account. Every finding cites a rule and a line of evidence.