ab-test-readout-1f357c — independently scanned and version-tracked by SaferSkills.
SaferSkills independently audited ab-test-readout-1f357c (Agent Skill) and scored it 100/100 (green). The audit ran 55 deterministic rules across Security, Supply Chain, Maintenance, Transparency, and Community; it found 0 high-severity and 0 lower-severity findings. The full rule-by-rule trace and per-finding evidence are below. Free, methodology-open.
Findings & checks · 0 flagged
Every scanned point with the score it earned and what moved between them.
First recorded scan — no prior version to compare against.
The primary manifest — the file an agent reads to learn what this artifact does.
The hard part of an experiment is the readout: not "B won" but "is this real, is it big enough to matter, and should we ship?" This skill turns results into an honest decision — and flags the ways A/B results lie.
Given results (even partial), write the full readout anyway. If significance isn't provided, reason about it from the numbers and flag what's needed to confirm. Mark assumed figures. Never declare a winner without addressing significance and sample.
Ask for (if not already provided):
Ship / Don't ship / Inconclusive — keep running — with the headline number.
| Metric | Control | Variant | Relative lift | Significant? |
|---|---|---|---|---|
| Primary | p / CI | |||
| Guardrail(s) |
State statistical significance (p-value / confidence interval) and practical significance (is the lift big enough to matter given the cost?).
Address the ways A/B tests mislead:
Where the effect is strong vs flat vs negative (new vs returning, platform, geography).
Ship / iterate / re-run, plus what to monitor post-launch or what the follow-up test should isolate.
~30 seconds. Free. No account. Every finding cites a rule and a line of evidence.