os-evolution-planner — independently scanned and version-tracked by SaferSkills.
SaferSkills independently audited os-evolution-planner (Agent Skill) and scored it 87/100 (green). The audit ran 55 deterministic rules across Security, Supply Chain, Maintenance, Transparency, and Community; it found 0 high-severity and 3 lower-severity findings. The full rule-by-rule trace and per-finding evidence are below. Free, methodology-open.
Findings & checks · 3 flagged
The text {match} tells the agent to skip the normal "ask the user first" gate. Used adversarially it removes the human-in-the-loop check before destructive or sensitive actions, turning a normally-gated agent into a fire-and-forget executor.
Every scanned point with the score it earned and what moved between them.
First recorded scan — no prior version to compare against.
The primary manifest — the file an agent reads to learn what this artifact does.
os-evolution-planner transforms an evolution goal into a structured task plan and a Copilot CLI delegation prompt that can be dispatched in one premium request. Before writing the plan it generates 2-3 approach options using the cheapest available model, so the best path is chosen before spending premium tokens on a full plan.
| Input | How provided | Default |
|---|---|---|
| Target plugin | argument or interview question | required |
| Target skill or agent | argument or interview question | "all" (full plugin audit) |
| Evolution goal | argument or interview question | required |
| Auto-detect gaps | flag | true |
| Dispatch immediately | flag | false (present for human review) |
Before doing anything else, check context/memory/environment.md:
## Delegation Strategy section to determine:"No environment profile found — defaulting to Claude-only. Run os-environment-probe to unlock low-cost Copilot or Agy brainstorming."Do this before gap detection and before writing any plan.
Using the cheapest available model, generate 2-3 distinct approaches to the evolution goal. Each approach sketch is ~3-5 sentences: what it does, what it doesn't do, estimated effort, key tradeoff.
Model selection (use first that is available per environment profile):
Consult references/cheapest_models.md for current model names and costs.| Priority | Engine | How to invoke |
|---|---|---|
| 1 | Copilot CLI (gpt-5-mini) | run_agent.py --cli copilot |
| 2 | Agy CLI (gemini-3.5-flash) | run_agent.py --cli agy |
| 3 | Claude Haiku subagent | Spawn Agent(subagent_type="haiku", prompt=...) |
Brainstorm prompt template:
Evolution goal: <goal>
Target: <target skill/agent>
Current gaps detected: <gap list>
Generate exactly 3 distinct approaches to this evolution goal. For each:
- Approach name (2-4 words)
- What it does (2-3 sentences)
- What it trades off (1 sentence)
- Estimated effort: [Small / Medium / Large]Present options to user:
Here are 3 approaches to <goal>:
**Option A — <name>** [<effort>]
<description>
Tradeoff: <tradeoff>
**Option B — <name>** [<effort>]
<description>
Tradeoff: <tradeoff>
**Option C — <name>** [<effort>]
<description>
Tradeoff: <tradeoff>
My recommendation: **Option <X>** — <one-line reason>.
Which would you like to proceed with? (A / B / C / modify)Wait for the user to select before proceeding to Phase 2.
Once the approach is confirmed, read the target files and check for each gap below. Each confirmed gap becomes one workstream:
| Check | Gap if... | Workstream type |
|---|---|---|
## Gotchas section | absent from SKILL.md or agent file | Add Gotchas (3–5 field-derived patterns) |
## HANDOFF_BLOCK in completion | absent from child skill completion section | Add HANDOFF_BLOCK code fence |
evals.json | stub (< 6 cases) or REPLACE placeholders | Fill with real routing cases |
| Model identifiers | contain dashes (claude-sonnet-4-6) | Fix to dot notation |
| Domain patterns layer | references/domain-patterns/ absent | Create README + first pattern file |
## Smoke Test | absent from SKILL.md | Add with 2–3 acceptance criteria |
| Session hook | hooks/session_end.py absent | Create session-end hook |
| Script security | --dangerously-skip-permissions unconditional | Add --tier flag |
Task plan written to tasks/todo/<YYYY-MM-DD>-<slug>-plan.md:
# <task-number> — <title>
## Context
[What triggered this evolution, what was found]
## Approach Selected
Option <X> — <name>: <one-line description of chosen approach and why>
(Options considered: <A>, <B>, <C> — see brainstorm output for tradeoffs)
## Gaps Identified
[One bullet per gap found by the detection lens]
## Workstreams
| WS | Scope | Delegate to |
...
**WS ordering rule**: Structural fixes (model identifiers, path bugs, security flags) MUST
be listed as the first workstreams. Additive content (Gotchas, HANDOFF_BLOCK, domain
patterns, smoke tests) comes after. The delegated agent executes workstreams in listed order.
## Delegation Plan
1. Delegation prompt at tasks/todo/copilot_prompt_<slug>.md
2. Dispatch via run_agent.py with claude-sonnet-4.6
3. Review output (diff, symlink audit)
4. Commit and PR
## Status
- [ ] WS-A ...Delegation prompt written to tasks/todo/copilot_prompt_<slug>.md:
If --dispatch flag is set (or user confirms dispatch), run the heartbeat then dispatch:
# Heartbeat first
python3 plugins/cli-agents/skills/copilot-cli-agent/scripts/run_agent.py \
/dev/null /dev/null temp/heartbeat_<slug>.md \
"HEARTBEAT CHECK: Respond HEARTBEAT_OK only."
grep -q "HEARTBEAT_OK" temp/heartbeat_<slug>.md || (echo "HEARTBEAT FAIL — aborting dispatch" && exit 1)
# Dispatch
python3 plugins/cli-agents/skills/copilot-cli-agent/scripts/run_agent.py \
/dev/null \
tasks/todo/copilot_prompt_<slug>.md \
temp/copilot_output_<slug>.md \
"Generate all files exactly as specified. Use the Write tool to write files directly." \
claude-sonnet-4.6
wc -l temp/copilot_output_<slug>.md # expect 100+ lines for multi-workstream outputAfter dispatch completes (or after plan is written if dispatch is off), log to experiment log:
python3 plugins/agent-agentic-os/scripts/experiment_log.py append \
--source-type planner \
--report tasks/todo/<slug>-plan.md \
--session-id "<slug>" \
--target "<target-skill-or-agent>" \
--triggered-by os-evolution-plannerThis records the workstream count and gaps identified as a qualitative entry in context/experiment-log/ — traceable alongside any subsequent verifier or tester runs.
If dispatch flag is NOT set, present the plan and prompt paths and ask:
"Plan written totasks/todo/<slug>-plan.mdand delegation prompt totasks/todo/copilot_prompt_<slug>.md. Dispatch to Copilot CLI now? (yes / review first)"
os-architect calls this skill when:
os-architect provides the intent classification and gap audit as context. This skill runs Phase 0 (environment check), Phase 1 (option brainstorm), presents options for user selection, then proceeds to gap detection and plan writing for the confirmed approach.
plugins/<plugin>/skills/<skill>/SKILL.md — the installed .agents/ copy may be stale.os-eval-runner skill, Phase 1 produces 3 named approaches with effort estimates before any plan file is written.--dispatch flag set and heartbeat passes, the skill calls run_agent.py with claude-sonnet-4.6 and verifies output line count before reporting complete.~30 seconds. Free. No account. Every finding cites a rule and a line of evidence.