os-environment-probe — independently scanned and version-tracked by SaferSkills.
SaferSkills independently audited os-environment-probe (Agent Skill) and scored it 87/100 (green). The audit ran 55 deterministic rules across Security, Supply Chain, Maintenance, Transparency, and Community; it found 0 high-severity and 3 lower-severity findings. The full rule-by-rule trace and per-finding evidence are below. Free, methodology-open.
Findings & checks · 3 flagged
The text {match} tells the agent to skip the normal "ask the user first" gate. Used adversarially it removes the human-in-the-loop check before destructive or sensitive actions, turning a normally-gated agent into a fire-and-forget executor.
Every scanned point with the score it earned and what moved between them.
First recorded scan — no prior version to compare against.
The primary manifest — the file an agent reads to learn what this artifact does.
os-environment-probe asks the user which AI environments they have access to, then verifies each claimed environment by running a lightweight probe command. Results are written to context/memory/environment.md — a single source of truth that downstream skills read to make delegation decisions without asking the user again.
Ask the user these questions (one prompt, multiple-choice, keep it brief):
Which of these AI tools do you currently have active on this machine? (Select all that apply)
>
A. Claude Code only B. Claude Code + GitHub Copilot CLI (Pro or Business plan) C. Claude Code + Agy CLI (Antigravity — gemini-3.5-flash backend) D. Cursor (Claude or GPT backend) E. Other (describe)
Wait for their answer before probing.
For each claimed environment, verify it is actually callable:
| Environment | Probe command | Pass condition | |
|---|---|---|---|
| Copilot CLI | `gh copilot explain "test" 2>&1 \ | head -3` | No "not authenticated" or "command not found" |
| Agy CLI | `agy --version 2>&1 \ | head -1` | Outputs a version string |
| Cursor | `cursor --version 2>&1 \ | head -1` | Outputs a version string |
| Claude Code | always present | — |
Report each probe result to the user:
Only write environments that pass to the profile.
Write context/memory/environment.md:
# AI Environment Profile
_Last updated: YYYY-MM-DD_
## Available Environments
| Environment | Status | Cheapest model | Premium model |
|-------------|--------|----------------|---------------|
| Claude Code | active | claude-haiku-4-5 | claude-sonnet-4-6 |
| Copilot CLI | active | gpt-5-mini | claude-sonnet-4.6 (via --model) |
| Agy CLI | active | gemini-3.5-flash | — |
> Consult `references/cheapest_models.md` for current model names and costs — do not hardcode here.
## Delegation Strategy
**Cheapest brainstorm model**: <first available in priority order below>
1. Copilot CLI — gpt-5-mini (per-token, low cost)
2. Agy CLI — gemini-3.5-flash (per-token, low cost)
3. Claude Haiku subagent — low cost, in-session
**Primary dispatch model**: claude-sonnet-4-6 (via Copilot CLI if available, else Claude subagent)
## Capability Matrix
| Task | Best tool | Fallback |
|------|-----------|---------|
| Brainstorm options (cheap) | <cheapest model> | claude-haiku-4-5-20251001 |
| Single-file delegation | Copilot CLI | Claude subagent |
| Multi-workstream delegation | Copilot CLI claude-sonnet-4-6 | Claude subagent (sonnet) |
| Overnight unattended loop | os-improvement-loop | — |os-evolution-planner reads environment.md at the start of every run:
run_agent.py --cli copilot (gpt-5-mini, low cost)run_agent.py --cli agy (gemini-3.5-flash, low cost)os-architect reads environment.md to choose the dispatch backend for Path B/C executions.
If environment.md is missing, both skills default to Claude-only mode and offer to run os-environment-probe before proceeding.
If the user adds a new environment later, they can run this skill again. It overwrites context/memory/environment.md with fresh probe results.
context/memory/environment.md exists and contains apopulated ## Delegation Strategy section with at least one "Cheapest brainstorm model" line.
"Cheapest brainstorm model: claude-haiku-4-5 (see references/cheapest_models.md)".
--version, explain "test", orsimilar read-only flags — never trigger billing or start sessions.
model IDs. Map to model IDs internally.
gh extension install github/gh-copilot. Confirm CLI specifically, not just Copilot.
llama (Gemma 4) is free. See references/cheapest_models.md for current costs.This skill now includes two convenience support files to make repro and re-probing easier. Inspect or run them from the skill directory (the agent may invoke them when safe):
Write any additional probe outputs to the references/ directory so downstream skills (os-architect, os-evolution-planner) can read concrete examples when deciding delegation.
~30 seconds. Free. No account. Every finding cites a rule and a line of evidence.