Llm Oracle — independently scanned and version-tracked by SaferSkills.
SaferSkills independently audited Llm Oracle (Agent Skill) and scored it 96/100 (green). The audit ran 55 deterministic rules across Security, Supply Chain, Maintenance, Transparency, and Community; it found 0 high-severity and 1 lower-severity findings. The full rule-by-rule trace and per-finding evidence are below. Free, methodology-open.
Findings & checks · 1 flagged
A bulleted imperative like {match} tells the agent to never reveal, disclose, or mention something to the user. Used adversarially it can instruct the agent to hide its tool calls or lie about what it did — stripping the transparency a user relies on to trust the agent.
Every scanned point with the score it earned and what moved between them.
First recorded scan — no prior version to compare against.
The primary manifest — the file an agent reads to learn what this artifact does.
Continuously-updated catalog + query API for LLM provider availability and pricing.
Built by weiseer.
Given a question like "for this prompt of N input tokens plus M expected output tokens, which currently-available model offers the lowest cost?" the oracle answers in milliseconds, with the source URL it used for the pricing claim.
Use it as:
catalog.json you can audit, vendor, or contribute fixes toLLM pricing changes monthly. Every multi-model app rebuilds the same lookup table. We maintain it so you don't.
as_of timestamp on every response so you know how fresh the data is5 providers, ~10 models. Growing as we observe demand.
git clone https://github.com/weiseer/llm-oracle
cd llm-oracleAdd to your MCP client config:
{
"mcpServers": {
"llm-oracle": {
"command": "python",
"args": ["/absolute/path/to/llm-oracle/mcp_server.py"]
}
}
}The agent now has tools:
list_models(provider?, capability?) → list models, optionally filteredget_model(model_id) → full record for one modelfind_cheapest(input_tokens, output_tokens, required_capabilities?) → ranked by estimated costcompare_models(model_ids[], input_tokens?, output_tokens?) → side-by-sidecheck_availability(model_id) → current status with cited source# Free tier: 1,000 calls/day per IP, no key
curl https://oracle.weiseer.com/catalog.json
curl 'https://oracle.weiseer.com/cheapest?input_tokens=2000&output_tokens=500'
curl https://oracle.weiseer.com/models/claude-sonnet-4-6curl https://oracle.weiseer.com/catalog.json > my-local-catalog.json| Tier | Calls | Cost |
|---|---|---|
| Free | 1,000/day | $0 |
| Pro | 100,000/month | $5 USDC/mo |
| Scale | 1,000,000/month | $20 USDC/mo |
| Raw catalog | unlimited | $0 (always free) |
Paid tiers settle in USDC. Email [email protected] to subscribe; we issue an API key and confirm receipt. (We'll automate this when the first three paid customers exist.)
See catalog.json for the canonical schema. Per-model fields include model_id, provider, family, context_window, max_output_tokens, input_price, output_price, cached_input_price, capabilities, availability_status, source URLs, and timestamps.
Found a stale price? An incorrect capability flag? A missing model? Open an issue — please include the source URL we should be tracking.
The hosted service logs each request as a single event (caller, query summary, latency, paid status) to weiseer's append-only audit ledger. The MCP server you self-host logs nothing.
The catalog format is MIT licensed. Vendor it, mirror it, build on top of it. We ask only that you cite weiseer/llm-oracle somewhere visible if you redistribute the data.
The server and MCP code are Apache-2.0.
This is P-001 in weiseer's strategic backlog — a market sensor for organism's architecture v2. We expand it where users ask, kill it if 4 weeks of public availability brings under 100 calls. Don't expect a polished commercial product; expect honest experimentation with daily updates.
What we might add (in observed-demand order):
~30 seconds. Free. No account. Every finding cites a rule and a line of evidence.