Rubric Library: five rules and a five-check script (free sample)
by PaperChaseWebb
From the Rubric Library: five rules for the scoring inside agent workflows (a human owns the library, every rubric has a number, every grade says what it means and what it triggers, people, clients and money go to a person, no profiling people who did not opt in), and a read-only script that checks one rubric file for them.
- Price
- Free
- Difficulty
- Beginner
- Setup
- 5 min
- Format
- .md file
rubric-library-five-rules-and-checks-free-sample.md · 8 KB · direct download, no signup
What you end up with
In a few minutes you can see whether the scores your agents produce rest on a written rubric or on a guess.
What you get
- Five rubric rules
- rubric_mini.py: five read-only checks on one rubric-lite.json
- One prompt for all four harnesses
- Worked example: 5 findings, then 0
Who it is for
Anyone who wants a quick check of the rubrics behind their agents' scores before trusting them with more.
Works with
Solid chips: the agent is named in this listing's own tools list. Dashed chip: Plain Markdown, so it also pastes into other agents such as Grok Bot, Hermes, OpenClaw or Muse. We list those as compatible by format only, not as tested.
Tools needed
Cost to run: Free.
Time to result: About five minutes to a first result
Sample prompts, free to use
Look through the last month of prompts where I asked you to score, rank, grade or triage anything. For each, write down the rubric you were actually using: the grades, what each meant and what it led to. Mark every place you guessed. Do not change anything. Run rubric_mini.py rubric-lite.json and show me the findings.
The rules and the script are in the file.
Free preview of the file
# Rubric Library: five rules and a five-check script (free sample)
Version 1.0, 2026-10-28. By PaperChaseWebb. For anyone who lets an agent score, grade or triage things, in Grok Bot, Claude Code, Codex, Hermes or a mix, and wants the scoring rules written down where the agent can load them. One Markdown file and one Python 3 script, standard library only. The script was tested on its worked example (5 findings, then 0) and on a missing file (exit 2). It was not run inside any agent harness or on a real scoring workflow.
Every "score these leads", "triage this inbox" or "rank these posts" prompt has a rubric in it. Usually it lives in one person's head or one chat thread, has no version, and changes a little every time someone rewrites the prompt. The scores look precise and mean whatever the agent guessed that day. The rubric is the product: write it down, give it an owner and a number, and say what each grade makes happen. These five rules cover the gaps that cost the most, and the script checks them in one small file.
## Install in one line
Save this page as FREE-SAMPLE.md, then:
```
python3 -c "import re;t=open('FREE-SAMPLE.md').read();open('rubric_mini.py','w').write(re.search(r'~~~python\n(.*?)~~~',t,re.S).group(1))"
python3 rubric_mini.py rubric-lite.json
```
## Five rules
1. **Every rubric library has a human owner.** A person decides what the grades mean. Not "TBD", and not the agent doing the scoring.
2. **Every rubric has a number.** An agent loads hook-pattTest record
- Date
- Oct 28, 2026
- What was run
- rubric_mini.py on the worked example, a fixed file and a missing file.
- Result
- 5 findings, then 0; exit 2 on a missing file.
- Not run
- The prompt inside a harness.
Copied from this item's dated test notes. What was not run stays in.
Worth knowing
- The sample checks one file against five rules. The six-file library, evidence rules, borderline and adversarial cases, load and check-score, owner approvals by hash and the fifteen checks are in the full pack.
- On 2026-10-28 rubric_mini.py gave 5 findings on the worked example, then 0 on the fixed file, and exited 2 on a missing file. The prompt was not run inside a harness.
Questions
Does it send anything anywhere?
No. It reads one file and opens no network connection.
What is in the full pack?
The six-file library with templates, rubric.py that your agents load rubrics from and check scores against, owner approvals tied to a hash with one use and expiry, fifteen read-only checks with a seeded test library, a skill file, AGENTS.md snippet and Grok Bot rules block, ten prompts and a failure table. $19.
Details
Version 1.0 · Updated Oct 28, 2026 · Markdown version of this page
License: Personal and commercial use. Download terms
Related
Rubric Library: name, version and own the scoring rubrics hiding in workflows
Every score, rank, flag or triage step an agent runs has a rubric in it, usually unnamed and rewritten each time. Six plain files give each rubric an owner, a version, grades with definitions and actions, evidence rules, borderline examples and an adversarial set. Agents load a rubric by name and number with rubric.py and check every score; unnamed or default is unverdicted, and anything touching a person, a client or money goes to a person. Fifteen read-only checks run on the library itself.
Desk Authority Map: five rules and a five-check script (free sample)
From the Desk Authority Map: five rules for an agent fleet (every desk has a human owner, no desk checks its own work, nothing that cannot be undone is decided alone, money gets a dollar limit, some actions belong to the owner), and a read-only script that checks one map file for them.
Agent Readiness Self-Check: score one workflow before you hand it to an AI agent
A free self-check for agencies and small businesses. Name the decision, then score one workflow across eight areas (workflow mapped, data access, approval gates, owner per agent, handoffs, cost tracking, security and vetting, measurement) with an evidence rule, three gate rules and a skeptical pass, and read your band and the next steps it allows. v1.1 starts with the decision the score will change, scores unknowns as unknown, adds rules for conflicting facts and lookalike public records, ties every band to the next steps it allows with the Production Readiness Audit before go-live, makes owner approval concrete (prepared and approved status, a one-reply approval line, decisions the agent must leave open, a done test), adds agent files for Grok Bot, Claude Code, Codex and Hermes, a second worked example (missed call to booked job), a readiness folder with a fifteen-check read-only checker, a front door test with four questions to ask anyone selling you an agent install, and a plain note on how it was tested. Still free.