In Agent Skill land, I have been synthesizing my 100+ review comments across our official Agent Skills corpus into review guidance to scale Skill quality reviews across our docs org.
If you wonder what types of things a human should be looking for when reviewing Agent Skills (beyond technical details, which should be reviewed by an SME), you might find this helpful. I look at:
- Scope and Skill boundaries
- Decision tree walkthrough
- Content justification
- Instruction precision
- Consistency and narrative coherence
- Cross-skill ecosystem awareness
The page also includes my guidelines for which things should block merge, request changes, or nice-to-haves. Available in our meta docs for anyone who might find it helpful:
https://www.mongodb.com/docs/meta/tutorials/review-agent-skill/