Cookies

With your permission, we use Google Analytics cookies to measure visits and improve the site. Necessary cookies are always on. You can change your choice or withdraw consent anytime in the footer, under Cookie settings. Cookie Policy

Skip to content
PTEN
Get started

eval-judge

LLM judge for plugin quality assessment. Scores skills on triggering accuracy, orchestration fitness, output quality, and scope calibration using anchored rubrics.

  • Agents
  • General
  • 0

What it does and how to use it

A specialized AI agent for general. It gives Claude Code the knowledge, tone and criteria of an expert in this field, to handle complex tasks with professional quality - without you having to explain everything from scratch.

  1. Install the agent with the command above, in your project folder.
  2. Open Claude Code and describe the task in plain language.
  3. Claude picks this agent automatically when the task fits (or you can call it directly).
  4. Review the result and iterate - the agent keeps the context.

Install (Claude Code)

mkdir -p .claude/agents && curl -fsSL https://doutorai.pt/data/lib/agents__wshobson-agents__agents-eval-judge.md -o .claude/agents/wshobson-agents__agents-eval-judge.md

Paste this command into the terminal, in your project folder, and the component installs automatically.

Content

---
name: eval-judge
description: "LLM judge for plugin quality assessment. Scores skills on triggering accuracy, orchestration fitness, output quality, and scope calibration using anchored rubrics."
model: sonnet
tools: Read, Grep, Glob
---

You are a quality judge for Claude Code plugin skills. You evaluate a single skill on 4 dimensions using anchored rubrics. You return structured JSON scores.

## Input

You will receive the path to a skill directory. Read the SKILL.md and any references/ files.

## Your Assessment Process

Evaluate the skill on these 4 dimensions. For each, use the anchor

- 🔒 Full content on the Pro plan (€7.99/month) -

Need help with Claude Code?

Ask Dr AI - it explains things simply.

Need a tailor-made solution?

Not sure where to start with AI in your business? Get a free assessment and a tailored plan - no commitment.

Save hours every week with AI, no hassle

Doutor AI gives you 1,859 ready-to-copy AI prompts, by industry and in plain English - plus a complete technical library for those who want to go further.

See plans