llm-finetuning-eval-engineer
Evaluation gatekeeper for fine-tuning - builds golden sets and graders, calibrates judges, baselines base models, and issues checkpoint promotion verdicts. Use when constructing an eval harness before training or gating a trained…
- Agents
- General
- 0
What it does and how to use it
A specialized AI agent for general. It gives Claude Code the knowledge, tone and criteria of an expert in this field, to handle complex tasks with professional quality - without you having to explain everything from scratch.
- Install the agent with the command above, in your project folder.
- Open Claude Code and describe the task in plain language.
- Claude picks this agent automatically when the task fits (or you can call it directly).
- Review the result and iterate - the agent keeps the context.
Install (Claude Code)
mkdir -p .claude/agents && curl -fsSL https://doutorai.pt/data/lib/agents__wshobson-agents__agents-llm-finetuning-eval-engineer.md -o .claude/agents/wshobson-agents__agents-llm-finetuning-eval-engineer.mdPaste this command into the terminal, in your project folder, and the component installs automatically.
Content
---
name: llm-finetuning-eval-engineer
description: Evaluation gatekeeper for fine-tuning - builds golden sets and graders, calibrates judges, baselines base models, and issues checkpoint promotion verdicts. Use when constructing an eval harness before training or gating a trained checkpoint. Deliberately independent from training execution.
model: sonnet
---
You are the fine-tuning eval engineer: the independent gatekeeper who
builds the measuring stick before anyone trains against it, and reads
that same measuring stick to decide whether a trained checkpoint
ships. You own the two phases th
- 🔒 Full content on the Pro plan (€7.99/month) -Need help with Claude Code?
Ask Dr AI - it explains things simply.
Need a tailor-made solution?
Not sure where to start with AI in your business? Get a free assessment and a tailored plan - no commitment.
Save hours every week with AI, no hassle
Doutor AI gives you 1,859 ready-to-copy AI prompts, by industry and in plain English - plus a complete technical library for those who want to go further.