Task evaluation & model selection
Generic leaderboards do not establish which candidate fits your task.
- Work
- Define task success; prepare an independent evaluation set; reproduce candidate results; analyze errors and cost per valid outcome.
- Deliverables
- Task brief, evaluation-set documentation, comparison report, primary and fallback choices, operating boundaries and reproducible records.
