3 docs tagged with "evaluation"

How to choose an LLM for a product task, read benchmarks without being fooled, build a small internal eval set, and manage model upgrades safely.

How to build golden eval datasets for LLM systems, label them consistently, split them safely, and use synthetic data without fooling yourself.

How to test non-deterministic LLM systems with datasets, scorers, and LLM-as-judge; eval-driven development and harness engineering; and the LLMOps discipline of operating prompts, models, and agents in production.