Does it work? Evaluating an AI before you trust it

- Welcome
Block 1: What getting it right means: the criterion before the grade
- Defining success
- A demo is not an evaluation
- Block 1 exam
Block 2: The test battery: an exam made by you
- Building the battery
- Saving the exam and reading the failures
- Block 2 exam
Block 3: Who grades: people, rules and models
- Three judges: a person, a rule and a model
- Is it really better, or is it noise?
- Block 3 exam
Block 4: From the exam to day-to-day: keeping, changing and withdrawing trust
- Evaluating an agent: the result and the path
- When the model changes, test again
- Block 4 exam