-
-
Block 1: Validating without cheating
-
The exam it has not seen
-
Leaks: when the model sees the answer
-
Block 1 exam
-
-
Block 2: Measuring: the metric is a decision
-
Errors in a quantity
-
Errors in a yes or a no
-
Block 2 exam
-
-
Block 3: Comparing and explaining
-
What to compare against
-
Explaining a prediction and checking that it treats everyone alike
-
Block 3 exam
-
-
Block 4: From model to system: evaluating an AI and keeping watch
-
From validation to the case battery
-
After the exam: drift and sign-off
-
Block 4 exam
-