Does it work? Evaluating an AI before you trust it

A demo always goes well: the cases are chosen by whoever wants to convince you. What you need to know is what happens with the cases in your own work, including the ugly ones. This course teaches you to measure it in four blocks: deciding what counts as getting it right, building your own exam, choosing who grades it and continuing to test when the system changes.