Skip to Content
Evaluating a model honestly: validate, measure and explain

Evaluating a model honestly: validate, measure and explain

A model is worth what it gets right on data it has not seen, measured with the metric that fits the decision and compared against something. That is exactly what is usually missing from the result a copilot hands you: a lone percentage arrives, with no exam to back it up, no rival and no fine print. This course teaches you to ask for those three things, to read them and to sign off on what comes out.

Private Course
Please sign in to contact responsible
Responsible Carlos Pascual
Last Update 2026-10-06
Completion Time 4 hours 40 minutes
Members 1
Intermediate Data, Analytics and AI
  • Block 1: Validating without cheating
    3Lessons · 1 hr 10 min
    • The exam it has not seen
    • Leaks: when the model sees the answer
    • Block 1 exam
      10 xp
  • Block 2: Measuring: the metric is a decision
    3Lessons · 1 hr 10 min
    • Errors in a quantity
    • Errors in a yes or a no
    • Block 2 exam
      10 xp
  • Block 3: Comparing and explaining
    3Lessons · 1 hr 10 min
    • What to compare against
    • Explaining a prediction and checking that it treats everyone alike
    • Block 3 exam
      10 xp
  • Block 4: From model to system: evaluating an AI and keeping watch
    3Lessons · 1 hr 5 min
    • From validation to the case battery
    • After the exam: drift and sign-off
    • Block 4 exam
      10 xp