AIAI Bytes
StartLesson 7 · Debug the broken assistant

Before you start

About 33 minutes · 8 steps
What you'll do
Someone broke the assistant. Reproduce the problem, look at the evidence, fix what's wrong, prove it with tests and write up what you found.
Why it matters
AI apps often fail quietly: no error message, just worse answers. Debugging from evidence instead of guesses is one of the most valuable things you can do for a client.
What you'll walk away with
  • A repeatable way to debug an AI app: reproduce, look at the evidence, fix, prove, write up
  • Practice reading token counts, settings and logs as evidence
  • A write-up of each fault that a colleague could check
What “done” looks like
  • The offline tests for the broken assistant pass
  • The live test passes: three answers in a row give the current limit
  • Your write-up has one row for each fault you found

This lab runs on a separate copy of the code, so your own work from Lessons 1 to 5 is safe.

All 8 steps in this lesson
  1. 1· 2 min
  2. 2· 2 min
  3. 3· 3 min
  4. 4· 15 min
  5. 5· 3 min
  6. 6· 5 min
  7. 7· 2 min
  8. 8· 1 min