← Quiz: Evaluating LLM Apps: all 10 questions
Quiz: Evaluating LLM Apps · Question 9 of 10
A bug reaches production. What should happen to the test set?
A bug reaches production. What should happen to the test set?
- A.Add the failing case to it, so every future version is checked against it
- B.Nothing; production bugs are separate
- C.Delete the test set and start again
- D.Remove the hardest cases
Answer & explanation
Correct answer: Add the failing case to it, so every future version is checked against it
The test set grows from real failures.
Can you get the rest right without peeking?
Take the timed Quiz: Evaluating LLM Apps quiz free. Pass it to earn XP and count towards your certificate.
Start the quiz →