← Quiz: Evaluating LLM Apps: all 10 questions
Quiz: Evaluating LLM Apps · Question 3 of 10
What should you do before trusting an LLM-as-judge?
What should you do before trusting an LLM-as-judge?
- A.Nothing
- B.Check its grades against human grades on a sample
- C.Make it score from 1 to 100
- D.Use the same prompt as the app
Answer & explanation
Correct answer: Check its grades against human grades on a sample
Judges have biases; validate them.
Can you get the rest right without peeking?
Take the timed Quiz: Evaluating LLM Apps quiz free. Pass it to earn XP and count towards your certificate.
Start the quiz →