← Quiz: Statistics: all 10 questions
Quiz: Statistics · Question 5 of 10
What does a p-value of 0.01 in an A/B test mean?
What does a p-value of 0.01 in an A/B test mean?
- A.If the change had no effect, a difference this large would appear only about 1% of the time by chance
- B.The new version is 1% better
- C.There is a 1% chance the test was run correctly
- D.99% of users preferred version B
Answer & explanation
Correct answer: If the change had no effect, a difference this large would appear only about 1% of the time by chance
Small p-values make "no effect" an unlikely explanation.
Can you get the rest right without peeking?
Take the timed Quiz: Statistics quiz free. Pass it to earn XP and count towards your certificate.
Start the quiz →