← Quiz: Statistics: all 10 questions
Quiz: Statistics · Question 10 of 10
Why is running many A/B tests and reporting only the one with p < 0.05 a mistake?
Why is running many A/B tests and reporting only the one with p < 0.05 a mistake?
- A.p-values cannot be below 0.05
- B.Only one test can be run per year
- C.It makes the sample size larger
- D.With many tests, some will reach p < 0.05 by chance alone
Answer & explanation
Correct answer: With many tests, some will reach p < 0.05 by chance alone
This is how false "discoveries" are made.
Can you get the rest right without peeking?
Take the timed Quiz: Statistics quiz free. Pass it to earn XP and count towards your certificate.
Start the quiz →