🎙 Free live masterclass · Sun, 29 Nov, 7:00 pm IST · Java Full Stack roadmap Register free →
Skills101
← Quiz: Statistics: all 10 questions

Quiz: Statistics · Question 10 of 10

Why is running many A/B tests and reporting only the one with p < 0.05 a mistake?

Why is running many A/B tests and reporting only the one with p < 0.05 a mistake?

  1. A.p-values cannot be below 0.05
  2. B.Only one test can be run per year
  3. C.It makes the sample size larger
  4. D.With many tests, some will reach p < 0.05 by chance alone
Answer & explanation

Correct answer: With many tests, some will reach p < 0.05 by chance alone

This is how false "discoveries" are made.

Can you get the rest right without peeking?

Take the timed Quiz: Statistics quiz free. Pass it to earn XP and count towards your certificate.

Start the quiz →