From the course: UX Insights Weekly

Unlock this course with a free trial

Join today to access over 22,600 courses taught by industry experts.

What is a statistically significant result?

What is a statistically significant result?

From the course: UX Insights Weekly

Start my 1-month free trial Buy for my team

What is a statistically significant result?

“

- It's always nice to have statistically significant results. Somehow, that makes everything right with the world. At least as far as executives and the product team are concerned. But there are times when significance is more important and times when it doesn't matter. Statistically significant actually means your results will be unlikely to occur if the effect you found wasn't real. You can have different levels of statistical significance. 5% probability is normally acceptable in behavioral research. The significance level is often written as a probability, using the letter p. So p less than 0.05. Here's an example to put this into context. Say you're working in a company that sells things online. You might want to see whether changing the color of the add to cart button makes a difference in how many people buy something. Your button is blue right now and a certain proportion of people who see the button click it and make a purchase. You decide to make the button red instead and…

Contents