Which arrangement of options correctly represents the meaning of blue stars in metrics?

• A. The data is incomplete
• B. The test is not yet concluded
• C. A statistically significant change between the two variations tested
• D. The metric is optional

Answer: (C)

Blue stars signal that the observed difference between two variants is statistically significant. In A/B testing, you compare a control and a treatment and run a statistical test. If the result meets the chosen significance level (often a p-value below 0.05), you reject the idea that there’s no real difference and conclude the change is likely real rather than due to random chance. That’s what the blue star indicates: a statistically significant change between the two variations tested. It doesn’t mean data is incomplete, the test isn’t finished, or the metric is optional. Keep in mind that significance shows evidence of an effect, not how large or practically important the effect is.