The range of true lifts compatible with the data, at the 95% level. Probant always shows the lift with its range: if the range is entirely above zero, the variant wins; if it contains zero, nothing is proven.
Autre nom : range
Sur le Revenue per visitor, l’écart mesuré est de +6.0%, avec une fourchette à 95% from +2.2% to +10.0%: toute la fourchette est au-dessus de zéro, la variante rapporte plus.
Sur la marge par visiteur, l’écart mesuré est de +3.0%, fourchette from -0.7% to +6.7%: la fourchette contient zéro, et rien n’est prouvé sur la marge, même si l’écart mesuré est positif.
Chiffres calculés par le moteur de Probant sur la boutique de démonstration, Maison Lune, fictive : ouvrir la démo.
The probability of seeing a lift at least this large if the two versions performed the same. Below 5%, the lift is called significant; in Probant, that’s the same as a 95% confidence interval that excludes zero.
The difference between the variant and the original, relative to the original: B / A − 1. A positive effect means the variant does better, in proportion to the starting value.
A range you can reread at any time and stop on at the first crossing without inflating the risk (Johari, Pekelis, and Walsh, 2017). It’s wider than a classic confidence interval. Probant uses it for rollout guardrails.
Create your workspace, or explore the demo first with data from a fictional store.