The difference between the variant and the original, relative to the original: B / A − 1. A positive effect means the variant does better, in proportion to the starting value.
Autre nom : lift
Le Revenue per visitor vaut €24.58 dans l’originale et €26.06 dans la variante. Effet relatif: €26.06 / €24.58 − 1 = +6.0%.
En valeur absolue, l’écart est de +€1.48 par visiteur. L’effet relatif se compare d’un test à l’autre, quelle que soit la valeur de départ; l’écart absolu se convertit en euros par mois.
Chiffres calculés par le moteur de Probant sur la boutique de démonstration, Maison Lune, fictive : ouvrir la démo.
The range of true lifts compatible with the data, at the 95% level. Probant always shows the lift with its range: if the range is entirely above zero, the variant wins; if it contains zero, nothing is proven.
The probability of seeing a lift at least this large if the two versions performed the same. Below 5%, the lift is called significant; in Probant, that’s the same as a 95% confidence interval that excludes zero.
Revenue divided by the number of visitors exposed to the test, whether they buy or not: a visitor with no order counts as €0. It combines conversion rate and average order value, and tells you what a change brings in.
Create your workspace, or explore the demo first with data from a fictional store.