The modified version of the page, compared with the original, which is the current version. The original is arm A, the variant arm B.
L’originale montre le panier tel qu’il est; la variante y ajoute une barre de progression vers la livraison offerte. Tirés au hasard, 30,650 visiteurs ont vu l’originale et 30,590 la variante.
La variante rapporte +6.0% de chiffre d’affaires par visiteur (fourchette from +2.2% to +10.0%): elle gagne, et le rapport chiffre aussi ce qu’elle coûte en livraisons offertes.
Chiffres calculés par le moteur de Probant sur la boutique de démonstration, Maison Lune, fictive : ouvrir la démo.
An experiment that shows the current version of a page (A) to some visitors and a modified version (B) to others, assigned at random, then compares the two on a primary metric set before launch. The lift is read with its confidence interval at the planned checkpoints.
Visitors aren’t split between versions as planned, a sign of an assignment problem. Probant checks every test with a chi-square test: below a p-value of 0.001, the verdict is blocked, whatever the lift.
The difference between the variant and the original, relative to the original: B / A − 1. A positive effect means the variant does better, in proportion to the starting value.
Create your workspace, or explore the demo first with data from a fictional store.