The share of traffic that sees the new version during a gradual rollout. Probant moves to the next step once the minimum duration has passed and no guardrail is crossed; to go to all traffic, every guardrail must sit entirely on the right side of its limit.
Par défaut, la variante gagnante passe par 25%, 50%, and 100% du trafic. Le profil prudent ajoute un premier palier: 10%, 25%, 50%, and 100%.
Chaque palier intermédiaire dure au moins three jours complets, pour couvrir des jours de semaine différents. Le passage au palier suivant attend qu’aucun garde-fou ne soit franchi; le passage à tout le trafic, que chaque garde-fou soit entièrement du bon côté de sa limite.
Chiffres calculés par le moteur de Probant sur la boutique de démonstration, Maison Lune, fictive : ouvrir la démo.
Automatic withdrawal of a version being rolled out as soon as a guardrail is crossed, that is, as soon as its whole always-valid range exceeds the limit. All traffic goes back to the original.
A metric that must not get worse (return rate, page speed, errors), with a limit set in the test plan. A guardrail stops the test only if its whole range exceeds the limit; a range that straddles the limit doesn’t prove harm.
A range you can reread at any time and stop on at the first crossing without inflating the risk (Johari, Pekelis, and Walsh, 2017). It’s wider than a classic confidence interval. Probant uses it for rollout guardrails.
Create your workspace, or explore the demo first with data from a fictional store.