Skip to content
Hosted in Europe. Your test data is stored in the European Union.Hosted and stored in EuropeLearn more

Probant exists so that every test tells the truth.

An A/B test answers one question: does the variant earn more? Probant gives the answer in one sentence, with its range and its amount in euros, revenue and margin shown separately. When the data is not enough yet, the report says so.

Four rules the product applies to every test.

They shape what you read in every report, from the test plan to the rollout.

  • A verdict in one sentence.

    The report opens with the conclusion, in plain language, with the range of the effect. The checks are listed alongside for anyone who wants to verify. You don’t need to be a statistician to decide.

  • Margin, in euros.

    A variant can raise revenue and cut into margin, for example by offering free shipping. Probant puts a monthly euro figure on both revenue and margin, after product costs, discounts, and shipping, each with its range. When the margin range includes zero, the report says so.

  • Checkpoints set in advance.

    Checkpoints are set before launch. Across 1,000 simulated A/A tests, comparing two identical versions, checking every day declares a difference in 22% of cases; the planned checkpoints, in 6%.

    The peeking trap
  • Uncertainty, always shown.

    Every effect comes with its range, and the reported gain is corrected for the winner’s curse. “No detectable effect” does not mean “no effect”: the report says what it would take to decide.

    The winner’s curse

An engine checked against reference values.

Each formula in the engine comes with its published source and an automated check against reference values. The differences, ranges, and durations shown in the demo and on this site are computed by the engine from raw data.

The statistics engine: the methods, their sources, and how they are checked.

What the engine computes

  • Relative B / A effects on a proportion or a mean: difference test, Fieller confidence interval
  • Power: sample size, minimum detectable effect, duration in days
  • Sample ratio mismatch (SRM) check
  • CUPED variance reduction
  • Always-valid intervals (mSPRT) and O’Brien-Fleming boundaries
  • Multiple comparisons: Holm, Bonferroni
  • Winner’s curse correction by Bayesian shrinkage

Who makes Probant.

Probant is published by Félix Boittin, sole proprietor (entrepreneur individuel, EI), trading as Clivio. Félix Boittin founded Probant.

The company

Publisher
Félix Boittin, sole proprietor (entrepreneur individuel, EI), trading as Clivio
Registration
SIREN 894 584 770 · SIRET 894 584 770 00016
Registered office
10 rue des Aqueducs, 94250 Gentilly
Team
Félix Boittin founded Probant.
Response time
within 48 hours

Conclusive Or not yet…

Create your workspace, or explore the demo first with data from a fictional store.

  • Open demo, no sign-up
  • Free to start, no overage charges
  • Database and compute in Amsterdam, with Scaleway