If the Orbe lamp’s product page shows the lamp switched on in a living room and where it’s made, visitors will add it to cart more often, because they can picture it at home and have fewer doubts about its quality.
D · Estimated difference +26.6% on the rate of “add to cart”, likely between +8.59% and +48.0% (99.5% range). Positive effect: the range goes from +8.6% to +48.0%, entirely above 0.
H · Estimated difference +21.9% on the rate of “add to cart”, likely between +4.43% and +42.8% (99.5% range). Positive effect: the range goes from +4.4% to +42.8%, entirely above 0.
9 combinations with no conclusive difference vs. the original. Their ranges are in the table below.
Test stopped: no more visitors enter the measurement.
Effect of each section across all traffic: each level’s average combines all the combinations that contain it, and is compared with the section’s original on “Add to cart”. The by-combination view below compares each combination with the original.
Combination D · In a room + Made in France
False positive risk, given the workspace’s past tests and the power reached for the target effect: “In a room” 2.4% and “Made in France” 3.2%.
| Level | Visitors | Rate | Difference vs. original · range | Reading |
|---|---|---|---|---|
| Original | 26,744 | 8.96% | — | baseline |
| Benefit | 26,964 | 9.23% | +3.0%-2.4 → +8.7 | Inconclusiveadjusted p 0.276 |
| Short | 26,804 | 8.59% | -4.1%-9.2 → +1.3 | Inconclusiveadjusted p 0.268 |
| Level | Visitors | Rate | Difference vs. original · range | Reading |
|---|---|---|---|---|
| Original | 40,579 | 8.47% | — | baseline |
| In a room | 39,933 | 9.38% | +11%+6.0 → +15.8 | Betteradjusted p < 0.001 |
| Level | Visitors | Rate | Difference vs. original · range | Reading |
|---|---|---|---|---|
| None | 40,269 | 8.64% | — | baseline |
| Made in France | 40,243 | 9.21% | +6.6%+2.0 → +11.4 | Betteradjusted p 0.014 |
For each pair of sections: how much one level’s effect changes when the other section switches to its level (in percentage points). Near 0, the two effects add up. Not pre-registered in the plan, so they’re for information only and decide nothing.
95% ranges per comparison. The conclusion accounts for the 4 comparisons pre-registered in the plan (4 differences vs. the original), corrected together.
| Variant | Visitors | Converters | Rate | Difference vs. A · range |
|---|---|---|---|---|
| AOriginale | 6,732 | 552 | 8.20% | |
| BMade in France | 6,704 | 561 | 8.37% | +2.05% |
| CIn a room | 6,603 | 587 | 8.89% | +8.42% |
| DIn a room + Made in France | 6,705 | 696 | 10.4% | +26.6% |
| EBenefit | 6,802 | 597 | 8.78% | +7.04% |
| FBenefit + Made in France | 6,804 | 606 | 8.91% | +8.62% |
| GBenefit + In a room | 6,637 | 613 | 9.24% | +12.6% |
| HBenefit + In a room + Made in France | 6,721 | 672 | 10.00% | +21.9% |
| IShort | 6,798 | 552 | 8.12% | -0.97% |
| JShort + Made in France | 6,739 | 570 | 8.46% | +3.15% |
| KShort + In a room | 6,697 | 578 | 8.63% | +5.26% |
| LShort + In a room + Made in France | 6,570 | 602 | 9.16% | +11.7% |
Locked at launch on Sep 28, 09:00 AM by Hugo Bernard · fingerprint 4afe6efd…2b328a
No deviations. The test follows its sealed plan.
Full fingerprint: 4afe6efd05c9642aabcfb6f9c2832885615db025c4943454b63d33f4682b328a. It’s the SHA‑256 of the text below, so anyone can recompute it and check that the plan wasn’t altered.
{"allocation":[{"changes":"4f53cda18c2baa0c","key":"a","name":"Originale","weight":1},{"changes":"b003e56b096e232a","key":"b","name":"Made in France","weight":1},{"changes":"2b43eb4d927fd072","key":"c","name":"In a room","weight":1},{"changes":"bf8c17c0af17f10a","key":"d","name":"In a room + Made in France","weight":1},{"changes":"0fbc069f1fdb3599","key":"e","name":"Benefit","weight":1},{"changes":"51d1a910d11d3996","key":"f","name":"Benefit + Made in France","weight":1},{"changes":"33889b61a869ac36","key":"g","name":"Benefit + In a room","weight":1},{"changes":"50af8b7e13acc480","key":"h","name":"Benefit + In a room + Made in France","weight":1},{"changes":"888d29bc687b25c0","key":"i","name":"Short","weight":1},{"changes":"32d820dc121ca8d4","key":"j","name":"Short + Made in France","weight":1},{"changes":"461c3330768fb612","key":"k","name":"Short + In a room","weight":1},{"changes":"d56980d3ab326a7d","key":"l","name":"Short + In a room + Made in France","weight":1}],"declared":{"baseline":{"kind":"proportion","rate":0.082},"dailyVisitors":2176},"factorial":{"comparisons":4,"interactions":false,"sections":[{"levels":["Original","Benefit","Short"],"name":"Title"},{"levels":["Original","In a room"],"name":"Photo"},{"levels":["None","Made in France"],"name":"Badge"}],"traffic":"measured"},"hypothesis":"If the Orbe lamp’s product page shows the lamp switched on in a living room and where it’s made, visitors will add it to cart more often, because they can picture it at home and have fewer doubts about its quality.","metrics":[{"aggregation":"visitor","capPercentile":null,"direction":null,"eventName":"ajout_panier","key":"ajout-panier","kind":"proportion","limit":null,"name":"Add to cart","role":"primary"}],"plan":{"alpha":0.05,"armSizes":null,"looks":1,"mde":0.1,"perArm":6525,"plannedDays":36,"power":0.8,"totalVisitors":78300},"targeting":{"endsAt":null,"holdoutShare":0.05,"rules":{"urlPattern":"/produits/orbe"},"startsAt":null,"trafficShare":1,"zone":"Product page"},"version":1}