Shipping costs shown on the product page
Product page · “Revenue per visitor” · Jun 15 to Jul 9
- Verdict
- Winner+2.1%95% range +0.2 → +4.0Proven gain: range from +0.2% to +4.0%, above 0.
- Decision
- Shipped“The surprise at the cart was costing sales”
- Counted gain
- None: the rollout contradicts the test. The +€180,309 per month it projected is shown separately in the impact report and not counted.
- Criteria
Other criteria · 5 met, 1 not applicable
- Sealed test plan
- Locked at launch on Jun 15, 10:30 AM by Camille Roux.
What was sealed, and its fingerprint
7f890fd6…a1412eSHA‑256 fingerprint:7f890fd613c3184e20b9c2dbf0ad07fa5b03ea63004c32f7c24b44b270a1412e- Hypothesis
- Shipping costs shown on the product page: an effect of at least 3% on “Revenue per visitor”.
- Primary metric
- Revenue per visitor
- Secondary metrics
- none
- Guardrails
- none
- Target effect
- +3%, risk 5%, power 80%
- Checkpoints
- 1
- Sample size
- 381,226 visitors per variant
- Planned duration
- not estimated
- Traffic split
- A / B: 50% / 50%
- Targeting
- zone “Product page”, 100% of its traffic · workspace holdout group of 5.0% excluded
Canonical form: its SHA‑256 is the fingerprint above.{"allocation":[{"changes":"4f53cda18c2baa0c","key":"a","name":"Original","weight":1},{"changes":"3a448714ff924e17","key":"b","name":"Shipping costs shown on the product page","weight":1}],"declared":null,"hypothesis":"Shipping costs shown on the product page: an effect of at least 3% on “Revenue per visitor”.","metrics":[{"aggregation":"visitor","capPercentile":null,"direction":null,"eventName":"ca-par-visiteur","key":"ca-par-visiteur","kind":"mean","limit":null,"name":"Revenue per visitor","role":"primary"}],"plan":{"alpha":0.05,"armSizes":null,"looks":1,"mde":0.03,"perArm":381226,"plannedDays":null,"power":0.8,"totalVisitors":762452},"targeting":{"endsAt":null,"holdoutShare":0.05,"rules":{},"startsAt":null,"trafficShare":1,"zone":"Product page"},"version":1}