Experiments A/B
Hypothèses, statistical significance (Z-test bilatéral), lift et p-value.
Total
18
Running
9
Concluded
8
Wins (p<0.05)
12
Backlog A/B tests (18)
| ID | Hypothèse | Métrique | Statut | Visit. A | Conv. A | Visit. B | Conv. B | Lift | p-value | Verdict |
|---|---|---|---|---|---|---|---|---|---|---|
| exp_001 | CTA « Essayer gratuitement » > « Démarrer » | Signup rate | concluded | 8 420 | 412 | 8 380 | 498 | +21.5% | 0.003 | win |
| exp_002 | Onboarding 3 étapes vs 5 étapes | Activation rate | running | 2 100 | 882 | 2 080 | 998 | +14.2% | <0.001 | win |
| exp_003 | Pricing 29€ vs 39€ Starter | Free → Paid conversion | running | 1 820 | 109 | 1 790 | 98 | -8.6% | 0.506 | inconclusive |
| exp_004 | Email D+3 « Voici votre 1er doc IA » vs D+1 | Activation J7 | concluded | 3 400 | 1 428 | 3 380 | 1 521 | +7.1% | 0.013 | win |
| exp_005 | Vidéo hero vs screenshot statique | Bounce rate (inv) | concluded | 14 200 | 4 544 | 14 100 | 5 076 | +12.5% | <0.001 | win |
| exp_006 | Recommander 5 templates vs 0 (cold start) | Time to value | running | 1 240 | 521 | 1 220 | 671 | +30.9% | <0.001 | win |
| exp_007 | Sticky nav header vs hidden on scroll | CTA click rate | concluded | 22 400 | 1 568 | 22 300 | 1 561 | +0.0% | 1.000 | inconclusive |
| exp_008 | Plan gratuit limité 3 docs vs illimité 7j | Free → Paid | running | 980 | 58 | 970 | 81 | +41.1% | 0.037 | win |
| exp_009 | Notification push J+1 inactivité | DAU/MAU | concluded | 5 200 | 1 976 | 5 180 | 2 124 | +7.9% | 0.002 | win |
| exp_010 | Pop-up exit-intent avec offre -20 % | Signup | concluded | 18 200 | 728 | 18 100 | 905 | +25.0% | <0.001 | win |
| exp_011 | Logo wall « Used by » au-dessus du fold | Trust → Signup | running | 4 200 | 168 | 4 180 | 192 | +14.8% | 0.180 | inconclusive |
| exp_012 | Slack invite obligatoire onboarding | K-factor | running | 820 | 148 | 810 | 218 | +49.1% | <0.001 | win |
| exp_013 | Pricing annuel mis en avant -2 mois | ARPU | running | 620 | 124 | 610 | 152 | +24.6% | 0.039 | win |
| exp_014 | Form 5 champs vs 2 champs (email + nom) | Signup completion | concluded | 9 800 | 1 862 | 9 750 | 2 535 | +36.8% | <0.001 | win |
| exp_015 | Testimonial vidéo client vs texte | Demo request | concluded | 6 400 | 192 | 6 380 | 245 | +28.0% | 0.009 | win |
| exp_016 | Webhook Zapier mis en avant landing | Activation Business segment | running | 1 240 | 372 | 1 230 | 418 | +13.3% | 0.034 | win |
| exp_017 | AI persona « DAF » vs persona « PM » | Activation by persona | paused | 1 820 | 728 | 1 800 | 738 | +2.5% | 0.540 | inconclusive |
| exp_018 | Bouton « Inviter team » avant 1er doc | Viral K-factor | running | 540 | 81 | 530 | 132 | +66.0% | <0.001 | win |
Calcul : Z-test bilatéral sur deux proportions. Significatif si p<0.05, hautement significatif si p<0.01. CI 95 % calculé sur (pB − pA).