Tech
Why our A/B testing tool refuses to call a winner
Two readings of the same experiment.
Day 4. Variant B is up 12.7% on conversion rate. 12,506 visitors in the variant, 12,418 in control. The number is green. Somebody screenshots it and drops it in Slack.
Day 11. Variant B is up 12.7%. Same test, same split, same traffic mix.
Same experiment, same lift. The only thing that changed is how long it was allowed to run. One of those two readings is a result. The other is a coin that has come up heads four times.
Every dashboard I have...
Read the full discussion on Dev.to
This article was aggregated from Dev.to. Click to join the conversation.
View on Dev.to