Why do many of my headline experiments complete at or just after 20 minutes?

There are two conditions where a headline wins and an experiment ends -- hard convergence and soft convergence.
 
Hard convergence is the usual method where a headline when there is 95% confidence that one headline is more successful at attracting clicks and attention.
 
Soft convergence handles the case of two roughly equal headlines. If 20 minutes have passed and we're 95% confident that no headline is better by a margin of 25%, the leading headline will win. We have this alternate method so that you don't have to wait around if neither headline isn't significantly more successful or is only marginally better.
 

Looking for something else? We’re happy to help.