In some cases, headline tests may complete after 15 minutes with no winner found:
Why it happens
- article URL: the precise value of the <a> tag href attribute, which is the target article URL in your homepage code
- headline text: the precise headline text from your CMS, the value which will become variant A in your test
- headline sub-location: the headline's sub-location, or truncated XPath which demonstrates the relationship of the headline text element to the parent <a> tag in your HTML
Here you can see the href (URL) and headline text values our code will collect if a test is initiated on this headline. The headline sub-location (aka truncated XPath), would be span since the headline text is nested in the first <span> tag within the parent <a> tag.
For tests that stop at the 15-minute mark with no winner found, we can assume there is a mismatch between the source code where your test was initiated and the source that code 95% of new visitors loaded. The mismatch can occur on any one of these three points.
How to fix it
When your editors are initiating new tests, they should ensure that they are viewing a version of the homepage where the headline HTML will match precisely the HTML that 95% or more of your visitors will load. They may be viewing a slightly modified version of the page, for example, an editor-specific version that requires a login.
As always, feel free to drop any questions to firstname.lastname@example.org! We are happy to help.