Forums

[Doïc de Maleprade Contribution Level: 2]

Hi everyone!
I have this split test for quite a long time now, on a little aweber list.
It's a popup to invite my visitors to subscribe to my list.
I test the best time to pop the form (20, 30 or 60 seconds), the results are:

Form....Displays.....Submits....S/D....Unique Displays.....S/UD
20s......3015...........208..........6.9%.....3010..................6.9%
30s......1440...........158..........11.0%...1439..................11.0%
60s......6348...........366..........5.8%.....6281..................5.8%

What I understand:
The best S/D is at 30 seconds, but - as the split test should be fair and the popup shows twice more at 20 seconds - if I show only at 30 seconds, I'll lose a lot of leads...
There's a lot of people who stay 60 seconds or more, but with a low S/D.

What sould I do ? keep the 30s only ? the 20s to maximize the displays ?
Do you think it's better to display the popup when they come in ?

[Rich Sale Contribution Level: 1]

Hi
Some interesting results. I assume that you are rotating the forms evenly but was confused as to why there was such a difference in the number of displays in the three cases.

If they are being rotated then 30 is a clear winner but only if the average time on page is greater than 30s.
Its probably worth checking this with Google Analytics or similar.

You could then do another test with the delay set to just less than the average time on page.

Another thing to consider is that if someone stays on your page for 30s then they are probably interested in what you are saying so they are more lightly to sign up. But of course this is inconsistent with the 60s result

So a bit like my response really. A lot of words but not many answers, Sorry.

Rich

[Doïc de Maleprade Contribution Level: 2]

Gracias Rich,

There's a good idea you gave here, I jumped to my analytics account and...
I tried to look for a correct indicator. On the past 3 months, the average time spent on the site was always greater than 50 seconds (on a per-hour view). The total average is 1 min 16.
But right now, I'm wondering if I'm using a good solution... I tried to surf my site without any cookie in my browser, and clicked on an intern link every 15 seconds... nothing happens: no popup. It's a big problem because my average number of pages viewed per visit is 2,5... and 2,5 x 20 seconds = 50 seconds. Plop.
Maybe, I just say MAYBE, there's a good targeted audience landing on my site, looking for something, clicking every 20 seconds and leaving without a trace...

I really need to do more split tests and test more ways to get them sign up.

Thanks Rich for motivate me to have a look to my analytics account today, as it's a secondary website I don't update, I never check the stats...

[Rich Sale Contribution Level: 1]

Just another thought.

You could put a small sign up form on each page. Still run the pop-up but at least you have some way of getting the leads even if they want to move on quickly.

Rich

[Doïc de Maleprade Contribution Level: 2]

Sure...

But I put this "popup" on a website that I didn't want to modify...
I need to change one or two things to implement the form...

Thanks.

[Ben Fitts Company: SendOutCards Contribution Level: 3]

Are you sure you understand how the aweber popup works? I am pretty sure that it does NOT popup twice per page. So if you set it to 20 seconds it will not popup again at 40 and 60. It only pops the one time.

Clearly the 30 seconds option works and I think I might even change my pop up to try it.

One comment I've received from my popup which comes up very quickly is that it comes up too quickly. People haven't had a chance to read the page and don't really know if they even want to subscribe to my newsletter/rss feed. That seems to lead some credibility to your results.

It also could be that if you wait until 60 seconds people are too engrossed in your content, they don't want to be interrupted. Maybe 30 seconds is the right amount of time that they have skimmed your content and know they want more information from you, but aren't too busy to subscribe.