« Email Campaign Performance Metrics | Main | links for 2007-07-16 »

4 Things to Keep in Mind When Testing

Posted by Tamara Gielen on Jul 16, 2007 | Permalink | Category: Testing

1. Be sure to send all e-mail at the same time. You don't want the day or time of the send to influence results (unless that's what you're testing).

2. Make clear notes about what you're testing and which group is getting the "business as usual" version. This makes it easy to quickly determine a winner and implement what you've learned.

3. Wait at least 48 hours before declaring a winner. Early results aren't always accurate. Often, what's ahead after an hour doesn't maintain its momentum.

4. Make sure test groups are of significant quantity. You can do an analysis to determine statistically significant sample size and margin of error. Or you can use these rules of thumb:

  • Have at least 1,000 e-mail addresses per group; 5,000 is better if your list is over 10,000.
  • If your total list is smaller than 2,000, repeat the same test over a few sends until you have aggregate results for 2,000 e-mail addresses (1,000 per each group).

Continue reading here and learn more about the most common things to test in email marketing: sender lines, subject lines, and the body of the email and the landing page.

Comments

Post a comment

Our Sponsors

Subscribe to this blog

Join the Email Marketer's Club!

More Sponsors

On Twitter right now...



Disclaimer

  • This is a personal blog that is not affiliated in any way with my current employer. The views that are expressed in this blog are entirely those of the bloggers and/or those of the authors of the articles published. They do not necessarily represent the views of my current or previous employers.

Wikio - Top of the Blogs - Business

© 2005-2008 BeRelevant! | Bergen 15, 2270 Herenthout, Belgium | Powered by TypePad
FacebookLinkedInSkypeTwitterdel.icio.us

Clicky