Comments on: How to Invalidate your Own A/B Testing http://blog.whatclinic.com/2009/04/how-to-invalidate-your-own-ab-testing.html Sharing Tech, Marketing & Health 2.0 information Sat, 11 Feb 2012 20:40:18 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: admin http://blog.whatclinic.com/2009/04/how-to-invalidate-your-own-ab-testing.html/comment-page-1#comment-381 admin Tue, 02 Jun 2009 11:00:09 +0000 http://ibehealth.com/2009/04/how-to-invalidate-your-own-ab-testing.html#comment-381 Hi Richard Thanks for dropping by and for the comment. You are right that it is a valid test, however it wasn't a valid test for what we were trying to measure. We were trying to test designs to find a better converting form, however by introducing a new varibable it wasn't possible to test how well the design affected form conversion though one A/B test run. Using different testing methodologies it would have, however this particular test wasn't set up that way. We did not mearure the importance of each element, this was straight forward, boil in the bag A/B testing. We also do multi-variant testing but not in this instance. Hi Richard

Thanks for dropping by and for the comment. You are right that it is a valid test, however it wasn’t a valid test for what we were trying to measure. We were trying to test designs to find a better converting form, however by introducing a new varibable it wasn’t possible to test how well the design affected form conversion though one A/B test run. Using different testing methodologies it would have, however this particular test wasn’t set up that way.

We did not mearure the importance of each element, this was straight forward, boil in the bag A/B testing. We also do multi-variant testing but not in this instance.

]]> By: Richard Hearne http://blog.whatclinic.com/2009/04/how-to-invalidate-your-own-ab-testing.html/comment-page-1#comment-377 Richard Hearne Sun, 31 May 2009 13:17:17 +0000 http://ibehealth.com/2009/04/how-to-invalidate-your-own-ab-testing.html#comment-377 Interesting. Not sure why this difference invalidates the test though? It's still a valid test, with the presence of the phone number being a variable tested. I'd also say that the hero shot may have been a strong variable, but as you mention opinions are more often than not wrong. Do you measure the relative importance of each element on the outcomes you derive? Rgds Richard Interesting. Not sure why this difference invalidates the test though? It’s still a valid test, with the presence of the phone number being a variable tested.

I’d also say that the hero shot may have been a strong variable, but as you mention opinions are more often than not wrong. Do you measure the relative importance of each element on the outcomes you derive?

Rgds
Richard

]]>