2013/05/17

A/B testing for lazies

Every time there is a question hanging in the air people call for A/B tests to find out the right solution. Isn't that a bit lazy? You don't have the time to test out everything with A/B tests, considering they aren't as easy to do as you think.

My answer is always do what best practice is from successful online games. So you simply take a bunch of them and look how they do it. Most of the long running ones have tested the hell out of their systems, so why don't you take their lesson and simply steal their key findings? They have it right there for you, online, in their game.

So there was a question recently if its better to sort your premium currency packages low to high or high to low. The answer is now really obvious if you follow my advice. You don't need to run an A/B test to find out.

You can learn so much by looking at good f2p games and what they do. Some of them even have fan made statistic sites which you can use how successful they are in various countries, popular items or vehicles. Simply look for them.

So open your eyes. All knowledge is right there in front of you, a simple search away.

2 comments:

Tehmina Cyclewala said...

Hi Teut

This is a nice thought. Even the HIPPOS would be very happy

Can you please elaborate more how to get competitive intelligence for knowing the results of what has already been tested.

This would also help understand market trends

Thanks and Regards

Tehmina

Teut said...

Tehmina,

you simply go to the successful f2p game companies and their largest titles. Considering some of them run for years now you can assume they have tested all sorts of things.

Of course they might be lazy and not test it, so you basically take 3 or 4 of those large games and compare their results.

So my example how to sort premium currency packages you will find that 90% of them sort them from low price to high price.

So the question is basically answered.

If you monitor their games items you can even see what sells as the non sellers will phase out over time and new ones will be adaptions from old sellers already. But thats taking it too far for this blog.