A/B test

Your game's icon and cover play an important part in generating traffic from the catalog — well-picked and eye-catching creatives are more likely to draw user attention. To gain an understanding of which icon and cover will produce the best results for your project, run an A/B test for each creative. Catalog users will automatically be split into two groups:

• 50% of users will see materials from the control group.
• 50% of users will see materials from the test group.

Wait a few days and go to the A/B icon test tab in the Yandex Games Console. There you'll find the preliminary data that show how the test icon and cover impact catalog conversion rates and in-game metrics.

Launching an A/B test

Step 1. Prepare promo materials

Prepare a new icon and cover, ensuring they meet the requirements specified in clause 8.3.

Step 2. Create a request

1. Open the Yandex Games Console and select the game.

2. Go to the A/B icon test tab.

3. Click Go to request.

Step 3. Upload files

Click Upload to attach a test icon and cover.

Step 4. Submit the game for moderation

Click Submit for moderation.

Assessing the results

The preliminary results of your testing will become available in a few days. But to gain more reliable data, we recommend running the experiment for at least a week. The A/B variants are compared based on the following metrics:

• Icon CTR in recommendations
• Cover CTR in recommendations
• Icon CTR in "My games"
• Players
• Play time per player
• Play time

If the metrics are colored in:

• Gray, the results do not demonstrate any definite effect on the user.
• Green, the results are positive and statistically significant.
• Red, the results are negative and statistically significant.

To view the results:

1. Open the Yandex Games Console and select the game.

2. Go to the A/B icon test tab.

Making a decision

1. Open the Yandex Games Console and select the game.

2. Go to the A/B icon test tab.

3. Review the testing metrics and make a decision based on the metrics' colors:

   • Green: Click Accept the experiment to use the test icon and cover as the default.
   • Red: Click Stop to end the experiment.