Varioqub experiments

With Varioqub, you can run experiments on sites of different structures, ranging from single-page business cards and landing pages to complex multi-page configurations.

This tool enables you to create experiments with multiple variants and make changes to not only the text, name, and color of page elements, but also to CSS styles and HTML markup. After running an experiment, you can access indicator statistics that help you determine which version of the site users prefer.

To conduct an experiment and split your website users into samples, Varioqub uses data from Yandex Metrica.

Getting started

Before you start, install a Yandex Metrica tag on your site. Yandex Metrica is required for collecting statistics about sessions and calculating the result.

  1. Prepare the site for the experiment: make changes to your site's code.

  2. Make sure that the code works correctly.

  3. Plan out the experiment. Make sure that your changes can be applied to all site pages and that the site works properly and is accessible to users.

    The experiment collects statistics based on the behavior of real users visiting the site. With more page visits, the experiment becomes more sensitive and can detect and record smaller changes in metrics. With Yandex Metrica reports, such as Traffic, you can find out how many users visit your site.

  4. Create an experiment.

  5. See the report to draw conclusions from the experiment's results.

How Varioqub processes data

Site user groups are identified

Before running an experiment, users visiting the site are divided into groups. Metrics are tracked for these groups individually, which helps evaluate the experiment's results.

Site elements are marked up

The changes evaluated as part of the experiment are applied using flags. These are a set of “key-value” pairs. With flags, you can make changes to your site's visual and technical elements.

Example of an A/B experiment:

You want to check if changing the color of a button has any effect on the conversion rate. For the control group, the button is white, while for the experimental sample, you need it to be red or blue. Information about the color change is transmitted to the site's code. Upon receiving it, the button turns red or blue.

Learn more about transmitting data

  1. A user visits your site.

  2. The site code (front end or back end) sends a Varioqub request containing the following data:

    • Request data (user's IP, URL of the page opened by the user, UserAgent).

    • User ID (empty during the user's first visit, then stored in the _ymab_param cookie parameter for use on subsequent visits).

  3. Varioqub returns:

    • User ID to be saved in the _ymab_param cookie.

    • Set of flags that define the experimental changes.

    • Technical data for the Yandex Metrica tag.

  4. The technical data is linked to the Yandex Metrica events that the experiment uses for tracking the conversions and displaying report information.

Contact support
Next
Connecting