How do I measure the success of my personalizations?

To measure the succes of your personalizations, you can best check the the statistics. To interpret them correctly it is good to know what the statistics mean and how they are calculated. In this article you will read about:

Conversion

The conversion is calculated based on the Attribution you have configured at the personalization. An example of this is a Purchase event, when showing recommendations, or EmailOptin, when showing a newsletter overlay

Note that every attribution event is counted towards the conversion, if the event is triggered within the Attribution Window. This means that the purchase event doesn’t necessarily needs to have the product shown in the personalization. Every purchase event counts. Purchase are of course deduplicated based on the order ID’s in the events.

Available statistics

It is possible you see less statistics in your overview than discussed in this article. When you click on ‘columns’ in the personalization overview, you can add or remove different statistics:

Statistics.png

Basic statistics

It is important to know the control group statistics are not counted with the basic statistics of the personalization.

  • Visitors: The number of unique visitors who triggered the PersonalizationView event
  • Views: The total number of PersonalizationView events
  • Clicks: The total number of PersonalizationClick events
  • Conversions: The total number of conversions, calculated with the number of attribution events within the attribution window.
  • Closes: The total of PersonalizationClose events

Derived statistics

Click-trough rate (CTR): The rate of the number of clicks to the total of views

clicks / views * 100

Conversion rate: The rate of the number of conversions to the number of visitors

conversions / visitors * 100

Conversion value: The accumulated revenue generated by the conversions

total conversion revenue

Average order value: The average revenue per conversion

conversion value / conversions

Order value per visitor: The average revenue per visitor

conversion value / visitors

Statistics with a control group

Added conversion value: The added revenue of the personalization

(conversion value variant - variant visitors) * order value per visitor of the control group

Conversion rate uplift: The lift in conversions compared to the control group

(conversion rate variant - conversion rate control group) / conversion rate control group * 100

Average order uplift: The lift in order value compared to the control group

(Avg. order value variant - Avg. order value control group) / Avg. order value control group * 100

Order value per visitor uplift: The lift in order value per visitor compared to the control group

(Order value per visitor variant - Order value per visitor control group) / Order value per visitor control group * 100

Total value uplift: The conversion value of the variant, compared to the conversion value of all the variants, excluding the control group.

added conversion value variant / conversion value complete personalization (excluding control group) * 100

FAQ's statistics personalization

Why don't the statistics show?

You need a minimum of 100 views, to correctly show statistics.

Why are the statistics of Spotler Activate different than my other platforms?
Every platform has it’s own way of measuring and calculating their statistics. Frontend behavior of the customer and extensions as add blockers can already prevent one platform from tracking, while another still can track. The way of calculating can also differ per platform, while some platforms use unique visitors, others calculate with all visitors, which can really make difference in rates.
How is it possible that the revenue of the product is more than the total sales of this product?
The revenue of the personalization is calculated based on the accumulated revenue of unique orders. This does not filter on the specific product which is shown in the personalization.
Why are the statistics changing, even if the personalization is paused?
If the personalization was shown before and there are still conversions made within the attribution window, this will still be counted towards the statistics of the personalization.
What happens to the statistics if we have a frontend and backend purchase, won't they be counted twice in the statistics?
As long as the order IDs of the events are identical, Spotler Activate will deduplicate these events. Only unique orders are counted towards the statistics.
Why is there such a big difference between my variants?
Keep in mind that some settings have a big impact on the performance of your variant. For example, if you have a variant which is shown once a week, while another variant is always shown, you will see a significant difference in the statistics.