A/B testing

[Guillaume Quintard]

Hi there,

Here's an article about this using VCS
https://info.varnish-software.com/blog/live-ab-testing-varnish-and-vcs

If you don't use VCS, the logic is the same, but you'll need to aggregate
data from the whole cluster by yourself.

The idea is that each user gets a group, either A or B, and get a cookie to
track this. Then, you change the request of the element you are testing
according to that group  (for example, you change /button.gif to
/buttonA.gif)., and you log this access (either "AccessA" or "AccessB")
Then, when a user triggers a conversion (button is clicked, for example),
you log it (either "ConversionA" or "ConversionB").

You can then count the occurences of each, and get the conversion rate by
dividing (number of ConversionX) by (number of AccessX). The group with the
highest ratio wins.

Logging can be done using std.log() in vcl and checking varnishlog, or by
settin a header and then using varnishncsa.

-- 
Guillaume Quintard

On Wed, Apr 12, 2017 at 9:32 AM, Pinakee BIswas <pinakee at waltzz.com> wrote:

> Hi,
>
> We have been using Varnish as web accelerator for ecommerce site. I would
> like to know if it is possible to do A/B testing using Varnish. If so,
> would appreciate if you could share the steps or related documents.
>
> Thanks,
> Pinakee
>
> _______________________________________________
> varnish-misc mailing list
> varnish-misc at varnish-cache.org
> https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.varnish-cache.org/lists/pipermail/varnish-misc/attachments/20170418/fc3ca81a/attachment.html>