Test Duration Calculator

Try out various numbers of combinations and see how they affect the length of the experiment. Keep in mind that the calculated experiment duration is an estimate only. Actual results will depend on many factors, including web visitor segmentation and conversion rate stability.

Duration Calculator


Number of test combinations: # of variations
Section1:
Section2:
Section3:
Section4:
Section5:
Section6:


Test combinations:
Web visitors per day:
% Participating in test:
% Control conversion rate:
% Expected improvement:
Test duration (days):

The Factors

Sections. Sections are the areas or elements of the web page that you desire to include in the test.
Variations. Variation is an alternative content to the existing section.
Test combinations. This is the number of of all page combinations that can be generated based on the number
     or sections and variations that you have included in the test. Fewer combinations mean less time it will take to
     run your experiment.
Web visitors per day. Provide you best estimate of the existing web traffic. All other factors being equal,
     experiments on pages with higher traffic will achieve results faster.
% Participating in test. This value indicates the percentage of visitors you want to participate in the experiment.
     A value of "50" would include only half of all visits; in effect, it halves the amount of traffic.
% Control conversion rate. This is the conversion rate the existing web page. The lower the conversion rate of
     your website, the longer your experiment will take.
% Expected improvement. If the current conversion rate is 5% and you hope to double that to 10%, then you’re
     looking for expected improvement of 100%. If you don’t have a figure in mind, keep the default of 10%.