Control and test probability density functions
The success rate distributions for the control (blue) and test (red) groups. The distributions completely overlap if no data is entered, or if the counts for each group are identical. Success rates that fall within high density intervals are more likely than those that fall in areas of low density.
Difference between test and control
Distribution of differences in success probability between test and control groups. Obtained by simulating draws from the test and control distributions, where each sample is a possible success probability for the given group. Each control sample is paired with a test sample, and a difference sample is obtained by subtracting the control value from the test value.
The range of values contained in each central interval. For example, the first row shows the minimum and maximum values of the control, test, and difference distributions, for the 99% interval (i.e., where 99% of the values of each distribution fall – between the 0.5% and 99.5% percentiles). Note that the bounds for the difference distribution aren't necessarily the same as test minus the control bounds.