Accelerating A/B-Tests with Counterfactual Estimation: Reducing Variance through Policy Overlap

Online controlled experiments are the gold standard for hypothesis testing in online platforms. Notwithstanding their ubiquity, they are notoriously expensive to run, and issues of variance hamper statistical power in assessing treatment effects. While standard variance reduction techniques leverage...