Statistics > Methodology
[Submitted on 27 Oct 2017 (v1), last revised 29 Jun 2020 (this version, v6)]
Title:Insights on Variance Estimation for Blocked and Matched Pairs Designs
View PDFAbstract:Evaluating blocked randomized experiments from a potential outcomes perspective has two primary branches of work. The first focuses on larger blocks, with multiple treatment and control units in each block. The second focuses on matched pairs, with a single treatment and control unit in each block. These literatures not only provide different estimators for the standard errors of the estimated average impact, but they are also built on different sets of assumptions. Neither literature handles cases with blocks of varying size that contain singleton treatment or control units, a case which can occur in a variety of contexts, such as with different forms of matching or post-stratification. In this paper, we reconcile the literatures by carefully examining the performance of variance estimators under several different frameworks. We then use these insights to derive novel variance estimators for experiments containing blocks of different sizes.
Submission history
From: Nicole Pashley [view email][v1] Fri, 27 Oct 2017 21:45:29 UTC (159 KB)
[v2] Tue, 20 Mar 2018 21:57:16 UTC (650 KB)
[v3] Thu, 26 Jul 2018 17:58:43 UTC (653 KB)
[v4] Wed, 24 Oct 2018 15:13:07 UTC (1,654 KB)
[v5] Wed, 3 Jul 2019 00:06:14 UTC (1,542 KB)
[v6] Mon, 29 Jun 2020 16:45:48 UTC (102 KB)
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
Connected Papers (What is Connected Papers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.