Causal inference in statistics: An overview

1 Statistics SurveysVol. 3 (2009) 96 146 ISSN: 1935-7516 inference in statistics: An overview Judea PearlComputer Science DepartmentUniversity of California, Los Angeles, CA 90095 review presents empirical researcherswith recent advancesin Causal inference , and stresses the paradigmatic shifts that must be un-dertaken in moving from traditional statistical analysis to Causal analysis ofmultivariate data. Special emphasis is placed on the assumptions that un-derly all Causal inferences, the languages used in formulating those assump-tions, the conditional nature of all Causal and counterfactual claims, andthe methods that have been developed for the assessment of such advances are illustrated using a general theory of causation basedon the Structural Causal Model (SCM) described inPearl(2000a)

2 , whichsubsumes and unifies other approaches to causation, and provides a coher-ent mathematical foundation for the analysis of causes and particular, the paper surveys the development of mathematical tools forinferring (from a combination of data and assumptions) answers to threetypes of Causal queries: (1) queries about the effects of potential interven-tions, (also called Causal effects or policy evaluation ) (2) queries aboutprobabilities of counterfactuals, (including assessmentof regret, attri-bution or causes of effects ) and (3) queries about direct and indirecteffects (also known as mediation ).

3 Finally, the paper defines the formaland conceptual relationships between the structural and potential-outcomeframeworks and presents tools for a symbiotic analysis thatuses the strongfeatures of and phrases:Structuralequation models, confounding,graph-ical methods , counterfactuals, Causal effects, potential-outcome, mediation,policy evaluation, causes of September Introduction ..972 From association to causation .. The basic distinction: Coping with change .. Formulating the basic distinction .. Ramifications of the basic distinction .. Two mental barriers: Untested assumptions and new notation.

4 101 Portions of this paper are based on my bookCausality(Pearl, 2000, 2nd edition 2009),and have benefited appreciably from conversations with readers, students, and colleagues. This research was supported in parts by an ONR grant #N000-14-09-1-0665. This paper was accepted by Elja Arjas, Executive Editor for the Pearl/ Causal inference in statistics973 Structural models, diagrams, Causal effects, and counterfactuals .. Introduction to structural equation models .. From linear to nonparametric models and graphs .. Representing interventions .. Estimating the effect of interventions .. Causal effects from data and graphs.

5 Coping with unmeasured confounders .. Covariate selection the back-door criterion .. General control of confounding .. From identification to estimation .. Bayesianism and causality, or where do the probabilitiescome from? .. Counterfactual analysis in structural models .. An example: Non-compliance in clinical trials .. Defining the target quantity .. Formulating the assumptions Instrumental variables .. Bounding Causal effects .. Testable implications of instrumental variables ..1254 The potential outcome framework .. The Black-Box missing-data paradigm .. Problem formulation and the demystification of ignorability.

6 Combining graphs and potential outcomes ..1315 Counterfactuals at work .. Mediation: direct and indirect effects .. direct versus total effects: .. Natural direct effects .. indirect effects and the Mediation Formula .. Causes of effects and probabilities of causation ..1366 Conclusions ..139 References ..1391. IntroductionThe questions that motivate most studies in the health, social and behavioralsciences are not associational but Causal in nature. For example, what is theefficacy of a given drug in a given population? Whether data canprove anemployer guilty of hiring discrimination?

7 What fraction ofpast crimes couldhave been avoided by a given policy? What was the cause of death of a givenindividual, in a specific incident? These arecausalquestions because they requiresome knowledge of the data-generating process; they cannotbe computed fromthe data alone, nor from the distributions that govern the , although much of the conceptual framework and algorithmictools needed for tackling such problems are now well established, they are hardlyknown to researchers who could put them into practical use. The main reason iseducational. Solving Causal problems systematically requires certain extensionsJ.

8 Pearl/ Causal inference in statistics98in the standard mathematical language of statistics, and these extensions are notgenerally emphasized in the mainstream literature and education. As a result,large segments of the statistical research community find ithard to appreciateand benefit from the many results that Causal analysis has produced in the pasttwo decades. These results rest on contemporary advances infour areas:1. Counterfactual analysis2. Nonparametric structural equations3. Graphical models4. Symbiosis between counterfactual and graphical survey aims at making these advances more accessible tothe general re-search community by, first, contrasting Causal analysis with standard statisticalanalysis, second, presenting a unifying theory, called structural, within whichmost (if not all)

9 Aspects of causation can be formulated, analyzed and compared,thirdly, presenting a set of simple yet effective tools, spawned by the structuraltheory, for solving a wide variety of Causal problems and, finally, demonstratinghow former approaches to Causal analysis emerge as special cases of the generalstructural this end, Section2begins by illuminating two conceptual barriers that im-pede the transition from statistical to Causal analysis: (i) coping with untestedassumptions and (ii) acquiring new mathematical these bar-riers, introduces the fundamentals of the structural theoryof causation, with emphasis on the formal representation ofcausal assump-tions, and formal definitions of Causal effects, counterfactuals and joint prob-abilities of counterfactuals.

10 These modeling fundamentals torepresent interventions and develop mathematical tools for estimating causaleffects ( ) and counterfactual quantities ( ). These tools aredemonstrated by attending to the analysis of instrumental variables and theirrole in bounding treatment effects in experiments marred by noncompliance( ).The tools described in this section permit investigators tocommunicate causalassumptions formally using diagrams, then inspect the diagram and1. Decide whether the assumptions made are sufficient for obtaining consis-tent estimates of the target quantity;2. Derive (if the answer to item1is affirmative) a closed-form expression forthe target quantity in terms of distributions of observed quantities; and3.