Finkelstein Etal Oregon 2012 PDF
Finkelstein Etal Oregon 2012 PDF
Finkelstein Etal Oregon 2012 PDF
QUARTERLY JOURNAL
OF ECONOMICS
Vol. 127 August 2012 Issue 3
Amy Finkelstein
Sarah Taubman
Bill Wright
Mira Bernstein
Jonathan Gruber
Joseph P. Newhouse
Heidi Allen
Katherine Baicker
Oregon Health Study Group
*We are grateful to Josh Angrist, Robert Avery, David Autor, Ethan
Cohen-Cole, Carlos Dobkin, Esther Duflo, Jack Fowler, Guido Imbens, Larry
Katz, Jeff Kling, John McConnell, Jon Levin, Richard Levin, Ben Olken, Alan
Zaslavsky, three anonymous referees, and numerous seminar participants for
helpful comments and advice; to Brandi Coates, Michael Gelman, John Graves,
Ahmed Jaber, Andrew Lai, Conrad Miller, Iuliana Pascu, Adam Sacarny,
Nivedhitha Subramanian, Zirui Song, James Wang, and Annetta Zhou for
expert research assistance; and to numerous Oregon state employees for help
acquiring the necessary data and for answering our many questions about the
! The Author(s) 2012. Published by Oxford University Press, on behalf of President and
Fellows of Harvard College. All rights reserved. For Permissions, please email: journals
.permissions@oup.com
The Quarterly Journal of Economics (2012), 10571106. doi:10.1093/qje/qjs020.
Advance Access publication on May 3, 2012.
1057
1058 QUARTERLY JOURNAL OF ECONOMICS
I. INTRODUCTION
In early 2008, Oregon opened a waiting list for a limited
number of spots in its Medicaid program for low-income adults,
which had previously been closed to new enrollment. The state
drew names by lottery from the 90,000 people who signed up. This
lottery presents an opportunity to study the effects of access to
public insurance using the framework of a randomized controlled
design.
that we conducted about six months after the time frame in this
article.
Our estimates of the impact of public health insurance apply
to able-bodied uninsured adults below 100% of poverty who ex-
press interest in insurance coverage, a population of considerable
policy interest. In 2011, fewer than half of the states offered
Medicaid coverage to able-bodied adults with income up to
100% of poverty absent specific categorical requirements
(Kaiser Family Foundation 2011). As part of the 2010 Patient
III. DATA
We briefly describe each data source here. Additional details
can be found in Online Appendix 1.
4. The state reviewed applications, first examining eligibility for OHP Plus
and then, if not eligible for Plus, examining eligibility for OHP Standard. Those who
did not apply during this window could not apply later (so unlike those categorically
eligible for Medicaid/OHP Plus, did not have conditional coverage if unenrolled).
OREGON HEALTH INSURANCE EXPERIMENT 1065
contacts. The response rate to the basic protocol was 36%; about
22% of those who did not respond to the basic protocol and who
received the intensive protocol responded. We calculate an effect-
ive response rate of 50%, with individuals who responded to the
intensive follow-up weighted by the inverse probability of being
included in the intensive follow-up subsample.
In Section V.C, we also briefly compare some of our estimates
from this main survey to those from two earlier, virtually identi-
cal surveys of the same population: an initial survey conducted
8. These nine lottery list variables are year of birth; sex; whether English is the
preferred language for receiving materials; whether the individuals signed them-
selves up for the lottery or were signed up by a household member; whether they
provided a phone number on sign-up; whether the individuals gave their address as
a PO box; whether they signed up the first day the lottery list was open; the median
household income in the 2000 census from their ZIP code; and whether the ZIP code
they gave is within a census-defined metropolitan statistical area.
OREGON HEALTH INSURANCE EXPERIMENT 1067
TABLE I
DEMOGRAPHIC CHARACTERISTICS OF STUDY POPULATION (CONTROL GROUP)
(continued)
Notes. All statistics are reported for control individuals only. Panel A reports the control means for prerandomization demographics taken from the lottery list (from January
and February 2008) for the whole sample (N = 45,088 for controls). Age refers to age at the end of the study period. English as preferred language indicates whether the individual
OREGON HEALTH INSURANCE EXPERIMENT
did not check a box requesting materials in a language other than English. Panel B reports control means of lottery list prerandomization demographics and survey questions for
survey responders (N = 11,933 for controls), weighted using survey weights. Household income is gross household income (in $) for 2008 (before taxes and deductions but including
any cash assistance or unemployment assistance received); it is reported in bins and we assign individuals the income at the midpoint of their bin (see Online Appendix Figure A4 for
details). For the insurance questions, we code as yes if the respondent checked that insurance type box; because the survey allows one to check multiple boxes for types of
insurance, the subgroups (OHP/Mediciad, private, and other) wont necessarily add up to any. Private insurance includes employer and privately paid insurance; Other insurance
includes Medicare and other. We treat responses for insurance as missing if the responder checked I dont know or left all checkboxes blank. We construct income relative to the
federal poverty line based on self-reported income and self-reported (total) number of household members. See Online Appendix 3 for more details.
1069
11. By contrast among a general adult population, 7% report ever being diag-
nosed with diabetes, 14% with asthma, 24% with high blood pressure, and 28% with
depression. (These numbers are based on our calculation from the 20042009
Behavioral Risk Factor Social Surveillance Survey, which uses virtually identical
questions to our survey questions.)
OREGON HEALTH INSURANCE EXPERIMENT 1071
lottery, would have also made them ineligible for OHP Standard);
13% report having private insurance.
14. The approach in this section draws heavily on Kling and Liebman (2004)
and Kling, Liebman, and Katz (2007).
15. Specifically, we stacked the data for the individual outcomes within a
domain and estimated a single regression equation that allowed the coefficients
on each covariate to vary flexibly across the outcomes and for correlation in the error
terms across outcomes.
16. The family-wise p-value corresponds to the probability of rejecting the null
hypothesis of no effect on a given outcome under the null family of hypotheses of no
1074 QUARTERLY JOURNAL OF ECONOMICS
effect on any outcome in this domain. We calculate these family-wise error rate
adjusted p-values based on 10,000 iterations of the free step-down resampling
method of Westfall and Young (1993); see Kling and Liebman (2004) or Anderson
(2008) for more detailed discussions as well as applications.
17. In the archived analysis plan we proposed presenting standardized treat-
ment effects of related outcomes within a domain separately for both survey and
administrative data, as well as a third standardized treatment effect using the
outcomes from both survey and administrative data in a given domain. Given the
major substantive and methodological differences between the two types of data, in
this article we have opted for reporting only the standardized treatment effects
across outcomes within domains for the survey and administrative data separately.
In practice this makes a negligible difference to the adjusted p-values; results avail-
able on request.
TABLE II
TREATMENT: CONTROL BALANCE
Notes. Standard errors in parentheses; per comparison p-values in square brackets. In Panel A, we analyze match and response rates. The first column reports the mean and
standard deviation for the control sample of the outcome shown in the left column. Columns (3) and (4) report estimated differences between treatments and controls for the
OREGON HEALTH INSURANCE EXPERIMENT
dependent variable shown in the left column and the sample indicated in the column heading. Specifically they report the coefficient on LOTTERY based on estimating equation (1).
All regressions include household fixed effects and cluster on household. In addition, in column (4) we include survey wave fixed effects and the interaction of survey wave fixed
effects and household fixed effects and use survey weights. The full sample (i.e., the sample used in the hospital discharge and mortality data) is used in column (3). and the entire
survey sample is used in column (4). In Panel B we report the F-statistic and p-value from regressing multiple prerandomization characteristics on LOTTERY in equation (1).
Lottery list variables are common across all three samples and consist of nine demographic variables derived from information provided at the time of lottery sign up: year of
birth; sex; whether English is the preferred language for receiving materials; whether the individual signed him- or herself up for the lottery or were signed up by a household
member; whether the individual gave his or her address as a PO box; whether he or she signed up the first day the lottery list was open; the median household income in the 2000
census from their ZIP code; whether the ZIP code given is within a census-defined MSA; and whether he or she provided a phone number on sign up. Prerandomization outcomes
are specific to the sample (we look at the hospital outcomes that we subsequently analyze for column (2), the credit report outcomes we subsequently analyze for column (3), and a
1075
few measures from each that approximate survey questions we subsequently analyze for column (4)). More detail on the prerandomization outcomes, the exact regression speci-
fications, and the results for each variable analyzed in Panel B are presented in Online Appendix 3, Table A13.
19. We use the fairly conservative procedure of Lee (2009) to bound the potential
bias arising from differential response rates between treatments and controls. Our
ability to reject the null of no effect of health insurance on health care use or finan-
cial strain is generally robust to this bounding exercise (although naturally the
magnitudes are attenuated at the lower bound), but our ability to reject the null
of no impact of health insurance on self-reported health is generally not robust to
this bounding exercise. These results are presented in Online Appendix Table A14
and discussed in Online Appendix 2.2. (This analysis was not prespecified.)
1078 QUARTERLY JOURNAL OF ECONOMICS
20. When we report standardized treatment effects for LATE estimates, they
are calculated based on the formula in equation (2) and using pooled instrumental
variables (IV) estimates of equation (3) across outcomes.
21. As we discuss in more detail in Online Appendix 1.3, the way the state
identified lottery participants in the Medicaid enrollment files may cause it to
slightly underestimate enrollment among nonselected (control) individuals, and
thus cause us to overestimate our first stage by, we estimate, 2 percentage points
or less.
22. The relative likelihood of being a complier is given by the ratio of the first
stage in the subgroup to the overall first stage (Angrist and Pishke 2009, p. 171).
These results are reported in Online Appendix Table A26.
TABLE III
FIRST-STAGE ESTIMATES
Notes. Standard errors in parentheses. Even-numbered columns report the coefficient and standard error on LOTTERY from estimating the first-stage equation (4) with the
dependent variable INSURANCE defined in the left column; odd-numbered columns report the control mean for that measure of INSURANCE. Full sample is the sample analyzed
in the hospital discharge and mortality data. All regressions include dummies for household size and adjust standard errors for household clusters. The regressions in columns (2)
and (4) also include lottery draw dummies; the regressions in column (6) also include dummies for survey wave and survey wave interacted with household size dummies, and use
survey weights. The insurance measures are taken from the Medicaid enrollment administrative data except for those labeled self-report (rows (5) through (7)) which are taken
from the survey. In the survey, respondents could report various types of insurance; we define private insurance as employer or private insurance and any insurance as
Medicaid, Medicare, employer, private, or other insurance. In rows (1) and (2), ever refers to enrollment ever during the study period, as defined in the text. In row (3), # of
1079
months refers to number of months enrolled during the study period. In row (8), insurance is measured as being on Medicaid according to the state Medicaid enrollment data on the
day the survey was returned. All outcomes are measured for the individual except that in row (10) (12) where TANF (food stamp) benefits measure total household benefits received
over the study period. For purposes of measuring the first stage, the study period is defined as ending on September 30, 2009. For the second-stage outcomes that we analyze in the
administrative data, the study period in the first stage begins with the notification date (which varies by lottery draw). For the second stage outcomes that we analyze in the survey
data, the study period in the first stage begins on the first notification date (March 10, 2008).
Downloaded from http://qje.oxfordjournals.org/ at MIT Libraries on September 24, 2012
1080 QUARTERLY JOURNAL OF ECONOMICS
bound on the first stage (and hence a lower bound on our estimate
of the LATE of Medicaid).
The survey data provide a broader measure of insurance
coverage than available in the Medicaid administrative data.
The results in row (5) indicate that the estimated increase in
self-reported any insurance coverage is very similar (within
two percentage points) to the estimated increase in self-reported
Medicaid coverage (row (7)). This suggests the lottery did not
crowd out other forms of insurance. Consistent with this, row
V. RESULTS
V.A. Health Care Utilization
1. Administrative Data. Table IV presents our primary esti-
mates using the hospital discharge data; all analyses exclude ad-
missions for childbirth.25 The most common admission is for
mental disorders (approximately 10% of admissions); skin infec-
tions, complications from diabetes, and alcohol-related disorders
are also common conditions (see Online Appendix Table A4).
Table IV, Panel A reports our estimates on admissions prob-
abilities. The LATE results suggest that insurance is associated
with an increase in the probability of any hospital admission of
2.1 percentage points (std. err. = 0.7), or about 30%. The increase
in hospital admissions appears to be disproportionately concen-
trated in the approximately 35% of admissions that do not
24. This is likely an upper estimate because the cash equivalent of food stamps
may be less than one (Hoynes and Schanzenbach 2009).
25. Regardless of lottery selection, many women in our sample would become
categorically eligible for OHP Plus for childbirth. However, Oregon does not have
presumptive Medicaid eligibility for pregnant women (Kaiser Family Foundation
2011), so it is possible that lottery selection could have an impact on
pregnancy-related hospital use. In Online Appendix Table A21, we show that our
results regarding hospital utilization are quite similar if we include admissions for
childbirth in the analysis or if we exclude women of childbearing age from the
sample (this analysis was not prespecified).
OREGON HEALTH INSURANCE EXPERIMENT 1083
TABLE IV
HOSPITAL UTILIZATION
Control
mean ITT LATE p-values
(1) (2) (3) (4)
Panel A: Extensive margin
All hospital admissions 0.067 0.0054 0.021 [0.004]
(0.250) (0.0019) (0.0074)
Admissions through ER 0.048 0.0018 0.0070 [0.265]
Notes. Standard errors in parentheses; per comparison p-values in square brackets; family-wise
p-values in curly brackets. Table investigates nonchildbirth-related hospitalizations during the time
period from notification date to August 31, 2009. All outcomes are measured unconditionally (i.e., are
not conditional on admission). Column (2) reports the coefficient and standard error on LOTTERY from
estimating equation (1) by OLS. Column (3) reports the coefficient and standard error on INSURANCE
from estimating equation (3) by IV; for the IV estimates in column (3), the endogenous variable
INSURANCE is defined as ever on Medicaid during our study period and the first stage is given in
the first row of Table III. Column (4) reports the per comparison p-value and (where applicable) the
family-wise p-value across the three different measures of utilization used to create the standardized
treatment effect. Standardized treatment effect reports results based on equation (2). All regressions
include household size fixed effect, lottery draw fixed effects, and the analogous outcome measure for
the time period from January 1, 2008, through the notification date. All standard errors are clustered on
the household. Sample consists of entire sample universe (N = 74,922).
1084 QUARTERLY JOURNAL OF ECONOMICS
26. List charges are accounting charges for rooms and procedures and do not
reflect transacted prices. They are perhaps best viewed as a price-weighted sum-
mary of treatment, albeit at somewhat artificial prices (Card, Dobkin, and Maestas
2009).
TABLE V
HEALTH CARE UTILIZATION (SURVEY DATA)
Control Control
mean ITT LATE p-values mean ITT LATE p-values
(1) (2) (3) (4) (5) (6) (7) (8)
Prescription drugs currently 0.637 0.025 0.088 [0.002] 2.318 0.100 0.347 [0.049]
(0.481) (0.0083) (0.029) {0.005} (2.878) (0.051) (0.176) {0.137}
Outpatient visits last six months 0.574 0.062 0.212 [<0.0001] 1.914 0.314 1.083 [<0.0001]
(0.494) (0.0074) (0.025) {<0.0001} (3.087) (0.054) (0.182) {<0.0001}
ER visits last six months 0.261 0.0065 0.022 [0.335] 0.47 0.0074 0.026 [0.645]
(0.439) (0.0067) (0.023) {0.547} (1.037) (0.016) (0.056) {0.643}
Inpatient hospital admissions last six months 0.072 0.0022 0.0077 [0.572] 0.097 0.0062 0.021 [0.311]
(0.259) (0.0040) (0.014) {0.570} (0.4) (0.0062) (0.021) {0.510}
Standardized treatment effect 0.050 0.173 [<0.0001] 0.040 0.137 [0.0003]
(0.011) (0.036) (0.011) (0.038)
Annual spendinga 3,156 226 778 [0.037]
(108) (371)
Notes. Standard errors in parentheses; per comparison p-values in square brackets; family-wise p-values in curly brackets. Hospital admissions exclude childbirth. Columns (2)
and (6) report the coefficient and standard error on LOTTERY from estimating equation (1) by OLS. Columns (3) and (7) report the coefficient and standard error on INSURANCE
from estimating equation (3) by IV; for the IV estimates in column (3), the endogenous variable INSURANCE is defined as ever on Medicaid during our study period and the first
stage is given in the first row of Table III. Columns (4) and (8) report the per-comparison p-value and the family-wise p-value across the four different measures of utilization used to
OREGON HEALTH INSURANCE EXPERIMENT
create the standardized treatment effect. Standardized treatment effect reports results based on equation (2). All regressions include household size fixed effects, survey wave fixed
effects, and the interaction between the two. All standard errors are clustered on the household and all regressions are weighted using survey weights. Sample consists of survey
responders (N = 23,741).
a
To calculate the implied spending effects associated with the estimated utilization effects, we use data from the 20022007 (pooled) Medical Expenditure Panel Survey (MEPS)
on expenditures of all nonelderly (age 1964) adults below 100% of poverty who are publicly insured. This gives us a total sample of over 7,500 individuals. We use their
expenditures (all inflated with the CPI-U to 2007 dollars) to calculate average expenditures per outpatient visit, average expenditures per ER visit, average expenditures per
inpatient visit (for visits not related to childbirth), and average semi-annual (six-month) spending on prescription drug. All spending is total expenditures (i.e., not just insured)
expenditures. The underlying costs are $150 per outpatient visit, $435 per ER visit, $7,523 per inpatient visit, and $156 six-month expenditure per current prescription drug; we
1085
err. = 0.0023), compared to 0.0022 (std. err. = 0.0040) in the survey data; for
number of visits in the last six months, the reduced-form estimate in the dis-
charge data is 0.0025 (std. err. = 0.0034) compared to 0.0062 (std. err. = 0.0062) in
the survey data. Self-reports do tend to overstate inpatient hospital use on average.
The average for the controls of any visit in the last six months is 0.07 in the
survey compared to 0.03 in the discharge data; for number of visits in the last
six months these numbers are 0.10 and 0.03, respectively. There is not, however,
any difference in reporting error between treatments and controls.
1088 QUARTERLY JOURNAL OF ECONOMICS
TABLE VI
COMPLIANCE WITH RECOMMENDED PREVENTIVE CARE (SURVEY DATA)
Control
mean ITT LATE p-values
(1) (2) (3) (4)
Blood cholesterol checked (ever) 0.625 0.033 0.114 [<0.0001]
(0.484) (0.0074) (0.026) {<0.0001}
Blood tested for high blood sugar/diabetes (ever) 0.604 0.026 0.090 [0.0004]
(0.489) (0.0074) (0.026) {<0.0001}
Mammogram within last 12 months (women 40) 0.298 0.055 0.187 [<0.0001]
Notes. Standard errors in parentheses; per comparison p-values in square brackets; family-wise
p-values in curly brackets. Column (2) reports the coefficient and standard error on LOTTERY from
estimating equation (1) by OLS. Column (2) reports the coefficient and standard error on INSURANCE
from estimating equation (3) by IV; for the IV estimates in column (3), the endogenous variable
INSURANCE is defined as ever on Medicaid during our study period and the first stage is given in
the first row of Table III. Column (4) reports the per comparison p-value and the family-wise p-value
across the four different preventive care measures used to create the standardized treatment effect.
Standardized treatment effect reports results based on equation (2). All regressions include household
size fixed effects, survey wave fixed effects, and the interaction between the two. All standard errors are
clustered on the household and all regressions are weighted using survey weights. Sample consists of
survey responders (N = 23,741).
28. Delinquencies are mechanically zero for the one quarter of our sample who
has no open credit over our study period.
OREGON HEALTH INSURANCE EXPERIMENT 1089
TABLE VII
FINANCIAL STRAIN (ADMINISTRATIVE DATA)
Control
mean ITT LATE p-values
(1) (2) (3) (4)
Panel A: Overall
Any bankruptcy 0.014 0.0022 0.0086 [0.106]
(0.119) (0.0014) (0.0053) {0.358}
Any lien 0.021 0.0012 0.0047 [0.406]
(0.144) (0.0014) (0.0056) {0.698}
Notes. Standard errors in parentheses; per comparison p-values in square brackets; family-wise
p-values in curly brackets. All outcomes are measured since notification date through September 2009.
Column (2) reports the coefficient and standard error on LOTTERY from estimating equation (1) by OLS.
Column (2) reports the coefficient and standard error on INSURANCE from estimating equation (3) by IV;
for the IV estimates in column (3), the endogenous variable INSURANCE is defined as ever on Medicaid
during our study period and the first stage is given in the first row of Table III. Column (4) reports the per
comparison p-value and the family-wise p-value across the different measures used to create the standar-
dized treatment effect. Standardized treatment effect reports results based on equation (2). All regressions
include household size fixed effects, lottery draw fixed effects, and the analogous outcome measure from
the February 2008 credit report data. All standard errors are clustered on the household. Sample consists
of all those matched to credit report data (N = 49,980).
TABLE VIII
FINANCIAL STRAIN (SURVEY DATA)
Control
mean ITT LATE p-values
(1) (2) (3) (4)
Any out of pocket medical expenses, 0.555 0.058 0.200 [<0.0001]
last six months (0.497) (0.0077) (0.026) {<0.0001}
Owe money for medical expenses 0.597 0.052 0.180 [<0.0001]
currently (0.491) (0.0076) (0.026) {<0.0001}
Borrowed money or skipped other 0.364 0.045 0.154 [<0.0001]
Notes. Standard errors in parentheses; per comparison p-values in square brackets; family-wise
p-values in curly brackets. Column (2) reports the coefficient and standard error on LOTTERY from
estimating equation (1) by OLS. Column (3) reports the coefficient and standard error on INSURANCE
from estimating equation (3) by IV; for the IV estimates in column (3), the endogenous variable
INSURANCE is defined as ever on Medicaid during our study period and the first stage is given in
the first row of Table III. Column (4) reports the per comparison p-value and the family-wise p-value
across the four different measures of financial strain used to create the standardized treatment effect.
Standardized treatment effect reports results based on equation (2). All regressions include household size
fixed effects, survey wave fixed effects, and the interaction between the two. All standard errors are
clustered on the household and all regressions are weighted using survey weights. Sample consists of
survey responders (N = 23,741).
29. These results imply that about 35% of those covered by OHP still have
out-of-pocket medical expenses. The control group reports, on average, $307 in
semi-annual out-of-pocket medical expenses; the LATE estimate of the impact of
insurance on these expenses is 122 (std. err. = 43), implying that those covered by
OHP average $185 in semi-annual out-of-pocket medical expenses. Our impression
from focus groups is that these reflect some combination of continued scheduled
payments on prior debts, reporting of monthly premiums as out-of-pocket medical
expenses, and perhaps including travel costs to the medical provider. It is also
possible that some individuals report out-of-pocket medical spending for other
family members (even though the question directed individuals to report only ex-
penditures on themselves) or for uncovered services, such as dental care (even
though the survey question explicitly said to exclude dental). Gross and
Notowidigdo (2011) similarly find evidence of reported out-of-pocket spending
from Medicaid recipients in the MEPS.
OREGON HEALTH INSURANCE EXPERIMENT 1093
Control
mean ITT LATE p-values
(1) (2) (3) (4)
Panel A: Administrative data
Alive 0.992 0.00032 0.0013 [0.638]
(0.092) (0.00068) (0.0027)
Panel B: Survey data
Self-reported health good/very good/excellent (not fair or poor) 0.548 0.039 0.133 [<0.0001]
(0.498) (0.0076) (0.026) {<0.0001}
Self-reported health not poor (fair, good, very good, or 0.86 0.029 0.099 [<0.0001]
excellent) (0.347) (0.0051) (0.018) {<0.0001}
Health about the same or gotten better over last six months 0.714 0.033 0.113 [<0.0001]
(0.452) (0.0067) (0.023) {<0.0001}
# of days physical health good, past 30 days* 21.862 0.381 1.317 [0.019]
(10.384) (0.162) (0.563) {0.018}
# days poor physical or mental health did not impair usual 20.329 0.459 1.585 [0.009]
activity, past 30 days* (10.939) (0.175) (0.606) {0.015}
# of days mental health good, past 30 days* 18.738 0.603 2.082 [0.001]
(11.445) (0.184) (0.64) {0.003}
Did not screen positive for depression, last two weeks 0.671 0.023 0.078 [0.001]
QUARTERLY JOURNAL OF ECONOMICS
Notes. Standard errors in parentheses; per comparison p-values in square brackets; family-wise p-values in curly brackets. Column (2) reports the coefficient and standard error
on LOTTERY from estimating equation (1) by OLS. Column (3) reports the coefficient and standard error on INSURANCE from estimating equation (3) by IV; for the IV estimates in
column (3), the endogenous variable INSURANCE is defined as ever on Medicaid during our study period and the first stage is given in the first row of Table III. Column (4)
reports the per comparison p-value and the family-wise p-value across the different measures used to create the standardized treatment effect. Standardized treatment effect reports
results based on equation (2). All regressions include household size fixed effects and standard errors are clustered on the household. The regressions in Panel A include lottery draw
fixed effects, and the dependent variable alive is measured from the notification date through September 2009 (N = 74,922). The regressions in Panel B include survey wave fixed
effects and the interaction of survey wave fixed effects with household size fixed effects, and are weighted using the survey weights (N = 23,741).
*These questions were worded to ask about number of days health not good or impaired; we switched the sign for consistency with the other measures. See Online Appendix
Figure A4 for the exact survey wording.
V.C. Health
Table IX shows our estimates of the impact of health insur-
ance on health. We have one measure of health from administra-
Control
mean ITT LATE p-values
(1) (2) (3) (4)
Panel A: Access to care
Have usual place of clinic-based care 0.499 0.099 0.339 [<0.0001]
(0.500) (0.0080) (0.027) {<0.0001}
Have personal doctor 0.490 0.081 0.280 [<0.0001]
(0.500) (0.0077) (0.026) {<0.0001}
Got all needed medical care, last six months 0.684 0.069 0.239 [<0.0001]
(0.465) (0.0063) (0.022) {<0.0001}
Got all needed drugs, last six months 0.765 0.056 0.195 [<0.0001]
(0.424) (0.0055) (0.019) {<0.0001}
Didnt use ER for nonemergency, last six months 0.916 0.0011 0.0037 [0.804]
(0.278) (0.0043) (0.015) {0.804}
Standardized treatment effect 0.128 0.440 [<0.0001]
(0.0084) (0.029)
Panel B: Quality of care
Quality of care received last six months good/very good/excellent (conditional on any) 0.708 0.043 0.142 [<0.0001]
(0.455) (0.0081) (0.027)
Panel C: Happiness
Very happy or pretty happy (vs. not too happy) 0.594 0.056 0.191 [<0.0001]
OREGON HEALTH INSURANCE EXPERIMENT
Notes. Standard errors in parentheses; per comparison p-values in square brackets, family-wise p-values in curly brackets. Column (2) reports the coefficient and standard error
on LOTTERY from estimating equation (1) by OLS. Column (3) reports the coefficient and standard error on INSURANCE from estimating equation (3) by IV; for the IV estimates in
column (3), the endogenous variable INSURANCE is defined as ever on Medicaid during our study period and the first stage is given in the first row of Table III. Column (4)
reports the per comparison p-value and the family-wise p-value across the four different measures of financial strain used to create the standardized treatment effect. Standardized
treatment effect reports results based on equation (2). All regressions include household size fixed effects, survey wave fixed effects, and the interaction between the two. All
1097
standard errors are clustered on the household and all regressions are weighted using survey weights. Sample consists of survey responders (N = 23,741).
Initial Six month Main Initial and six month Six month and main Initial and main
(1) (2) (3) (4) (5) (6)
Utilization (extensive margin) 0.0038 0.047 0.050 0.035 0.867 <0.0001
(0.0084) (0.020) (0.011)
[0.656] [0.02] [<0.0001]
Utilization (total) 0.00023 0.027 0.040 0.188 0.556 0.001
(0.0086) (0.020) (0.011)
[0.978] [0.187] [0.0003]
Financial strain 0.035 0.099 0.089 0.002 0.613 <0.0001
(0.0089) (0.020) (0.010)
[<0.0001] [<0.0001] [<0.0001]
Health 0.042 0.097 0.061 0.014 0.121 0.112
(0.010) (0.023) (0.011)
[<0.0001] [<0.0001] [<0.0001]
Access 0.047 0.075 0.119 0.163 0.026 <0.0001
(0.0078) (0.019) (0.0086)
[<0.0001] [<0.0001] [<0.0001]
QUARTERLY JOURNAL OF ECONOMICS
Notes. The analysis in this table was not prespecified. Standard errors in parentheses; per comparison p-values in square brackets. Table reports standardized treatment effects
from estimating equation (1) in three different surveys. The first column shows the results for our so-called initial survey, which occurred about 2.6 months after lottery notification;
the second column shows results for our six-month survey, which occured about 8 months after lottery notification (6 months after insurance coverage began); the third column
shows results for our main survey, which occured about 15 months after lottery notification; this is the survey that has been analyzed in prior tables. The surveys had similar
response rates and questionnaires; the six-month survey was conducted on an approximately 20percent sample of the other surveys (see Section III.D and Online Appendix 1 for
details). Columns (1), (2), and (3) report the coefficient, standard error, and p-value on LOTTERY from estimating equation (1) by OLS. Columns (3), (4), and (5) report the p-value of
the difference between various estimates. All regressions include household size fixed effects, survey wave fixed effects, and the interaction of survey wave and household size fixed
effects. Regressions based on the six-month and main surveys (columns (2) and (3)) are weighted using the survey weights for those surveys. Standard errors are clustered on the
household. N = 26,423 for the initial survey, N = 6,359 for the six-month survey, and N = 23,741 for the main survey. The individual components of the standardized treatment effects
are the same as in the earlier tables, except that health excludes the depression screen question and access excludes the personal doctor question (as these questions were not
asked in the initial survey). The reference period for the underlying questions is usually either currently or in the last six months (see prior tables for details).
30. There is also evidence of a decline in financial strain in the initial survey
that is about 40% the magnitude of the analogous measures in the later survey. This
is consistent with the fact that coverage was applied retroactively for lottery win-
ners to about one month prior to the approval date. Individuals in the initial survey
had therefore been covered retroactively for about two months, or about one-third of
the six-month look-back period. Thus, although they may not have changed their
health care utilization in the first month of coverage, the retroactive coverage for
two months had an impact on their finances.
31. Our IV or LATE estimates in Table X indicate that Medicaid increases hap-
piness by about 0.4 standard deviations. The literature on the relationship between
happiness and income tends to find that a log-point increase in income is associated
with an increase in happiness of about this magnitude (see, e.g., Sacks, Stevenson,
and Wolfers 2010, table 1).
1100 QUARTERLY JOURNAL OF ECONOMICS
32. For example, RAND found that moving from the least comprehensive in-
surance planwhich still offered considerable insurance coverage to full insurance
was associated with a 45% increase in annual spending, whereas our
back-of-the-envelope calculation suggested that relative to being uninsured,
Medicaid was associated with a 25% increase in six-month spending. The same
insurance variation in RAND also produced about a 75% increase in the number
of annual outpatient visits, compared with the 55% increase we estimated
(Newhouse and the Insurance Experiment Group 1993, p. 41). RAND found no
evidence of an impact of insurance generosity on adult self-reported general
health or adult mental health (Newhouse and the Insurance Experimenta Group
1993, p. 209).
33. In the United States, we know of only three quasi-experimental studies of
the impact of health insurance on risk exposure. Like us, these studies find that
health insurance reduces the distribution of out-of-pocket medical expenditures
(Finkelstein and McKnight 2008; Englehardt and Gruber 2011) although, unlike
us, evidence that Medicaid expansions (at a slightly higher income level) are asso-
ciated with a decline in personal bankruptcies (Gross and Notowidigdo 2011).
OREGON HEALTH INSURANCE EXPERIMENT 1101
VI.C. Conclusion
Using a randomized controlled experiment design, we exam-
ined the approximately one-year impact of extending access to
Medicaid among a low-income, uninsured adult population. We
found evidence of increases in hospital, outpatient, and drug util-
ization; increases in compliance with recommended preventive
care; and declines in exposure to substantial out-of-pocket med-
ical expenses and medical debts. We also found evidence of im-
provement in self-reported mental and physical health measures,
perceived access to and quality of care, and overall well-being.
Our results suggest that Medicaid provides benefits to this popu-
lation above and beyond the non-Medicaid alternatives that exist
through various safety-net options. These results are important
inputs into a careful cost-benefit analysis of this expansion in
Medicaid, although such an analysis would require a number of
additional assumptions that go beyond the data that this experi-
ment can provide.
1104 QUARTERLY JOURNAL OF ECONOMICS
Supplementary Material
An Online Appendix for this article can be found at QJE
online (qje.oxfordjournals.org).
REFERENCES
Alatas, Vivi, Abhijit Banerjee, Rema Hanna, Benjamin A. Olken, and
Julia Tobias, Targeting the Poor: Evidence from a Field Experiment in
Indonesia, NBER Working Paper No. 15980, 2010.
Allen, Heidi, Katherine Baicker, Amy Finkelstein, Sarah Taubman, and
Bill Wright, and the Oregon Health Study Group, What the Oregon
Health Study Can Tell Us about Expanding Medicaid, Health Affairs, 29
(2010), 14981506.
Anderson, Michael, Multiple Inference and Gender Differences in the Effects of
Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and
Early Training Projects, Journal of the American Statistical Association,
103 (2008), 14811495.
Anderson, Michael, Carlos Dobkin, and Tal Gross, The Effect of Health
Insurance Coverage on the Use of Medical Services, NBER Working Paper
No. 15823, 2010.
Angrist, Joshua, Estimation of Limited-Dependent Variable Models with
Dummy Endogenous Regressors: Simple Strategies for Empirical Practice,
Journal of Business Economics and Statistics, 19 (2001), 216.
Angrist, Joshua, Guido Imbens, and Donald Rubin, Identification and Causal
Effects Using Instrumental Variables, Journal of the American Statistical
Association, 91 (1996), 444472.
Angrist, Joshua, and Steve Pischke. Mostly Harmless Econometrics: An
Empiricists Companion (Princeton, NJ: Princeton University Press, 2009).
Avery, Robert, Paul Calem, and Glenn Canner, An Overview of Consumer Data
and Credit Reporting, Federal Reserve Bulletin, 89 (2003), 4778.
Card, David, Carlos Dobkin, and Nicole Maestas, The Impact of Nearly Universal
Coverage on Health Care Utilization: Evidence from Medicare, American
Economic Review, 98 (2008), 22422258.
, Does Medicare Save Lives? Quarterly Journal of Economics, 124 (2009),
597636.
OREGON HEALTH INSURANCE EXPERIMENT 1105