10.1093@ajae@aaz029
10.1093@ajae@aaz029
10.1093@ajae@aaz029
Probability distributions of crop yields are important for understanding technological change, the
effects of weather on crop production, and production risk. It can be difficult to model these distribu-
tions because they are time-varying and do not follow a particular parametric form. To overcome
some of the empirical challenges inherent in yield modeling, we implement a Bayesian spatial quan-
tile regression model for the conditional distribution of yields. The statistical model is semiparamet-
ric, borrows information across space and quantile level, and models the complete quantile process.
We use the model in two empirical applications where flexible modeling of the yield distribution is
essential. First, we evaluate the effects of weather across quantiles and conduct a Bayesian test of the
difference in the rate of technological change at opposite ends of the yield distribution. We then de-
rive crop insurance premium rates and compare the predictive performance of the Bayesian spatial
quantile regression to other existing approaches for modeling time-varying yield distributions.
Key words: Bayesian spatial quantile regression, crop insurance, crop yields, probability distribu-
tions, technological change, weather.
JEL codes: C11, Q10, Q16, Q54.
Quantities and prices are the fundamental yield distribution as it relates to technological
units of economic analysis. In agriculture, change and crop modification (Chavas and
crop quantities are usually reported as crop Shi 2015; Tolhurst and Ker 2015; Lusk, Tack,
yield, that is, quantity per unit of land. and Hendricks 2017), production technology
Observed yields are random variables drawn and agricultural profitability, (Griliches 1957;
from a probability distribution. Randomness Dixon 1980), the effects of climate and
in yields results from weather over the grow- weather (Roberts, Schlenker, and Eyer 2013;
ing period, invasions of pests, interactions be- Tack and Ubilava 2015; Tack, Coble, and
tween weather and pests, soil quality, and a Barnett 2018), and crop insurance programs
number of other factors. The distribution of (Ker and Goodwin 2000; Zhu, Goodwin, and
yields also changes with the introduction of Ghosh 2011; Sherrick et al. 2014). However,
new technologies and management practices. limited data on yields in any one location
Researchers pursue inference on the prob- complicates empirical modeling of the yield
ability distribution of yields as a methodolog- distribution. Yields result from a biological
ical problem or the first step in economic process of plant growth and are usually mea-
analysis. Previous work has examined the sured only once a year. In addition, yield dis-
tributions do not follow a specific parametric
form, vary over time with technological
change, and often exhibit skewness and other
A. Ford Ramsey is an assistant professor in the Department of
Agricultural and Applied Economics at Virginia Tech. The au- non-normal features. Flexibly modeling a
thor wishes to thank the editor, three anonymous referees, and time-varying distribution with potentially
seminar participants at Meiji University, Peking University, many moments changing across time is a fun-
Beijing Institute of Technology, and the 30th Triennial
Conference of the International Association of Agricultural damentally difficult problem.
Economists for their helpful comments and suggestions. This To overcome these empirical difficulties,
work was supported by the USDA National Institute of Food
and Agriculture, Hatch project 1016069. Correspondence may be
we model the probability distribution of crop
sent to: aframsey@vt.edu. yields using Bayesian spatial quantile
regression. We apply the model in two empir- normal distribution in Botts and Boles
ical situations where the economic analysis (1958), the beta distribution in Nelson and
drive losses in the federal crop insurance pro- quantile process implied by the regressions is
gram. Antle (2010) used partial-moment coherent.
of the mixture. There was a relatively close one form or another; a common assumption
agreement between the two methods. is that the parametric form of the distribution
primary interest (Buchinsky 1994; Jalan and ð4Þ bj ðs; sÞ ¼ Bm ðsÞajm ðsÞ
m¼1
Ravallion 2001; Sanglestsawai, Rejesus, and
Yorobe 2014). The quantile curves are usu-
ally estimated independently so estimates at where j ¼ 1; . . . ; K and the ajm ðsÞ are basis
extreme quantiles do not borrow information coefficients that determine the shape of the
from estimates at quantiles near the mass of quantile process. This semiparametric ap-
the distribution. Because of their indepen- proach was first proposed by Reich, Fuentes,
dent estimation, quantile curves can cross, and Dunson (2011), who used quantile re-
thus rendering the distribution of the depen- gression to study trends in summer ozone lev-
dent variable invalid. Several authors have els. Several extensions of the model have
proposed methods for the simultaneous esti- since been implemented. These include
mation of quantile curves, and empirical Reich (2012), who accounted for residual cor-
applications indicate that more precise coeffi- relation in predictors, Reich and Smith
cient estimates result (Bondell, Reich, and (2013), who considered censored data, and
Wang 2010; Tokdar and Kadane 2012). Smith et al. (2015), who developed a hierar-
Bayesian methods for quantile regression chical variant of the model.
extend to a number of domains including lim- To obtain estimates of the quantile process,
ited independent variables, instrumental vari- it is necessary to identify a suitable basis that
ables, spatial data, and regularization (Hallin, permits the monotonicity constraint on the
Lu, and Yu 2009; Lancaster and Jun 2010; Li, quantile process. Selection can be made
Xi, and Lin 2010; Benoit and Poel 2012). among a number of different basis functions,
Bayesian models are able to incorporate both including parametric quantile functions
temporal and spatial information into estima- (Reich 2012), bernstein polynomials (Reich,
tion of the quantiles while providing benefits Fuentes, and Dunson 2011), or splines (Smith
in terms of inference and the construction of et al. 2015). The R package BSquare imple-
conditional densities. Consider an extension ments non-spatial versions of Bayesian simul-
of the hypothetical random sample of equa- taneous quantile regression (Reich 2013). On
tion (1) where the response yi is observed at selecting the form of the basis, the analyst
space/time location ðs; tÞi . The time and must specify the number of basis functions. If
location of the ith observation are given by ti Bernstein polynomials are used, then
and si. The model of equation (1) can be !
modified as M
ð5Þ Bm ðsÞ ¼ sm ð1 sÞMm
m
ð3Þ qðsjXi ; si Þ ¼ Xi 0 bðs; si Þ
which is the Bernstein basis polynomial.
where the effects of the covariates now vary Equation (4) is specifically a Bernstein polyno-
by both quantile level and location. A valid mial of degree M. Bernstein polynomials have
quantile process will be non-decreasing in the proven to be popular for statistical and economic
quantile for all values of the predictors. The problems where shape constraints must be im-
advantage of a model and estimation proce- posed (Ryu and Slottje 1996; Chak, Madras, and
dure for the quantile process, as opposed to a Smith 2005; Wang and Ghosh 2014). As the
6 June 2019 Amer. J. Agr. Econ.
degree of the Bernstein polynomial goes to parameters and can include interactions and
infinity, it converges uniformly to any arbi- other transformations of variables. The spa-
(a) (b)
Rejesus et al. (2015). These authors mea- marginal impact of additional precipitation
sure temperature over the growing season or an ameliorating effect of precipitation on
(April to September) as the aggregate num- high temperatures.
ber of degree days in three bins: 0 to 9 Changes in technology and weather are
centigrade, 10 to 29 centigrade, and temporal phenomena. Identifying the effect
greater than 29 centigrade. Precipitation is of technological change requires controlling
measured cumulatively over the same pe- for weather and, conversely, identifying the
riod. The weather variables are at the effect of weather requires controlling for
county level and provide spatial variation technological change. Both Lobell,
necessary to identify weather impacts on Schlenker, and Costa-Roberts (2011) and
county-level yields. The binning of degree Tack, Coble, and Barnett (2018) made similar
days admits a piecewise linear relationship observations. Considering yields over short
between temperature and the response. periods of time where the sample of weather
Interaction terms can be added to allow for may not be representative exacerbates the
additional effects, such as a decreasing problem. The manner in which the weather
8 June 2019 Amer. J. Agr. Econ.
variables enter the model is one difference function of time and weather, the quantile
between this approach and the normal mix- process is modeled. In contrast to the mo-
4
The algorithm was implemented in R on an Intel Xeon
3
This may be because incorporating weather directly in the CPU E5-1650 at 3.60 GHz. Total time to estimate the model with
normal mixture model would require more complicated con- 5,000 draws for one crop and one state was just under 30 minutes.
straints on the components of the mixture. For instance, one We conducted sensitivity analysis with alternative priors and
would need to keep the mixture components from crossing across found that there were no changes in the substantive results of the
time and at all possible values of weather covariates. model. The MCMC algorithm appeared to converge.
Ramsey Probability Distributions of Crop Yields: A Bayesian Spatial Quantile Regression Approach 9
(a) (b)
posterior mean quantile curves with all cova- effectively borrows information from the
riates except year fixed at their sample bulk of the distribution and partially deals
means. The quantile model provides a close with the problem of outliers.
fit to the bulk of the conditional distribution In Christian County, Illinois, the number of
and weather covariates have the effect of low- and medium-degree days increases
shifting the quantiles up or down. The slopes yields at all quantiles. Consistent with other
of the quantile curves at higher quantiles studies, figure 2 shows that high-degree days
tend to be larger than the slopes at lower have a severe, negative impact on crop yields.
quantiles. Slightly more than 5% of the Precipitation over the growing season has a
observations lie above the first and last ven- small, positive impact, although we cannot
tiles. As the other predictors have been fixed, make the statement with a large amount of
this does not imply an egregious model fit. credibility given the width of the credible
Were extremely high heat included, for in- intervals. While the effect of low- and me-
stance, the fitted quantile curves would shift dium-degree days is essentially constant
down and better capture catastrophically low across quantiles, the effect of high-degree
yields. The infrequency with which cata- days is most negative at the low end of the
strophic yields occur makes the estimation at yield distribution. In contrast, precipitation
low quantiles particularly difficult. By pre- has a greater effect at low quantiles. The
venting crossing quantiles, the model impacts of the weather variables are
10 June 2019 Amer. J. Agr. Econ.
(a) (b)
Figure 3. Year and high-heating degree day effects by quantile and county
Note: Each curve represents the quantile process for a single county in the sample. (a) Year effect for soybeans, (b) high HDD effect for soybeans, (c) year ef-
fect for corn, and (d) high HDD effect for corn.
generally consistent with past literature in Figures 3b and 3d also support the earlier
terms of their signs. results on the effect of heating degree days
The plots of greatest interest, which summa- on yields in Christian County, Illinois. Across
rize differences in the time coefficient across most counties, high heating degree days have
quantiles, are figures 3a and 3c. Plotting the ef- a larger negative effect at lower quantiles of
fect of time for all counties in the sample the yield distribution. However, while most
reveals that the effect of technological change, counties have quantile processes of similar
as embodied in the coefficient associated with shape, the magnitudes vary. This suggests
the trend, is greater at higher quantiles for that researchers should allow models of
most counties in the sample. These results pro- yields to vary across counties when practical.
vide some support for the hypothesis of Lobell Flexibility is difficult to achieve in many sit-
et al. (2014) but do not constitute a statistical uations because of short time series of yields.
test. Weather has been at least partially con- Nonetheless, by bringing spatial information
trolled, so the observation of this behavior in into a model, it is possible to measure county-
spite of the weather variables lends credence specific effects.
to the idea that there are tradeoffs to be had We conduct a Bayesian test of the hypothe-
in breeding new crop varieties. The growth at sis that technological change primarily
upper quantiles is most marked for corn and impacts higher quantiles. As an example,
less evident in soybeans. consider a single county where we are
Ramsey Probability Distributions of Crop Yields: A Bayesian Spatial Quantile Regression Approach 11
interested in whether the coefficient on time the heart of the hypothesis that technological
is greater at the 75th percentile compared to change is making yields more sensitive to, for
the 25th percentile. Within each Markov instance, extreme heat. The question is
chain Monte Carlo draw, we obtain the dif- whether, conditional on given weather condi-
ference between b1 ð:75Þ and b1 ð:25Þ, and con- tions, yield distributions show increased vari-
struct a posterior distribution of the ance or negative skew.
difference. This posterior distribution is We argue that the question cannot be an-
shown in figure 2b for Christian County, swered by solely examining yields over time.
Illinois. If the posterior mean is greater than If weather is not evenly distributed over the
zero, and zero is not within the given credible sample period and a once-in-100-year (or
set (two standard deviations), then we view worse) weather event occurs near the end of
the effect of technological change as being the sample, then the difference in the rate of
different across the two quantiles. change at different quantiles could be dis-
Based on the posterior distributions of the torted. The problem is the same as if there is
coefficients, we found that 44 of 70 counties correlation between weather and time, but is
for soybeans had greater technological exaggerated because we are considering ex-
change at the 75th percentile than at the 25th treme quantiles and thus giving additional
percentile of the conditional distribution. The weight to a small portion of the data. If we
test showed this behavior in 47 out of 70 wished to only regress on time, we would
counties for corn. Table 1 shows a numerical need a long enough sample to characterize
summary of the trend coefficients at the me- the distribution of weather and the distribu-
dian and the difference in the 75th and 25th tion of yields. It is difficult to argue that 50 or
percentiles. At least in Illinois, there is some even 100 years of yield and weather data is
limited evidence that the upper mass of the adequate for this purpose.
yield distribution has grown more rapidly Figure 4 shows conditional yield distribu-
than the lower tail. In this framework, it is tions over time in two counties for soybeans
very easy to test differences between other and corn, respectively. The use of quantile re-
quantiles as well. A general finding across all gression does not exclude more formal meas-
crops was that the difference in the trend ures of the skewness and kurtosis of the
coefficients was small at quantiles above the conditional distributions. While conventional
median but large when considering quantiles skewness and kurtosis are estimated by sam-
below the median. ple averages, several quantile-based alterna-
For comparison, we fit the model with only tives exist. These alternatives replace, more
a time trend to the same sample of Illinois or less, the mean with the median for location
corn and soybean yields. Conducting the and the variance with an interquartile range
same Bayesian test, we found that 70 out of for dispersion. Based on the estimated quan-
70 counties had greater growth at higher tiles, we calculated the coefficient of quantile
quantiles. Controlling for weather has major variation, the skewness coefficient of Hinkley
impacts on the results of the test and the em- (1975), and the kurtosis coefficient of Crow
pirical implications. Our conclusion, if we did and Siddiqui (1967). Kim and White (2004)
not control for weather, would be that tech- found that the skewness and kurtosis meas-
nological change has a major impact on the ures compare favorably to classical skewness
yield distribution and is significantly increas- and kurtosis coefficients, and are robust to
ing risk in all counties. On controlling for outliers.
weather, the conclusion is radically different Table 2 shows summary statistics for the
and much weaker. This difference strikes at estimated coefficient of quantile variation,
12 June 2019 Amer. J. Agr. Econ.
(a) (b)
skewness, and kurtosis, using quantile-based distribution. In all counties, the median yield
measures for the last year in the sample. The increased over time and the variance of the
kurtosis measure is normalized so that a data has increased. Mean measurements of
value of zero corresponds to a normal skewness and kurtosis across the counties
Ramsey Probability Distributions of Crop Yields: A Bayesian Spatial Quantile Regression Approach 13
indicate negative skew and excess kurtosis covariates in the model or including a longer
for corn. The coefficient of quantile variation sample of yields so that the distribution of
40
Yield (Bu./Ac.)
30
20
Figure 5. Conventional estimate of the quantile process for Brown County, Illinois soybeans
levels at which we conduct the regressions, it ð10Þ EðindemnityÞi ¼Pðyi < k^yi Þ
is not difficult to find crossing quantiles when
estimating the quantile process. ðk^yi Eðyi jyi < k^yi ÞÞ
Federal crop insurance policies are avail-
able at farm and aggregate levels. Area yield where yi is the realized yield. The expected
insurance is based on county-level yields, and indemnity is the product of the probability of
although farm-level insurance is more popu- a loss occurring multiplied by the expected
lar, area-based policies protect against moral loss given that a loss occurs. In practice, the
hazard and adverse selection (Miranda 1991). expected indemnity under an area-yield pol-
For an area yield insurance policy, the pre- icy is scaled by a specified price. Because the
mium rate is given by price is not stochastic, and therefore not ger-
mane to this rating exercise, we do not con-
ð8Þ ratei ¼ EðindemnityÞi =liabilityi sider it here. The loss ratio for a portfolio of
policies is given by
where both the indemnity and liability de-
pend on the coverage level. The subscript i P
N
maxðk^yi yi ; 0ÞÞ
refers to the county over which the policy is
written. With a given coverage level ð11Þ loss ratio ¼ i¼1
P
N
k 2 ð0; 1Þ, the liability under the policy is ratei k^yi
i¼1
complete yield series from 1950 to 2015.6 favorable loss ratios over the period; they are
Because recent changes to federal crop insur- close to one in most cases. The frequentist
ance (such as the supplemental coverage op- quantile regressions tend to produce loss ratios
tion) now allow for higher coverage levels, that are lower than those produced by the
we calculate premium rates for 70% and 90% Bayesian spatial model. We did not check for
coverage. The estimated Bayesian spatial crossing of the frequentist regressions, so it
quantile regression is could be that some of the estimated distribu-
tions are invalid. The average loss ratios of the
ð12Þ qðsjX i ; si Þ ¼ b0 ðs; si Þ þ b1 ðs; si Þt: normal mixture model are close to those esti-
mated using the Bayesian quantile regressions.
We use the same prior distributions as in However, examination of the loss ratios does
the first application and take the same not constitute a statistical test of the accuracy
amount of draws when running the MCMC of the models; it only suggests that either of the
algorithm. The Bayesian spatial quantile re- models could be a reasonable approach in
gression model is estimated in each state sep- terms of controlling outlays under the program.
arately.7 For the frequentist quantile Similar to Park, Brorsen, and Harri (2019),
regressions, we estimate the quantile process Ker, Tolhurst, and Liu (2016), and as origi-
at all possible quantiles that the data permits. nally developed by Ker and McGowan (2000),
The densities are constructed using adaptive we compare methods using a rating game. The
kernel density estimation fitted to projected rating game is an out-of-sample exercise
values from the quantile regressions. We esti- intended to assess the predictive performance
mate the normal mixture model as in Tolhurst of the methods. In the game, a private insurer
and Ker (2015). The premium rate is calcu- cedes a certain number of policies in its port-
lated in each county for the years between folio to the government. This mimics the
2001 and 2015. For example, data from 1950 Standard Reinsurance Agreement that gov-
to 2014 are used to estimate the premium rate erns the relationship between private insurers
for 2015. The estimation of the premium rate and the federal government in the federal
for 2014 uses data from 1950 to 2013. crop insurance program. The private insurer
Table 3 shows the average loss ratio across has an internal rating system that may be
all years for each crop/state/coverage/model more accurate than the rating system
combination. The rates generated from the employed by the government in pricing crop
Bayesian spatial quantile regressions have insurance policies. This leads to a decision
rule for the insurer in deciding whether to
cede or retain a policy. If the insurer’s rate is
6
For corn, the sample includes 76 counties in Illinois, 65 in higher than the government’s rate, the policy
Indiana, 95 in Iowa, 58 in Minnesota, and 71 counties in is ceded as the government is underestimating
Nebraska. For soybeans, the sample includes 85 counties in
Illinois, 64 in Indiana, 96 in Iowa, and 56 in Minnesota.
the risk inherent in the policy. Likewise, if the
7
We might be able to obtain better estimates by varying the insurer’s rate is lower than the government’s
priors by state. There might also be gains in running the model rate, then the policy is retained.
over several states and incorporating more spatial information.
However, the 48 hours of computational time required to pro- The results of a randomization test sug-
duce the estimates in this section was already high. gested in Ker, Tolhurst, and Liu (2016) are
16 June 2019 Amer. J. Agr. Econ.
shown in table 4. For all state/crop/coverage The difference is statistically significant at the
combinations, the table gives the percentage 5% level in six out of ten states. The insurer
of policies retained by the insurer using can obtain rents at all state/coverage combina-
Bayesian spatial quantile regression com- tions for soybeans, of which seven out of eight
pared to the government using the normal are statistically significant at the 5% level.
mixture model. The case where the govern- Good performance in the lower tail does not
ment operates using frequentist quantile re- imply worse performance in the bulk of the
gression can be seen in table 5. Using the distribution; the Bayesian spatial model is
decision rule and the government rating found to be statistically significant in more
method, we calculate loss ratios for the insurer cases at the 90% coverage level.
and the government. To construct the p-val- The Bayesian spatial quantile regression
ues, we select a random sample of policies also performs well against the frequentist
with the size of the sample equal to the num- quantile regressions. Insurers extract rents in
ber of policies retained by the insurer. The loss eight out of ten state/coverage combinations
ratio is calculated from the random sample for corn. The results are statistically signifi-
and repeating this procedure 5,000 times yields cant in three out of ten state/coverage combi-
5,000 loss ratios. These loss ratios are used to nations. Similar results hold for soybeans
construct the distribution of loss ratios under with all state/coverage combinations generat-
the null hypothesis that the decision rule for ing rents and five out of eight being statisti-
the insurer has no effect. The p-value is the cally significant. The differences between the
area under this distribution of loss ratios and two forms of quantile regression are gener-
to the left of the estimated insurer loss ratio. ally smaller than those between the quantile
Compared to the normal mixture model regression and normal mixture. We expect
and the frequentist quantile regression, the this to be the case because we are using the
Bayesian spatial quantile regression performs approximate approach of Reich, Fuentes, and
much better in the lower tail of the distribu- Dunson (2011) to estimate the Bayesian spa-
tion. Against the normal mixture, insurers can tial model. This approach uses frequentist
extract economic rents in all states and at all estimates to inform the Bayesian MCMC
coverage levels for corn, with the exception of algorithm.
Minnesota, which requires 70% coverage.8 The results of the insurance pricing exer-
cise and rating game show that Bayesian spa-
tial quantile regression can be a potent model
8
Over the 15 years, there were actually zero losses at the for constructing conditional distributions.
70% coverage level in all counties in Minnesota. Therefore, we This has to do with the spatial aspects of the
cannot calculate a p-value for tables 4 and 5.
Ramsey Probability Distributions of Crop Yields: A Bayesian Spatial Quantile Regression Approach 17
model and the ability of the model to more distribution of yields is central to the eco-
accurately capture behavior at extreme quan- nomic analysis.
tiles. The fact that the Bayesian spatial model In the first application, we use Bayesian
offers competitive performance when com- spatial quantile regression to determine if the
pared with the normal mixture suggests that effects of weather are different across quan-
borrowing information across both space and tiles of the yield distribution, and to test the
quantile level is important. The spatial com- hypothesis that technological change occurs
ponent is not the only feature of the model faster at upper quantiles. We find that the
that results in these favorable results. But as impacts of some weather covariates vary
we have not separated the spatial modeling across quantiles. In particular, the negative
and modeling of the individual yield distribu- effects of extreme heat (as measured by heat-
tions, we cannot say which of the two facets ing degree days) are largest in the lower tail
of the Bayesian spatial model is more of the conditional yield distribution. We also
important. find significant variation in the effects of
weather across counties, implying that yield
modelers should consider spatially-varying
effects in their analyses. After controlling for
Conclusion weather in the quantile regressions, a
Bayesian test of the trend coefficients yields
Limited data in most locations, spatial corre- some evidence that technological change has
lation among yields, and the need for a statis- a greater impact at upper quantiles of the
tical model that allows for flexibility confront yield distribution. We argue that this test con-
empirical applications using a probability trolling for weather is more appropriate be-
distribution of crop yields. The principal cause it tests for differences in technological
problem is that the distribution of yields is change conditional on given weather condi-
time-varying and has an unknown form. For tions. The technology trend is much less pro-
economic analysis, where parameters of the nounced when compared with the results of
model facilitate inference, the model must Tolhurst and Ker (2015). As a result, the
also yield easily interpreted results. The ten- yield distributions are less skewed when con-
sion is between model flexibility on the one ditioned on weather.
hand and usability on the other. We suggest We then price area-yield crop insurance
Bayesian spatial quantile regression as an ap- policies using the Bayesian spatial quantile
propriate model for the yield distribution and regression. Data are limited in each county
apply it in two empirical settings where the and limited at extreme quantiles of the yield
18 June 2019 Amer. J. Agr. Econ.
Goodwin, B.K., and A.P. Ker. 1998. Kurtosis. Finance Research Letters 1 (1):
Nonparametric Estimation of Crop Yield 56–73.