The Impact of High Frequency Rapid Viral Antigen Screening On COVID-19 Spread and Outcomes: A Validation and Modeling Study
The Impact of High Frequency Rapid Viral Antigen Screening On COVID-19 Spread and Outcomes: A Validation and Modeling Study
The Impact of High Frequency Rapid Viral Antigen Screening On COVID-19 Spread and Outcomes: A Validation and Modeling Study
1 The impact of high frequency rapid viral antigen screening on COVID-19 spread
4 Authors: Beatrice Nash1,2*, Anthony Badea1,3*, Ankita Reddy1,4*, Miguel Bosch1,5, Nol
5 Salcedo1, Adam R. Gomez1, Alice Versiani6, Gislaine Celestino Dutra Silva6, Thayza
6 Maria Izabel Lopes dos Santos6, Bruno H. G. A. Milhim6, Marilia M. Moraes6, Guilherme
7 Rodrigues Fernandes Campos6, Flávia Quieroz6, Andreia Francesli Negri Reis6, Mauricio
11
12 Affiliations:
1
13 E25Bio, Inc., Cambridge, MA, USA
2
14 Department of Computer Science, Harvard University School of Engineering and Applied
20 Brazil
7
21 Division of the Nutrition Epidemiology and Data Science, Friedman School of Nutrition
1
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
9
24 Department of Immunology and Infectious Diseases, Harvard T.H. Chan School of Public
26
‡
27 Corresponding Author. BBH, email: bbherrera@e25bio.com
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
2
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
47 Abstract
50 coupled with clinical data from a rapid antigen test, to predict the impact of frequent rapid
52 specimens, we demonstrate that the sensitivity and specificity of the rapid antigen test
53 compared to quantitative real-time polymerase chain reaction (qRT-PCR) are 84.7% and
54 85.7%, respectively; moreover, sensitivity correlates directly with viral load. Based on
55 COVID-19 data from three regions in the United States and São José do Rio Preto, Brazil,
56 we show that high frequency, strategic population-wide rapid testing, even at varied
58 fraction of the cost of nucleic acid detection via qRT-PCR. We propose large-scale
61
62
63
64
65
66
67
68
69
3
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
70 INTRODUCTION
72 healthcare systems, and global economies. As of 1 September 2020, there have been
73 more than 25.5 million confirmed cases globally with more than 850,000 confirmed
74 deaths1. However, these numbers and the current mapping of disease spread present an
75 incomplete picture of the outbreak largely due to the lack of adequate testing, particularly
76 as undetected infected cases are the main source of disease spread2–7. It is estimated
77 that the reported detection rate of actual COVID-19 cases is only 1-2%5. As of September
78 2020, the United States and Brazil remain the top two countries with the highest number
79 of COVID-19 cases and deaths worldwide. As countries begin to re-open their economies,
80 a method for accessible and frequent surveillance of COVID-19, with the necessary rapid
82 The current standard of care rightfully places a strong focus on the diagnostic limit
83 of detection, yet frequently at the expense of both cost and turnaround time. This situation
86 standard method for clinical diagnosis, with high sensitivity and specificity, but these tests
87 are accompanied by the need for trained personnel, expensive reagents and
89 sometimes require a week or longer to complete and return the results to the patient.
90 During this waiting period the undiagnosed individual may spread the infection and/or
91 receive delayed medical treatment. Moreover, due to the cost and relative inaccessibility
4
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
95 asymptomatic COVID-19 cases as well as a variation in viral load within and between
96 individuals at different time points, suggesting the need for more frequent testing for
97 informative surveillance.
102 accuracy before they can reach the market8. In countries such as India, where the qRT-
103 PCR resources would not be sufficient to cover monitoring of the population, the use of
104 rapid antigen tests is well underway9,10. In early May 2020, the United States Food and
105 Drug Administration (FDA) authorized the first antigen test for the laboratory detection of
106 COVID-19, citing a need for testing beyond molecular and serological methods. Antigen
107 testing detects the viral proteins rather than nucleic acids or human antibodies, allowing
108 for detection of an active infection with relative ease of sample collection and assay.
109 These rapid assays – like other commercially-available rapid antigen tests - can be mass-
110 produced at low prices and be administered by the average person without a laboratory
111 or instrumentation. These tests also take as little as 15 minutes to determine the result,
112 enabling real-time surveillance and/or diagnosis. Although antigen tests usually perform
113 with high specificities (true negative rate), their sensitivity (true positive rate) is often lower
114 when compared to molecular assays. While qRT-PCR can reach a limit of detection as
5
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
115 low as 102 genome copies per mL11, rapid antigen testing detects viral protein that is
116 assumed to correlate with approximately 105 genome copies per mL.
117 We hypothesize that frequent antigen-based rapid testing even with lower
118 sensitivities compared to qRT-PCR - along with appropriate quarantine measures - can
119 be more effective at decreasing COVID-19 spread than less frequent molecular testing of
120 symptomatic individuals. Keeping in mind the realities of daily testing in resource-limited
121 regions, we also hypothesize that testing frequency can be adjusted according to the
122 prevalence of the disease; that is, an uptick in reported cases should be accompanied by
123 more frequent testing. During the viral incubation period, peak infectivity correlates with
124 a high viral load that can be detected by either qRT-PCR or rapid antigen testing12–15.
125 Rapid tests thus optimize diagnosis for the most infectious individuals. Studies also point
126 to the relatively small window of time during an individual’s incubation period in which the
128 In this study we report the development and clinical validation of a direct antigen
129 rapid test for detection of SARS-CoV-2 spike glycoprotein using 121 retrospectively
130 collected nasopharyngeal swab specimens. Using the clinical performance data, we
131 develop a modeling system to evaluate the impact of frequent rapid testing on COVID-19
132 spread and outcomes using a variation of a SIR model, which has been previously used
134 states and testing protocols to examine the effects of different testing regimes. This model
135 distinguishes between undetected and detected infections and separates severe cases,
136 specifically, those requiring hospitalization, from those less so, which is important for
137 disease response systems such as intensive care unit triaging. We simulate COVID-19
6
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
138 spread with rapid testing and model disease outcomes in three regions in the United
139 States and São José do Rio Preto, Brazil - the site of the clinical validation study - using
140 publicly available data. To date, COVID-19 modeling describes the course of disease
141 spread in response to social distancing and quarantine measures, and a previous
142 simulation study has shown that frequent testing with accuracies less than qRT-PCR,
143 coupled with quarantine process and social distancing, are predicted to significantly
144 decrease infections12,16,22–26. This is the first modeling system using publicly-available
145 data to simulate how potential public health strategies based on testing performance,
146 frequency, and geography impact the course of COVID-19 spread and outcomes. Our
147 findings suggest that a rapid test, even with sensitivities lower than molecular tests, when
148 strategically administered 2-3 times per week, will diminish COVID-19 spread,
149 hospitalizations, and deaths at a fraction of the cost of nucleic acid testing via qRT-PCR.
150
151 RESULTS
152 Direct Antigen Rapid Test Accuracy Correlates with Viral Load Levels
153 Rapid antigen tests have recently been considered a viable source for first-line
154 screening, although concerns about the accuracy of these tests persist. We developed a
155 direct antigen rapid test in a lateral flow dipstick format for the detection of the spike
156 glycoprotein from SARS-CoV-2 in nasopharyngeal swab specimens. Of the total number
158 CoV-2 RNA-dependent RNA polymerase (RdRp), nucleocapsid (N), and envelope (E)
7
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
160 The overall sensitivity and specificity of the rapid antigen test was 84.7% and
161 85.7%, respectively (Table 1). Our data demonstrate that the sensitivity of our test is
162 positively correlated to the viral load level (Fig. 1, Table 2). The rapid test result was
163 compared to the qRT-PCR cycle threshold (Ct) value measured across RdRp, N, and E
165
166
Table 1. Clinical validation summary for the SARS-CoV-2 direct antigen rapid test (DART)
evaluated using 121 retrospectively collected patient nasopharyngeal swab specimens.
167
All Data Summary
qRT-PCR 95% Confidence
(gene average) Interval
DART
Positive
- 11 42 53 Predictive 89.7% 86.2% 93.2%
Value
Negative
Total 72 49 121 Predictive 79.2% 73.6% 84.9%
Value
Overall
85.1% 82.0% 88.3%
Agreement
168
169
170
171
172
173
174
175
8
177
176
Percentile 95% 95%
Positive Negative
Cycle Positives in Confidence Confidence
Total DART DART Predictive Predictive Overall
threshold Total Sensitivity Interval Specificity Interval Prevalence
Cases Positives Negatives Value Value Agreement
(Ct) value Positive (semi- (semi-
(PPV) (NPV)
Population interval) interval)
< 10 50 1 49 98.6% 100.0% 30.0% 85.7% 4.9% 12.5% 100.0% 2.0% 86.0%
< 15 65 16 49 77.8% 100.0% 3.9% 85.7% 4.9% 69.6% 100.0% 24.6% 89.2%
< 20 90 41 49 43.1% 97.6% 2.8% 85.7% 4.9% 85.1% 97.7% 45.6% 91.1%
< 25 108 59 49 18.1% 96.6% 2.5% 85.7% 4.9% 89.1% 95.5% 54.6% 91.7%
< 30 121 72 49 2.8% 84.7% 4.1% 85.7% 4.9% 89.7% 79.2% 59.5% 85.1%
RdRp gene
< 35 121 72 49 0.0% 84.7% 4.1% 85.7% 4.9% 89.7% 79.2% 59.5% 85.1%
< 10 49 0 49 100.0% - - 85.7% 4.9% 0.0% 100.0% 0.0% 85.7%
< 15 61 12 49 83.3% 100.0% 5.1% 85.7% 4.9% 63.2% 100.0% 19.7% 88.5%
< 20 90 41 49 43.1% 97.6% 2.8% 85.7% 4.9% 85.1% 97.7% 45.6% 91.1%
< 25 109 60 49 16.7% 91.7% 3.5% 85.7% 4.9% 88.7% 89.4% 55.0% 89.0%
N gene
< 30 120 71 49 1.4% 85.9% 4.0% 85.7% 4.9% 89.7% 80.8% 59.2% 85.8%
< 35 121 72 49 0.0% 84.7% 4.1% 85.7% 4.9% 89.7% 79.2% 59.5% 85.1%
< 10 54 5 49 93.1% 100.0% 10.8% 85.7% 4.9% 41.7% 100.0% 9.3% 87.0%
< 15 81 32 49 55.6% 100.0% 2.0% 85.7% 4.9% 82.1% 100.0% 39.5% 91.4%
< 20 91 42 49 41.7% 97.6% 2.7% 85.7% 4.9% 85.4% 97.7% 46.2% 91.2%
< 25 114 65 49 9.7% 90.8% 3.5% 85.7% 4.9% 89.4% 87.5% 57.0% 88.6%
SARS-CoV-2 qRT-PCR
E gene
< 30 121 72 49 0.0% 84.7% 4.1% 85.7% 4.9% 89.7% 79.2% 59.5% 85.1%
< 35 121 72 49 0.0% 84.7% 4.1% 85.7% 4.9% 89.7% 79.2% 59.5% 85.1%
< 10 51 2 49 97.2% 100.0% 20.9% 85.7% 4.9% 22.2% 98.9% 3.9% 86.3%
< 15 72 23 49 68.1% 100.0% 2.8% 85.7% 4.9% 76.7% 98.9% 31.9% 90.3%
< 20 90 41 49 43.1% 97.6% 2.8% 85.7% 4.9% 85.1% 96.6% 45.6% 91.1%
< 25 111 62 49 13.9% 91.9% 3.4% 85.7% 4.9% 89.1% 89.4% 55.9% 89.2%
< 30 121 72 49 0.0% 84.7% 4.1% 85.7% 4.9% 89.7% 79.2% 59.5% 85.1%
Gene Average
< 35 121 72 49 0.0% 84.7% 4.1% 85.7% 4.9% 89.7% 79.2% 59.5% 85.1%
It is made available under a CC-BY-NC-ND 4.0 International license .
9
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
178
Figure 1. Performance of direct antigen rapid test (DART) for the detection of SARS-CoV-2 in
121 retrospectively collected patient nasopharyngeal swab specimens. Percentile Positive
ranks the samples in order of high Cycle threshold (Ct) value to low Ct value. DART sensitivity
is determined by calculating true positive agreement to qRT-PCR; the plot uses an axb+c fit
and 95% confidence intervals for the sensitivity. Shown are the percentile positive cases of
the total positive population conditioned to qRT-PCR Ct for RdRp (RNA-dependent RNA
polymerase), N (nucleocapsid), and E (envelope) genes, and the average of these genes.
179
180 Ct value cutoffs represent the number of qRT-PCR cycles at which generated
181 fluorescence crosses a threshold during the linear amplification phase. The x-axis of
182 Figure 1 describes the percentile positives in the total positive population. Percentile
183 Positives ranks the samples in order of high qRT-PCR Ct value to low. In other words,
184 the higher the percentile, the more “positive” because fewer qRT-PCR cycles are required
185 for gene detection. Because the Ct value is a variable unit based upon qRT-PCR protocol
186 and instrumentation, we evaluated sensitivity against the percentile of cases across Ct
187 values.
188 As the percentile positive increases, the sensitivity between the rapid test and the
10
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
190 positive for the gene average detection. Significantly, even at percentile positives
191 between 0% and 68.1%, the sensitivity remains above 80%. Taken together, the clinical
192 data shows that the rapid antigen test performs with increasing accuracy for individuals
193 with a higher viral load, and are thus the most infectious13–15.
194
197 of the classical SIR model in order to expand our clinical validation study and to
198 understand the effects of using frequent rapid tests such as the rapid antigen test on
199 COVID-19 outbreak dynamics. The changes we make to the basic model to encompass
200 the unique characteristics of the COVID-19 pandemic are similar to those presented by
201 Giordano et al.16 (Fig. 2). The differential equations governing the evolution of the
202 SIDHRE-Q model and descriptions of the parameter values are provided in the material
204
205
206
11
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
207
Figure 2. Graphical scheme displaying the relationships between the stages of quarantine
and infection in SIDHRE-Q model: Q-U, quarantine uninfected; S, susceptible (uninfected); I,
infected undetected (pre-testing and infected); D, infected detected (infection diagnosis
through testing); H, hospitalized (infected with life threatening symptom progression); R,
recovered (healed); E, extinct (dead); and Q-R, quarantine recovered (healed but in
quarantine by false positive testing).
209
210 An individual that begins in S may either transition to a Quarantine Uninfected (Q-
211 U) state via a false positive result or to an Infected Undetected (I) state via interaction
212 with an infected individual. Should an individual in S move into Q-U, they are quarantined
213 for 14 days before returning to S, a time period chosen based on current knowledge of
214 the infectious period of the disease. One could also conceive of an effective strategy in
215 which individuals exit quarantine after producing a certain number of negative rapid tests
216 in the days following their initial positive result or confirm their negative result using qRT-
217 PCR.
12
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
218 Given that those diagnosed are predominantly quarantined, individuals in I interact
219 more with the S population than do those in Infected Detected (D). Therefore, the
220 infectious rate for I is assumed to be significantly larger than for D. Furthermore, a region’s
221 ability to control an outbreak is directly related to how quickly and effectively people in I
222 test into D, reducing their infectiousness through quarantine. This study, in particular,
223 highlights the critical role frequency of testing, along with strict quarantine, has in
224 mitigating the spread of the disease and provides specific testing strategies based on
226 In this model, we assume that individuals receive a positive diagnosis before
227 developing severe symptoms and that those with symptoms severe enough to be
228 potentially fatal will go to the hospital. If an individual develops symptoms, we assume
229 they are tested daily until receiving a positive result; hence, before severe symptoms
230 develop, they will be diagnosed with high probability. Those who do not develop
231 symptoms are tested according to the frequency of tests administered to the general
232 population. Therefore, there is no modeled connection between I and H or between I and
233 E. Removing these assumptions would have negligible impact on the results as these
235 Should an individual test positive and transition to D, they may either develop
236 serious symptoms requiring care or recover. Those who develop serious symptoms and
237 transition to state H will then transition to either R or E. The recovered population is
238 inevitably tested, as infected individuals may recover without being detected. Therefore,
239 the Quarantined Recovered (Q-R) state is introduced with the same connections to R as
240 the connections between S and Q-U. Though the reinfection rate of SARS-CoV-2 has
13
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
241 been a point of recent debate, it is assumed that the number of re-infected individuals is
242 small27–31. Therefore, individuals cannot transition from R to S, hence the separately
245 simulations, we tested additional states, such as those in the SIDARTHE model, which
246 include distinctions between symptomatic and asymptomatic cases for both detected and
247 undetected populations16. Incorporating information about the correlations between viral
248 load and infectivity and sensitivity were also considered. Altogether, our modeling system
249 has been well tuned to predict the impact of high frequency rapid testing on COVID-19
251
254 In order to demonstrate how strategies could affect the disease spread in different
255 geographies and demographics, we used surveillance data obtained from regions of
256 varying characteristics: the state of Massachusetts (MA), New York City (NYC), Los
257 Angeles (LA), and São José do Rio Preto (SJRP), Brazil, the site of the rapid antigen test
258 clinical validation study. These regions are also selected in our study due to the readily
259 available surveillance data provided by the local governments. We fit the model to the
260 data from each region starting 1 April 2020. At this time point the disease reportedly is
261 most advanced in NYC and least advanced in SJRP, Brazil with estimated cumulative
14
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
263 After calibrating the SIDHRE-Q model, the disease spread is observed with varying
264 validated rapid antigen test performances and frequencies (Fig. 3). Sensitivity (the ratio
265 of true positives to the total number of positives) and specificity (the ratio of true negatives
266 to the total number of negatives) compared to gold-standard qRT-PCR were used as
268 The rapid test frequency is varied while maintaining an accuracy of 80% sensitivity
269 and 90% specificity, comparable to our clinical data collected in SJRP, Brazil. These
270 testing scenarios are then compared to symptomatic testing, in which individuals receive
271 a rapid test only when presenting symptoms, via either a rapid test or qRT-PCR. Since
272 the primary testing regiment deployed in MA, LA, NYC and SJRP, Brazil is qRT-PCR-
273 based and focused on symptomatic individuals, the symptomatic testing protocol via qRT-
274 PCR is directly estimated from the data to be the rate 𝜈 (Table 5).
275 The difference between the qRT-PCR and rapid test simulations (red and orange
276 lines, respectively) is therefore only sensitivity of testing (Fig. 3). We assumed that test
277 outcome probability is a function only of whether an individual is infected and independent
278 of other factors; one can consider this a lower bound on effectiveness of a strategy, as
279 sensitivity and infectivity are often positively correlated with antigen testing.
15
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
280
16
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
282
283 To better understand the effect of rapid testing frequency and performance on
284 healthcare capacity and mortality rates, we simulate the testing strategy with 30%-90%
285 sensitivity each with 80% or 90% specificity against the symptomatic testing strategy.
286 Table 3 describes the different test performances implemented in the model matched with
290
17
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
292 reduced infections, simultaneous hospitalizations, and total deaths when compared to the
293 purely symptom-based testing regiments, and infections, hospitalization, and death were
294 reduced as frequency increased. Although testing every day was clearly most effective,
295 even testing every fourteen days with an imperfect test gave an improvement over
296 symptomatic testing with qRT-PCR. While the strategy works best when implemented at
297 the very beginning of an outbreak, as demonstrated by the results in SJRP, Brazil, it also
298 works to curb an outbreak that is already large, as demonstrated by the results in NYC.
299 The difference between frequencies is more noticeable when the testing strategy is
300 applied to the outbreak in NYC, leading us to hypothesize that smaller outbreaks require
301 a lower testing frequency than larger ones; note the difference between the dependence
302 on frequency to curb a small initial outbreak in SJRP, Brazil versus a large one in NYC
304 For test performance of 80% sensitivity and 90% specificity, the percent of the
305 population that has been infected in total from the beginning of the outbreak to mid-July
306 drops from 18% (MA), 11% (LA), 26% (NYC), and 11% (SJRP, Brazil) to 3%, 2%, 12%,
307 and 0.26%, respectively, using a weekly rapid testing and quarantine strategy (with
308 regards to predictions of overall infection rates, other studies based on seroprevalence
310 increased to once every three days, these numbers drop further to 1.6% (ΜΑ), 1.4% (LΑ),
312
18
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
São José do
Massachusetts Los Angeles New York City
Rio Preto, Brazil
qRT-PCR 1 per 3 days qRT-PCR 1 per 3 days qRT-PCR 1 per 3 days qRT-PCR 1 per 3 days
Total Infected 18.40% 1.60% 11.70% 1.42% 26.40% 9.45% 11.70% 0.186%
Max
0.056% 0.025% 0.028% 0.022% 0.144% 0.130% 0.054% 0.003%
Hospitalized
Total Deaths 0.119% 0.029% 0.039% 0.009% 0.226% 0.157% 0.040% 0.003%
314
315
316 To further examine the relationship between frequency and sensitivity, we modeled
317 the maximum number of individuals in a given state over the 105-day time period for four
318 geographic regions (Fig. 4). In all four geographic regions, as frequency of testing
319 increases, the total infections, maximum simultaneous hospitalizations, and total deaths
320 converge to small percentages regardless of the sensitivity at high frequencies. It is clear
321 that the difference in frequency required to achieve the same result using tests of differing
322 sensitivities is very small (Fig. 4) For example, we predict that for the outbreak in LA, a
323 testing strategy started on 1 April of every 10 days using a test of sensitivity 90% would
324 have resulted in 2.5% of the population having been infected, while using a test of
325 sensitivity 30% would require a strategy of every 5 days to achieve the same number.
326 Thus, we conclude that frequency is more important than sensitivity in curbing the spread,
327 and a large range of sensitivities prove effective when testing sufficiently often. How
328 frequently, exactly, depends on the specific outbreak and what stage it is in, which leads
19
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
330 testing can be significantly reduced to effectively contain the disease once the initial
331 outbreak has been controlled; it is clear that this takes only a matter of weeks (Fig. 3).
332 On the other hand, according to the specificity of the rapid test and the quarantine
333 duration, larger testing frequency result in a larger percent of the population quarantined
334 (Fig. 3). Assuming a 90% rapid test specificity and 14-day quarantine duration, for the 1-
335 , 3- and 7-day frequencies almost 60%, 38% and 20% of the population, respectively,
336 would be quarantined. This figure may be reduced with additional rules for exiting
337 quarantine early, such as after complementary testing. An example of such a strategy is
338 that individuals who test positive are required to either quarantine for two weeks or
339 produce two consecutive negative rapid tests in the two days following their positive
340 result. Assuming 80% sensitivity and 90% specificity, those individuals will reenter the
341 public while still infected with probability 0.04. If uninfected, that individual will exit
342 quarantine after two days with probability 0.81. However, a compromise between the
343 reduction of infections and the proportion of the population in quarantine would be part of
344 the planning for the appropriate testing protocol in each community or region.
345 Additionally, while high frequency may be necessary to contain a large outbreak
346 initially, relatively infrequent testing, such as every one or two weeks, is sufficient to keep
347 controlled outbreaks small, while reducing the number of quarantined individuals to less
20
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
349
Figure 4. Effect of Rapid Testing Protocol under variable testing sensitivities and increasing
frequency under the SIDHRE-Q Model. The Cumulative Infections, Maximum Simultaneously
Hospitalized, and Deceased populations are modeled for Massachusetts, Los Angeles, New
York City, and São José do Rio Preto in Brazil. The effect of increasing frequency of testing
is modeled for various testing sensitivities (30%-90%) with a 90% specificity.
Figure 4 - Figure Supplement 1. Effect of Rapid Testing Protocol under variable testing
sensitivities and increasing frequency under the SIDHRE-Q Model (80% specificity).
350
351
352
353
354
21
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
358 COVID-19 prevalence by varying testing frequency across counties of California. For this
359 analysis, only California was analyzed because of the accessibility of the county level
360 data. In this scheme, the percent of active infected detected individuals in a county
361 determines the frequency of testing. We define thresholds for the number of active
362 detected infections that, when hit, initiate testing protocols of different frequencies
363 depending on the threshold hit. We first tested evenly spaced thresholds for the number
364 of detected active infections up to 1% of the population, but later adopted thresholds that
366 time of testing. T = number of active infections which, if reached, initiates everyday
367 testing. The days between tests are rounded to the closest integer value.
368
369 (1)
370 The days between tests are chosen such that the detected active infections should
371 remain near to or below T. If the initial detected active infections are greater than T, then
372 the testing frequency of 1 will cause infections to rapidly drop. Both the threshold at which
373 everyday testing begins and the coefficient of log2T/D can be modified to produce a
374 strategy that is more or less frequent in testing or resource effective; a range of days
375 between tests from 14 days to 1 day are used (Fig. 5). A scan over different choices of T
376 is shown in the supplements to Figure 5; the threshold we choose in Figure 5 is 0.05%
377 because it is successful in curbing the outbreak within the time period we consider. While
22
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
378 these choices work for the epidemic in California at the point we start our simulations, 10
379 April, they do not necessarily reflect the most resource effective choices everywhere. Our
380 analysis could be redone to select the best strategy in other states or in the country as a
381 whole.
Figure 5. Effect of County Based Rapid Test Protocol (A) and Uniform qRT-PCR Protocol
(B) on active infected detected population over time in California (CA). The legend denotes
the thresholds at which testing frequency is determined, the testing frequencies, the
percent of CA population under the strategy, and the cost per person per day.
Figure Supplement 2. Time series of the three fitted pieces of data Cumulative Cases,
Daily Hospitalized, and Cumulative Deaths for each CA county receiving testing.
383
384 Using a rapid test with a sensitivity of 80% and specificity of 90%, the county-based
385 testing with threshold 0.05% reduces the active infections from 0.94% to 0.0005%, while
386 the uniform strategy with tests administered every 7 days results in double the number of
387 active infections (Fig. 5). As the threshold is reduced, the total cost increases while the
23
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
388 cumulative infections, maximum percentage hospitalized, and cumulative deaths all
391 highlighted population with a frequency of once weekly. The average cost per person per
392 day is just under $15. Despite this frequency and the accuracy of qRT-PCR, the strategy
393 does not succeed in curbing the spread as fast as strategy A, which uses a testing
394 sensitivity and specificity of 80% and 90%, respectively, and testing frequency that vary
395 between counties depending on the proportion of their population that is currently
396 infected. The total cost for strategy A is estimated at a fraction of the other at $1.53 per
398
399
400 DISCUSSION
401 In this study we examine the potential effects of a novel testing strategy to limit the
402 spread of SARS-CoV-2 utilizing rapid antigen test screening approaches. Our clinical data
403 and SIDHRE-Q modeling system demonstrate that 1) frequent rapid testing even at a
404 range of accuracies is effective at reducing COVID-19 spread, 2) rapid antigen tests are
405 a viable source for this strategy and diagnose the most infectious individuals, and 3)
406 strategic geographic-based testing can optimize disease control with the amount of
407 available resources. The information from a diagnostic test itself is of tremendous value,
408 as it can prompt the necessary quarantine measures to prevent spread, guide proper care
409 and triage, and provide crucial disease-tracking information. Diagnostic testing in the
410 United States and abroad, however, has been a significant public health hurdle. The
411 public has witnessed and experienced symptomatic individuals being denied testing due
24
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
412 to shortages, and few testing structures for asymptomatic or mildly symptomatic
413 individuals - the main source of disease spread. Though several factors contributed to the
414 stymied early response measures, such as lockdown and quarantine protocols and
415 adherence, severe testing bottlenecks were a significant culprit34–36. Early control
416 measures have been shown to decrease lives lost by several orders of magnitude37.
417 These challenges, though exacerbated during the early months of the pandemic, remain
420 yet remains expensive and requires a laboratory and experienced personnel for sample
421 preparations and experimentation. Significantly, the turnaround time for results can be up
422 to 10 days38. On an individual scale, this leaves the public in limbo, preventing people
423 from either leaving quarantine if they are negative, or delaying critical care and infecting
424 others if they are positive. On a societal level, this current testing scheme yields
425 incomplete surveillance data on which response efforts such as societal reopening and
427 diagnostic method because of its high sensitivity and specificity, the logistical hurdles
429 As qRT-PCR remains impractical for this strategy, and rapid tests are facing
430 regulatory challenges because they do not perform with qRT-PCR-like accuracy, rapid
431 test screening is either nonexistent in several countries or symptom-based. Even under
432 best-case assumptions, findings have shown that symptom and risk-based screening
433 strategies miss more than half of the infected individuals39. Some have argued that the
434 need for widespread testing is overstated due to the variability in test sensitivity and
25
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
435 specificity40. Our findings show, however, that test performance, though valuable, is
436 secondary to widespread test frequency, which is enabled by accessibility and turnaround
437 time.
438 Giordano et al. has modeled the evolution of SARS-CoV-2 spread, introducing a
439 diagnosed state to elucidate the importance of population-wide testing16. Mina et al. has
440 examined how various test sensitivities and frequencies affect the reproductive number12.
441 We build upon these findings to show how in affected United States and Brazil regions,
442 population-wide frequent and rapid testing schemes, with sensitivities ranging from 30%-
443 90%, can be more effective in curbing the pandemic than a PCR-based scheme.
444 Integrating real-world surveillance and clinical data into our modeling system has allowed
446 health policy and adherence, state GDP, and environmental factors - under the same
447 model. Significantly, our findings hold true across Massachusetts, New York City, Los
448 Angeles, and São José do Rio Preto, Brazil. We also present the economic
449 considerations of these testing regimes, showing that widespread rapid testing is more
450 cost efficient than less frequent qRT-PCR testing. In line with these economic
452 frequent testing regime, in which high disease prevalence areas receive more frequent
455 would benefit from incorporating demographic information correlated with disease
456 progression and spread to define sub-models and sets of parameters accordingly. Age,
457 pre-existing conditions, job types, and density of population are examples of possible
26
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
458 categories, each of which influence the risk of contracting and/or dying from COVID-19.
459 Further studies may benefit from incorporating these ideas should more information
461 Our findings also point to low-cost tools for implementation of this testing strategy,
462 such as a rapid antigen-based test for the detection of SARS-CoV-2 proteins. We show
463 that the rapid antigen test performs with a range of accuracies under which disease
464 spread can be dramatically mitigated under our model. Notably, the sensitivity is
465 correlated to the individual’s viral load, effectively diagnosing those who are most
466 infectious with the highest accuracy. Our findings are significant because these rapid
467 antigen tests are cheaper than qRT-PCR, can be mass produced to millions per day,
468 present results within 15 minutes, and can be administered by a nonexpert without a lab
470 There are several policy implications for these findings. First, our model supports
471 that systems of high frequency rapid testing should be implemented as a first-line
472 screening method. This can be first enabled by a more holistic regulatory evaluation of
473 rapid diagnostics, such that policy emphasizes accessibility and turnaround time even
474 under a range of accuracies. One can imagine a less accurate, though rapid method of
475 first-line screening in schools, public transportation, and airports, or even at home, and a
476 qRT-PCR-based method for second-line screening (testing those who present severe
477 symptoms or have been in contact with infected individuals, testing in a clinical setting,
478 etc). Second, our cost analysis and rapid antigen test data present a viable and potentially
479 more cost-effective method for screening. Third, our county-based testing scheme
480 presents a possible method for wide-scale screening while optimizing resources. Future
27
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
481 studies should investigate how this selective testing strategy can be applied to different
482 location scales to further inform health policy. Moreover, though our models analyze
483 regions in the United States and Brazil, similar testing strategies can be considered
484 globally in both resource limited and abundant settings due to the higher accessibility of
487 proper adherence to quarantine measures and 2) the combined use of a variety of
488 diagnostic methods including nucleic acid, antigen, and antibody tests. According to these
489 models, rapid antigen tests are an ideal tool for first-line screening. Clinical molecular
490 tests such as qRT-PCR are vital to the diagnostic landscape, particularly to re-test
491 suspected cases that were negative on the rapid test. Because rapid tests present a
492 higher rate of false negatives, methods such as qRT-PCR remain integral to second-line
493 screening. Antibody tests provide important information for immunity and vaccination
494 purposes as well as epidemiological surveillance. This model also assumes that
495 individuals will quarantine themselves before being tested and for 14 days following a
497 Our simulations combined with real-world data demonstrate a robust modeling
498 system and elucidates the significance of this novel testing strategy. However, there are
500 geographical regions and the incomplete nature of COVID-19 surveillance data, often due
501 to the lack of testing, are not considered in the model. It is imperative that the testing
502 results, hospitalization and death statistics, and changes in protocol are reported in real-
503 time to scientists and policy makers so that models can be accurately tuned as the
28
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
504 pandemic develops. The model also does not take into account infrastructural limitations
505 such as hospital capacity. Though the rapid antigen test offers several advantages such
506 as affordability, fast turnaround time, and ease of mass production, we are also assuming
507 that there are systems in place to implement frequent and safe low-cost screening across
509 Our model underscores the need for a point-of-care or at-home test for frequent
510 screening, particularly as lockdown restrictions ease. Regulatory agencies such as the
511 FDA could work towards regulating rapid tests to alternative standards other than
512 comparison to high sensitivity molecular diagnostics, as our model shows that frequency
513 and scale of testing may overcome lower sensitivities. Rather, we could refocus policy to
514 implement first-line screening that optimizes accuracy with efficiency and equitability.
515
517 Development of Direct Antigen Rapid Test for the Detection of SARS-CoV-2
518 We developed a direct antigen rapid test for the detection of the spike glycoprotein
520 the rapid antigen test is an immunochromatographic format with a visual readout using
521 anti-spike mouse monoclonal antibodies (E25Bio, Inc., Cambridge, MA, USA) that are
523 nitrocellulose membranes (Sartorius, Goettingen, Germany). Each rapid antigen test has
524 a control area adjacent to the paper absorbent pad; the control is an anti-mouse Fc
525 domain antibody (Leinco Technologies, Fenton, MO, USA) that will capture any of the
526 antibody-conjugated gold nanoparticles to generate a control visual signal. A visual signal
29
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
527 at the test area reflects SARS-CoV-2 spike glycoprotein that is “sandwiched” between an
528 anti-spike glycoprotein antibody adsorbed to the nitrocellulose membrane and a second
530
531 Validation of Direct Antigen Rapid Test for the Detection of SARS-CoV-2
533 we compared the accuracy of the rapid antigen test to the viral load of individuals.
534 Nasopharyngeal swab specimens (n = 121) were tested in Brazil following approved
535 human subjects use protocols. The age of study participants ranged from 1 to 95 years
536 with an overall median of 37 years (interquartile range, 27–51 years), and 62% were
537 female. The demographic summary of the patients are included in Supplementary Table
538 1. The nasopharyngeal swab specimens were banked refrigerated or frozen samples
539 from suspected patients submitted to the lab for routine COVID diagnosis. Prior to using
540 the rapid test, the nasopharyngeal swab samples were validated by qRT-PCR using
542 Republic of Korea I). The primary study under which the samples and data were collected
543 received ethical clearance from the Faculdade de Medicina de São José do Rio Preto
545 corresponding data were banked and de-identified prior to the analyses.
546 A nasopharyngeal swab specimen (1 mL) was concentrated using a Vivaspin 500
549 collection tube and the rapid antigen test was inserted into the tube with the retentate and
30
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
550 allowed to react for 15 minutes. After processing of the rapid antigen test, the visual
552
554 As of August 2020, the United States and Brazil have the highest number of
555 confirmed COVID-19 cases and deaths worldwide, with both countries reporting their first
556 case on 26 February 20201. Although several affected US regions could have been
557 modeled, we look at data from Massachusetts, New York, and Los Angeles: these regions
558 each contained “hotspots”, or areas of surging COVID-19 cases, at different points in time
559 during the pandemic and have publicly available government-provided surveillance data.
560 Our model is fit using data over 105 days beginning on April 1 for Figures 3 and 4 and
561 105 days beginning on April 10 for Figure 5 (see “Modeling Parameters” in Methods). In
562 order to understand the various testing proposals on a global scale, we performed our
563 clinical study in and expanded the modeling study to Brazil. The specific data we use to
564 fit our model are cumulative confirmed cases, total deaths, and number of daily
565 hospitalizations due to COVID-19. This surveillance data was retrieved from government-
567
569 Equation 2 below provides the exact differential equations governing the model.
31
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
570 (2)
571 In order to determine the values of the parameters defining the flows between states, we
572 use a least squares regression performed at seven day intervals in the datasets to which
573 we fit. This allows the model to take into account the time dependent nature of the
574 parameters, which rely on factors such as social distancing regulations and changes in
575 testing capacity. We also fit window sizes between 1 and 21 days and find that while the
576 fit degrades with larger window size, the overall shape of the fits do not change. We
577 choose seven days assuming policy changes take a week to become effective and that
578 reasonable parameters can be expected to change within this time period. Also, the seven
579 day window size accounts for the fact that often data is not reported as diligently over the
580 weekend. Time series of the values of the parameters for the geographic locations
581 discussed in this paper can be found in the supplemental materials for Figure 2.
582 Given the restrictions on data available for the populations of various states,
583 varying all of the parameters results in an over parameterized system. Therefore, a subset
584 of the model parameters are fit while the others are either extracted from other sources;
586
587
32
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
𝛼is the probability that an interaction between an undetected infected Mean St. Dev.
LA 0.090 0.034
𝜂 𝜂is the probability that an interaction between an infected person and an uninfected person results in
a new infection, divided by the average number of uninfected people a detected infected person
comes into contact with on a given day.𝜂 = 0.01 ⋅ 𝛼
The constant relating 𝜂 , 𝛼 accounts for a small but nonzero transmission due to the quarantined
(detected) infected population. This value was chosen to be small, assuming a quarantined individual
will only infect others with low probability.
𝜈 𝜈is the probability that a symptomatic undetected individual is diagnosed Mean St. Dev.
LA 0.011 0.006
𝜖 𝜖 is the probability that an asymptomatic undetected infected individual is diagnosed on a given day.
𝜖 = 0 while fitting (during PCR symptomatic testing). 𝜖 =(sensitivity/days between tests) when the
rapid testing strategy is activated.
𝜆 𝜆 is the probability that an undetected infected individual transitions to the recovered state on a given
day. 𝜆 = 1/14, or the inverse of average recovery time.48
𝜇 𝜇 is the probability that an infected individual develops severe symptoms Mean St. Dev.
on a given day and transitions into the hospitalized state. The flow from 𝐷
to 𝐻 is assumed to be independent of the ratio 𝐼/𝐷, but comes only from MA 0.0013 9.5e-4
the detected infected population, hence why it is multiplied by (𝐼 + 𝐷)/𝐷.
𝜇 is estimated from the data.
LA 0.0016 2.4e-4
𝜌 𝜌is the probability that a detected infected individual transitions to the recovered state on a given day.
33
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
𝜎 𝜎is the probability that a hospitalized individual transitions to the recovered state on a given day. 𝜎 =
1/11, or the inverse of the average recovery time for a hospitalized individual. 48
𝜏 𝜏 is the probability that a hospitalized individual expires on a given day. 𝜏 Mean St. Dev.
LA 0.016 0.004
𝛾 𝛾 is the probability of entering either of the quarantine states on a given day from either the
Susceptible or Recovered populations. 𝛾 = 0 while fitting (during PCR symptomatic testing). 𝛾 =
(1 −specificity) × (1/days between tests) when the rapid testing strategy is activated.
𝜓 𝜓is the probability that an individual exits quarantine on a given day. 𝜓 = 1/14, or the inverse of the
quarantine period for fixed length quarantine.
589
590 The fitting procedure minimizes the sum of the squared residuals of the total cases,
591 current daily hospitalizations, cumulative deaths, and percentage of total infected
592 individuals currently hospitalized. The first three are present in the data sets while the
593 latter is derived from the estimates of the ratio between infected undetected to infected
594 detected individuals from the CDC Laboratory Seroprevalence Survey Data49. While this
595 ratio changes over time, the percentage of infected individuals developing severe
596 symptoms should remain roughly constant throughout the course of the epidemic in the
598 We consider the data sets for outbreaks in MA, NYC, LA, and SJRP, Brazil42–47.
599 While each location has testing and fatality information dating back to January,
600 hospitalization data was not included until late March (for NYC and SJRP) and April (for
601 MA and LA). Hence we begin our fitting procedure and testing strategy on 1 April for
602 each of the data sets; by this point, the outbreak is advanced in NYC, substantial in MA,
603 non-negligible, but far from its peak, in LA, and in early stages in SJRP, Brazil. Starting
34
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
604 simulations at various stages of the outbreak allows one to see the difference in results
606 In order to determine the effectiveness of the county-based strategy when applied
607 to the state of California, we also fit all of the counties in California with a population
608 greater than 1.5% of that of the entire state and with greater than zero deaths. The results
609 do not depend on these selections, but instead suggest a practical criteria to administer
610 limited resources. The fitting is done starting 10 April for these counties, as at this point
611 the outbreak is sufficiently well-documented in each to successfully model. For the
612 county-level data we compute a seven day running average of each of the data sets to
613 which we then fit in order to smooth out fluctuations in the data, likely due to reporting,
614 which are more significant here than in the other data sets considered, as the county
615 populations are smaller and hence discrepancies impact the smoothness of the data
616 more. The fits for each of the counties can be found in the supplementary materials to
617 Figure 5.
618 As one can see from Figure 2, these data sets are particularly not smooth, which
620 within the dates provided or to compare between locations, as reporting mechanisms
621 changed over time within the same locations. Despite this lack of consistency, our model
622 and fitting mechanism was successful in reproducing the progress of the outbreak in each
624 The authors confirm that the data supporting the findings of this study are available within
625 the article and/or its supplementary materials; any other data will be made available upon
35
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
628 with the packages scipy, numpy, lmfit, matplotlib and plotly50–54.
629
630 Acknowledgments
631 We thank Professor Lee Gehrke for critical reading of the manuscript. The study is
632 funded, in part, by a Bill and Melinda Gates Foundation Award (INV-017872) to E25Bio,
633 Inc. EN is funded by Tufts University DISC Seed Grant. MLN is supported by a FAPESP
634 grant (#2020/04836-0) and is a CNPq Research Fellow. AFV is supported by a FAPESP
635 Fellow grant (#18/17647-0). GRFC is supported by a FAPESP Fellow grant (#20/07419-
636 0). BHGAM is supported by a FAPESP Scholarship (#19/06572-2). The funders had no
637 role in the design of the study; in the collection, analyses, or interpretation of data; in the
639
641 BN, AB, AR, MB, NS, AG, IB, and BBH are employed by or affiliated with E25Bio
642 Inc. (www.e25bio.com), a company that develops diagnostics for epidemic viruses.
643
644 References
646 https://www.who.int/emergencies/diseases/novel-coronavirus-2019/situation-reports.
647 2. Menkir, T. F. et al. Estimating the number of undetected COVID-19 cases exported
649 3. Ivorra, B., Ferrández, M. R., Vela-Pérez, M. & Ramos, A. M. Mathematical modeling of the
650 spread of the coronavirus disease 2019 (COVID-19) taking into account the undetected
36
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
651 infections. The case of China. Commun Nonlinear Sci Numer Simul 105303 (2020)
652 doi:10.1016/j.cnsns.2020.105303.
653 4. Salathé, M. et al. COVID-19 epidemic in Switzerland: on the importance of testing, contact
654 tracing and isolation. Swiss Med Wkly 150, w20225 (2020).
655 5. Lau, H. et al. Evaluating the massive underreporting and undertesting of COVID-19 cases in
657 6. Silverman, J. D., Hupert, N. & Washburne, A. D. Using influenza surveillance networks to
658 estimate state-specific prevalence of SARS-CoV-2 in the United States. Science Translational
660 7. Böhning, D., Rocchetti, I., Maruotti, A. & Holling, H. Estimating the undetected infections in
661 the Covid-19 outbreak by harnessing capture-recapture methods. Int. J. Infect. Dis. 97, 197–
664 amplification as a rapid early-detection method for novel SARS-CoV-2. Emerg Microbes Infect
666 9. Leo, L. Mylab gets commercial approval from ICMR for Covid-19 antigen rapid testing kit.
669 10. Dey, S. Coronavirus testing: Rapid antigen tests now make up nearly half of daily checks |
671 https://timesofindia.indiatimes.com/india/rapid-antigen-tests-now-make-up-nearly-half-of-
672 daily-checks/articleshow/77340459.cms.
673 11. Vogels, C. B. F. et al. Analytical sensitivity and efficiency comparisons of SARS-CoV-2 RT-
675 12. Larremore, D. B. et al. Test sensitivity is secondary to frequency and turnaround time for
37
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
677 13. Shen, Z. et al. Superspreading SARS events, Beijing, 2003. Emerging Infect. Dis. 10, 256–
679 14. Peiris, J. S. M. et al. Clinical progression and viral load in a community outbreak of
681 (2003).
682 15. He, X. et al. Temporal dynamics in viral shedding and transmissibility of COVID-19. Nat. Med.
684 16. Giordano, G. et al. Modelling the COVID-19 epidemic and implementation of population-wide
686 17. Choi, S. & Ki, M. Estimating the reproductive number and the outbreak size of COVID-19 in
688 18. Wei, Y. Y. et al. [Fitting and forecasting the trend of COVID-19 by SEIR(+CAQ) dynamic
689 model]. Zhonghua Liu Xing Bing Xue Za Zhi 41, 470–475 (2020).
690 19. Yang, Z. et al. Modified SEIR and AI prediction of the epidemics trend of COVID-19 in China
691 under public health interventions. J Thorac Dis 12, 165–174 (2020).
692 20. Cao, S., Feng, P. & Shi, P. [Study on the epidemic development of COVID-19 in Hubei
693 province by a modified SEIR model]. Zhejiang Da Xue Xue Bao Yi Xue Ban 49, 178–184
694 (2020).
695 21. Huang, R., Liu, M. & Ding, Y. Spatial-temporal distribution of COVID-19 in China and its
696 prediction: A data-driven modeling analysis. J Infect Dev Ctries 14, 246–253 (2020).
697 22. Godio, A., Pace, F. & Vergnano, A. SEIR Modeling of the Italian Epidemic of SARS-CoV-2
698 Using Computational Swarm Intelligence. Int J Environ Res Public Health 17, (2020).
699 23. Gatto, M. et al. Spread and dynamics of the COVID-19 epidemic in Italy: Effects of emergency
700 containment measures. Proc. Natl. Acad. Sci. U.S.A. 117, 10484–10491 (2020).
701 24. Hou, C. et al. The effectiveness of quarantine of Wuhan city against the Corona Virus Disease
702 2019 (COVID-19): A well-mixed SEIR model analysis. J. Med. Virol. 92, 841–848 (2020).
38
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
703 25. Zhou, T. et al. Preliminary prediction of the basic reproduction number of the Wuhan novel
705 26. Reno, C. et al. Forecasting COVID-19-Associated Hospitalizations under Different Levels of
706 Social Distancing in Lombardy and Emilia-Romagna, Northern Italy: Results from an
708 27. Alizargar, J. Risk of reactivation or reinfection of novel coronavirus (COVID-19). J. Formos.
710 28. Batisse, D. et al. Clinical recurrences of COVID-19 symptoms after recovery: viral relapse,
712 29. Deng, W. et al. Primary exposure to SARS-CoV-2 protects against reinfection in rhesus
714 30. Ota, M. Will we see protection or reinfection in COVID-19? Nat. Rev. Immunol. 20, 351 (2020).
715 31. Victor Okhuese, A. Estimation of the Probability of Reinfection With COVID-19 by the
718 32. Gu, Y. COVID-19 Projections Using Machine Learning. COVID-19 Projections Using Machine
722 doi:10.1101/2020.06.28.20142190.
723 34. Goodnough, A. & Shear, M. D. The U.S.’s Slow Start to Coronavirus Testing: A Timeline. The
725 35. Shear, M. D. et al. The Lost Month: How a Failure to Test Blinded the U.S. to Covid-19. The
727 36. Kaplan, S. & Thomas, K. Despite Promises, Testing Delays Leave Americans ‘Flying Blind’.
39
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
729 37. de Souza, W. M. et al. Epidemiological and clinical characteristics of the COVID-19 epidemic
731 38. Mervosh, S. & Fernandez, M. ‘It’s Like Having No Testing’: Coronavirus Test Results Are Still
733 39. Gostic, K., Gomez, A. C., Mummah, R. O., Kucharski, A. J. & Lloyd-Smith, J. O. Estimated
734 effectiveness of symptom and risk screening to prevent the spread of COVID-19. eLife 9,
736 40. Zitek, T. The Appropriate Use of Testing for COVID-19. West J Emerg Med 21, 470–472
737 (2020).
738 41. Bosch, I. et al. Rapid antigen tests for dengue virus serotypes and Zika virus in patient serum.
740 42. Massachusetts Department of Public Health. COVID-19 Response Reporting. Mass.gov
741 https://www.mass.gov/info-details/covid-19-response-reporting.
742 43. California Department of Public Health. COVID-19 Cases - California Open Data.
743 https://data.ca.gov/dataset/covid-19-cases.
744 44. California Department of Public Health. COVID-19 Hospital Data - California Open Data.
745 https://data.ca.gov/dataset/covid-19-hospital-data.
746 45. Department of Health and Human Hygiene. COVID-19 Daily Counts of Cases,
748 19-Daily-Counts-of-Cases-Hospitalizations-an/rc75-m7u3.
749 46. Sao Jose do Rio Preto Public Health Office. COVID-19 Surveillance Data, Sao Jose do Rio
750 Preto.
751 47. New York State Government. Daily Hospitalization Summary by Region. New York Forward
752 https://forward.ny.gov/daily-hospitalization-summary-region.
753 48. Massachusetts General Hospital Institute for Technology Assessment. COVID-19 Simulator
40
medRxiv preprint doi: https://doi.org/10.1101/2020.09.01.20184713.this version posted September 4, 2020. The copyright holder for this preprint
(which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
It is made available under a CC-BY-NC-ND 4.0 International license .
755 19_simulator_methodology_download_20200507.pdf.
756 49. CDC. Coronavirus Disease 2019 (COVID-19). Centers for Disease Control and Prevention
757 https://www.cdc.gov/coronavirus/2019-ncov/cases-updates/commercial-lab-surveys.html
758 (2020).
761 52. Non-Linear Least-Squares Minimization and Curve-Fitting for Python — Non-Linear Least-
764 54. Plotly: The front-end for ML and data science models. https://plotly.com/.
41