Population-Level Counterfactual Trend Modelling
Population-Level Counterfactual Trend Modelling
Population-Level Counterfactual Trend Modelling
Abstract
Background Studies have suggested that some US adult smokers are switching away from smoking to e-cigarette
use. Nationally representative data may reflect such changes in smoking by assessing trends in cigarette and
e-cigarette prevalence. The objective of this study is to assess whether and how much smoking prevalence differs
from expectations since the introduction of e-cigarettes.
Methods Annual estimates of smoking and e-cigarette use in US adults varying in age, race/ethnicity, and sex were
derived from the National Health Interview Survey. Regression models were fitted to smoking prevalence trends
before e-cigarettes became widely available (1999–2009) and trends were extrapolated to 2019 (counterfactual
model). Smoking prevalence discrepancies, defined as the difference between projected and actual smoking
prevalence from 2010 to 2019, were calculated, to evaluate whether actual smoking prevalence differed from those
expected from counterfactual projections. The correlation between smoking discrepancies and e-cigarette use
prevalence was investigated.
Results Actual overall smoking prevalence from 2010 to 2019 was significantly lower than counterfactual
predictions. The discrepancy was significantly larger as e-cigarette use prevalence increased. In subgroup analyses,
discrepancies in smoking prevalence were more pronounced for cohorts with greater e-cigarette use prevalence,
namely adults ages 18–34, adult males, and non-Hispanic White adults.
Conclusion Population-level data suggest that smoking prevalence has dropped faster than expected, in ways
correlated with increased e-cigarette use. This population movement has potential public health implications.
Keywords Adult, E-Cigarette, Vaping, Counterfactual, NHIS, Smoking, Trend modelling
*Correspondence:
Floe Foxon
[email protected]
1
PinneyAssociates Inc, 201 North Craig Street, Suite 320, 15213 Pittsburgh,
PA, USA
© The Author(s) 2022. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use,
sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and
the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this
article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included
in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will
need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The
Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available
in this article, unless otherwise stated in a credit line to the data.
Foxon et al. BMC Public Health (2022) 22:1940 Page 2 of 10
e-cigarettes were defined as “electronic cigarettes, often Linear weighted least squares regression models were
called e-cigarettes” without explicit reference to nicotine. fitted to NHIS adult e-cigarette use prevalence from 2014
From 2015 to 2018, e-cigarettes were defined as “vape- (the first year e-cigarette use was assessed) to 2019 (with
pens, hookah-pens, e-hookahs, or e-vaporizers… usually e-cigarette use prevalence defined as zero in 2010). These
contain[ing] liquid nicotine.” In 2019, e-cigarettes were models were used to estimate e-cigarette use prevalence
defined as “Electronic cigarettes (e-cigarettes)… include from 2010 to 2013.
electronic hookahs (e-hookahs), vape pens, e-cigars, and The correlation between e-cigarette use prevalence
others… usually contain[ing] nicotine… These questions from 2010 to 2019 (model-based e-cigarette use esti-
concern electronic vaping products for nicotine use. The mates for 2010–2013; actual NHIS e-cigarette use preva-
use of electronic vaping products for marijuana use is lence estimates for 2014–2019) and cigarette smoking
not included in these questions.” For full definitions, see discrepancies from 2010 to 2019 was then investigated
Additional File 1. by calculating Pearson correlation coefficients with
The prevalence of current smoking and current e-cig- two-tailed p-values (alpha = 0.05). These analyses were
arette use was determined for three age cohorts (18–34 repeated for the three age cohorts (18–34, 35–54, 55+),
years, 35–54 years, and 55+ years, following Axelsson et three race/ethnicity cohorts (Hispanic, NH White, NH
al. [35]), three race/ethnicity cohorts (Hispanic, non-His- Black), and two sex cohorts (female, male). Goodness of
panic (NH) White, and NH Black), and two sex cohorts fit was evaluated with Root Mean Square Errors (RMSE),
(female and male). These cohorts were selected to maxi- which is appropriate for forecasts on means [38].
mize the sample sizes used in each prevalence estimate. NHIS prevalence estimates were calculated in SAS
Analyses were not repeated for any of the other race/ version 9.4 using PROC SURVEY to account for com-
ethnicity categories in NHIS due to very low sample size, plex survey design. All other analyses were performed in
producing coefficients of variation (relative standard Python version 3.7.6 with the packages NumPy version
error) >30% which is standard practice with NHIS data. 1.18.1, Scipy version 1.4.1, Uncertainties version 3.1.5,
[34]. Kneed version 0.7.0, and Matplotlib version 3.1.3.
Table 1 Combined Sample Characteristics female, majority never smoking/e-cigarette using, and is
Demographic Percent of sample approximately evenly distributed by age category.
% (n)
Root mean square errors of all models were consistent
Total N = 870,652
and small relative to the y-axis scale, ranging from 0.518
Age 18–34 31.8 (252,410)
to 1.115, at least one order of magnitude smaller than cig-
35–54 36.9 (309,068)
arette smoking prevalence (see Additional File 1, Supple-
55+ 31.3 (309,174)
mentary Table 1).
Race/Ethnicity Hispanic 12.4 (128,597)
Figure 1 shows the results of counterfactual trend mod-
NH White 70.7 (576,919)
elling among all adults. Smoking prevalence declined
NH Black 11.5 (119,210)
NH Other 5.4 (44,869)
steadily from 1990 to 2010. This decline apparently accel-
Sex Female 51.9 (489,143)
erated in the post-2010 period, where actual smoking
Male 48.1 (381,506)
prevalence was as much as approximately 3.4 ± 0.5 (SE)
Cigarette Smoking Status Current 20.6 (180,511) percentage points lower than projected. This smoking
Former 22.4 (196,163) discrepancy coincided with a rise in e-cigarette use prev-
Never 57.0 (486,181) alence to approximately 4.5 ± 0.2% of adults in 2019. The
E-Cigarette Use Status Current 3.5 (6,013) correlation between smoking discrepancy and e-cigarette
Former 11.2 (19,931) use prevalence from 2010 to 2019 was high and statisti-
Never 85.3 (158,470) cally significant (Pearson r = 0.803, p = 0.005).
Figure 2 shows the results by age group. Smoking
prevalence declined steadily from 1990 to 2010 among
for the smoking discrepancy or prevalence observed in 18–34 and 35–54 year olds, while smoking prevalence
the present study, this suggests these interventions alone was more stable among those aged 55+. The discrepancy
do not explain the observed smoking discrepancy, which between projected and actual smoking prevalence was
allows for possible association between e-cigarette use most pronounced among 18–34 year olds, with discrep-
and the observed smoking discrepancy (among other ancies up to 8.0 ± 0.9 percentage points. This age cohort
factors). also had the highest e-cigarette use prevalence, with
approximately 8.2 ± 0.4% of 18–34 year olds being current
Results e-cigarette users in 2019. Smoking discrepancies were
Main results approximately half as pronounced among 35–54 year
Table 1 shows the combined NHIS sample distribution. olds as they were among 18–34 year olds, but were still
The total sample consists of nearly one million observa- substantial (up to 3.5 ± 0.7 percentage points). E-cigarette
tions (N = 870,652) and is majority NH White, majority use prevalence among 35–54 year olds was approximately
Fig. 1 Trends in Smoking and E-Cigarette Use Prevalence among All Adults
Foxon et al. BMC Public Health (2022) 22:1940 Page 5 of 10
4.6 ± 0.3% in 2019, which is also about half the prevalence seen in Fig. 2. This age cohort also had the lowest e-cig-
among 18–34 year olds. Smoking discrepancies were not arette use prevalence at 1.4 ± 0.1% in 2019. Correla-
apparent among 55+ year olds, with most actual smok- tion between smoking discrepancy and e-cigarette use
ing prevalence estimates from 2010 to 2019 falling within was higher among 18–34 year olds (r = 0.869, p = 0.001),
the 95% confidence limits of the counterfactual model, as
Foxon et al. BMC Public Health (2022) 22:1940 Page 6 of 10
followed by 35–54 year olds (r = 0.614, p = 0.06), and those Finally, Fig. 4 shows the modelling results by race/
age 55+ (r = 0.115, p = 0.8). ethnicity cohort. From 1990 to 2019, smoking preva-
Figure 3 shows the results by sex cohort. Similar to the lence declined consistently among all three race/eth-
age cohort results, smoking discrepancies were most pro- nicity cohorts. Smoking prevalence discrepancies up to
nounced for the cohort with the highest e-cigarette use 4.2 ± 0.6 percentage points were observed among the NH
prevalence. Among males, smoking discrepancies up to White cohort, whereas discrepancies were less appar-
4.2 ± 0.6 percentage points were observed, while among ent among the NH Black and Hispanic cohorts (up to
females, smoking discrepancies up to 2.5 ± 0.6 percentage 1.9 ± 1.2 and 2.0 ± 0.8 percentage points respectively).
points were observed. E-cigarette use prevalence mean- E-cigarette use prevalence in 2019 was highest among
while was approximately 5.5 ± 0.3% among males and NH White individuals (5.1 ± 0.2%) compared to NH Black
3.5 ± 0.2% among females in 2019. Correlation between (3.4 ± 0.4%) and Hispanic (2.8 ± 0.3%) individuals. Finally,
smoking discrepancy and e-cigarette use was stronger correlation between e-cigarette use prevalence and
among males (r = 0.869, p = 0.001) than among females cigarette smoking discrepancy was greatest for the NH
(r = 0.634, p = 0.05). White cohort (r = 0.804, p = 0.005) followed by the NH
Foxon et al. BMC Public Health (2022) 22:1940 Page 7 of 10
Black (r = 0.676, p = 0.03) and Hispanic (r = 0.570, p = 0.09) Sensitivity test results
cohorts. Results from the main analyses were largely robust to the
five sensitivity tests described in the Methods, namely,
(1) excluding the 2019 point estimates due to NHIS
survey changes; (2) excluding the regression-estimated
Foxon et al. BMC Public Health (2022) 22:1940 Page 8 of 10
e-cigarette prevalence; (3) using 2009 as an alternative adults in 2018. Because the 3.3 ± 0.5 percentage point dis-
to the Kneedle cut-off year of 2010; (4) using 2011 as an crepancy observed in the present study is much greater
alternative to the Kneedle cut-off year of 2010; and (5) than the 0.4 percentage point decrease in smoking prev-
using exponential decay functions instead of linear func- alence associated with Tips®, Tips® does not explain the
tions (see Additional File 1, Supplementary Table 2). smoking discrepancy observed.
For the total sample (all adults), the Pearson correla- The association between the FSPTCA and smok-
tion between smoking discrepancy and e-cigarette use ing prevalence is quantified in the literature by a study
prevalence were similar to the main result (main result: which estimated a 0.6% reduction in US adult smoking
r = 0.803, range of r values across sensitivity tests (lowest prevalence each quarter following implementation of
to highest): r = 0.679–0.843; p < 0.05 for 4/5 tests). This the FSPTCA in June 2009 [42]. Cumulatively, this would
was also true for the 18–34 cohort (main result: r = 0.869, result in a 24% reduction in adult smoking prevalence
test range: r = 0.789–0.889; p < 0.05 for 5/5 tests), the Male from mid-2009 to mid-2019 (0.6% times 40 quarters).
cohort (main result: r = 0.869, test range: r = 0.782–0.897; NHIS smoking prevalence among all adults in 2009 was
p < 0.05 for 5/5 tests), the NH White cohort (main result: approximately 20.6 ± 0.4% (present study). Applying the
r = 0.804, test range: r = 0.668–0.840; p < 0.05 for 4/5 tests), 24% reduction associated with the FSPTCA to the 2009
the NH Black cohort (main result: r = 0.676, test range: NHIS smoking prevalence provides a predicted adult
r = 0.572–0.742; p < 0.05 for 3/5 tests), and Female cohort smoking prevalence of approximately 15.7% in 2019, due
(main result: r = 0.634, test range: r = 0.488–0.700; p < 0.05 to the FSPTCA. By comparison, in the present study the
for 3/5 tests). actual NHIS smoking prevalence in 2019 was approxi-
For the 55+ cohort, the main correlation result dif- mately 14.0% (95% CI: 13.5–14.5%), which is statisti-
fered more substantially from the sensitivity test results cally lower than the 15.7% prevalence from the FSPTCA.
(main result: r = 0.115, test range: r=-0.011–0.452), how- Because the actual NHIS smoking prevalence of 14.0% is
ever correlations were consistently low (below r = 0.5) and statistically lower than the 15.7% prevalence predicted
non-significant in all analyses for this cohort. from FSPTCA effects, FSPTCA effects do not explain the
For the 35–54 cohort, while the main correlation result smoking prevalence observed.
was high (r = 0.614), the correlations across sensitivity
tests ranged from low (r = 0.386) to high (r = 0.692). This Discussion
is also true for the Hispanic cohort for which the sensi- The aim of this research was to use population-level
tivity tests also ranged widely (r = 0.175–0.728), but only data to examine the correlation in trends between e-cig-
reached significance in sensitivity tests and not in the arette use and smoking prevalence among US adults
main analysis. from 2010 to 2019. Results suggest that actual smoking
Root mean square errors for non-linear models were prevalence was lower than it otherwise would have been
the same as those for the linear models to between one if trends from 1990 to 2009 (before e-cigarettes became
and three significant figures (see Additional File 1, Sup- widely available) had continued uninterrupted. Further,
plementary Table 1), suggesting little difference between the discrepancy between actual and predicted smoking
the linear and non-linear fits for these data. prevalence tended to be highest in groups with higher
e-cigarette use prevalence, such as among adults age
Other considerations 18–34, adult males, and non-Hispanic White adults.
The effect of the FSPTCA and the CDC’s ‘Tips®’ cam- Overall, the sensitivity analyses largely confirmed
paign, which represent major, distinct national popu- results from the primary analysis. However, sensitiv-
lation interventions, were considered by comparing ity test results ranged more widely for the age 35–54
quantitative estimates for the association between these and Hispanic cohorts. Some of the variations showed a
two interventions and smoking prevalence from the pub- stronger association between e-cigarette prevalence and
lished literature, to the smoking prevalence observed in discrepancy in smoking prevalence, suggesting that the
the present study. main analysis is conservative.
The association between the Tips® campaign and smok- These lower-than-expected smoking prevalences, cor-
ing prevalence is quantified in the literature by a CDC related with e-cigarette use, suggest population-level dis-
study which estimated approximately one million Tips® placement of cigarettes by e-cigarettes, consistent with
campaign-associated sustained quits between 2012 and extant modelling literature [28, 29]. A significant over-
2018 [41]. This equates to a 0.4 percentage point decrease all decline in adult cigarette smoking is observed, above
in smoking prevalence (because one million adults repre- what was otherwise expected, even for younger adults,
sent approximately 0.4% of the US adult population [43]). among whom the reported ‘gateway’ effect is claimed to
By comparison, in the present study, a 3.3 ± 0.5 percent- be strong and e-cigarette use is relatively high [1]. Levy et
age point smoking discrepancy was observed among all al. [27] also identified similar vaping-related reductions in
Foxon et al. BMC Public Health (2022) 22:1940 Page 9 of 10
2. Chatterjee K, Alzghoul B, Innabi A, Meena N. Is vaping a gateway to smoking: 23. Cotti CD, Courtemanche CJ, Maclean JC, Nesson ET, Pesko MF, Tefft N: The
a review of the longitudinal studies. Int J Adolesc Med Health 2016, 30(3). Effects of E-Cigarette Taxes on E-Cigarette Prices and Tobacco Product Sales:
3. Soneji S, Barrington-Trimis JL, Wills TA, Leventhal AM, Unger JB, Gibson LA, Evidence from Retail Panel Data. National Bureau of Economic Research Work-
Yang J, Primack BA, Andrews JA, Miech RA, et al: Association Between Initial ing Paper Series 2020, No. 26724.
Use of e-Cigarettes and Subsequent Cigarette Smoking Among Adolescents 24. Pesko MF, Courtemanche CJ, Catherine Maclean J. The effects of traditional
and Young Adults: A Systematic Review and Meta-analysis. JAMA Pediatrics cigarette and e-cigarette tax rates on adult tobacco product use. J Risk
2017, 171(8):788–797. Uncertain. 2020;60(3):229–58.
4. Lee P, Coombs K, Afolalu E: Considerations related to vaping as a possible 25. Zheng Y, Zhen C, Dench D, Nonnemaker JM. U.S. Demand for Tobacco Prod-
gateway into cigarette smoking: an analytical review [version 3; peer review: ucts in a System Framework. Health Econ. 2017;26(8):1067–86.
2 approved]. F1000Research 2019, 7(1915). 26. Wissmann R, Zhan C, D’Amica K, Prakash S, Xu Y. Modeling the Population
5. Chan GCK, Stjepanović D, Lim C, Sun T, Shanmuga Anandan A, Connor JP, Health Impact of ENDS in the US. Am J Health Behav. 2021;45(3):588–610.
Gartner C, Hall WD, Leung J. Gateway or common liability? A systematic 27. Levy DT, Sanchez-Romero LM, Travis N, Yuan Z, Li Y, Skolnick S, Jeon J, Tam
review and meta-analysis of studies of adolescent e-cigarette use and future J, Meza R. US Nicotine Vaping Product SimSmoke Simulation Model: The
smoking initiation. Addiction. 2021;116(4):743–56. Effect of Vaping and Tobacco Control Policies on Smoking Prevalence and
6. Kim S, Selya AS. The Relationship Between Electronic Cigarette Use and Con- Smoking-Attributable Deaths. Int J Environ Res Public Health 2021, 18(9).
ventional Cigarette Smoking Is Largely Attributable to Shared Risk Factors. 28. Selya AS, Wissmann R, Shiffman S, Chandra S, Sembower M, Joselow J, Kim S.
Nicotine Tob Res. 2020;22(7):1123–30. US Sales of Electronic Nicotine Delivery Systems (ENDS) Are Associated with
7. Considerations related to vaping as a possible gateway into cigarette smok- Declines in Cigarette Sales. Journal of Consumer Policy 2022.
ing [https://osf.io/z3st5/]. 29. Wagner LM, Clifton SM. Modeling the public health impact of e-cigarettes
8. Sun R, Mendez D, Warner KE. Is Adolescent E-Cigarette Use Associated With on adolescents and adults. Chaos: An Interdisciplinary Journal of Nonlinear
Subsequent Smoking? A New Look. Nicotine Tob Res. 2021;24(5):710–8. Science. 2021;31(11):113137.
9. Foxon F, Selya AS. Electronic cigarettes, nicotine use trends and use 30. Dai H, Leventhal AM. Prevalence of e-Cigarette Use Among Adults in the
initiation ages among US adolescents from 1999 to 2018. Addiction. United States, 2014–2018. JAMA. 2019;322(18):1824–7.
2020;115(12):2369–78. 31. Syamlal G, Clark KA, Blackley DJ, King BA. Prevalence of Electronic Cigarette
10. Levy DT, Warner KE, Cummings KM, Hammond D, Kuo C, Fong GT, Thrasher JF, Use Among Adult Workers - United States, 2017–2018. MMWR Morb Mortal
Goniewicz ML, Borland R. Examining the relationship of vaping to smoking Wkly Rep. 2021;70(9):297–303.
initiation among US youth and young adults: a reality check. Tob Control. 32. 2018-19 TUS-CPS Data, Table 3: E-Cigarette Use https://cancercontrol.cancer.
2019;28(6):629–35. gov/brp/tcrb/tus-cps/results/2018-2019/table-3.
11. Selya AS, Foxon F. Trends in electronic cigarette use and conventional smok- 33. National Health Interview Survey [https://www.cdc.gov/nchs/nhis/about_
ing: quantifying a possible ‘diversion’ effect among US adolescents. Addiction nhis.htm].
2021. 34. Cornelius ME, Wang TW, Jamal A, Loretan CG, Neff LJ. Tobacco product use
12. Sokol NA, Feldman JM. High school seniors who used e-cigarettes may have among adults—United States, 2019. Morb Mortal Wkly Rep. 2020;69(46):1736.
otherwise been cigarette smokers: Evidence from Monitoring the Future 35. Axelsson GT, Eythorsson ES, Hardardottir H, Gudmundsson G, Hansdottir S.
(United States, 2009–2018). Nicotine Tob Res 2021. [The impact of lung diseases, smoking and e-cigarette use on the severity of
13. Walker N, Parag V, Wong SF, Youdan B, Broughton B, Bullen C, Beaglehole R. COVID-19 illness at diagnosis]. Laeknabladid. 2020;106(12):574–9.
Use of e-cigarettes and smoked tobacco in youth aged 14–15 years in New 36. Satopaa V, Albrecht J, Irwin D, Raghavan B: Finding a “kneedle” in a haystack:
Zealand: findings from repeated cross-sectional studies (2014-19). Lancet Detecting knee points in system behavior. In: 2011 31st international
Public Health. 2020;5(4):e204–12. conference on distributed computing systems workshops: 2011: IEEE; 2011:
14. Hartmann-Boyce J, McRobbie H, Butler AR, Lindson N, Bullen C, Begh R, 166–171.
Theodoulou A, Notley C, Rigotti NA, Turner T, et al: Electronic cigarettes for 37. Electronic cigarette dollar sales worldwide from 2008 to 2017
smoking cessation. Cochrane Database of Systematic Reviews 2021(9). (in million U.S. dollars) [https://www.statista.com/chart/9607/
15. Thomas KH, Dalili MN, López-López JA, Keeney E, Phillippo D, Munafò MR, sales-electronic-cigarettes-dollar-sales-worldwide/].
Stevenson M, Caldwell DM, Welton NJ: Smoking cessation medicines and 38. Hyndman RJ, Athanasopoulos G. Forecasting: principles and practice. 2nd ed.
e-cigarettes: a systematic review, network meta-analysis and cost-effective- Melbourne: OTexts; 2018.
ness analysis. 2021, 25:59. 39. 2019 Questionnaire Redesign https://www.cdc.gov/nchs/nhis/2019_quest_
16. Chan GCK, Stjepanović D, Lim C, Sun T, Shanmuga Anandan A, Connor JP, redesign.htm.
Gartner C, Hall WD, Leung J. A systematic review of randomized controlled 40. Goodwin R, Wall M, Galea S, Zvolensky MJ, Gbedemah M, Hu M-C, Hasin
trials and network meta-analysis of e-cigarettes for smoking cessation. Addict DS. Has nicotine dependence increased among smokers in the United
Behav. 2021;119:106912. States? A new test of the hardening hypothesis. Drug Alcohol Depend.
17. Goldenson NI, Shiffman S, Hatcher C, Lamichhane D, Gaggar A, Le GM, 2017;100(171):e76.
Prakash S, Augustson EM. Switching away from Cigarettes across 12 Months 41. Murphy-Hoefer R, Davis KC, King BA, Beistle D, Rodes R, Graffunder C. Associa-
among Adult Smokers Purchasing the JUUL System. Am J Health Behav. tion Between the Tips From Former Smokers Campaign and Smoking Cessa-
2021;45(3):443–63. tion Among Adults, United States, 2012–2018. Prev Chronic Dis. 2020;17:E97.
18. Selya AS, Shiffman S, Greenberg M, Augustson EM. Dual Use of Cigarettes 42. Rossheim ME, Livingston MD, Krall JR, Barnett TE, Thombs DL, McDonald KK,
and JUUL: Trajectory and Cigarette Consumption. Am J Health Behav. Gimm GW. Cigarette Use Before and After the 2009 Flavored Cigarette Ban. J
2021;45(3):464–85. Adolesc Health. 2020;67(3):432–7.
19. Le GM, Holt NM, Goldenson NI, Smith LC, Hatcher C, Shiffman S, Augustson 43. The US. Adult and Under-Age-18 Populations: 2020 Census https://www.
EM. Cigarette Smoking Trajectories in Adult Former Smokers Using the JUUL census.gov/library/visualizations/interactive/adult-and-under-the-age-of-
System. Am J Health Behav. 2021;45(3):505–26. 18-populations-2020-census.html.
20. Shiffman S, Holt NM. Smoking Trajectories of Adult Never Smokers 12 44. Mendez D, Warner KE. Setting a challenging yet realistic smoking prevalence
Months after First Purchase of a JUUL Starter Kit. Am J Health Behav. target for Healthy People 2020: learning from the California experience. Am J
2021;45(3):527–45. Public Health. 2008;98(3):556–9.
21. Pierce JP, Chen R, Kealey S, Leas EC, White MM, Stone MD, McMenamin SB, 45. Sedgwick P. Bias in observational study designs: cross sectional studies. BMJ:
Trinidad DR, Strong DR, Benmarhnia T, et al. Incidence of Cigarette Smoking Br Med J. 2015;350:h1286.
Relapse Among Individuals Who Switched to e-Cigarettes or Other Tobacco
Products. JAMA Netw Open. 2021;4(10):e2128810.
22. Barufaldi LA, Guerra RL, de Albuquerque RCR, Nascimento A, Chança RD, de Publisher’s Note
Souza MC, de Almeida LM. Risk of smoking relapse with the use of electronic Springer Nature remains neutral with regard to jurisdictional claims in
cigarettes: A systematic review with meta-analysis of longitudinal studies. Tob published maps and institutional affiliations.
Prev Cessat. 2021;29:29.