1. Introduction
1.1. Background
Healthcare spending, per person and as a percentage of the Gross Domestic Product (GDP), is the highest in the United States compared to any other country in the world [
1]. However, the US has a higher mortality rate for treatable or preventable conditions and double the mortality rate for multiple chronic conditions when compared to other countries [
1]. This indicates that increased spending may not be directly related to higher quality of care or higher patient outcomes According to the Centers for Disease Control and Prevention (CDC), costs associated with chronic diseases and mental health treatments accounted for 90% of all annual US healthcare expenses [
2]. In 2021, spending on healthcare in the U.S. increased to
$4.3 trillion (about
$13,000 per person in the U.S.) and healthcare expenditures represented 18.3% of GDP [
3]. Hospital care accounted for 31.1% of the 2021 expenditures, and private health insurance (28.5%), Medicare (21.2%), and Medicaid (17.2%) were the largest payers [
4].
Partially because of these national trends, patient safety and quality of care concerns have become more prominent in the past two decades. The Institute of Medicine’s (IOM’s) 2000 seminal report,
To Err Is Human: Building a Safer Health System estimated that as many as 98,000 deaths in hospitals each year could be the result of inpatient safety issues [
5]. A more recent study indicates that medical errors are the third leading cause of death in the U.S. and reported preventable medical errors surpass 250,000 annually [
6]. In response to these issues, numerous public and private entities have sought to advance patient safety and quality-enhancing initiatives. For example, in 2005, the Center for Medicare and Medicaid Services (CMS) pay-for-performance initiative associated Hospital-Acquired Conditions (HACs) with reduced Medicare payments as an incentive to reduce infection rates and improve overall patient safety [
7]. In 2006, the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) surveys of discharged patients were nationally implemented and included questions on several patient experience measures including patient-provider communications, the hospital environment, discharge instructions, and more. By 2007, the Institute for Healthcare Improvement’s (IHI) Triple Aim of Healthcare framework for improving health system performance called for the concurrent pursuit of improving the patient care experience, improving the health of populations, and reducing per capita costs of healthcare [
8]. Similarly, the Patient Protection Affordable Care Act of 2010 created the Hospital Value-Based Purchasing Program (VBP) and the Medicare Access and CHIP Reauthorization Act of 2015 provided financial rewards to doctors via the Quality Payment Program [
9]. Both are focused on improving the quality of care for Medicare patients [
10,
11]. And, earlier this year, the Joint Commission’s National Patient Safety Goals for 2023 suggestions for improving patient safety included the use of medicines safely and preventing mistakes in surgery [
12].
1.2. Relevance
These broad and expansive sets of guidance, regulations, and policies from numerous agencies and sources put hospitals and healthcare systems under increasing pressure to provide higher quality services, concurrently constrain costs for patient care, and maintain financial viability. This can be a challenging endeavor to accomplish. The American College of Healthcare Executives 2022 annual survey of Chief Executive Officers discloses that ‘financial challenges’ of healthcare organizations are a continuing top concern (#2) along with ‘patient safety and quality’ (#4), ‘governmental mandates’ (#5) and ‘patient satisfaction’ (#7) [
13,
14]. In particular, rural hospitals' financial solvency has been a persistent issue [
15]. A few subspecialties have managed to increase healthcare quality while controlling costs, but efforts to improve the value of healthcare systems by reducing costs, improving quality, and improving patient outcomes remain inconsistent across the US healthcare systems [
16].
Barriers to maintaining financial viability in the healthcare industry are numerous. They include payer reimbursement tied to quality of care improvements, patient safety mandates, cost of new technologies, unplanned readmissions, supply driven demand, and the increasing costs of healthcare delivery (e.g., labor, telehealth, medical devices, and supply chain expenses) [
17]. However, it is clear that failing to address patient safety issues is costly for US hospitals. As just one example, the cost of treating preventable adverse drug events related to inappropriately overriding medicine alerts was estimated to be between
$871 million to
$1.8 billion for US hospitals [
18]. And, when considered collectively, adverse events account for an estimated cost of
$20 billion annually in the United States [
19].
The prevalence and cost of preventable adverse events can affect hospital quality ratings and profitability. Related research has found positive quality–profitability relationships in numerous non-healthcare industries [
20,
21,
22,
23]. However, such research is relatively sparse in the healthcare setting. Barnes et al. (2017) only found 13 studies assessing the association between hospital quality measures and financial performance over 20 years (1997-2017) in their systematic literature review [
24]. Bai and Anderson (2016) suggest examining the quality factors related the hospital profitability but did not include it in their study on the topic [
25]. Similarly, Holt et. al (2011) and Enumah et al. (2022) also encourage the future examination of the association of quality-related organizational factors and hospital financial performance [
23,
26]. Although informative in their guidance, these few studies leave several unanswered questions to resolve. None of the studies incorporate the present measures of patient perceptions of quality, nor do they include measures that are currently financially incentivized by CMS and directly tied to organizational improvement.
Thus, building on the work of the referenced studies and noting their recognized limitations, the research team seeks to advance our understanding of the association between several contemporary quality measures and hospital profitability in acute care hospitals in the United States. We specifically aim to assess whether the quality of care from the perspective of the patient and clinical data are positively associated with a hospital’s ability to attract patients as measured by revenue. We intend to provide healthcare leaders and policy developers with insight into the studied relationship in the context of current market and hospital characteristics.
2. Literature Review
2.1. Hospital Financial Performance
Although there is a general lack of studies that evaluate the association between quality and financial performance in the healthcare setting, there are several prior studies that have examined the factors directly associated with financial performance. Such factors have included numerous organizational factors, practices, strategies, and/or organizational profiles. With respect to the relationship between organizational practices and/or strategies and financial performance, Kaissi et al. (2008) found that having a strategic plan, having the CEO lead the strategic planning regimen, and involving the Board of Directors are all factors that are positively associated with financial performance in terms of net income and profit margin [
27]. Another study regarding hospital-physician integration strategies found that involving physicians in hospital governance was associated with higher operating margins and the integration of financial arrangements between the hospitals and physicians was associated with decreased cost, while direct hospital ownership among physicians was associated with decreased operating margin and increased cost [
28]. A structural equation modeling study on the relationships between medical technology and information technology adoption strategies and financial performance found that both technologies were positively associated with financial performance in terms of the composite measure of return on assets, return on investment, and operating profit [
29]. In the same vein, the study of Zengul et al. (2018) found that the breadth of high-technology services was positively associated with total margin, among for-profit hospitals, while both the breadth and rareness of high medical technology were positively associated with total margin among not-for-profit hospitals [
30]. The study on the adoption of patient engagement strategy found that early adopters exhibited higher operating margins compared to the majority and later adopters [
31]. Nurse staffing strategy (increased nurse-to-patient ratio) was also found to be associated with increased hospital total profit margin, especially for hospitals operating in competitive markets, while McCue, Markm, and Harless (2003) found that registered nurse staffing level was positively associated with operating cost but had no significant effect on profit [
32,
33]. The more recent study by Lee et al. (2022) showed that hiring more advanced practice registered nurses compared to physicians was positively associated with operating margin and return on assets [
34]. Another staffing strategy regarding hospitalists indicated that using a high hospitalist staffing intensity strategy was associated with both increased revenue and higher operating costs, resulting in a marginally significant increase in operating profit (Epane et al., 2019) [
35]. Other organizational strategies such as privatization (Ramamonjiarivelo et Al. 2018), and merger (Groff, Lien, Su, 2007), were also found to positively impact financial performance in terms of margins and efficiency, respectively [
36,
37].
Extant studies examining the association between organizational factors and financial performance indicated that some factors affect financial performance. For instance, Gapenski, Vogel, and Langland-Orban (1993) found teaching status, number of beds, ownership status, system affiliation status, age of plant, case mix, average length of stay, and others [
38]. They categorized the determinant factors as organizational, managerial, patient mix, and market variables. Holt et al. (2011) added to the literature by examining current studies and categorizing ownership, governance, management strategy, integration, and quality as the five most studied determinants [
39]. Turner, Broom, Elliott, and Lee (2015) looked at the determinants of hospital profitability using the DuPont analysis tool and recommended further study of the relationship between quality outcomes and profitability [
40]. Bai and Anderson (2016) used similar metrics in their study of the key factors that most financially successful hospitals share [
25]. They found that for-profit ownership, higher markup, regional power, and price regulation had the largest positive association with hospital profitability, and yet identified quality performance as an area for further study. The more recent study by Lee et al. (2022) found that metropolitan location was positively associated with hospitals’ profitability in terms of return on assets and return on equity while rural location was associated with loss of profitability (negative operating margin) [
34]. They also found that government-owned hospitals and private not-for-profit hospitals are less profitable compared with for-profit hospitals; compared to non-teaching hospitals, teaching hospitals are less profitable in terms of operating margin.
2.2. Hospital Quality of Care
The World Health Organization (WHO) defines quality of care as “the degree to which health services for individuals and populations increase the likelihood of desired health outcome” [
41]. The Institute of Medicine reports elevated healthcare quality concerns on a national level [
42]. Subsequent efforts by numerous organizations including the Centers for Medicare & Medicaid (CMS), the Centers for Disease Control (CDC), and The Joint Commission (TJC) yielded an evolving list of programs designed to improve quality by prompting enhanced organizational performance. The Affordable Care Act of 2010 established the Hospital Value-Based Purchasing Program (VBP), which rewards more than 3,000 acute care hospitals with incentive payments for the quality of care they provide to Medicare beneficiaries. Numerous factors combine to influence any acute care hospital’s VBP score [
10].
The Hospital Value-Based Purchasing (HVBP) program continues to evolve on an annual basis.
Numerous data elements have been included in the program since its inception [
11]. The HVBP program now includes evaluation of the patient experience of care using the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) Survey, numerous clinical outcomes, and patient safety indicators (e.g., Central Line-Associated Blood Stream Infection (CLASBI), Catheter-Associated Urinary Tract Infection (CAUTI), Methicillin-Resistant Staphylococcus Aureus (MRSA), pneumonia, heart failure, acute myocardial infarction) as well as efficiency as determined by Medicare Spending per Beneficiary (MSPB). These measures join other CMS value-based programs, including the Hospital Readmissions Reduction Program (HRRP), the Hospital-Acquired Condition Reduction Program (HAC), the Physician Value-Based Modifier Program (PVBM), and the Medicare Access and CHIP Reauthorization Act of 2015 (MACRA) Quality Payment Program.
2.3. Hospital Quality of Care & Financial Performance
Some authors have noted that not all quality improvement initiatives are economically sustainable or provide a return to the organization [
43]. Despite the prevalence of improvement programs in the United States, the evidence is mixed regarding whether
these programs have had a positive effect [
44,
45,
46,
47]. Some have expressed concern about whether the efforts invested in quality improvement have had any meaningful return on investment [
48]
. Others have questioned whether the incentives in the current value-based purchasing models are sufficient to impart consequential improvement and if the aggregate results are worth the efforts involved in improving performance [
49,
50].
To address this issue, in a limited number of studies, some have endeavored to investigate the ‘business case’ of quality in the healthcare industry. Harkey and Vraciu (1992) and Alexander, Weiner, and Griffith (2006) both reported hospitals that pursue broad and intense baseline quality improvement programs demonstrated improved financial performance [
51,
52]. Similarly, Nelson et al. (1992) in their study of 15,095 randomly selected patients from 51 general medical/surgical hospitals owned by the Hospitals Corporation of America (HCA) found that patient ratings of hospital services, based on validated and reliable survey instrument (Hospital Quality Trends: Patient Judgment System), were positively associated with earnings before depreciation, interest and taxes per bed, net revenue per bed, and return on assets. In the same vein, Velez-Gonzalez et al. (2011) assessed the association between non-financial performance measures and financial performance of for-profit system hospitals and their finding suggest that quality of care in terms of Joint Commission’s quality composite score was positively associated with total margin and operating margin.
More recent studies focused on a limited set of outcome measures or adverse events and their associated financial implications. As an example, Beauvais, Richter, and Kim (2019) examined the impact of hospital safety scores from the Leapfrog Group on hospital financial performance and concluded there was a positive relationship between the scores and all financial measures tested [
53]. In subsequent work, Beauvais, et al. (2019) also determined there is a positive association between hospital patient safety measures and financial performance [
54].
2.4. Conceptual Framework and Hypotheses
W. Edward Deming’s statement, “Profits are the result of attention to quality and customer satisfaction, while the reverse is rarely true,” captures a viewpoint that has reformed numerous industries since the 1950s [
55]. We refer to Deming’s insights for our research and draw further clarity from the later work of Rust, Zahorik, and Keiningham (1995) who provide a guide to conceptualizing how improved quality performance can simultaneously increase revenues, reduce costs, enhance market share, and positively influence profitability in the service industry [
56]. These authors indicate superior service quality supports profitability in the services sector in two ways. First, the direct impact of cost reductions generated from service quality improvement on profitability. Second, quality improvement efforts can indirectly boost revenues via improved customer perception of quality, customer satisfaction, and customer retention. Third, positive word-of-mouth from satisfied customers attracts new customers, which ultimately increases revenues and market share. Thus, based on the body of empirical we conjecture that quality-enhancing initiatives at the hospital level are likely to be associated with improved financial outcomes. Therefore, we hypothesize that:
Hypothesis 1 (H1): Hospitals with better patient perceptions of quality performance will be associated with improved financial performance.
Hypothesis 2 (H2): Hospitals with lower readmission rates performance will be associated with improved financial performance.
Hypothesis 3 (H3): Hospitals with better HVBP Total Performance Scores will be associated with improved financial performance.
Hypothesis 4 (H4): Hospitals with better HVBP Domain Scores will be associated with improved financial performance.
3. Methods
3.1. Data
Data were obtained from Definitive Healthcare which contains the databases of several US healthcare organizations, such as hospitals, physician group practices, surgery centers, and long-term care organizations [
57]. Concerning US hospital data, Definitive Healthcare combines data from several sources, such as the American Hospital Association Annual Survey (hospital profile), Medicare Cost Report (financial data), and Hospital Compare (healthcare quality data). Definitive Healthcare provided 2,127 hospital observations for the year 2022. The original data set consisted of all 3,876 short-term acute care hospitals in the United States. All Federal hospitals, including 172 Veterans Affairs, 26 Indian Health Service, and 31 Military Health System facilities, were excluded from our study sample due to a lack of numerous relevant data elements. We removed an additional 1,520 facilities because of significant data missingness – particularly in the independent variables of interest. The final data set comprises 54.8 percent of the total active short-term acute care facility population in the United States.
3.2. Dependent Variable
Consistent with the Bai & Anderson (2016) study about the determinants of hospital profitability, the dependent variable analyzed in our study was the hospital’s net patient revenue per discharge (NPRPD) for the year 2022 [
25]. The year 2022 was specifically chosen as it was the most recent complete year of data. “Net patient revenue” reflects revenue for patient care only and does not include revenue from other operations such as the cafeteria, parking, rent, research, and educational activities. A “discharge” is defined as the formal release of a treated individual due to the conclusion of the clinical stay, either by death, return home, or transfer to another institution.
3.3. Independent Variables of Interest
Given the variety of perspectives and the robust number of quality measures available, eight independent variables were used for this study. The first independent variable includes the 2021 HCAHPS (Hospital Consumer Assessment of Healthcare Providers and Systems) Summary Star Rating [
58]. The HCAHPS survey asks discharged patients 29 questions about their experience with a hospital stay including questions about communication with nurses and doctors, the responsiveness of hospital staff, the cleanliness and quietness of the hospital environment, communication about medicines, discharge information, overall rating of the hospital, and would they recommend the hospital. The patient survey summary star rating is the average of all the Star Ratings of the HCAHPS measures. Hospitals can earn 1 to 5 stars for this metric, in which more stars are better [
58].
The second independent variable included in the study is the 2021 Hospital Compare Overall Rating. This measure provides consumer-focused aggregated scores related to hospitals’ performance by taking the weighted average of scores calculated based on measures of mortality, safety of care, readmission, patient experience, effectiveness of care, timeliness of care, and efficient use of medical imaging. The Hospital Compare Overall Rating is calculated using only measures reported to CMS through the Hospital Inpatient Quality Reporting (IQR) and Hospital Outpatient Quality Reporting (OQR) Programs. Hospitals can earn 1 to 5 stars for this metric, in which more stars are better [
59].
The third independent variable was the 2021 All Cause Hospital-Wide Readmission Rate. The 30-day rate indicates how many patients had to be readmitted back into a hospital within 30 days after they were originally discharged. Hospitals maintain lower readmission rates when they have appropriately resolved the patient’s healthcare needs without further intervention [
60].
The fourth through eighth variables considered included the 2021 Hospital Value Based Purchasing (VBP) Total Performance Score and associated domain scores. Value-based purchasing is a CMS program that adjusts a hospital's payments based on its performance in four equally weighted quality measurement domains to comprise its Total Performance Score. The domains include (1) clinical outcomes, (2) safety, (3) person and community engagement, and (4) efficiency and cost reduction [
61]. The “clinical outcomes” domain contains measures six measures including mortality from acute myocardial infarction (AMI), chronic obstructive pulmonary disease (COPD), coronary artery bypass graft (CABG), heart failure (HF), pneumonia (PN), and measure of complications from elective primary total hip / total knee arthroplasty. The “safety” domain contains six healthcare-associated infection measures including catheter-associated urinary tract infections (CAUTIs), central line associated bloodstream infections (CLABSIs), clostridium difficile infections (C. diff), methicillin resistant staphylococcus aureus bacteremia (MRSA), surgical site infection (SSI) from abdominal hysterectomy, and SSIs from colon surgery. The “person and community engagement” domain contains eight dimensions derived from the HCAHPS Survey including communication with nurses, communication with doctors, responsiveness of the hospital staff, communication about medicines, cleanliness and quietness of the hospital environment, discharge information, care transitions, and the overall rating of the hospital. Lastly, the “efficiency and cost reduction” domain contains one measure related to Medicare Spending per Beneficiary [
61].
3.4. Controls
Numerous independent variables are included in the study to account for the variation in hospital profitability associated with various individual hospital and hospital market characteristics, including the total assets per staffed bed (in millions), the complication/comorbid and major complication/comorbid (CC/MCC) rate, urban or rural location, local hospital market concentration (as measured via the Herfindahl–Hirschman Index), government-operated or not, the average daily census, surgical case mix index, medical case mix index, and overall case mix index, Medicaid days of service, Medicare days of service, bed utilization rate, average age of the facility (in years), average length of stay, amount of uncompensated care (in millions), amount of charity care (in millions), the labor compensation ratio, and geographic region of the country (Southeast, Southwest, Midwest, West, or Northeast).
3.5. Analysis
The potential for reverse causality prompted us to use older quality data from the various public datasets to ensure that our two datasets did not fully overlap. This allows for the impact of improved quality performance to be realized in the hospital financial reporting systems. The practice of replacing an explanatory variable with its lagged value to counteract endogeneity is prevalent across a wide variety of disciplines in economics and finance [
54,
62,
63]. Due to the skewness of the dependent variable, the distribution was shifted, and natural log transformed. Due to the natural log transformation of the dependent variables, interpretation of our results requires adjustment of the parameter estimates for final analysis, we would say that an increase of one unit in 𝑥 is associated with a 100 × (𝑒
𝛽 −1) change in 𝑦. In more simple terms, this implies there is a percent change in y associated with a one-unit increase in x.
Multicollinearity was evaluated and any variables with a variance inflation factor over 10 were removed. To aid in ease of interpretation, all independent variables of interest were treated as continuous variables, including the Likert-scale Hospital Compare and HCAHPS Star Ratings. This approach is in alignment with prior research that indicates ordinal variables with five or more categories can be used as continuous data without any harm to the analysis [
64,
65,
66,
67]. Several control variables were also included as dichotomous measures, including rural = 1, urban = 0; government = 1, not government operated = 0; and for-profit = 1, not-for-profit = 0. Eight multivariable linear regressions with listwise deletion were conducted using IBM (International Business Machines) SPSS (Statistical Package for Social Sciences) Statistics package 28 [
68]. In each of the analyses performed, the association between the studied independent variables and the dependent variable was rejected at an α = .05. Model fit was assessed using adjusted
R2.
4. Results
A descriptive analysis of all variables is available in
Table 1. Our sample is comprised of only 8% rural hospitals (SD = 0.27), of which 13% are government operated (SD = 0.34), 20% are for-profit (SD = 0.40), and the majority of which are hospitals in the Southeast Region (30%; SD = 0.46). Our sample hospitals maintain an average age of plant of just over 14 years (SD = 10.17), keep an average of
$2.45 million in assets per staffed bed (SD = 6.34), sustain
$26.73 million in uncompensated care (SD = 56.69), perform
$10.11 million in charity care each year (SD = 26.0), experience a CC/MCC rate of 67% on average (SD = 0.07), and manage an average daily census of 146.36 (SD = 169.94). On average, these facilities’ patients are comprised of 9% Medicaid (SD = 0.08) and 28% Medicare (SD = 0.10) patients, utilize 56% bed occupancy (SD = 0.19), and utilize 45% of revenue to compensate their employees (SD = 0.19).
4.1. Primary Findings
Table 2 presents the multivariate regression results for our first four independent variables of interest. The beta coefficients, standard error (S.E.), and significance (Sig.) are given for the HCAHPS rating and Hospital Compare rating, Readmission Rate, and Total Performance Score. Our regression findings indicate that quality is associated with higher levels of hospital profitability across each of the first four quality dimensions. In our first analysis, hospital HCAHPS Summary Star Rating is positively associated with Net Patient Revenue per Discharge (
R² = 48.2%,
β: 0.088, S.E.: 0.01, p < 0.001). One practical interpretation of these results, given our dependent variable is natural log transformed, is a one-point increase in a hospital’s HCAHPS Summary Star rating is associated with an 8.8% increase in Net Patient Revenue per Discharge. These findings are supportive of our first hypothesis (H1). Similar findings were observed in the analysis of the Hospital Compare Rating. In this analysis, the Hospital Compare rating is positively associated with Net Patient Revenue per Discharge (
R² = 45.2%,
β: 0.034, S.E.: 0.01, p < 0.001). This could be interpreted to mean that a one-point increase in a hospital’s Hospital Compare rating is associated with a 3.4% increase in Net Patient Revenue per Discharge. These findings also appear to be supportive of our first hypothesis (H1).
With respect to hospitals’ All-Cause Readmission Rate, we observed a negative association with Net Patient Revenue per Discharge (
R² = 43.9%,
β: -0.017, S.E.: 0.01, p < 0.01). We could infer this to mean that a 1% increase in the All-Cause Readmission Rate is associated with a 1.7% decrease in Net Patient Revenue per Discharge. These findings are supportive of our second hypothesis (H2). In the final column in
Table 2, we noted that the HVBP Total Performance Score is positively associated with Net Patient Revenue per Discharge (
R² = 45.8%,
β: 0.005, S.E.: 0.00, p < 0.001). This implies that for a one-point increase in Total Performance Score, there is an associated 0.5% increase in Net Patient Revenue per Discharge. These findings are supportive of our third hypothesis (H3).
Table 3 presents similar multivariate regression results for our second set of four independent variables of interest pertaining to the HVBP sub-domains. In this set of variables, our findings still generally indicate that quality is associated with higher levels of hospital profitability, with one exception. In our first analysis in
Table 3, the HVBP Clinical Domain score is not significant. This finding is contrary to our fourth hypothesis (H4).
In our second analysis on
Table 3, we note that the HVBP Safety Domain Score is positively associated with Net Patient Revenue per Discharge (
R² = 46.2%,
β: 0.003, S.E.: 0.001, p < 0.01). One practical interpretation of these results is a one-point increase in a hospital’s Safety Domain Score is associated with a 0.3% increase in Net Patient Revenue per Discharge. These findings are supportive of our fourth hypothesis (H4).
In our third analysis, we observed that the HVBP Engagement Domain Score is positively associated with Net Patient Revenue per Discharge (R² = 48.6%, β: 0.016, S.E.: 0.001, p < 0.001). This could be interpreted to mean that a one-point increase in a hospital’s Engagement Domain Score is associated with a 1.6% increase in Net Patient Revenue per Discharge. These findings are supportive of our fourth hypothesis (H4).
In our final analysis in
Table 3, we see a positive association between the HVBP Efficiency Domain Score and Net Patient Revenue per Discharge (
R² = 46.3%,
β: 0.008, S.E.: 0.001, p < 0.001). This could be interpreted to mean that a one-point increase in a hospital’s Efficiency Domain Score is associated with a 0.8% increase in Net Patient Revenue per Discharge. These findings are also supportive of our fourth hypothesis (H4).
4.2. Secondary Findings
Although not originally considered in our hypothesis testing, there were several interesting secondary findings related to hospital net patient revenue per discharge that are worth noting in our analysis. Although there was variation across the eight analyses, findings were relatively consistent, and some were surprising in their directionality. Using the HCAHPS Summary Rating results from
Table 2 as our reported analysis, we noted positive associations with NPRPD from total assets per staffed bed (+1.2% in NPRPD per million in assets; S.E.: 0.001, p < 0.001), the CC/MCC rate (+36.3% in NPRPD per point change; S.E.: 0.098, p < 0.001), rural facilities (+6.4% in NPRPD; S.E.: 0.025, p < 0.001), market concentration (+13.3% in NPRPD per point increase; S.E.: 0.018, p < 0.001) and government operated facilities (+7.1% in NPRPD; S.E.: 0.017, p < 0.001). Similar positive associations were noted with the overall case mix index (+42.4% in NPRPD per point increase; S.E.: 0.032, p < 0.001), Medicare days (+0.2% in NPRPD per day; S.E.: 0.001, p < 0.001), average length of stay (+8.7% in NPRPD per day; S.E.: 0.006, p < 0.001), and the Western geographic region (+10.3% in NPRPD – compared to the Northeast region; S.E.: 0.019, p < 0.001).
Significant negative associations were also noted including for-profit status (-8.8% in NPRPD per day; S.E.: 0.014, p < 0.001), surgical case mix index (-18.5% in NPRPD per unit increase; S.E.: 0.018, p < 0.001), medical case mix index (-24.3% in NPRPD per unit increase; S.E.: 0.076, p < 0.001), bed utilization (-0.3% in NPRPD per point increase; S.E.: 0.000, p < 0.001), average age of facility (-0.1% in NPRPD per year increase; S.E.: 0.001, p < 0.01), charity care (-0.1% in NPRPD per million; S.E.: 0.000, p < 0.05), and labor compensation ratio (-0.2% in NPRPD per percent increase; S.E.: 0.000, p < 0.001). Both the Southeast geographic region (-16.2% in NPRPD; S.E.: 0.017, p < 0.001) and Southwest geographic region (-15.7% in NPRPD; S.E.: 0.021, p < 0.001) reflected a significantly lower NPRPD when compared to the Northeast region.
5. Discussion
In general, our results indicate that improved quality performance is associated with improved hospital profitability as measured by net operating margin per discharge. With the exception of the HVBP clinical care sub-domain, our findings appear to support the prior work of Rust, Zahorik, and Keiningham (1995) who conceptualized quality as a two-pronged value to the organization via market recognition and improved internal performance [
56]. As we examine our study outcomes in more detail, we first turn our attention to the HVBP Total Performance Score and note the strong association that exists between this measure of hospital performance and net patient revenue per discharge. To extrapolate the results further, with each additional point in the TPS score, measured on a 0-100 scale, our results indicate there is an associated 0.5% increase in net patient revenue per discharge. This would seem to indicate improving overall organizational quality is at least partially self-sustaining financially.
Our findings related to HCAHPS, the Hospital Compare Star Rating, and HVBP Engagement scores lend further support to the premise that quality performance is associated with revenue enhancement. These results, each measuring a slightly different perspective of patient perceptions of quality, indicate that improved quality is recognized in the marketplace by payers, providers, and patients, which may have a downstream impact on profitability. In addition, we observe that quality improvements related to readmission rates and safety performance are also associated with improved financial position. This appears to support the work of both Beauvais, Richter, and Kim (2019) and Beauvais, et al., (2019) [
53,
54]. In each case, the authors were able to identify a statistically significant association between patient safety performance and improved profitability. Logically, the readmissions finding is related to the fact hospitals are liable for the total expense of readmissions resulting from a prior episode of care within the past 30 days. It is also plausible to consider improved safety scores related to performing care with fewer costly errors, less waste, and increased efficiency.
In contrast to our collective findings showing an association between quality and financial performance, we noted some relationships in our analysis that require additional thought. Among our primary independent variables of interest, only the HVBP clinical performance sub-domain was found to not be significantly associated with hospital profitability. This is ironic given the central role that clinical care has in generating income for any hospital. However, we conjecture that a more nuanced analysis of the impact of clinical performance is required to gain an appreciation of why the clinical care measure was not associated with profitability. Future researchers might consider evaluating the quality of care or performing a cost analysis at the service line or even the procedural level. Unfortunately, developing a study of this granular nature is not possible with the currently available dataset.
Our secondary findings are also of interest and worth discussing. Although these results are not our original focus, the magnitude, directionality, and significance of some of the findings are worth noting. The case mix index and CC/MCC rates are perhaps the two most notable variables on this list. The case mix index is a metric that reflects the diversity, complexity, and severity of the patients treated at a healthcare facility, such as a hospital. The case mix index is used by the Centers for Medicare and Medicaid Services (CMS) to determine hospital reimbursement rates for Medicare and Medicaid beneficiaries [
43]. The CC/MCC Rate is a measure of the incidence of complications (CCs) and major complications (MCCs) within a period. The numerator is the number of patients with Medicare Severity Diagnosis Related Groups (MS-DRGs) defined by the presence of a CC or MCC. The denominator is the total number of Inpatient Prospective Service (IPPS) patients [
43]. In our study, we find a full point change in CMI (range 1.01 – 3.85) is associated with a 42.4% increase in NPRPD. Likewise, a full point increase in CC/MCC (range 0.13 – 0.86) is associated with a 36.3% increase in NPRPD (S.E.: 0.098, p < 0.001), but given this variable range, a full point change is not possible. Nonetheless, a tenth of a point is associated with a 3.63% increase, which is a noteworthy increase. Beyond these two measures, several other variables provided intriguing results and may be worthy of future research.
5.1. Practice Implications
Others have previously suggested that improved hospital quality (e.g., surgical care improvement, safety scores, etc.) was associated with improved financial performance [
41,
42]. These prior researchers exposed some of the interactions between quality and profitability in hospital systems. However, in this study, we sought to take a more expansive look into the organizational data to see if other quality metrics are associated with financial performance in the same way prior researchers have found with patient safety performance. Our results were highly consistent within our study and also with prior authors’ findings. Although we believe more work needs to be done in this area, we contend that our findings continue to add to the evidence base that affirms the business case for improving organizational quality. With our results, healthcare leaders' support of focused investments in patient safety, the patient experience, reducing readmissions, and improving efficiency can be profitable irrespective of the influence of current or future value-based purchasing initiatives.
6. Limitations and Suggestions for Future Research
Several limitations are present in our study. First, the current study is drawn from a single data year (2022), and we have lagged independent and control variables (2021) to address endogeneity and reverse causality. In the future, we could consider the tested relationship by using longitudinal data.
Second, there may be additional significant factors that influence the variation in our chosen dependent variable. Although we tested a broad range of variables in our tested models, and our regressions maintained relatively strong R2 values, we recognize other variables that influence our studied relationship that we are not capturing in our study. For instance, we conjecture variables such as the service mix, the demographics of the supported patient population, the range of services offered by the hospital, and the composition of the clinical staff may all be relevant in teasing out additional variation in the dependent variable.
A final limitation centers on the fact that all our chosen quality-dependent variables are weighted aggregates. Although this provides consistency across our studied population, additional insight might be gained by examining our study relationship on more granular aspects of each of the current independent variables. As an example, even though we have evaluated each of the sub-domains of the value-based purchasing Total Performance Score, we could delve more deeply into the component measures of the sub-domains. Likewise, future analysis could examine the granular components of the All-Cause Readmission Rate to see if there are specific readmission types that have more or less influence on hospital profitability. Similar efforts could be applied to the measures supporting the Hospital Compare overall rating or the HCAHPS summary star rating.
7. Conclusions
Historically hospital leaders have been reluctant to invest in quality improvement and safety programs, with up to 92% indicating they did not have a budget line item attributed to patient safety twenty years ago [
42]. We contend those days are in the past. There has been, and likely always will be, a trade-off between quality improvement and hospital profitability. However, our research indicates improved performance in enhancing the patient experience, reducing readmissions, and improving patient safety may be associated with improved hospital financial performance, especially given the expanding role of value-based case incentives and evolving healthcare reimbursement structures
. We believe that this research provides an encouraging and reassuring message to healthcare leaders as it justifies investing in hospital quality improvement projects. Specific recommendations regarding the exact allocation of resources are premature, however, there is broad support for action, and we suggest that this support will only continue to strengthen over time.
Author Contributions
Conceptualization, B.B. and D.D.; methodology, B.B.; software, B.B.; validation, B.B., D.D., Z.R., C.L., and M.N.; formal analysis, B.B.; investigation, B.B., D.D., and Z.R.; resources, B.B.; data curation, B.B.; writing—original draft preparation, B.B., D.D., and Z.R.; writing—review and editing, Z.R., C.L., and M.N.; visualization, B.B.; supervision, B.B.; project administration, B.B.; funding acquisition, B.B. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
All analyses were conducted in SPSS, Version 28, and all tables were constructed in Microsoft Excel.
Acknowledgments
The authors would like to thank Scott Kruse in the School of Health Administration at Texas State University for his guidance and support.
Conflicts of Interest
The authors declare no conflict of interest.
References
- The Commonwealth Fund. U.S. Health Care from a Global Perspective, 2022: Accelerating Spending, Worsening Outcomes. Available online: https://www.commonwealthfund.org/publications/issue-briefs/2023/jan/us-health-care-global-perspective-2022 (accessed on 9/16/2023).
- National Center for Chronic Disease Prevention and Health Promotion. Health and Economic Costs of Chronic Diseases. Available online: https://www.cdc.gov/chronicdisease/about/costs/index.htm (accessed on 9/16/2023).
- American Medical Association. Trends in health care spending. Available online: https://www.ama-assn.org/about/research/trends-health-care-spending (accessed on 9/16/2023).
- Telesford, I.; Rakshit, S.; McGough, M.; Wager, E.; Amin, K. How Has U.S. Spending on Healthcare Changed Over Time? R. Available online: https://www.healthsystemtracker.org/chart-collection/u-s-spending-healthcare-changed-time/ (accessed on 9/27/2023).
- Kohn, L.T.; Corrigan, J.M.; Donaldson, M.S. To err is human: Building a safer health system; National Academies Press: Washington, DC, 2000. [Google Scholar]
- Makary, M.A.; Daniel, M. Medical error—the third leading cause of death in the US. BMJ Open 2016, 353. [Google Scholar] [CrossRef] [PubMed]
- Centers for Medicare & Medicaid Services. Hospital-Acquired Condition Reduction Program. Available online: https://www.cms.gov/medicare/quality/value-based-programs/hospital-acquired-conditions (accessed on 9/10/2023).
- Berwick, D.M.; Nolan, T.W.; Whittington, J. The triple aim: care, health, and cost. Health affairs (Project Hope) 2008, 27, 759–769. [Google Scholar] [CrossRef] [PubMed]
- Centers for Medicare & Medicaid Services. The Medicare Access and Chip Reauthorization Act of 2015. Available online: https://www.cms.gov/medicare/quality/value-based-programs/chip-reauthorization-act (accessed on 9/27/2023).
- HHS. About the Affordable Care Act. Available online: https://www.hhs.gov/healthcare/about-the-aca/index.html (accessed on 9/10/2023).
- Centers for Medicare and Medicaid Services. The Hospital Value-Based Purchasing (VBP) Program. Available online: https://www.cms.gov/medicare/quality/value-based-programs/hospital-purchasing (accessed on 9/10/2023).
- The Joint Commission. Hospital National Patient Safety Goals. Available online: https://www.jointcommission.org/-/media/tjc/documents/standards/national-patient-safety-goals/2023/2023-hap-npsg-goals-102122_simple.pdfs (accessed on.
- American College of Healthcare Executives (ACHE). Top Issues Confronting Hospitals in 2022. Available online: https://www.ache.org/learning-center/research/about-the-field/top-issues-confronting-hospitals/top-issues-confronting-hospitals-in-2022 (accessed on 9/4/2023).
- Gamble, M.; Ten most concerning issues for hospital CEOs. Becker’s Hospital Review. Available online: http://www.beckershospitalreview.com/hospital-management-administration/10-most-concerning-issues-for-hospital-ceos.html (accessed on 9/4/2023).
- Ge, B.; Yehia, F.; Wei, C.; Anderson, G.F. Varying Trends In The Financial Viability Of US Rural Hospitals, 2011-17. Health Affairs 2020, 39, 942–948. [Google Scholar] [CrossRef]
- Kokko, P. Improving the value of healthcare systems using the Triple Aim framework: A systematic literature review. Health policy 2022. [Google Scholar] [CrossRef]
- American Hospital Association. The Financial Stability of America's Hospitals and Health Systems Is at Risk as the Costs of Caring Continue to Rise. Available online: https://www.aha.org/system/files/media/file/2023/04/Cost-of-Caring-2023-The-Financial-Stability-of-Americas-Hospitals-and-Health-Systems-Is-at-Risk.pdf (accessed on 9/25/2023).
- Slight, S.P.; Seger, D.L.; Franz, C.; Wong, A.; Bates, D.W. The national cost of adverse drug events resulting from inappropriate medication-related alert overrides in the United States. Journal of the American Medical Informatics Association : JAMIA 2018, 25, 1183–1188. [Google Scholar] [CrossRef] [PubMed]
- Rodziewicz, T.L.; Houseman, B.; Hipskind, J.E. Medical Error Reduction and Prevention. [Updated 2023 May 2]. In StatPearls [Internet]; StatPearls Publishing: Treasure Island (FL), Jan- 2023; Available from: https://www.ncbi.nlm.nih.gov/books/NBK499956/.
- Mellat-Parast, M.; Golmohammadi, D.; McFadden, K.L.; Miller, J.W. Linking business strategy to service failures and financial performance: Empirical evidence from the US domestic airline industry. Journal of Operations Management 2015, 38, 14–24. [Google Scholar] [CrossRef]
- Angelini, A.; Bianchi, M. Service quality and profitability. An empirical study about clients and financial advisors of the Allianz Bank F. A. International Journal of Management Cases 2015, 17, 7–18. [Google Scholar]
- Haines, S. The systems thinking approach to strategic planning and management.; CRC Pres: Boca Raton, FL, 2016. [Google Scholar]
- Enumah, S.J.; Resnick, A.S.; Chang, D.C. Association of measured quality with financial health among US hospitals. Plos one 2022, 17. [Google Scholar] [CrossRef] [PubMed]
- Barnes, C.M.; Nurettin, O.; Zengul, F. Exploring the Association between Quality and Financial Performance in U.S. Hospitals: A Systematic Review. Journal of Healthcare Finance 2017, 44. [Google Scholar]
- Bai, G.; Anderson, G.F. A more detailed understanding of factors associated with hospital profitability. Health Affairs 2016, 35, 889–897. [Google Scholar] [CrossRef]
- Holt, H.; Clark, J.; DelliFraine, J.; Brannon, D. Organizing for performance: What does the empirical literature reveal about the influence of organizational factors on hospital financial performance? Biennial Review of Health Care Management 2011, 11, 21–62. [Google Scholar] [CrossRef]
- Kaissi, A.A.; Begun, J.W. Strategic Planning Processes and Hospital Financial Performance. Journal of Healthcare Management 2008, 53, 197–209. [Google Scholar] [CrossRef] [PubMed]
- Goes, J.B.; Zhan, C. The effects of hospital-physician integration strategies on hospital financial performance. 1995, p. 507.
- Li, L.X.; Collier, D.A. The role of technology and quality on hospital financial performance : An exploratory analysis. International Journal of Service Industry Management 2000, 11, 202–224. [Google Scholar] [CrossRef]
- Zengul, F.D.; Weech-Maldonado, R.; Ozaydin, B.; Patrician, P.A.; O'Connor, S.J. Longitudinal analysis of high-technology medical services and hospital financial performance. Health Care Management Review 2018, 43, 2–11. [Google Scholar] [CrossRef] [PubMed]
- Asagbra, O.E.; Zengul, F.D.; Burke, D. Patient Engagement Functionalities in U.S. Hospitals: Is Early Adoption Associated With Financial Performance? 2019, p. 381.
- Everhart, D.; Neff, D.; Al-Amin, M.; Nogle, J.; Weech-Maldonado, R. The effects of nurse staffing on hospital financial performance : Competitive versus less competitive markets. Health Care Management Review 2013, 38, 146–155. [Google Scholar] [CrossRef]
- McCue, M.; Mark, B.A.; Harless, D. Nurse staffing, quality, and financial performance. Journal of Health Care Finance 2003, 29, 54–76. [Google Scholar]
- Lee, C.C.; Lee, J.; Foster, C.; Khan, H.; Zaidi, F.; Chaleun-Aloun, S. Determinants Of Hospital Profitability: Advanced Practice Registered Nurses, Location, Teaching Status, And Ownership. Global Journal of Accounting and Finance 2022, 6, 14. [Google Scholar]
- Epané, J.P.; Weech-Maldonado, R.; Hearld, L.; Menachemi, N.; Sen, B.; O'Connor, S.; Ramamonjiarivelo, Z. Hospitals’ use of hospitalists: Implications for financial performance. Health Care Management Review 2019, 44, 10–18. [Google Scholar] [CrossRef]
- Groff, J.E.; Lien, D.; Su, J. Measuring Efficiency Gains From Hospital Mergers. Research in Healthcare Financial Management 2007, 11, 77–90. [Google Scholar]
- Ramamonjiarivelo, Z.; Weech-Maldonado, R.; Hearld, L.; Pradhan, R.; Davlyatov, G.K. The Privatization of Public Hospitals: Its Impact on Financial Performance. Medical Care Research & Review 2020, 77, 249–260. [Google Scholar] [CrossRef]
- Gapenski, L.C.; Vogel, W.B.; Langland-Orban, B. The determinants of hospital profitability. Journal of Healthcare Management 1993, 38, 63–80. [Google Scholar]
- Holt, H.; Clark, J.; DelliFraine, J.; Brannon, D. Organizing for performance: What does the empirical literature reveal about the influence of organizational factors on hospital financial performance? Biennial Review of Health Care Management 2011, 11, 21–62. [Google Scholar] [CrossRef]
- Turner, J.; Broom, K.; Elliott, M.; Lee, J.F. A decomposition of hospital profitability: An application of DuPont analysis to the US market. Health Services Research and Managerial Epidemiology. Health Services Research and Managerial Epidemiology 2015. [Google Scholar] [CrossRef]
- World Health Organization. Quality of care. Available online: https://www.who.int/health-topics/quality-of-care#tab=tab_1 (accessed on 9/18/2023).
- Devers, K.J.; Pham, H.H.; Liu, G. What is driving hospitals’ patient-safety efforts? Health Affairs 2004, 23, 103–115. [Google Scholar] [CrossRef]
- Aaker, D.; Jacobson, R. The financial information content of perceived quality. Journal of Marketing Research 1994, 31, 191–201. [Google Scholar] [CrossRef]
- Rosenthal, M.B.; Frank, R.G.; Li, Z.; Epstein, A.M. Early experience with pay-for-performance: From concept to practice. JAMA 2005, 194, 1788–1793. [Google Scholar] [CrossRef]
- Landrigan, C.P.; Parry, G.J.; Bones, C.B.; Hackbarth, A.D.; Goldmann, D.A.; Sharek, P.J. Temporal trends in rates of patient harm resulting from medical care. New England Journal of Medicine 2010, 363. [Google Scholar] [CrossRef]
- Figueroa, J.F.; Tsugawa, Y.; Zheng, J.; Orav, E.J.; Jha, A.K. Association between the Value-Based Purchasing pay for performance program and patient mortality in US hospitals: Observational study. BMJ 2016, 353. [Google Scholar] [CrossRef] [PubMed]
- Glickman, S.W.; Ou, F.S.; DeLong, E.R.; Roe, M.T.; Lytle, B.L.; Mulgund, J.; Rumsfeld, J.S.; Gibler, W.B.; Ohman, E.M.; Schulman, K.A.; Peterson, E.D. Pay for performance, quality of care, and outcomes in acute myocardial infarction. JAMA 2007, 197, 2373–2380. [Google Scholar] [CrossRef] [PubMed]
- Swensen, S.J.; Dilling, J.A.; Mc Carty, P.M.; Bolton, J.W.; Harper, C.M., Jr. The business case for health-care quality improvement. Journal of Patient Safety 2013, 9, 44–52. [Google Scholar] [CrossRef]
- Jha, A.K. Time to get serious about pay for performance. JAMA 2013, 309, 347–348. [Google Scholar] [CrossRef]
- Jha, A.K. Value-based purchasing: Time for reboot or time to move on? JAMA 2017, 317, 1107–1108. [Google Scholar] [CrossRef]
- Alexander, J.A.; Weiner, B.J.; Griffith, J. Quality improvement and hospital financial performance. Journal of Organizational Behavior, 2006, 2006. [Google Scholar] [CrossRef]
- Harkey, J.; Vraciu, R. Quality of health care and financial performance: Is there a link? Health Care Management Review 1992, 17, 55–63. [Google Scholar] [CrossRef]
- Beauvais, B. , Richter, J.P., & Kim, F.S. Doing well by doing good: Evaluating the influence of patient safety performance on hospital financial outcomes. Health Care Management Review 2019, 44, 2–9. [Google Scholar] [CrossRef]
- Beauvais, B.; Richter, J.P.; Kim, F.S.; Sickels, G.; Hook, T.; Kiley, S.; Horal, T. Does patient safety pay? Evaluating the association between surgical care improvement project performance and hospital profitability. Journal of Healthcare Management, 2019, 64, 142–154. [Google Scholar] [CrossRef]
- Deming, W.E. Out of the crisis; Massachutes Institute of Technology: Cambridge, MA, 1988. [Google Scholar]
- Rust, R.T.; Zahorik, A.J.; Keiningham, T.L. Return on quality (ROQ): Making service quality financially accountable. The Journal of Marketing 1995, 59. [Google Scholar] [CrossRef]
- Definitive Healthcare. Available online: https://www.definitivehc.com/ (accessed on 9/17/2023).
- Centers for Medicare and Medicaid Service. HCAHPS: Patients’ Perspectives of Care Survey. Available online: https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/HospitalQualityInits/HospitalHCAHPS (accessed on 9/10/2023).
- Centers for Medicare and Medicaid Services. Hospital Quality Initiative Public Reporting – Hospital Care Compare and Provider Data Catalog.
- Benbassat, J.; Taragin, M. Hospital readmissions as a measure of quality of health care: advantages and limitations. Archives of internal medicine 2000, 160, 1074–1081. [Google Scholar] [CrossRef]
- Centers for Medicare and Medicaid Services. Hospital Value Based Purchasing – Total Performance Score. Available online: https://data.cms.gov/provider-data/dataset/ypbt-wvdk (accessed on 9/10/2023).
- Stiebale, J. Do financial constraints matter for foreign market entry? A firm-level examination. World Economy 2011, 34, 123–153. [Google Scholar] [CrossRef]
- Buch, C.; Koch, C.T.; Koetter, M. Do banks benefit from internationalization? Revisiting the market power–risk nexus. Review of Finance 2013, 17. [Google Scholar] [CrossRef]
- Johnson, D.R.; Creech, J.C. Ordinal measures in multiple indicator models: A simulation study of categorization error. American Sociological Review 1983, 398–407. [Google Scholar] [CrossRef]
- Norman, G. Likert scales, levels of measurement and the “laws” of statistics. Advances in health sciences education 2010, 15, 625–632. [Google Scholar] [CrossRef] [PubMed]
- Sullivan, G.M.; Artino, A.R., Jr. Analyzing and interpreting data from Likert-type scales. Journal of graduate medical education, 2013, 5, 541–542. [Google Scholar] [CrossRef]
- Zumbo, B.D.; Zimmerman, D.W. Is the selection of statistical methods governed by level of measurement? Canadian Psychology/Psychologie Canadienne 1993, 34, 390. [Google Scholar] [CrossRef]
- IBM Corp. IBM SPSS Statistics for Windows (Version 28.0) [Computer software]. 2023.
Table 1.
Descriptive Statistics.
Table 1.
Descriptive Statistics.
Table 2.
Regression Results – HCAHPS, Hospital Compare, Readmissions & Total Performance Score.
Table 2.
Regression Results – HCAHPS, Hospital Compare, Readmissions & Total Performance Score.
Table 3.
Regression Results – HVBP Sub-Domains (Clinical, Safety, Engagement & Efficiency).
Table 3.
Regression Results – HVBP Sub-Domains (Clinical, Safety, Engagement & Efficiency).
|
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).