Skip to main content
Download PDF

The application research of AI image recognition and processing technology in the early diagnosis of the COVID-19

BMC Medical Imaging volume 22, Article number: 29 (2022) Cite this article

Abstract

Background

This study intends to establish a combined prediction model that integrates the clinical symptoms,the lung lesion volume, and the radiomics features of patients with COVID-19, resulting in a new model to predict the severity of COVID-19.

Methods

The clinical data of 386 patients with COVID-19 at several hospitals, as well as images of certain patients during their hospitalization, were collected retrospectively to create a database of patients with COVID-19 pneumonia. The contour of lungs and lesion locations may be retrieved from CT scans using a CT-image-based quantitative discrimination and trend analysis method for COVID-19 and the Mask R-CNN deep neural network model to create 3D data of lung lesions. The quantitative COVID-19 factors were then determined, on which the diagnosis of the development of the patients' symptoms could be established. Then, using an artificial neural network, a prediction model of the severity of COVID-19 was constructed by combining characteristic imaging features on CT slices with clinical factors. ANN neural network was used for training, and tenfold cross-validation was used to verify the prediction model. The diagnostic performance of this model is verified by the receiver operating characteristic (ROC) curve.

Results

CT radiomics features extraction and analysis based on a deep neural network can detect COVID-19 patients with an 86% sensitivity and an 85% specificity. According to the ROC curve, the constructed severity prediction model indicates that the AUC of patients with severe COVID-19 is 0.761, with sensitivity and specificity of 79.1% and 73.1%, respectively.

Conclusions

The combined prediction model for severe COVID-19 pneumonia, which is based on deep learning and integrates clinical aspects, pulmonary lesion volume, and radiomics features of patients, has a remarkable differential ability for predicting the course of disease in COVID-19 patients. This may assist in the early prevention of severe COVID-19 symptoms.

Peer Review reports

Background

Pneumonia is a highly contagious disease caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection that emerged in December 2019 [1, 2]. At the beginning of the epidemic in China, of 1,099 laboratory-confirmed COVID-19 patients, 5.0% were admitted to intensive care units (ICU), 2.3% received invasive mechanical ventilation, and 1.4% died [3, 4]. COVID-19 represents a wide spectrum of clinical manifestations, including fever, cough, and fatigue, which may cause fatal acute respiratory distress syndromes [4]. COVID-19 has been proven to be infectious from person to person [5], and the World Health Organization (WHO) has declared COVID-19 a pandemic [6]. Therefore, the identification of risk factor parameters and the establishment of accurate prognostic prediction models are expected to improve clinical outcomes. Planning for early intervention and enhancing surveillance is critical in the event of a pandemic.

Currently, the sarS-COV-2 reverse transcription polymerase chain reaction (RT-PCR) is the preferred method for the detection of COVID-19 [7]. However, this method has the disadvantages of being a time-consuming and having a high false negative rate [8]. Computed tomography (CT) has a natural advantage in displaying lung lesions, and it is an important tool for the diagnosis, treatment and prognosis evaluation of lung diseases including pneumonia [9]. Chest CT images of the patients with COVID-19 pneumonia can provide detailed information related to pathology, as well as quantitative measurement of the size of the lesion and the severity of pulmonary involvement [2, 10, 11]. Recent research has also demonstrated that while RT-PCR is negative, chest CT can reveal lung abnormalities [12, 13]. Therefore, CT is a valuable auxiliary diagnostic tool for the early diagnosis and genotyping of patients with suspected COVID-19 pneumonia.

AI technology is a diagnostic assistance technology that has progressed rapidly in recent years, with impressive achievement in many medical domains [14,15,16]. As an AI method, deep learning has shown important clinical value in the use of CT images to assist in the analysis of lung diseases [17,18,19]. Thanks to powerful feature learning capabilities, deep learning can automatically detect features related to clinical results from CT images. Recent studies have shown [20] that using CT scanning to establish an AI system to detect COVID-19 can help radiologists and clinicians treat patients suspected of COVID-19. Gozes et al. (2020) used commercial software RADLogics Inc to detect pulmonary nodules and ground-glass opacities on 3D thoracic CT scans, and combined with 2D convolutional neural networks to segment the lung area and diagnose COVID-19. The test achieved an AUC of 0.996, sensitivity of 98.2%, and specificity of 92.2% on a dataset of 107 cases [21].

Critically ill patients with COVID-19 pneumonia have a significant fatality rate. 1.6% of active cases are in a severe or critical condition [22], and the mortality rate of critically ill patients is as high as 61.5% [23]. To reduce the rate of severe illness and mortality, it is critical to identify patients who are at risk of critical illness and are most likely to benefit from intensive care therapy as soon as possible. We can create an early warning model of severe COVID-19 using the Recurrent Neural Network (RNN) deep neural network and a comprehensive analysis of the thoracic CT radiomics and the patient's clinical characteristics. We expect to apply this model to generate early predictions regarding confirmed COVID-19 patients, allowing us to make more appropriate hierarchical management decisions, enhance patient prognosis, and reduce social medical costs.

Methods

Data source

According to the standards of COVID-19 Diagnosis and Treatment Protocol (Trial 7th Edition) [24], this research included 386 cases in Tianyou Hospital, which is Affiliated with Wuhan University of Science and Technology, the First Affiliated Hospital of Zhejiang University School of Medicine, and the First hospital of Jiaxing. Among the confirmed COVID-19 patients, 205 of them have CT image samples, and each patient took one or more CT images during the treatment. A total of 522 packets of CT image samplefrom COVID-19 patients and 95 packets of CT image of normal people were collected at the same time. The main clinical basic information of the patients was collected and sorted out, including the patient's basic demographic data, basic comorbidities, epidemiological histories, classification of the severity of the condition at admission, changes in the condition during treatment, symptoms during treatment, and laboratory examinations results etc. The control group consisted of samples from healthy patients who had not been infected with COVID-19 over the same time period.

Patient diagnosis and clinical classification

The included patients met the following diagnostic criteria: high-throughput sequencing or RT-PCR of nasopharyngeal swab specimens were positive. According to the standards of the COVID-19 Diagnosis and Treatment Protocol (Trial 7th Edition), this research divides COVID-19 pneumonia into mild, moderate, and severe types. Since there are no pneumonia indications in the images of patients with mild symptoms, the study classified mild pneumonia as moderate pneumonia as well, in order to distinguish clinically diagnosed severe COVID-19 pneumonia from the other two types.

CT image labeling and quality control

In order to train and evaluate our semantic segmentation framework, we manually segmented 100 CT slices manifesting COVID-19 features from 10 patients. Annotation was done through polygons. The segmentation labels were used to distinguish the relevant pathological features of COVID-19 pneumonia from other common pneumonia. The annotation included lung fields and five commonly seen lesion categories, including Compliance of Lung (CL), ground glass shadow, pulmonary fibrosis, interstitial thickening, and pleural effusion. Three senior radiologists with 15 to 25 years of expertise annotated and assessed the segmentation.

In order to analyze the CT images of patients, all images were selected for quality control by deleting any scans that were low-quality or unreadable. All images were subjected to a hierarchical grading system that included two levels of qualified grading professionals with good professional expertise who could verify and correct the image labels. Each image that was imputed into the database began with a label that matched to the patient's diagnostic results. This was an initial quality check performed by radiologists with 5 to 15 years of clinical practice experience who acted as first-level graders to exclude images with serious artifacts or with significantly reduced image resolution. Then they looked at the CT images to see whether there were any lung lesions.

Model construction and verification

This research provides a CT-image-based COVID-19 pneumonia quantitative discrimination and trend analysis algorithm based on, through the Mask R-CNN deep neural network model [25], which extracts the contour of lungs and lesion locations from CT images to generate 3D lesion data and calculate COVID-19 pneumonia quantitative factors to determine whether the patient is infected by the pneumonia, and to determine the trend of patients’ condition (Fig. 1). Then, using CT imaging features and clinical parameters, an artificial neural network is used to create a prediction model for the severity of COVID-19. For training, an ANN is utilized, and the prediction model is validated using tenfold cross-validation (Fig. 2).

Fig. 1
figure 1

Flow chart of the quantitative discrimination and trend analysis algorithm of COVID-19 based on CT

Full size image
Fig. 2
figure 2

Design flow chart of the whole research

Full size image

Statistical analysis

The ROC and AUC were used to evaluate model performance. Sensitivity, specificity, and accuracy were determined by the selected operating point. The operating point between the low false-negative diagnosis rate (sensitivity) and the low positive diagnosis rate (1 − specificity) was set at different thresholds. The Pearson and Spearman correlation test of the Holm-Bonferroni Method was used for statistical analysis. The training, verification, and testing procedures of the deep learning model were carried out by using Pytorch (v.1.2.0). We used the Python scikit-learn library for data analysis [26] and used the Python matplotlib and seaborn libraries to draw graphics. We used the Python lightgbm and lifeline to predict prognosis. The measure value of sensitivity, specificity, and accuracy was also calculated by the Python scikit-learn library.

Results

Construction of a database of patients with COVID-19

Of 386 confirmed patients with COVID-19 included in this research, 205 had CT image specimens (Table 1); 207 (53.6%) were men and 179(46.4%) were women; the mean age of the patients was 57.3 years old; 362 (93.8%) had no previous smoking history; 293 (75.9%) had a history of underlining diseases, of which 45.3% had a history of two or more underlining diseases among which hypertension (123 cases) and diabetes (41 cases) being the most common; in the classification of severity of illness at the time of hospital admission, 45.6% of patients were mildly ill and 54.4% were critically or severely ill. During the treatment period, 47 patients who were mildly ill turned into critically ill patients. The data presented above suggested that the objects included in this research research can fully reflect the overall characteristics of the current COVID-19 patient population. The images of some patients during hospitalization were collected and analyzed, and these image files were archived and stored on the platform(Fig. 3).

Table 1 Patient’s clinical characteristics
Full size table
Fig. 3
figure 3

COVID-19 intelligent evaluation platform

Full size image

The utilization of CT radiomics features extraction and analysis based on a deep neural network

Based on the characteristics of Mask R-CNN [25] transfer learning, only the above-mentioned 100 CT slice images containing lesion information were employed, with 80 used for training and 20 used for testing. The test accuracy rate reached 90%, and the results of the testing model on the slice samples basically coincided with the opinions of medical experts.

The polygonal contours on the CT cross-section of the lungs were the focuses of infection predicted by the model (Fig. 4). Based on the deep learning network of Mask R-CNN, lung contours and the focuses of infection were extracted from CT images, and we generated 3D lesion data through intelligent matching and calculated the quantitative factors of COVID-19(Fig. 5). On the construction of the combined prediction model, 617 CT samples were utilized for testing, 522 of which were from critically ill patients, and the remaining 95 were samples from normal healthy people. On the basis of the deep neural network, we obtained the quantitative factors of the CT samples, and then performed the threshold discrimination. COVID-19 detection has an 86% sensitivity and an 85% specificity.

Fig. 4
figure 4

Schematic diagram of filing of patients’ CT images

Full size image
Fig. 5
figure 5

Schematic diagram of the CT lesion area of a patients’ lungs

Full size image

In-depth integration of CT radiomics features and clinical parameters to predict the severity of COVID-19

Following that, we employed artificial neural networks to create a prediction model for the severity of COVID-19 by combining distinctive imaging features on CT and clinical parameters. Among the 205 COVID-19 patients, 140 patients with both CT imaging and clinical data were selected, with 70 critically ill and 70 mildly ill. 11 imaging features were extracted from CT samples using the deep neural network and combined with 17 clinical measurement indicators during the hospitalization of the patient. The SelectKBest method was used to select the best 15 feature combinations from 28 features (Table 2). The ANN neural network was utilized for training, and the prediction model was verified using tenfold cross-validation. As shown in Fig. 6, the area under the curve (AUC) of the prediction model is 0.761, and the sensitivity and specificity of the model are 79.1% and 73.1%, respectively, reaching a prediction accuracy of 76.1%.

Table 2 CT image characteristics and clinical parameters
Full size table
Fig. 6
figure 6

Trend graph drawn on the basis of patients’ lesion information (quantification factor) on CT images

Full size image

Building the AI lung image recognition processing technological platform on the basis of the constructed deep neural network model

The research takes AI imaging technology as the core; CT imaging sample data of patients with COVID-19 as a motivator; servers, databases, and human–computer interaction interfaces as carriers to build an AI imaging platform with practical value. Relevant medical workers can log into the platform (Fig. 7) and use the functions with corresponding permissions. In the later stage, the account authority can be shared with the existing system of the hospital to realize the integration of the system platform.

Fig. 7
figure 7

Visualization platform for CT image features

Full size image

The platform can display lesion images, parameters, variation tendency of the disease, etc. (Fig. 8). The lesion information and severity of the pneumonia collected from the samples using the aforementioned AI model will be saved in the COVID-19 AI technology platform.Then, we can combine medical experience with calculated quantitative factors (Fig. 9) to explain the severity of the disease.

Fig. 8
figure 8

3D images of lesions. The 6 quantitative factors are as follows: i Number of lesions: calculating the number of lesions by 3D lesion data. The more the lesions, the more severe the condition. ii Maximum lesion length: calculating the maximum lesion length of each lesion. The larger the lesion, the more severe the condition. iii Lesion density: Generally, the more uneven the density of the lesions, the more severe the disease, and the higher the density, the more serious the disease. iv Lesion boundary: usually the boundaries of inflammation are blurry, and the boundaries of diseases such as cancer are clearer. v Distance from the edge of the lesion to the pleura: One of the characteristics of COVID-19 is that it often occurs under the pleura. vi The shape of the largest 3 lesions: usually the safer lesions are regular in shape, that is, round or oval, and the dangerous lesions are irregular in shape

Full size image
Fig. 9
figure 9

ROC curve of feature combination model

Full size image

Discussion

COVID-19 is an acute contagious disease with a high transmission rate and spreading rapidity, which has caused a global pandemic [4]. Chest CT is an important standard for diagnosis and discharge, and it plays a important role in the diagnosis, disease evaluation, and efficacy evaluation of COVID-19 [12]. However, CT may have certain imaging features in common between COVID-19 and other types of pneumonia, making differentiation difficult [27]. AI technology represented by deep learning has made a breakthrough in the domain of medical imaging [28, 29]. The image learning method, segmentation and applications in lung diseases are the research hotspots of AI in medical imaging with high clinical application potential [30]. Deep learning has been applied to detect and differentiate between bacterial and viral pneumonia on pediatric chest radiographs [31]. In this study, we proposed to build a severe COVID-19 early warning model based on the deep learning network of Mask R-CNN and chest CT images and patient clinical characteristics. We hope to make early predictions of severe COVID-19 patients by this model.

In recent years, an artificial intelligence imaging diagnosis system that can perform quantitative analysis and differential diagnosis of lung inflammation has become a research hotspot [16]. AI technology can extract image data information quickly and in parallel, allowing for a more comprehensive and detailed analysis of the nature of the lesion from the aspects of overall characteristics, peripheral characteristics, internal characteristics, and surrounding tissues, as well as other clinical characteristics of patients [21, 32]. The radiologic diagnostic tool built by AI technology for the diagnosis of COVID-19 has been confirmed to be helpful for the early screening of COVID-19 pneumonia [33, 34]. Li L et al. developed an AI program based on the results of chest CT scans. The sensitivity and specificity of the program for diagnosing patients with COVID-19 pneumonia were 90% and 96%, respectively [35]. Shi et al. used data from 1,658 COVID-19 patients and 1,027 community-acquired pneumonia patients to generate an AI program, and used five-fold cross-validation to obtain 90% sensitivity and 83% specificity in the detection of COVID-19 pneumonia [36]. On the other hand, Shan et al. created an AI program to assess the extent of lesion spread using the V-net and V-bet-based networks, and its Dice similarity coefficient was 91.6 ± 10(%), with an estimated error of the percentage of infection (POI) of 0.3 percent [37]. In this research, we used the Mask R-CNN deep neural network model to extract lung contours and lesion locations from CT images to generate 3D lesion data, and to calculate quantification factors for COVID-19 [38]. The quantification parameters of CT samples obtained using the deep learning network showed a sensitivity of 96% and a specificity of 85% for detecting COVID-19. Additionally, we combined CT image characteristics with clinical parameters and applied an AI neural network to develop a prediction model for the severity of COVID-19. The model, which was validated using tenfold cross-validation, had an AUC of 0.761 for detecting patients with severe COVID-19, and the sensitivity and specificity were 79.1% and 73.1%, respectively, showing that the model performed effectively.

This research builds an early warning model for severe COVID-19, which has a certain innovative contribution. Firstly, it overcomes the bottleneck of predictingwhether patients will become critically ill in the diagnosis and treatment of COVID-19 [39], and build a highly accurate early warning model for COVID-19, which can help health workers hierarchically manage confirmed patients and intervene in the diagnosis and treatment of high-risk patients in advance to improve patient prognosis and reduce social medical costs at the same time. In addition, the image features extracted by traditional radiomics methods are low-level or intermediate-level features, and these functions are not detailed enough to illustrate the deep information of the images. This research uses deep learning to extract the advanced radiological characteristics of CT images, and combines traditional radiomics and key clinical data to construct a high-performance early prediction model to realize the early warning of severe COVID-19. Furthermore, deep learning can provide more effective imaging features than conventional radiomics, but its main limitation, the black box, restricts its clinical application and promotion. This research uses the attention mechanism to assess the importance of each potential feature or component learned by the model in order to increase the accuracy of early warning of severe COVID-19 and to visualize and interpret these important features using statistical analysis of clinical data.Visualization and interpretability of the clinical data will help clinicians in developing principles and criteria for the hierarchical diagnosis of COVID-19 patients based on an early warning model.

However, there are certain limitations to this study. The small sample size is one of the most significant limitations. Although the results of utilizing AI models to diagnose and predict whether COVID-19 patients will become severe are encouraging, more data is needed to validate the model's universality. Moreover, the model's training and verification are limited to a small number of domestic populations, and we hope that international populations can be employed to further validate and increase the model's universality. It is important to note that the AI image recognition platform built by this research is extensible.The AI image recognition platform can not only seamlessly include other lung diseases into the platform, but also other diseases based on image recognition, such as the identification of restricted airways (Fig. 1). We hope that the system can be developed into a multi-functional tool against COVID-19 and other emerging virus infections.

Conclusions

In conclusion, based on deep learning, the combined prediction model for severe COVID-19 pneumonia has a strong differential ability for predicting the course of disease in COVID-19 patients by combining clinical features, pulmonary lesion volume, and radiomics features. This may assist in the early prevention of severe COVID-19 symptoms.

Availability of data and materials

The data supporting this article are available from the corresponding author on reasonable request.

Abbreviations

RNN:

Recurrent neural network

CL:

Compliance of lung

ANN:

Artificial neural network

ROC:

Receiver operating characteristic

SARS-CoV-2:

Severe acute respiratory syndrome coronavirus 2

ICU:

Intensive care unit

WHO:

World Health Organization

RT-PCR:

Reverse transcription-polymerase chain reaction

CT:

Computed tomography

AUC:

Area under the curve

References

  1. Yamayoshi S, Sakai-Tagawa Y, Koga M, Akasaka O, Nakachi I, Koh H, Maeda K, Adachi E, Saito M, Nagai H et al. Comparison of rapid antigen tests for COVID-19. Viruses. 2020;12(12).

  2. Shi Y, Wang G, Cai XP, Deng JW, Zheng L, Zhu HH, Zheng M, Yang B, Chen Z. An overview of COVID-19. J Zhejiang Univ Sci B. 2020;21(5):343–60.

    Article  CAS  Google Scholar 

  3. Wang W, Tang J, Wei F. Updated understanding of the outbreak of 2019 novel coronavirus (2019-nCoV) in Wuhan, China. J Med Virol. 2020;92(4):441–7.

    Article  CAS  Google Scholar 

  4. Habas K, Nganwuchu C, Shahzad F, Gopalan R, Haque M, Rahman S, Majumder AA, Nasim T. Resolution of coronavirus disease 2019 (COVID-19). Expert Rev Anti Infect Ther. 2020;18(12):1201–11.

    Article  CAS  Google Scholar 

  5. Riou J, Althaus CL. Pattern of early human-to-human transmission of Wuhan 2019 novel coronavirus (2019-nCoV), December 2019 to January 2020. Euro Surveill. 2020;25(4).

  6. Liu NN, Tan JC, Li J, Li S, Cai Y, Wang H. COVID-19 pandemic: experiences in china and implications for its prevention and treatment worldwide. Curr Cancer Drug Targets. 2020;20(6):410–6.

    Article  Google Scholar 

  7. Tahamtan A, Ardebili A. Real-time RT-PCR in COVID-19 detection: issues affecting the results. Expert Rev Mol Diagn. 2020;20(5):453–4.

    Article  CAS  Google Scholar 

  8. Arevalo-Rodriguez I, Buitrago-Garcia D, Simancas-Racines D, Zambrano-Achig P, Del Campo R, Ciapponi A, Sued O, Martinez-García L, Rutjes AW, Low N, et al. False-negative results of initial RT-PCR assays for COVID-19: a systematic review. PLoS ONE. 2020;15(12):e0242958.

    Article  CAS  Google Scholar 

  9. Hani C, Trieu NH, Saab I, Dangeard S, Bennani S, Chassagnon G, Revel MP. COVID-19 pneumonia: a review of typical CT findings and differential diagnosis. Diagn Interv Imaging. 2020;101(5):263–8.

    Article  CAS  Google Scholar 

  10. Wong HYF, Lam HYS, Fong AH, Leung ST, Chin TW, Lo CSY, Lui MM, Lee JCY, Chiu KW, Chung TW, et al. Frequency and distribution of chest radiographic findings in patients positive for COVID-19. Radiology. 2020;296(2):E72–8.

    Article  Google Scholar 

  11. Li K, Wu J, Wu F, Guo D, Chen L, Fang Z, Li C. The Clinical and chest CT features associated with severe and critical COVID-19 pneumonia. Investig Radiol. 2020;55(6):327–31.

    Article  CAS  Google Scholar 

  12. Feng H, Liu Y, Lv M, Zhong J. A case report of COVID-19 with false negative RT-PCR test: necessity of chest CT. Jpn J Radiol. 2020;38(5):409–10.

    Article  CAS  Google Scholar 

  13. Xie X, Zhong Z, Zhao W, Zheng C, Wang F, Liu J. Chest CT for typical coronavirus disease 2019 (COVID-19) pneumonia: relationship to negative RT-PCR testing. Radiology. 2020;296(2):E41-e45.

    Article  Google Scholar 

  14. Liu HC. Artificial intelligence stomatology. Zhonghua Kou Qiang Yi Xue Za Zhi. 2020;55(12):915–9.

    CAS  PubMed  Google Scholar 

  15. Pashkov VM, Harkusha AO, Harkusha YO. Artificial intelligence in medical practice: regulative issues and perspectives. Wiad Lek. 2020;73(12 cz 2):2722–27.

  16. Wagner JB. Artificial intelligence in medical imaging. Radiol Technol. 2019;90(5):489–501.

    PubMed  Google Scholar 

  17. Wang S, Shi J, Ye Z, Dong D, Yu D, Zhou M, Liu Y, Gevaert O, Wang K, Zhu Y et al. Predicting EGFR mutation status in lung adenocarcinoma on computed tomography image using deep learning. Eur Respir J. 2019;53(3).

  18. Walsh SLF, Calandriello L, Silva M, Sverzellati N. Deep learning for classifying fibrotic lung disease on high-resolution computed tomography: a case-cohort study. Lancet Respir Med. 2018;6(11):837–45.

    Article  Google Scholar 

  19. Walsh SLF, Humphries SM, Wells AU, Brown KK. Imaging research in fibrotic lung disease; applying deep learning to unsolved problems. Lancet Respir Med. 2020;8(11):1144–53.

    Article  Google Scholar 

  20. Abd-Alrazaq A, Alajlani M, Alhuwail D, Schneider J, Al-Kuwari S, Shah Z, Hamdi M, Househ M. Artificial Intelligence in the Fight Against COVID-19: Scoping Review. J Med Internet Res. 2020;22(12):e20756.

    Article  Google Scholar 

  21. Gozes O, Frid-Adar M, Greenspan H, Browning PD, Zhang H, Ji W, Bernheim A, Siegel E. Rapid ai development cycle for the coronavirus (covid-19) pandemic: initial results for automated detection & patient monitoring using deep learning ct image analysis. arXiv e-preprint 2020;arXiv:2003.05037.

  22. Grasselli G, Greco M, Zanella A, Albano G, Antonelli M, Bellani G, Bonanomi E, Cabrini L, Carlesso E, Castelli G, et al. Risk factors associated with mortality among patients with COVID-19 in intensive care units in Lombardy, Italy. JAMA Intern Med. 2020;180(10):1345–55.

    Article  CAS  Google Scholar 

  23. Correction to Lancet Respir Med 2020; published online Feb 21. https://doi.org/10.1016/S2213-2600(20)30079-5. Lancet Respir Med. 2020;8(4):e26.

  24. P GOotNHC, OoNAoTC M. COVID-19 Diagnosis and treatment protocol (Trial 7th Edition). Chin Med. 2020;15(06):801–05.

  25. He K, Gkioxari G, Dollár P, Girshick R: Mask r-CNN. In: Proceedings of the IEEE international conference on computer vision: 2017; 2017:2961–69.

  26. Morita S. Chemometrics and related fields in python. Anal Sci. 2020;36(1):107–12.

    Article  CAS  Google Scholar 

  27. Ye Z, Zhang Y, Wang Y, Huang Z, Song B. Chest CT manifestations of new coronavirus disease 2019 (COVID-19): a pictorial review. Eur Radiol. 2020;30(8):4381–9.

    Article  CAS  Google Scholar 

  28. Ye H, Gao F, Yin Y, Guo D, Zhao P, Lu Y, Wang X, Bai J, Cao K, Song Q, et al. Precise diagnosis of intracranial hemorrhage and subtypes using a three-dimensional joint convolutional and recurrent neural network. Eur Radiol. 2019;29(11):6191–201.

    Article  Google Scholar 

  29. Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, van der Laak J, van Ginneken B, Sánchez CI. A survey on deep learning in medical image analysis. Med Image Anal. 2017;42:60–88.

    Article  Google Scholar 

  30. Cicero M, Bilbily A, Colak E, Dowdell T, Gray B, Perampaladas K, Barfett J. Training and validating a deep convolutional neural network for computer-aided detection and classification of abnormalities on frontal chest radiographs. Investig Radiol. 2017;52(5):281–7.

    Article  Google Scholar 

  31. Kermany DS, Goldbaum M, Cai W, Valentim CCS, Liang H, Baxter SL, McKeown A, Yang G, Wu X, Yan F, et al. Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell. 2018;172(5):1122-31.e9.

    Article  CAS  Google Scholar 

  32. Ren HW, Wu Y, Dong JH, An WM, Yan T, Liu Y, Liu CC. Analysis of clinical features and imaging signs of COVID-19 with the assistance of artificial intelligence. Eur Rev Med Pharmacol Sci. 2020;24(15):8210–8.

    PubMed  Google Scholar 

  33. Bundgaard H, Bundgaard JS, Raaschou-Pedersen DET, von Buchwald C, Todsen T, Norsk JB, Pries-Heje MM, Vissing CR, Nielsen PB, Winsløw UC, et al. Effectiveness of adding a mask recommendation to other public health measures to prevent SARS-CoV-2 infection in Danish mask wearers: a randomized controlled trial. Ann Intern Med. 2021;174(3):335–43.

    Article  Google Scholar 

  34. Han Z, Battaglia F, Terlecky SR. Discharged COVID-19 patients testing positive again for SARS-CoV-2 RNA: a minireview of published studies from China. J Med Virol. 2021;93(1):262–74.

    Article  CAS  Google Scholar 

  35. Li L, Qin L, Xu Z, Yin Y, Wang X, Kong B, Bai J, Lu Y, Fang Z, Song Q, et al. Using artificial intelligence to detect COVID-19 and community-acquired pneumonia based on pulmonary CT: evaluation of the diagnostic accuracy. Radiology. 2020;296(2):E65-e71.

    Article  Google Scholar 

  36. Shan F, Gao Y, Wang J, Shi W, Shi N, Han M, Xue Z, Shen D, Shi Y. Lung infection quantification of COVID-19 in CT images with deep learning. arXiv e-preprint 2020;arXiv:2003.04655.

  37. Shi F, Xia L, Shan F, Wu D, Wei Y, Yuan H, Jiang H, Gao Y, Sui H, Shen D. Large-scale screening of covid-19 from community acquired pneumonia using infection size-aware classification (2020). arXiv e-preprint. 2020;arXiv:2003.09860.

  38. Alsharif W, Qurashi A. Effectiveness of COVID-19 diagnosis and management tools: a review. Radiography (Lond). 2021;27(2):682–7.

    Article  CAS  Google Scholar 

  39. Venugopal U, Jilani N, Rabah S, Shariff MA, Jawed M, Mendez Batres A, Abubacker M, Menon S, Pillai A, Shabarek N, et al. SARS-CoV-2 seroprevalence among health care workers in a New York City hospital: a cross-sectional analysis during the COVID-19 pandemic. Int J Infect Dis. 2021;102:63–9.

    Article  CAS  Google Scholar 

Download references

Acknowledgements

The authors would like to express their appreciation for all hospital staf for their eforts to combat the COVID-19 outbreak.

Funding

This study was supported by the Jiaxing Fight Novel Coronavirus Pneumonia Emergency Technology Attack Special Research in 2020(NO.2020GZ30001), the Key Discipline of Jiaxing Respiratory Medicine Construction Research (No.2019-zc-04), A Project Supported by Scientific Research Fund of Zhejiang Provincial Education Department (NO. Y202043729), and Jiaxing Key Laboratory of Precision Treatment for Lung Cancer. The funding body had no role in the design of the study, collection, analysis, and interpretation of data, or in writing the manuscript.

Author information

Author notes

  1. Wenyu Chen, Ming Yao and Zhenyu Zhu have contributed equally to this work

Authors and Affiliations

  1. Department of Respiration, Affiliated Hospital of Jiaxing University, Jiaxing, China

    Wenyu Chen

  2. Department of Pain Medicine Center, Affiliated Hospital of Jiaxing University, Jiaxing, China

    Ming Yao

  3. Yangtze Delta Region Institute of Tsinghua University, Zhejiang, No. 705, Asia Pacific Road, Nanhu District, Jiaxing, 314006, Zhejiang, China

    Zhenyu Zhu & Xiuping Han

  4. Radiology Department, Affiliated Hospital of Jiaxing University, No. 1882 Zhonghuan South Road, Jiaxing, 314000, China

    Yanbao Sun

Authors
  1. Wenyu Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ming Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhenyu Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yanbao Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xiuping Han
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Study concept and design, WYC, YBS and XPH; acquisition of data, MY, ZYZ and YBS; analysis and interpretation of data, WYC, MY, ZYZ and XPH; statistical analysis and drafting of the manuscript, WYC, MY, ZYZ, YBS and XPH; technical support, YBS and XPH. All authors read and approved the fnal manuscript.

Corresponding authors

Correspondence to Yanbao Sun or Xiuping Han.

Ethics declarations

Ethics approval and consent to participate

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.The study was approved by the institutional review board of the Tianyou Hospital to Affiliated to Wuhan University of Science and Technology, the First Affiliated Hospital of Zhejiang University School of Medicine, and the First hospital of Jiaxing. Informed consent was waived due to the nature of the retrospective study.

Consent for publication

Not applicable.

Competing interests

The authors had no conficts of interest to declare in relation to this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, W., Yao, M., Zhu, Z. et al. The application research of AI image recognition and processing technology in the early diagnosis of the COVID-19. BMC Med Imaging 22, 29 (2022). https://doi.org/10.1186/s12880-022-00753-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12880-022-00753-1

Keywords

BMC Medical Imaging

ISSN: 1471-2342

Contact us