Establishment Of A Mathematic Model For Predicting Malignancy In Solitary Pulmonary Nodules

Background:Owing to the extensive use of computed tomography (CT), the detection rate of solitary pulmonary nodules (SPNs) has shown a significantly increasing trend in recent years (1-3). Lung cancer screening trials with large sample sizes indicate that the detection rate of SPN ranges from 8% to 51%, with the vast majority at approximately 20%(4). In SPN cases, malignant nodules account for 5-69%, with an average rate of 40%(5,6). Early diagnosis and treatment of such malignant nodules greatly improves the overall survival rate and prognosis of patients with lung cancer (7,8). Therefore, correctly identifying malignancy in the detected SPN becomes a key point. The ideal goal is to diagnose and treat of malignant nodules early while avoiding unnecessary invasive examinations and surgery for benign nodules. The ultimate goal is to avoid unnecessary cost while allowing SPN patients to obtain the maximum cost benefit.Differentiation of malignancy or benignancy in SPNs prior to invasive examination or positron emission tomography (PET)/CT scan depends primarily on empirical prediction, which is closely associated with the doctor’s theoretical level, practical experience, and diagnostic ability. To reduce human factors and improve diagnostic accuracy, scholars have established models for predicting the probability of malignancy in SPNs based on a combination of clinical and imaging data. Such prediction models can be used to guide doctors in choosing interventions for the next step (9-11). The use of mathematical prediction models is currently recommended by both the American College of Clinical Pharmacy (ACCP) and the Specialty Committee of Lung Cancer, Chinese Anti-cancer Association. It is recommended to first calculate the probability of malignancy in the detected SPN and then perform targeted intervention in accordance with the predicted level of probability of malignancy (4).Among the diagnostic prediction models for SPN, the Mayo model established the earliest by Swensen et al (9). The Mayo model includes three clinical features (age, smoking history and past history of a malignant tumor) and three imaging features (nodule diameter, presence of spiculation, and location in the lobe). The items included in the Mayo model have an area under the receiver operating characteristic (ROC) curve (AUC) of 0.83. In addition, different diagnostic prediction models for SPNs have been established, such as Mayo model(9), VA model(10), Peking University People’s (PKUPH) model(11) and Brock University model (12). According to their respective studies, most of these models achieve a diagnostic accuracy of more than 80%.Most of the existing prediction models for SPNs have been established from general clinical data and imaging features of SPN patients, while fewer models have included lung tumor markers. However, the detection of lung tumor markers is an important method in the screening, early diagnosis, and differential diagnosis of lung cancer. Moreover, tumor markers are unaffected by race or the environment. Carcinoembryonic antigen (CEA), cytokeratin-19 fragment (Cyfra21-1), and neuron-specific enolase (NSE) are currently commonly used as lung tumor markers and are available for routine detection in most hospitals. Combined detection of multiple tumor markers has been found to greatly improve the detection rate of lung cancer (13-16). Lung tumor markers are also used in combination with CT images to differentiate malignancy from benignancy in SPNs, which has proven to improve the detection rate of malignant nodules (17,18). However, few prediction models for SPNs have included lung cancer markers to date. Therefore, this study aimed to establish a diagnostic prediction model for SPNs by including lung tumor markers.Objective:To establish a model for predicting the probability of malignancy in solitary pulmonary nodules (SPNs) and provide guidance for the diagnosis and follow-up intervention of SPNs.Materials and methods:Clinical data:294 patients were collected as group A to create amathematical model. Patients were collected from the Affiliated Hospital of Inner Mongolia Medical University and the First Affiliated Hospital of Guangzhou Medical University from January 2005 to December 2011. The inclusion criteria were the following:1)≤3 cm diameter solitary round lesion in the lung, without atelectasis, significant enlargement of hilar and mediastinal lymph nodes, or pleural effusion; 2) clear pathological diagnosis; and 3) complete clinical medical records and CT image data. The patients included 153 men and 141 women, aged 32-80 (55.1 ± 10.7) years. Clinical data were collected from the selected patients, including gender, age, smoking history and quantity, family and past history of malignant tumors, and serum levels of CEA, NSE, and Cyfra21-1.Another 120 patients with a clear pathological diagnosis of SPN by surgical resection or lung biopsy were collected from January 2012 to December 2014. These patients served as group B and were used to verify the accuracy of the prediction model.Imaging data:Plain and/or contrast-enhanced CT data on the patients were collected and independently reviewed by two experienced high-qualification physicians. Detailed records were made for the following CT features of the SPNs:nodule position and size; maximum nodule diameter measured in the lung window; presence or absence of a clear boundary, spiculation and lobulation; cavitation and calcification; vascular convergence; and pleural retraction signs. In cases of discrepancy between the descriptions by the two physicians, re-evaluation was performed by a third physician.Statistical analysis:Data were analyzed using SPSS 13.0. First, univariate analysis was performed in group A for age, gender, smoking history and quantity, family and past history of malignant tumors, lesion position, maximum nodule diameter, lobulation, spiculation, clear border, cavitation, calcification, vascular convergence sign, pleural retraction sign, and serum levels of CEA, NSE, and Cyfra21-1. Categorical data were analyzed using the x2 test, and continuous data were analyzed using the t test. Next, multivariate logistic regression analysis was used to screen independent predictors of the probability of malignancy in SPNs and establish a regression equation for predicting the probability of malignancy. Group B was used to verify the model by the maximum likelihood ratio test, Omnibus test, and Hosmer-Lemeshow test. An appropriate probability cutoff of malignancy or benignancy was chosen, and the sensitivity, specificity, accuracy, positive predictive value, and negative predictive value of the model were calculated. A P value of less than 0.05 was considered statistical significance.ResultsPathological diagnosis:In group A (294 cases), there were 176 cases (59.9%) diagnosed as malignant SPNs, including adenocarcinoma (112 cases,38.1%), squamous cell carcinoma (45 cases,15.3%), bronchioloalveolar carcinoma (8 cases, 2.7%), small cell lung cancer (4 cases,1.3%), large cell carcinoma (3 cases,1.0%), carcinoid tumor (2 cases,0.6%), and adenosquamous carcinoma (2 cases,0.6%). The other 118 cases (40.1%) were diagnosed as benign SPNs, including tuberculoma (61 cases,20.7%), inflammatory pseudotumor (23 cases,7.8%), hamartoma (21 cases, 7.1%), sclerosing hemangioma (5 cases,1.7%), Aspergillus infection (3 cases,1.0%), local cyst with concomitant infection (3 cases,1.0%), organizing pneumonia (1 case, 0.3%), and fibrosis (1 case,0.3%). In group B, there were 72 cases (60.0%) of malignant SPNs and 48 cases (40%) of benign SPNs. No significant differences were found between the two groups in gender, age or nodule diameter.Univariate and multivariate analyses of independent predictors of SPNs:Univariate analysis showed that there were significant differences between the subgroups of benign and malignant SPNs in terms of age, smoking history, smoking quantity, family history of malignant tumor, tumor diameter, spiculation, lobulation, clear border, calcification, pleural retraction sign, and CEA, NSE, and Cyfra21-1 levels (P < 0.05) (Table 1). Furthermore, multivariate logistic regression analysis revealed that age, smoking history, maximum nodule diameter, spiculation, clear border, and Cyfra21-1 level were significantly different between the subgroups of benign and malignant SPNs (P<0.05). These factors were identified as independent predictors for malignancy in SPNs (Table 2).Establishment of logistic regression equation:Prediction model for the probability of malignancy in SPNs:p=ex/(1+e*), x=-14.417+(0.111 × age)+(1.009× smoking history)+(2.597× nodule diameter)+(1.056× spiculation)+(-1.258× clear border)+(1.184× Cyfra21-1), where the following are used:e is the natural logarithm; age is recorded by year; history of smoking, either previously or currently, is scored as 1 or otherwise as 0; nodule diameter refers to the maximum nodule diameter measured by chest CT prior to surgery (unit:cm); spiculation and clear border are both derived from the imaging report (1-yes,0-no); and Cyfra21-1 represents the serum Cyfra21-1 level (units:ng/ml).Verification of mathematical prediction model and selection of an appropriate probability cut off:Another 120 cases of SPNs (group B) were substituted into the regression equation in accordance with the risk factors and assignments to generate the ROC curve (Figure 1). The AUC of group B was 0.910 (95% confidence interval [95%CI] 0.857-0.963). An appropriate cutoff point was selected at p=0.5552, and the model achieved a sensitivity of 86.8%, a specificity of 84.6%, a positive predictive value of 88.1%, and a negative predictive value of 83.0%.Added value of the Cyfra21-1:The data for group B were substituted into the our model with and without Cyfra21-1 to generate the respective ROC curves (Figure 1). The model with Cyfra21-1 significantly better than the the model without Cyfra21-1: the AUC was 0.910 (95% CI,0.857 to 0.963) in model with Cyfra21-1 as compared with 0.812 (95% CI,0.763 to 0.861) in model without Cyfra21-1 (P= 0.008 for the difference in AUC), that suggesting added Cyfra21-1 could improve prediction.Validation and Comparison of Different Predictive Models:The data for group B were substituted into the proposed model, Mayo model, VA model, Peking University People,s (PKUPH) mode and Brock University model to generate the respective ROC curves (Figure 2). The area under the ROC curve of the five model was 0.910,0.752,0.730,0.833 and 0.878 (Table 3).The area under ROC curve of our model is significantly higher than the Mayo model, VA model and PKUPH model(Table 3).A comparison of the our model and Brock model,the AUC in our model was 0.910 (95% CI,0.857 to 0.963) higher than the AUC in Brock model was 0.878 (95%CI,0.837 to 0.929). Although the difference was not statistically significant (P=0.350),suggesting that our model might improve prediction.Conclusions:In this study, multivariate logistic regression analysis showed that age, smoking history, maximum nodule diameter, spiculation, and Cyfra21-1 level were identified as independent predictors for estimating malignancy in SPNs, whereas a clear nodule border was found to be a protective factor indicating the possibility of a benign SPN. Based on the above results, a clinical prediction model for SPNs was established by including two general clinical indices (age and smoking history), three imaging indices (maximum nodule diameter, spiculation, and clear border of nodule), and a laboratory index (Cyfra21-1 level). Various independent risk factors in the model have been reported previously, such as age, smoking history (9,10), maximum nodule diameter (19), spiculation, and tumor border (11). One exception is that the Cyfra21-1 level was included in the diagnostic prediction model for SPNs for the first time. Although there have been literature proposed:Adding Cyfra21-1 into the prediction models might improve the accuracy of prediction for SPN. But it has not established a model containing Cyfra21-1(20).Research has shown that tumor position and past history of a malignant tumor (9,10) are both independent predictors of malignant SPNs. However, no statistically significant difference was found in tumor position between the subgroups of benign and malignant SPNs in this study. One possible reason is that China has a high incidence of tuberculosis, which accounts for the relatively high proportion of tuberculosis in patients with benign SPNs included in the study. Moreover, tuberculosis occurs preferentially in the upper lobe, similarly to malignant tumors and thus resulting in no significant difference in nodule position between benign and malignant SPNs. In the present study, a past history of cancer had no reference value to distinguish malignancy from benignancy in SPNs, possibly due to the smaller number of SPN patients with a history of malignant tumors and the relatively small total sample size included in the study.Serum tumor markers are of great significance in the early diagnosis, disease monitoring, therapeutic evaluation, and other aspects of lung cancer(20-22).There was also a study of the combination of tumor markers and imaging in the diagnosis of SPN. The results show that the sensitivity and accuracy of the diagnosis are not improved(23).However,these research has indicated that the tumour markers exhibited higher specificity, which may be a useful supplement to the imaging diagnosis. Recently, some scholars have found that CEA and CYFRA21-1 have higher positive rates in the malignant SPN patients, suggesting a certain value in the early diagnosis of malignant SPN(24). Fei Xiao et al(25)observed serum Cyfra21-1 as a new risk factor adding into the prediction models might improve the accuracy of prediction for SPN. Our results show that serum Cyfra21-1 level was found to be significantly higher in the malignant SPN subgroup compared with the benign SPN subgroup. Multivariate analysis revealed that the Cyfra21-1 level was an independent predictor of the probability of malignancy in SPNs. Therefore, the present study was include the lung tumor marker Cyfra21-1 in a mathematical model for predicting malignancy or benignancy in SPNs. Our results show that the model added CYFRA21-1 increase the area under the ROC curve, that suggesting added Cyfra21-1 could improve prediction.Serum Cyfra21-1 is the cytokeratin 19 fragment released during tumorigenesis in normal cells. Both adenocarcinoma and squamous cell carcinoma are associated with Cyfra21-1 expression. Thus, Cyfra21-1 is among the serum markers with the greatest diagnostic value in non-small cell lung cancer (26). Meta-analysis has shown that serum Cyfra21-1 is of great value in the diagnosis of non-small cell lung cancer; it is the lung tumor marker with the highest diagnostic efficacy compared with CEA and NSE (27,28). Previous studies have combined the tumor marker CEA with imaging features to establish a prediction model (18). In the present study, despite its significant difference between the two SPN subgroups, the serum CEA level was not an independent predictor of malignancy in SPNs.Another 120 patients not participating in the model establishment were chosen and substituted into the proposed model, Mayo model, VA model, Peking University People’s (PKUPH) mode and Brock University model. The accuracy of the proposed model was verified, and its diagnostic efficacy was compared with other four model. For the five models tested, the area under ROC curve of our model is significantly higher than the Mayo model, VA model and PKUPH model. our model Compared with Brock model, the difference was not statistically significant. This result indicates that our model and Brock model both have a good ability to differentiate, but our model is superior to the Brock model in the area under ROC curve, which suggested that our model may have better diagnostic efficiency in clinic. Based on our calculations, the optimal probability cut off for malignancy was determined to be p= 0.5552. When the predicted probability of malignancy is greater than or equal to 0.5552, the possibility of a malignant SPN is considered, and further invasive examination or PET/CT is recommended for auxiliary diagnosis. When the predicted probability is less than 0.5552, the possibility of a benign SPN should be considered and follow-up observation recommended. The proposed model achieved a sensitivity of 86.8%, a specificity of 84.6%, a positive predictive value of 88.1%, and a negative predictive value of 83.0%.Despite its relatively high accuracy, we need to emphasize that this prediction model cannot take the place of a pathological diagnosis. It only serves as a tool for use before targeted intervention following the detection of a SPN. The role of the prediction model is to guide intervention in the next step. Application of the prediction model, on the one hand, can enable timely diagnosis and treatment of the detected malignant SPNs, and on the other hand, it will avoid unnecessary invasive examination and surgery for benign SPNs, ultimately protecting patients from unnecessary medical costs, pain, and risk. This prediction model also has a few defects, such as the relatively small sample size. Moreover, most of the subjects were patients undergoing surgical treatment, indicating a potential selection bias.In conclusion, a combination of risk factors for malignancy in SPN (age, smoking history, and diameter and shape of nodule) with tumor markers can enable accurate differentiation of malignancy from benignancy in SPNs. As a commonly used clinical marker for lung cancer, incorporation of the Cyfra21-1 level into a prediction model consisting of clinical and chest CT data enhances the diagnostic efficacy. Such noninvasive SPN evaluation methods, once confirmed to have excellent diagnostic efficacy by multi-center studies in a larger range of patients, will provide meaningful guidance for the diagnosis and treatment of SPNs.