|Year : 2014 | Volume
| Issue : 6 | Page : 897-901
Risk prediction models for biochemical recurrence after radical prostatectomy using prostate-specific antigen and Gleason score
Xin-Hai Hu1, Henning Cammann2, Hellmuth-A Meyer1, Klaus Jung3, Hong-Biao Lu4, Natalia Leva5, Ahmed Magheli1, Carsten Stephan3, Jonas Busch1
1 Department of Urology, Charité - Universitätsmedizin Berlin, Berlin, Germany
2 Institute of Medical Informatics, Charité - Universitätsmedizin Berlin, Berlin, Germany
3 Department of Urology, Charité - Universitätsmedizin Berlin; Berlin Institute for Urologic Research, Berlin, Germany
4 Department of Urology, Charité - Universitätsmedizin Berlin, Berlin, Germany; Department of Urology, Changzhou No. 2 People's Hospital, Changzhou, China
5 Stanford University School of Medicine, Stanford, CA, USA
|Date of Submission||29-Oct-2013|
|Date of Decision||08-Feb-2013|
|Date of Acceptance||22-Jan-2014|
|Date of Web Publication||04-Jul-2014|
Department of Urology, Charité - Universitätsmedizin Berlin, Berlin, Germany
Source of Support: None, Conflict of Interest: None
Many computer models for predicting the risk of prostate cancer have been developed including for prediction of biochemical recurrence (BCR). However, models for individual BCR free probability at individual time-points after a BCR free period are rare. Follow-up data from 1656 patients who underwent laparoscopic radical prostatectomy (LRP) were used to develop an artificial neural network (ANN) to predict BCR and to compare it with a logistic regression (LR) model using clinical and pathologic parameters, prostate-specific antigen (PSA), margin status (R0/1), pathological stage (pT), and Gleason Score (GS). For individual BCR prediction at any given time after operation, additional ANN, and LR models were calculated every 6 months for up to 7.5 years of follow-up. The areas under the receiver operating characteristic (ROC) curve (AUC) for the ANN (0.754) and LR models (0.755) calculated immediately following LRP, were larger than that for GS (AUC: 0.715; P = 0.0015 and 0.001), pT or PSA (AUC: 0.619; P always <0.0001) alone. The GS predicted the BCR better than PSA (P = 0.0001), but there was no difference between the ANN and LR models (P = 0.39). Our ANN and LR models predicted individual BCR risk from radical prostatectomy for up to 10 years postoperative. ANN and LR models equally and significantly improved the prediction of BCR compared with PSA and GS alone. When the GS and ANN output values are combined, a more accurate BCR prediction is possible, especially in high-risk patients with GS ≥7.
Keywords: artificial neural network; prostate cancer; recurrence
|How to cite this article:|
Hu XH, Cammann H, Meyer HA, Jung K, Lu HB, Leva N, Magheli A, Stephan C, Busch J. Risk prediction models for biochemical recurrence after radical prostatectomy using prostate-specific antigen and Gleason score. Asian J Androl 2014;16:897-901
|How to cite this URL:|
Hu XH, Cammann H, Meyer HA, Jung K, Lu HB, Leva N, Magheli A, Stephan C, Busch J. Risk prediction models for biochemical recurrence after radical prostatectomy using prostate-specific antigen and Gleason score. Asian J Androl [serial online] 2014 [cited 2019 Nov 12];16:897-901. Available from: http://www.ajandrology.com/text.asp?2014/16/6/897/129940 - DOI: 10.4103/1008-682X.129940
| Introduction|| |
Prostate-specific antigen (PSA) is a widely accepted screening parameter for early detection of prostate cancer (PCa). Treatment of localized PCa is often performed by radical surgery such as laparoscopic radical prostatectomy (LRP).  The PSA value in most patients will drop to zero within 2 months after LRP. A consecutive increase of serum PSA up to 0.1 or 0.2 ng ml−1 is defined as biochemical recurrence (BCR).  BCR is considered a predictor of clinical recurrence and metastasis of PCa. , Therefore, early identification and treatment of BCR is important to improve the long-term survival.
Presently, Gleason Score (GS), preoperative PSA, and pathological stages (pTs) are the main parameters used to predict the risk of BCR.  For higher accuracy and specificity; multivariate logistic regression (LR) models such as nomograms  have been used to improve prediction. Most applications of LR in BCR prediction are available with standard nomograms, but there are only few artificial neural networks (ANNs) available for BCR prediction  and none is freely available online. Further, there are no available models that calculate the individual BCR free probability at multiple time-points after operation especially after different time periods without BCR.
Artificial neural networks imitate learning processes and interactions between human neurons.  During the training phase, it gradually reduces the deviation of prediction by learning the relationships among inputs (variables) and outputs (prediction results) as well as relationships between the input variables. Finally, the ANN has the ability to predict the probability of BCR.
Opinions vary regarding the comparison between ANN and LR. ,,,,, Most criticism arises from the limited prediction accuracy due to limitations of the algorithm. , LR is a special form of ANN. If the relationships among input parameters are nonlinear, ANN models will perform better than LR. Otherwise, the LR is preferable because the influence of each parameter can be observed much easier than in ANNs.
In this study, we describe the suitability of ANNs as a prediction tools for BCR. Evaluation of the ability of a computer model to predict of BCR after radical prostatectomy is mainly based on the following parameters: the accuracy of the predicting models, the universality of the internal/external validation, correction capability, complexity, and clinical value.  Here, we analyzed ANN and LR performance in predicting BCR based on these criteria. In addition to the ANN and LR models immediately after surgery, we analyzed ANN and LR models that evaluate BCR risk at 6-month intervals, which allows for a more accurate prediction of BCR at any given time after surgery. ANN has already been described as a good alternative to Cox and other regression models.  From a practical point of view, there is an urgent need for tools that provide information on recurrence-free survival (FS) at distinct time points after radical prostatectomy taking into account the already elapsed recurrence-free interval.
| Materials and Methods|| |
Between 1999 and 2007, 1897 PCa patients underwent LRP at our institution. Among them, 322 patients were lost to follow-up or had to be eliminated due to neo-adjuvant hormonal therapy or largely incomplete datasets. The remaining 1575 patients were divided into two groups: 1300 patients (82.5%) with no evidence of BCR (nonBCR) and 275 patients (17.5%) with BCR (BCR group). The median follow-up period was 82.1 months (range from 0.2 to 129.5).
Biochemical recurrence was defined as serum PSA levels greater than 0.1 ng ml−1 at two consecutive time points. All preoperative blood samples were measured by Immulite® 2000 assays (Siemens Healthcare, Erlangen, Germany). Data collection included: age, PSA, free/total PSA (%fPSA), prostate weight, digital rectal examination (DRE) status, pT,  margin status (positive surgical margin [PSM] or negative surgical margin [NSM]) and GS.  For the parameter distribution analysis, pTs of the prostatectomy specimens were classified into pT2, pT3/4; GS < 7, GS =7, GS > 7; PSM or NSM; positive DRE or negative DRE. PSA, margin status, pT and GS were used for ANN and LR analysis.
This study was conducted under a local Ethics Committee approved protocol and obeys Reporting of Diagnostic Accuracy guidelines. 
Artificial neural network and LR models were computed using the MATLAB-software and the Neural Network Toolbox (Mathworks, Natick, MA, USA). Each ANN (feed forward network with error back propagation) had three layers: input layer with four neurons, hidden layer with two neurons and output layer with one neuron representing the nonBCR probability. Follow-up data after LRP were collected every 6 months and respectively added into the separate models. Every 6 months separate models (ANN and LR) were calculated with those patients still not having a BCR at this time-point (those with a BCR earlier were excluded) and those who were not censored. For all models, internal validation was performed with the leave one out method.
Statistical analysis was performed using SPSS 19.0 (IBM, Chicago, IL, USA) and MedCalc 12.4.0 (MedCalc Software, Mariakerke, Belgium) to compare all variables using receiver operating characteristic (ROC) analyses regarding sensitivity, specificity and areas under ROC curve (AUC). The comparison of ROC curves were performed with the method of Delong and the comparison of prediction results were conducted using Mann-Whitney U test for continuous variables and Fisher's exact test for ordinal variables. Differences were considered statistically significant if P < 0.05.
| Results|| |
[Table 1] displays the patient characteristics as well as the distribution of clinico-patholological parameters of the BCR and nonBCR group. There were no relevant differences between the two groups for age (P = 0.37), PSA (P = 0.12), %fPSA (P = 0.26), prostate volume (P = 0.33), and PSA density (P = 0.11). In contrast, the pathological GS, margin status, and pT were different between the BCR and nonBCR group except for GS =7 (P = 0.12), as shown in [Table 1].
Receiver operating characteristic analysis of selected parameters
Specificities of the BCR prediction results computed by ANN and LR models with the PSA, margin status, pT, and GS directly after LRP were the highest at both sensitivity cutoffs of 90% and 95%, as shown in [Table 2]. GS and PSA showed lower specificities and lower AUCs than ANN and LR. [Figure 1] clearly shows the larger AUCs of the two models compared with GS and PSA alone. [Table 3] displays the pairwise comparison of all parameters. While ANN and LR were not different (P = 0.39), ANN and LR predicted BCR better than PSA or GS (P = 0.0015 for ANN vs GS and P < 0.0001 for ANN vs PSA, LR vs GS and vs PSA, respectively).
|Figure 1: Receiver operating characteristic curves for the models: artificial neural network (area under ROC curve [AUC] 0.754) and logistic regression (AUC 0.755) and the variables Gleason Score (AUC 0.715) and prostate-specific antigen (AUC 0.619).|
Click here to view
|Table 2: ROC analysis with prediction results at 90% sensitivity and 95% sensitivity|
Click here to view
Biochemical recurrence-free survival curves
[Figure 2] displays probabilities for BCR-FS up to 2.5, 5, and 7.5 years after LRP for different categories of GS and ANN outputs. PCa patients with GS <7 always have the highest probability for BCR-FS compared with patients with GS =7 or GS > 7 ([Figure 2]a-c).
|Figure 2: Probability of recurrence-free survival at 2.5, 5, and 7.5 years after laparoscopic radical prostatectomy (LRP) according to Gleason score (above three figures) and artificial neural network output (below three figures). The curves are based on Kaplan-Meier curves computed every 6 months after LRP for patients which are under investigation, that is, patients without biochemical recurrence or not censored patients.|
Click here to view
In predicting BCR-FS, ANN, and LR perform similarly (LR data not shown). To allow better differentiation of patients who more urgently may need adjuvant radiation (and hormonal treatment) we subdivided all patients using the continuous ANN output values and separated them into two groups below and above the median. This median output was calculated from the 1575 ANN output values according to the prevalence of nonBCR. [Figure 2]d-f shows the difference between patients above and below the median ANN output values with up to 2.5, 5, and 7.5 years of follow-up.
Analysis of individual ANN output values had no benefit in patients with a GS < 7 PCa but it improved the prediction for all patients with GS ≥7. Of all 1026 PCa patients with GS ≥7, 235 (23%) had a BCR ([Table 4]). Of the 768 patients with an ANN value below the median cutoff, only 16.5% (n = 127) developed BCR. On the other hand, of the 258 patients with an ANN value above the median cutoff, 41.9% (n = 108) developed BCR. Further analysis of the 260 patients with a GS >7 showed an overall BCR rate of 43.5% (113 of 260) that dropped tremendously when the ANN value was below the cutoff. Only 28 of 96 patients (29.2%) had a BCR. Interestingly, among patients with aggressive PCa and high ANN values, 51.8% had a BCR (85 of 164).
|Table 4: Proportion of patients with biochemical recurrence depending of Gleason score and artificial neural network output|
Click here to view
| Discussion|| |
Different types of ANNs have been used for a variety of purposes in management of PCa. For example, PSA, prostate volume, DRE, and other variables are used as input parameters for diagnosing PCa.  ANN is also used to predict the outcome of repeat prostate biopsies,  and furthermore, to predict the risk of lymph node metastasis in PCa patients.  However, ANN applications to predict BCR are rare. ,
Our data on BCR prediction show that ANN and LR models including the parameters PSA, margin status, pT and GS, can correctly simulate and reflect interactions between variables in the training set. The models improve the prediction better than any single variable and thus estimate BCR more accurately for each individual patient with PCa.  Some studies have verified that ANN models have the ability to improve prognosis prediction for PCa patients after prostatectomy. ,,,,, These data have been summarized in [Table 5]. One of the first studies in 1994 demonstrated 87% accuracy. 
Among all available studies to date, the results by Tewari et al.  showed the best AUC with 0.83; however, their accuracy was somewhat lower than in the present study and in other studies. Potter et al. gained similar AUCs of 0.71, 0.74, 0.74 using different input parameters, but the specificity was relatively lower than in our present study. However, despite large differences in sensitivity and specificity levels there are relatively small accuracy ranges (70%-87%) and AUCs between 0.71 and 0.83 for all studies. This demonstrates that the parameters that were used do not allow a better prediction of BCR. Interestingly, PSA has been thought to improve prediction of BCR following PCa diagnosis;  however in our study, %fPSA did not improve prognosis. The median values were not different between the non-BCR and BCR group (10.7 vs 9.2%; P = 0.26) ([Table 1]).
An important finding was the additional benefit of our ANN for patients with aggressive PCa (GS ≥7). Among 1026 patients, 235 had a BCR (23%). Patients with a low ANN value (below the chosen cutoff) had only 16.5% of the 768 BCR ([Table 4]). But if patients had an ANN value above the cutoff, 41.9% showed BCR. This rate is almost doubled in comparison to the 23% without considering the ANN output value and almost tripled in comparison to the group below the cutoff. However, analysis of individual ANN output values had no benefit in patients with GS <7 PCa, where only 40 patients had a BCR.
When further analyzing the 260 patients with highly aggressive PCa and a GS > 7, the overall BCR rate of 43.5% (113 of 260). This rate dropped when the ANN value was below the cutoff. Only 28 of 96 patients (29.2%) had a BCR. In contrast, those patients with aggressive PCa and high ANN values had a >50% likelihood to have a BCR (51.8%; 85 of 164). This individual risk estimation could support further treatment, especially in patients with high GS and high ANN values compared with lower risk patients.
Uniquely, our calculated models at every 6 months following surgery can provide the individual BCR free probability at individual time-points after a BCR free period. For example, as shown in [Figure 2]b, a patient with a GS of 7 and a recurrence free survival of 3 years after LRP only has an 8% likelihood of a BCR up to 5 years, and 14% up to 7.5 years ([Figure 2]c). Without considering the three BCR free years, the estimated BCR risk would be ~22%. This allows for a more optimistic prognosis in comparison to those values calculating risk only immediately after prostatectomy.
A limitation of this study is the availability of only internal validation results for all models. However, our aim was to demonstrate the possibility of improving individual BCR estimation at any point after LRP. Another limitation was the decreased available patient data with increased follow-up time.
Nevertheless, patient's age, PSA, and GS were found to play a distinct role in PCa prognosis. ,, Currently, those prediction parameters and the ANN output value best predict a PCa recurrence. Further, with our ANN models, this prediction can be made for an individual time point after LRP and with patients who have BCR free time-points. Other parameters such as %fPSA or the margin status did not contribute as speculated before. The %fPSA performs well in PCa diagnosis, but is less competitive in the prognosis of PCa or BCR, therefore it is not used in our models.
| Conclusion|| |
The predictive ability of our ANN and LR models is better than single standard parameters GS and PSA. Our models for individual BCR free probability at individual time-points after a BCR free period offer an individual BCR prediction. By combining the GS and ANN output value, a BCR prediction is more accurate and may lead to a more accurate application of adjuvant therapy after prostatectomy especially in high-risk patients with GS ≥7.
| Author Contributions|| |
CS, JB, HC, HAM, and KJ took part in conception and design, in acquisition, analysis, and interpretation of data. XHH and HBL took part in acquisition, analysis, and interpretation of data. NL and AM took part in the acquisition of data. All authors took part in drafting and revising the manuscript. All authors read and approved the final version of the manuscript.
| Competing Interests|| |
The authors declare no competing interests.
| Acknowledgments|| |
This study was supported by a grant of the Berliner Sparkassenstiftung Medizin (Grant No. 89838600).
| References|| |
|1.||Touijer K, Secin FP, Cronin AM, Katz D, Bianco F, et al. Oncologic outcome after laparoscopic radical prostatectomy: 10 years of experience. Eur Urol 2009; 55: 1014-9. |
|2.||Gao X, Zhou JH, Li LY, Qiu JG, Pu XY. Laparoscopic radical prostatectomy: oncological and functional results of 126 patients with a minimum 3-year follow-up at a single Chinese institute. Asian J Androl 2009; 11: 548-56. |
|3.||Pound CR, Partin AW, Eisenberger MA, Chan DW, Pearson JD, et al. Natural history of progression after PSA elevation following radical prostatectomy. JAMA 1999; 281: 1591-7. |
|4.||D'Amico AV, Moul JW, Carroll PR, Sun L, Lubeck D, et al. Surrogate end point for prostate cancer-specific mortality after radical prostatectomy or radiation therapy. J Natl Cancer Inst 2003; 95: 1376-83. |
|5.||Jia HJ, Li Y, Wang JG, Zhang L, Zhang HT, et al. Prostate-specific antigen screening for prostate cancer: benefits for patients with highly aggressive prostate cancer. Asian J Androl 2013; 15: 218-20. |
|6.||Kattan MW, Stapleton AM, Wheeler TM, Scardino PT. Evaluation of a nomogram used to predict the pathologic stage of clinically localized prostate carcinoma. Cancer 1997; 79: 528-37. |
|7.||Tewari A, Issa M, El-Galley R, Stricker H, Peabody J, et al. Genetic adaptive neural network to predict biochemical failure after radical prostatectomy: a multi-institutional study. Mol Urol 2001; 5: 163-9. |
|8.||Burke HB, Goodman PH, Rosen DB, Henson DE, Weinstein JN, et al. Artificial neural networks improve the accuracy of cancer survival prediction. Cancer 1997; 79: 857-62. |
|9.||Lee HJ, Hwang SI, Han SM, Park SH, Kim SH, et al. Image-based clinical decision support for transrectal ultrasound in the diagnosis of prostate cancer: comparison of multiple logistic regression, artificial neural network, and support vector machine. Eur Radiol 2010; 20: 1476-84. |
|10.||Poulakis V, Witzsch U, de Vries R, Emmerlich V, Meves M, et al. Preoperative neural network using combined magnetic resonance imaging variables, prostate specific antigen, and Gleason score to predict prostate cancer recurrence after radical prostatectomy. Eur Urol 2004; 46: 571-8. |
|11.||Stephan C, Rittenhouse H, Cammann H, Lein M, Schrader M, et al. New markers and multivariate models for prostate cancer detection. Anticancer Res 2009; 29: 2589-600. |
|12.||Kattan MW. Editorial comment on: development, validation, and head-to-head comparison of logistic regression-based nomograms and artificial neural network models predicting prostate cancer on initial extended biopsy. Eur Urol 2008; 54: 611. |
|13.||Gulkesen KH, Koksal IT, Bilge U, Saka O. Comparison of methods for prediction of prostate cancer in Turkish men with PSA levels of 0-10 ng/mL. J BUON 2010; 15: 537-42. |
|14.||Stephan C, Xu C, Brown DA, Breit SN, Michael A, et al. Three new serum markers for prostate cancer detection within a percent free PSA-based artificial neural network. Prostate 2006; 66: 651-9. |
|15.||Lukiæ S, Cojbašiæ Z, Miloševiæ Z. Comparation of artificial neural network and logistic regression models for predicting clinically relevant outcome. World Neurosurg 2012 Jul 13. doi: 10.1016/j.wneu.2012.07.005. [Epub ahead of print]. |
|16.||Rughani AI, Tranmer BI, Dumont TM. Comparation of artificial neural network and logistic regression models for predicting clinically relevant outcome. World Neurosurg 2012 Jul 13. doi: 10.1016/j.wneu. 2012.07.006. [Epub ahead of print]. |
|17.||Miyake H, Fujisawa M. Prognostic prediction following radical prostatectomy for prostate cancer using conventional as well as molecular biological approaches. Int J Urol 2013; 20: 301-11. |
|18.||Ohno-Machado L. Modeling medical prognosis: survival analysis techniques. J Biomed Inform 2001; 34: 428-39. |
|19.||Edge SB, Compton CC. The American Joint Committee on Cancer: the 7 th edition of the AJCC cancer staging manual and the future of TNM. Ann Surg Oncol 2010; 17: 1471-4. |
|20.||Epstein JI, Allsbrook WC Jr, Amin MB, Egevad LL, ISUP Grading Committee. The 2005 International Society of Urological Pathology (ISUP) Consensus Conference on Gleason Grading of Prostatic Carcinoma. Am J Surg Pathol 2005; 29: 1228-42. |
|21.||Altman DG, McShane LM, Sauerbrei W, Taube SE. Reporting recommendations for tumor marker prognostic studies (REMARK): explanation and elaboration. PLoS Med 2012; 9: e1001216. |
|22.||Stephan C, Cammann H, Semjonow A, Diamandis EP, Wymenga LF, et al. Multicenter evaluation of an artificial neural network to increase the prostate cancer detection rate and reduce unnecessary biopsies. Clin Chem 2002; 48: 1279-87. |
|23.||Remzi M, Anagnostou T, Ravery V, Zlotta A, Stephan C, et al. An artificial neural network to predict the outcome of repeat prostate biopsies. Urology 2003; 62: 456-60. |
|24.||Batuello JT, Gamito EJ, Crawford ED, Han M, Partin AW, et al. Artificial neural network model for the assessment of lymph node spread in patients with clinically localized prostate cancer. Urology 2001; 57: 481-5. |
|25.||Snow PB, Rodvold DM, Brandt JM. Artificial neural networks in clinical urology. Urology 1999; 54: 787-90. |
|26.||Potter SR, Miller MC, Mangold LA, Jones KA, Epstein JI, et al. Genetically engineered neural networks for predicting prostate cancer progression after radical prostatectomy. Urology 1999; 54: 791-5. |
|27.||Snow PB, Smith DS, Catalona WJ. Artificial neural networks in the diagnosis and prognosis of prostate cancer: a pilot study. J Urol 1994; 152: 1923-6. |
|28.||Porter C, O'Donnell C, Crawford ED, Gamito EJ, Errejon A, et al. Artificial neural network model to predict biochemical failure after radical prostatectomy. Mol Urol 2001; 5: 159-62. |
|29.||Ziada AM, Lisle TC, Snow PB, Levine RF, Miller G, et al. Impact of different variables on the outcome of patients with clinically confined prostate carcinoma: prediction of pathologic stage and biochemical failure using an artificial neural network. Cancer 2001; 91: 1653-60. |
|30.||Stephan C, Jung K, Lein M, Sinha P, Schnorr D, et al. Molecular forms of prostate-specific antigen and human kallikrein 2 as promising tools for early diagnosis of prostate cancer. Cancer Epidemiol Biomarkers Prev 2000; 9: 1133-47. |
|31.||Schiavina R, Borghesi M, Fiorentino M, Brunocilla E, Manferrari F, et al. Identification of prostate cancer risk categories according to surgical margins status, pathological stage and Gleason score. Int J Urol 2013; 20: 1097-103. |
|32.||Yamamoto S. Editorial comment to identification of prostate cancer risk categories according to surgical margins status, pathological stage and Gleason score. Int J Urol 2013; 20: 1104. |
[Figure 1], [Figure 2]
[Table 1], [Table 2], [Table 3], [Table 4], [Table 5]
|This article has been cited by|
||A Novel Predictor Tool of Biochemical Recurrence after Radical Prostatectomy Based on a Five-MicroRNA Tissue Signature
| ||Zhongwei Zhao,Sabine Weickmann,Monika Jung,Michael Lein,Ergin Kilic,Carsten Stephan,Andreas Erbersdobler,Annika Fendler,Klaus Jung |
| ||Cancers. 2019; 11(10): 1603 |
|[Pubmed] | [DOI]|
||Tissue-Based MicroRNAs as Predictors of Biochemical Recurrence after Radical Prostatectomy: What Can We Learn from Past Studies?
| ||Zhongwei Zhao,Carsten Stephan,Sabine Weickmann,Monika Jung,Glen Kristiansen,Klaus Jung |
| ||International Journal of Molecular Sciences. 2017; 18(10): 2023 |
|[Pubmed] | [DOI]|