Check whether claims match experiments, exact reported results, and stated limitations.Know what the science actually supports before you trust the answer.
Press Enter β΅ to review paper
Explore by Goal
"The most beautiful experience we can have is the mysterious."
- Albert Einstein
Quick Explanation
Copied
Bonotti et al. report a 4-marker serum panel (SMRP, pOPN, IL6, Vimentin) reaching AUC 0.962 with 100% sensitivity but only 73% specificity in 27 epithelioid MPM cases vs 43 asbestos-exposed controls; the authors themselves flag the small sample and lack of independent validation, and confounders (age, sex mismatch) plus the unadjusted case-control design mean these performance estimates are almost certainly optimistic and require multicenter validation .
Long Explanation
What the paper actually shows
In this controlled ELISA study, 27 treatment-naive epithelioid MPM patients were compared with 43 asbestos-exposed workers. Nineteen markers were assayed; eight differed significantly between groups (SMRP p<0.001, IL6 p<0.001, HGF p=0.002, IP10 p=0.002, pOPN p=0.004, Desmin p=0.004, Vimentin p=0.023, THSP2 p=0.023), and logistic-regression combinations were ranked by AUC. The best four-marker panel (SMRP-pOPN-IL6-Vimentin) reached AUC 0.962 (95% CI 0.910β1.000), sensitivity 100%, specificity 73%; adding Desmin and HGF raised specificity to 85.7% .
The AUC gain from combining markers is real but modest in absolute terms (single best marker IL6: 0.880 vs panel: 0.962), and error bars for the single markers (shown) reveal how much of the panel's apparent gain rests on 27 cases β the panel's lower CI bound is not reported for most combinations .
Critical weaknesses a skeptical reader should weigh
Overfitting risk: six-marker logistic models were fitted on 27 events. With ~4-6 predictors per ~27 cases, shrinkage is severe and the AUC of 0.962 is likely upward-biased; no cross-validation or bootstrap correction was performed .
Confounding by age and sex: controls were 100% male and ~10.7 years younger (58.7 vs 69.4) than MPM patients. IL6 rises with age and chronic inflammation, yet the model was not age-adjusted, so part of the IL6 signal may reflect demographics rather than malignancy .
Wrong comparator for clinical use: the differential that matters is MPM vs lung cancer, metastatic pleural disease, and benign asbestos-related pleurisy β none were included. Marker combinations built only against asbestos-exposed healthy workers overstate real-world discrimination.
Low-prevalence math: the authors correctly note that predictive values collapse at MPM's low incidence; at ~100% sensitivity and 73β86% specificity, population screening would generate large false-positive burdens requiring radiation-based work-up .
Context from larger validations: later, larger case-control work (163+ cases) found calretinin achieved 71% sensitivity at 95% specificity and that mesothelin combinations still fell short of screening-grade accuracy β sobering benchmarks for any claimed 96% AUC panel . Meanwhile, tissue-level panels (BAP1 + CDKN2A FISH) reach ~85β93% sensitivity with near-100% specificity for malignancy, underscoring how far serum-only approaches still lag .
Reporting quality flags: Table 2 states significance as "p < 0.5" (a typo for 0.05), the home-made prelamin A/C ELISA and internally derived markers (Vimentin, Desmin from the same group's proteomics) create circular discovery-to-validation risk, and no data/code availability statement exists .
Performance trade-off the panel faces
Even the six-marker version sacrifices ~14% specificity, meaning ~1 in 7 asbestos-exposed healthy workers would be flagged. The panel's value proposition is plausible as a triage adjunct to reduce imaging frequency in surveillance programs, not as a stand-alone diagnostic β a framing the authors themselves largely maintain . What would most change this assessment: an external, multi-center, prospective cohort with age-matched controls, competing pleural malignancies, and pre-registered cut-offs. Falsification would occur if the panel's AUC falls below ~0.85 in such a cohort, as happened for single markers in larger validations .
Combining mesothelioma-specific markers discovered in-house via proteomics (Vimentin, Desmin, Prelamin A/C) and transcriptomics (THBS2, TIMP3) with classic markers (SMRP, pOPN) was a reasonably fresh combinatorial strategy for 2017, though individual markers were already known.
Scientific Quality
50%
Sound assay methods but undermined by n=27, six-predictor models without validation or shrinkage, unadjusted age/sex confounding (controls 100% male, ~11 years younger), absence of competing diagnoses, a p-value typo (<0.5), and no CI for most combination AUCs; authors transparently disclose the main limitations.
Study Generality
50%
Findings are restricted to epithelioid MPM in an Italian asbestos-exposed cohort against healthy exposed controls; limited generalizable mechanistic insight beyond biomarker performance.
Study Usefulness
60%
Provides a concrete, testable marker-panel lead for high-risk surveillance triage and a rational combinatorial framework, though clinical deployment awaits external validation; no therapy or screening recommendation follows directly.
Study Reproducibility
40%
Home-made prelamin A/C ELISA, internally sourced antigens/antibodies, no data or code availability statement, and no discovery/validation split hinder independent replication of the reported panel performance.
Explanatory Depth
40%
The paper reports association-level diagnostic performance without mechanistic work on why these markers discriminate (e.g., IL6 inflammatory biology or Vimentin release kinetics), leaving the biology descriptive.
Simulating optimistic-bias in small-cohort AUC estimates for the reported 4-marker MPM panel using Firth-penalized logistic regression and bootstrap resampling, benchmarking against larger calretinin/mesothelin validation cohorts.
Get emailed when your analysis is done!
We'll email you the results when your analysis is finished.
Hypothesis Graveyard
Single-marker screening (SMRP alone) for asbestos-exposed cohorts: displaced because individual-patient meta-analysis showed inadequate sensitivity, motivating combination approaches like this one.
Six-marker panels maximize diagnostic yield: probably falsified here; the gain from marker 4 to 6 (specificity 73β85.7%) is within noise for n=27 and may not survive validation.