Check Claims Before You Publish

 Quick Explanation Copied

 Long Explanation

Evidence Base and Methodological Identity

Pittelkow's flagship contribution analyzed trial-level FDA data across 72 drug-disorder combinations (253 trials; ~58,800 participants) using one-sided Bayes factors with Bayesian model-averaged meta-analysis, finding ADHD medications carried extreme evidential strength (median BF_BMA 1820.4) while antidepressant evidence for depression (median 94.2) and anxiety (49.8) was comparatively modest and sometimes ambiguous Bayesian meta-analysis of psychotropic drug evidence.

Open Science Leadership

Her portfolio centers on replication science: first-authored work on replication target selection in clinical psychology proposing a two-step Bayesian-qualitative re-evaluation framework Replication target selection framework, and a widely cited process paper on how replication targets should be chosen Replication target selection process. She also co-authored critical reviews on scientific error Perspectives on scientific error and applied Bayesian reanalysis to remdesivir trials Bayesian remdesivir reanalysis.

Blindspots and Limitations

Her psychotropic-drug analysis is restricted to pre-marketing FDA data, relies on prior-distribution choices (mitigated by sensitivity analyses), and does not address post-marketing safety Study limitations, psychotropic evidence analysis. Her recent output skews toward conceptual/perspective pieces with weaker empirical grounding (e.g., a 2026 qualitative open-science commentary scored lower on rigor and lacking systematic search) Qualitative open science perspectives. Citation trajectory is strong for career stage (peak 163 in 2021) though 2024-2026 citations lag publication output, typical for junior researchers.

Confidence and Falsifiability

Confidence is moderate-to-high: methods are transparent with public data/code (OSF 364t5), and the evidence-strength framework is falsifiable by reanalyses showing convergent BF distributions across disorder groups. What would change the assessment: evidence that prior choices independently drive the ADHD-vs-antidepressant divergence, or accumulation of perspective-heavy work without empirical follow-through.

 BGPT Author Review

Scientific Quality

Pittelkow shows genuine methodological competence: first-authored Bayesian meta-analyses with pre-registered-style transparency, public code/data, and rigorous treatment of priors and model averaging. Her h-index of 9 at 67 works with 429 citations reflects a solid emerging track record in metascience, not yet transformative impact. Strengths: Bayesian statistics, replication methodology, evidence synthesis. Weaknesses: reliance on senior collaborators (van Ravenzwaaij as senior author on several key works), limited empirical перво-authorship beyond meta-analysis, and growing output of lower-rigor perspective pieces. No red flags for data integrity; no disclosed conflicts in key work.

Communication Quality

Papers are clearly structured with well-motivated problems (e.g., why replication target selection matters given resource constraints). Abstracts communicate findings accessibly. Some Bayesian methodological work is inherently technical and less accessible to general clinical audiences; the qualitative open-science commentary is more discursive and less crisp.

Author Novelty

Her contributions are methodological refinements rather than paradigm shifts: applying Bayesian model averaging to regulatory data was timely and somewhat novel, and the replication-target-selection framework fills a real gap. However, the broader replication-crisis framing is well-trodden territory in metascience.

Scientific Rigor

Strong rigor in quantitative work: pre-specified priors, sensitivity analyses, public code/data (OSF), honest reporting of ambiguous evidence for some drugs rather than universally positive claims, and explicit limitations sections. Deductions for imputed values in some analyses, reliance on FDA document extraction (potential transcription error), and recent lower-empirical-rigor perspective publications.