Loading...
Loading...
Contributors:
Dataset URI:
10.6084/m9.figshare.34715427.v1Background: Recurrent pregnancy loss (RPL) affects 1%–5% of women worldwide. Advanced maternal age and increasing pre-pregnancy coexisting diseases have complicated its clinical management. Large language models (LLMs) and clinical decision support (CDS) tools are widely used clinically, yet combined use evidence for RPL remains scarce. Objective: To evaluate whether structured CDS materials improve the guideline compliance of three LLMs for standardized RPL clinical scenarios. Design: Comparative simulation study with self-controlled two-stage assessment. Method: Two reproductive medicine specialists developed 25 standard clinical scenarios based on the 2018 and 2022 ESHRE guidelines. Three LLMs (ChatGPT-5.5, Claude-4.8, DeepSeek-R1) were assessed in two phases: baseline evaluation and assessment with structured CDS figures. Response compliance with guidelines was evaluated. Weighted pooled Cohen’s kappa was used to assess inter-rater reliability. The Friedman test with Bonferroni correction was applied for inter-group comparisons, and the Wilcoxon signed-rank test for paired analyses. Results: At baseline, the full guideline compliance rates of the ChatGPT-5.5, Claude-4.8, and DeepSeek-R1 were 44.0%, 28.0%, and 20.0%, with significant differences among groups (P
Keyword(s):
Medicine; Medicine.
MeSH Term(s):
Grants and Funding:
No Grants or Funding Data Available
Associated Publication(s):
Supplementary Data:
No Supplementary Data Available
Related Dataset(s):
No Related Dataset Data Available
The National Library of Medicine (NLM) provides information about biomedical datasets. Inclusion on an NLM Web page does not imply endorsement of, or agreement with, the contents by NLM or the National Institutes of Health. Learn more: NLM Web Policies (nih.gov)