Loading...
Loading...
Contributors:
Dataset URI:
10.3389/fpubh.2026.1961647.s005BackgroundLarge language models may support postpartum health consultation and nursing care plan development, but their performance across different task types remains uncertain. This study compared the performance of ChatGPT 5.5 and DeepSeek V3 in these settings.MethodsA three-stage cross-sectional evaluation was conducted, comprising repeated querying of 30 guideline-based questions, consultations involving 120 postpartum women, and 120 de-identified retrospective clinical cases. Responses were evaluated by clinical experts using a blinded assessment process. In Stage 2, the postpartum women who submitted the questions also performed blinded evaluations from the user perspective. Paired-samples t tests or Wilcoxon signed-rank tests were used, as appropriate. Holm-Bonferroni correction was applied within outcome families defined by study stage and evaluator type, and intraclass correlation coefficients were calculated to assess agreement among clinical expert ratings.ResultsIn Stage 1, ChatGPT 5.5 received a higher correctness score than DeepSeek V3 (4.00 ± 0.00 versus 3.88 ± 0.33; Holm-adjusted p = 0.002). DeepSeek V3 received higher scores for completeness and clinical management appropriateness (both Holm-adjusted p ConclusionLLM performance varied depending on the task, evaluation metric, and use case. ChatGPT 5.5 received higher scores across most clinically relevant dimensions in real-world postpartum consultations and nursing care plan generation, whereas DeepSeek V3 received higher scores for completeness and safety in standardized questions, clinician-rated readability in real-world consultations, and individualization in care-plan generation. LLMs may support health education and preparation of initial nursing care plan drafts, but their outputs require clinical review.
Keyword(s):
digital health; health consultation; large language models; maternal health; nursing decision support.
MeSH Term(s):
Grants and Funding:
No Grants or Funding Data Available
Associated Publication(s):
Supplementary Data:
No Supplementary Data Available
Related Dataset(s):
No Related Dataset Data Available
The National Library of Medicine (NLM) provides information about biomedical datasets. Inclusion on an NLM Web page does not imply endorsement of, or agreement with, the contents by NLM or the National Institutes of Health. Learn more: NLM Web Policies (nih.gov)