Loading...
Loading...
Contributors:
Dataset URI:
10.3389/fneur.2026.1970459.s005BackgroundParkinson’s disease (PD) requires both disease-specific knowledge and contextual clinical reasoning. However, most evaluations of medical large language models (LLMs) emphasize closed-ended questions and factual accuracy, providing limited insight into broader dimensions of performance on professional PD tasks.MethodsNine contemporary LLMs were evaluated using a 200-item English-language professional PD benchmark spanning five clinical domains, four difficulty levels, and multiple question formats. Responses were assessed for expert-rated factual accuracy, clinical reasoning, Global Quality Scale (GQS), and Flesch–Kincaid Grade Level (FKGL).ResultsThe nine models generated 1,800 responses. Between-model separation was minimal for expert-rated factual accuracy (Kendall’ s W = 0.031) but greater for FKGL (W = 0.235), Clinical Reasoning (W = 0.256), and GQS (W = 0.301). Between-model separation in expert-rated factual accuracy was small for closed-ended questions (W = 0.020, p = 0.001) but greater for open-ended questions (W = 0.121, p ConclusionContemporary LLMs showed limited between-model separation in expert-rated factual accuracy within this benchmark and scoring framework, whereas greater differentiation emerged in open-ended tasks, clinical reasoning, overall response quality, and readability. Multidimensional evaluation may therefore provide a more informative characterization of model performance and help inform task-specific model selection and oversight in medical applications.
Keyword(s):
benchmarking; large language models; medical information systems; multidimensional evaluation; Neurology and Neuromuscular Diseases.
MeSH Term(s):
Grants and Funding:
No Grants or Funding Data Available
Associated Publication(s):
Supplementary Data:
No Supplementary Data Available
Related Dataset(s):
No Related Dataset Data Available
The National Library of Medicine (NLM) provides information about biomedical datasets. Inclusion on an NLM Web page does not imply endorsement of, or agreement with, the contents by NLM or the National Institutes of Health. Learn more: NLM Web Policies (nih.gov)