Loading...
Loading...
Contributors:
Dataset URI:
10.3389/fpsyg.2026.1981428.s002IntroductionGenerative artificial intelligence is increasingly used in engineering education, but self-reported literacy may not establish whether students can evaluate its outputs. The distinction between perceived competence and performance on engineering-specific AI scenarios remains insufficiently examined. This study investigated their correspondence and whether reported verification frequency statistically accounted for the association between demonstrated literacy and engineering task performance.MethodsA cross-sectional online survey and assessment involved 1,206 mechanical engineering students at three Chinese universities. Measures comprised a 20-item perceived literacy questionnaire, a 12-item scenario test, an eight-item verification frequency scale, and two engineering tasks. Mediation and moderated mediation models controlled gender, year of study, AI use, AI course experience, and university fixed effects.ResultsPerceived and demonstrated literacy were modestly correlated, r = 0.265, 95% confidence interval [0.212, 0.317]. Demonstrated literacy was associated with verification frequency, b = 0.065, and the adjusted indirect association with engineering performance was 0.124, 95% bootstrap confidence interval [0.096, 0.154]. A small negative interaction suggested a weaker verification-performance association at higher perceived literacy, but its practical importance remains uncertain. A reverse-order model also produced a nonzero indirect association.DiscussionThe findings support assessing self-perception and scenario performance separately and investigating the quality of verification. Because the assessment was unproctored, the scores do not establish unaided competence; the cross-sectional associations do not establish a causal verification mechanism.
Keyword(s):
Applied Psychology; engineering education; generative AI literacy; moderated mediation; problem solving.
MeSH Term(s):
Grants and Funding:
No Grants or Funding Data Available
Associated Publication(s):
Supplementary Data:
No Supplementary Data Available
Related Dataset(s):
No Related Dataset Data Available
The National Library of Medicine (NLM) provides information about biomedical datasets. Inclusion on an NLM Web page does not imply endorsement of, or agreement with, the contents by NLM or the National Institutes of Health. Learn more: NLM Web Policies (nih.gov)