[Performance of generative pre-trained transformer-4 on the certification test for mental health management: A factorial design].
Kazuhiro WatanabeYasuhiro TsutsuiTakao TsutsuiTakenori YamauchiMitsuo UchidaYuriko HachiyaIlsung KimMako IidaKotaro ImamuraAsuka SakurayaNorito KawakamiPublished in: Sangyo eiseigaku zasshi = Journal of occupational health (2024)
GPT-4 had a sufficient knowledge network for occupational mental health, surpassing the criteria for levels II and III tests. For the level I test, which required the ability to describe more advanced knowledge accurately, GPT-4 did not meet the criteria. External information may be needed when using GPT-4 at this level. Although the tuned prompts did not significantly improve the performance, they were promising in avoiding unintended outputs and organizing output formats. UMIN trial registration: UMIN-CTR ID = UMIN000053582.