Role of ChatGPT and Google Bard in the Diagnosis of Psychiatric Disorders: A Comparative Study
Abstract
Introduction
The incorporation of artificial intelligence (AI) in the medical decision-making matrix has captured interest across diverse medical domains. This study aimed to juxtapose the decision-making patterns of humans and artificial intelligence regarding psychiatric disorders.
Methods
A set of case stories composed of 20 questions and the ideal answers were developed by a psychiatrist (the first author) based on International Classification of Diseases or Diagnostic and Statistical Manual of Mental Disorders. The cases and replies were revised by other authors, and one by one, they were presented to ChatGPT and Google Bard. The results were presented in a table.
Results
Both ChatGPT and Google Bard reported a high rate of precision in the spot diagnosis of the cases. ChatGPT provided a correct diagnosis for 15 cases (75%), while Google Bard diagnosed 14 cases (70%) successfully.
Conclusion
ChatGPT and Google Bard's success in this study opens the door for deeper AI integration in psychiatric evaluations. As technology evolves, the boundary between human and AI decision-making may become less distinct, promising a new era in psychiatric care. Moving forward, we must approach AI in healthcare with enthusiasm, collaboration, and caution.
References
- Malik P, Pathania M, Rathaur VK. Overview of artificial intelligence in medicine. Journal of family medicine and primary care. 2019;8(7):2328-31. doi:10.4103/jfmpc.jfmpc_440_19
- Aydın, Ö. Google Bard Generated Literature Review: Metaverse. Journal of AI. 2023;7(1):1-14. doi: N/A
- Salih AM, Mohammed BA, Hasan KM, Fattah FH, Najmadden ZB, Kakamad FH, et al. Mitigating the Burden of meningitis outbreak; ChatGPT and Google Bard Recommendations for the general populations; general practitioners and pediatricians. Barw Medical Journal. 2023;1(2). doi:10.58742/bmj.v1i2.32.
- Gilson A, Safranek CW, Huang T, Socrates V, Chi L, Taylor RA, et al. How does ChatGPT perform on the United States medical licensing examination? The implications of large language models for medical education and knowledge assessment. JMIR Medical Education. 2023;9(1): e45312. doi:10.2196/45312
- Ayers JW, Zhu Z, Poliak A, Leas EC, Dredze M, Hogarth M, et al. Evaluating Artificial Intelligence Responses to Public Health Questions. JAMA Network Open. 2023;6(6):e2317517-. doi:10.1001/jamanetworkopen.2023.17517
- Baumgartner C. The potential impact of ChatGPT in clinical and translational medicine. Clinical and translational medicine. 2023;13(3):e1206. doi:10.1002/ctm2.1206
- Topol EJ. High-performance medicine: the convergence of human and artificial intelligence. Nature medicine. 2019;25(1):44-56. doi:10.1038/s41591-018-0300-7
- Jha S, Topol EJ. Adapting to artificial intelligence: radiologists and pathologists as information specialists. Jama. 2016;316(22):2353-4. doi:10.1001/jama.2016.17438.
- Castelvecchi D. Can we open the black box of AI? Nature. 2016; 538(7623):20-23. doi:10.1038/538020a
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.