Summary
Introduction. Artificial Intelligence has emerged as a transformative force across various industries, with a particularly profound impact on healthcare. It is well known that patients today increasingly turn to the internet searching for information about their medical conditions, utilizing tools like AI-based chatbots. However, information from unverified sources can influence patients’ decisions regarding treatment options. This study aims to evaluate the quality of medical information provided by ChatGPT for Assigned Female At Birth (AFAB) patients considering gender-affirming surgery.
Methods. Given the possibility that some patients might use ChatGPT as an information source for their medical conditions, specific questions were posed to the chatbot in the same manner a patient interested in gender-affirming surgery would. The quality of the information was assessed using the standardized EQIP scale. The survey involved 30 individuals: 15 plastic surgery residents and 15 non-healthcare professionals, with data collected in February 2023 and analyzed using SPSS Software version 28.0.
Results. Separate surveys evaluated the quality of information provided by ChatGPT regarding two primary procedures for AFAB patients undergoing gender-affirming surgery: phalloplasty and top surgery. The quality of the information was found to be adequate in both cases, with significant qualitative differences across the various survey sections. ChatGPT excelled in delivering information in a simple and accessible manner, earning high scores in the “Structured Data” area. However, the “Content Data” area, representing the completeness of information, was deemed sufficient. A significant deficiency was noted in the “Identification Data” section, highlighting the absence of information about revisions, bibliographies, and the names of the entities or individuals providing content.
Conclusions. ChatGPT demonstrated excellent capability in providing information in a straightforward and accessible manner, achieving high scores in the “Structured Data” area in both evaluations. The completeness of information, represented in the “Content Data” area, was considered sufficient. However, a notable deficiency in the “Identification Data” section underscored the absence of details regarding revisions, bibliographies, and content authorship. Although the content score could be improved by adjusting the number and phrasing of questions, the lack of bibliography and source verification remains a significant limitation of this tool. ChatGPT offers advantages such as ease of communication, privacy, anonymity, and overcoming language barriers; nonetheless, given its limitations, its role should always be seen as supplementary to that of the surgeon.
Downloads
License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Copyright
Copyright (c) 2022 Plastic Reconstructive and Regenerative Surgery
How to Cite
- Summary viewed - 22 times
- PDF downloaded - 5 times