For many patients, the internet serves as a powerful tool for self-education on medical topics. With ChatGPT now at patients' fingertips, researchers from Brigham and Women's Hospital, a founding member of the Mass General Brigham healthcare system, assessed how consistently the artificial intelligence chatbot provides recommendations for cancer treatment that align with National Comprehensive Cancer Network (NCCN) guidelines.
Reviewed by Danielle Ellis, B.Sc.Aug 25 2023 Their findings, published in JAMA Oncology, show that in approximately one-third of cases, ChatGPT 3.5 provided an inappropriate recommendation, highlighting the need for awareness of the technology's limitations.
Danielle Bitterman, MD, Corresponding Author, Department of Radiation Oncology and the Artificial Intelligence in Medicine Program of Mass General Brigham Although medical decision-making can be influenced by many factors, Bitterman and colleagues chose to evaluate the extent to which ChatGPT's recommendations aligned with the NCCN guidelines, which are used by physicians at institutions across the country. They focused on the three most common cancers and prompted ChatGPT to provide a treatment approach for each cancer based on the severity of the disease.
Related StoriesIn 12.5 percent of cases, ChatGPT produced "hallucinations," or a treatment recommendation entirely absent from NCCN guidelines. These included recommendations of novel therapies, or curative therapies for non-curative cancers. The authors emphasized that this form of misinformation can incorrectly set patients' expectations about treatment and potentially impact the clinician-patient relationship.
Australia Latest News, Australia Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Be careful asking ChatGPT questions about cancer, Brigham study saysBe careful asking ChatGPT questions about cancer, Brigham study says
Read more »
ChatGPT shows limited ability to recommend guidelines-based cancer treatmentsFor many patients, the internet serves as a powerful tool for self-education on medical topics. With ChatGPT now at patients' fingertips, researchers from Brigham and Women's Hospital, a founding member of the Mass General Brigham health care system, assessed how consistently the artificial intelligence chatbot provides recommendations for cancer treatment that align with National Comprehensive Cancer Network (NCCN) guidelines.
Read more »
ChatGPT outperforms average uni students in computer scienceDetection algorithms also fail to distinguish between answers from real people and large language models
Read more »
Study uncovers genetic risk factors for heart failureIn a new study co-led by investigators at the United States Department of Veterans Affairs and Brigham and Women's Hospital, a founding member of the Mass General Brigham health care system, a global team of scientists conducted one of the largest genetic association studies on heart failure to date. Using genomic data from over 90,000 heart failure patients and more than a million controls, the team identified 39 genetic mutations associated with heart failure, 18 of which had not been reported previously.
Read more »
Largest genetic study of heart failure finds new risk factorsIn a new study co-led by investigators at the United States Department of Veterans Affairs and Brigham and Women's Hospital, a founding member of the Mass General Brigham healthcare system, a global team of scientists conducted one of the largest genetic association studies on heart failure to date.
Read more »
AI can achieve better grades than university students, report suggestsNew research found Sam Altman's ChatGPT matched or performed better than students when answering assessment questions. Model outperformed in psychology and others.
Read more »