Can ChatGPT Be Used For Cancer Information?

An artificial intelligence chatbot that has been developed by OpenAI and launched in November 2022, ChatGPT is based on OpenAI's GPT-3.5 and GPT-4 families of large language models and has been tuned not only using supervised learning techniques but also using reinforcement learning techniques.

Recent years have seen an increase in the popularity of AI-based chatbots across industries to assist users with finding information and navigating online spaces - and healthcare is no different [1].

Can ChatGPT Be Used For Cancer Detection

Chatbots and artificial intelligence (AI) have become popular resources for cancer information, according to a study published in the Journal of The National Cancer Institute Cancer Spectrum.

When asked about common cancer myths and misconceptions, these resources provide accurate information [2].

Skyler Johnson, MD, physician-scientist at Huntsman Cancer Institute and assistant professor at the University of Utah (the U), conducted the first study of its kind to evaluate ChatGPT's accuracy and reliability.

ChatGPT Provides Accurate Information On Cancer Myths And Misconceptions

Here are the important findings from the study:

  • According to the researchers, 97% of the answers provided by ChatGPT regarding cancer were accurate based on the National Cancer Institute's (NCI's) common myths and misconceptions.
  • The researchers compared ChatGPT's outputs with answers provided by the National Cancer Institute (NCI) using questions from the NCI's "Common Cancer Myths and Misconceptions" web page.
  • It is important to point out that this finding comes with some important considerations, including a concern among the team that some of the ChatGPT answers might be interpreted incorrectly.
Can ChatGPT Be Used For Cancer Detection
  • There may be a risk for cancer patients to make incorrect decisions if they use chatbots for cancer information. The team recommended that patients use caution when advising them about whether to use chatbots to obtain cancer information as inaccurate information may cause harm to the patient.
  • Both the ChatGPT and NCI responses were blinded, which means the five cancer experts reviewing the answers were not aware of the source of the answers.
  • While the answers provided by ChatGPT were accurate, reviewers found the language to be indirect, vague, and in some cases, unclear.
  • Studying these sources will allow experts to guide cancer patients through the murky waters of online information as they attempt to find answers to their diagnoses.

"This could lead to some bad decisions for cancer patients. The team suggested caution when advising patients about whether they should use chatbots for information about cancer," says Johnson [3].

Can ChatGPT Be Used For Cancer Detection

On A Final Note...

According to the researchers, the next step is to assess how often patients use chatbots to seek information regarding cancer, what questions they are asking, and whether AI chatbots can provide accurate answers to unusual or uncommon questions regarding cancer.

Disclaimer: The information provided in this article is for general informational and educational purposes only and is not intended as a substitute for professional medical advice, diagnosis, or treatment. Always seek the advice of your physician or a qualified healthcare provider with any questions you may have regarding a medical condition.

Read more about: cancer signs chatgpt