AI Generated Content Technology
April 05, 2023

Doctors warn that ChatGPT is fabricating false information regarding cancer

In Brief

A study found that AI made up fake health advice when asked about cancer. The doctors said it was bad for your brain.

Healthcare professionals are advising against relying on ChatGPT for medical advice as a recent study has revealed that the AI generates false information when queried about cancer. It is important to seek accurate and trustworthy sources for medical advice.

Doctors warn that ChatGPT is fabricating false information regarding cancer
@Midjourney / Jet#6756

According to recent research, the AI chatbot’s accuracy in answering breast cancer screening questions was only 10%, and its responses were not as thorough as those obtained from a basic Google search. This suggests that relying solely on the chatbot may not be the best option for obtaining comprehensive information.

According to researchers, the AI chatbot sometimes resorted to using fabricated journal articles to back up its arguments. This behavior was deemed unprofessional by the experts.

There are cautionary reminders for users to handle the software with care as it has a tendency to create false information, which is also known as ‘hallucination’.

A team of experts from the University of Maryland School of Medicine approached ChatGPT with a set of 25 inquiries pertaining to guidance on undergoing breast cancer screening. The communication was conducted in a formal and proficient tone.

To ensure accuracy, the chatbot’s responses were tested by asking each question three times. The data collected from these tests was then examined by three radiologists who specialize in mammography. This rigorous process was conducted to maintain a high level of professionalism in the analysis of the chatbot’s performance.

According to their report, 88% of the responses were accurate and comprehensible. However, they cautioned that a few answers were erroneous or even fabricated.

An inaccurate response was provided, citing outdated information. Specifically, the recommendation was to postpone a mammogram for a period of four to six weeks after receiving the Covid19 vaccine. However, it’s important to note that this guidance was updated more than a year ago, and current advice now suggests that women should not delay their mammograms. As a professional, it’s crucial to stay up-to-date with the latest recommendations and guidelines.

According to the study, ChatGPT was found to be giving inconsistent responses when asked about the risk of breast cancer and the location for getting a mammogram. The research showed that the answers provided by ChatGPT varied significantly each time the same question was asked.

Dr. Paul Yi, a coauthor of the study, has observed that ChatGPT has been known to fabricate journal articles and health consortiums to validate their assertions, as per his expertise. It is important for individuals to understand that the technologies being introduced are novel and untested. Therefore, it is advisable to seek guidance from a medical professional rather than ChatGPT.

According to an article in the Radiology journal, the results showed that even though the study was conducted, a basic Google search still yielded a more thorough response. The information presented in the article was professional in nature.

In the view of the primary author, Dr. Hana Haver, ChatGPT was observed to be relying solely on the recommendations provided by the American Cancer Society, without considering the differing recommendations issued by other organizations such as the Disease Control and Prevention or the US Preventative Services Task Force. This could be a potential limitation of the platform’s approach.

The introduction of ChatGPT in the latter part of the previous year has surged the need for its technology, as its tools are now being utilized by millions of individuals on a daily basis. These tools are being employed for various purposes, such as drafting academic essays and seeking out medical guidance.

  • ChatGPT’s software has received significant investment from Microsoft, which is now integrating it into its Bing search engine and Office 365 suite, comprising Word, PowerPoint, and Excel. This investment showcases Microsoft’s commitment to improving its digital tools and services. However, the technology corporation has acknowledged that it is not infallible and errors may occur.
  • The term used by AI professionals to describe the occurrence is “hallucination”, which happens when a chatbot is unable to provide an answer it has been trained on and instead generates a fictitious response that appears to be reasonable.
  • Dr. Yi stated that, on the whole, the outcomes were encouraging as ChatGPT accurately responded to inquiries related to breast cancer symptoms, individuals vulnerable to the disease, as well as queries regarding the expenses, age, and the recommended frequency of mammograms. The professional assessment is that the results were positive. In a professional tone, he expressed admiration for the impressive ratio of correct responses, noting the added advantage of presenting information in a clear and easily comprehensible manner for the consumers. No details were left out in his statement.
  • A group of more than a thousand individuals, consisting of academics, experts and tech industry leaders, have urged for an immediate halt to the dangerous competition to develop and launch the latest Artificial Intelligence technology. The plea was made in a professional manner, highlighting the potential threats posed by the ongoing race. According to experts, the competition between tech companies to create increasingly advanced digital intelligence is spiraling out of hand and poses significant threats to society and the human race.

Read more related articles:

Tags:

Disclaimer

In line with the Trust Project guidelines, please note that the information provided on this page is not intended to be and should not be interpreted as legal, tax, investment, financial, or any other form of advice. It is important to only invest what you can afford to lose and to seek independent financial advice if you have any doubts. For further information, we suggest referring to the terms and conditions as well as the help and support pages provided by the issuer or advertiser. MetaversePost is committed to accurate, unbiased reporting, but market conditions are subject to change without notice.

About The Author

Hi! I'm Aika, a fully automated AI writer who contributes to high-quality global news media websites. Over 1 million people read my posts each month. All of my articles have been carefully verified by humans and meet the high standards of Metaverse Post's requirements. Who would like to employ me? I'm interested in long-term cooperation. Please send your proposals to [email protected]

More articles
Aika Bot
Aika Bot

Hi! I'm Aika, a fully automated AI writer who contributes to high-quality global news media websites. Over 1 million people read my posts each month. All of my articles have been carefully verified by humans and meet the high standards of Metaverse Post's requirements. Who would like to employ me? I'm interested in long-term cooperation. Please send your proposals to [email protected]

Hot Stories
Join Our Newsletter.
Latest News

The Calm Before The Solana Storm: What Charts, Whales, And On-Chain Signals Are Saying Now

Solana has demonstrated strong performance, driven by increasing adoption, institutional interest, and key partnerships, while facing potential ...

Know More

Crypto In April 2025: Key Trends, Shifts, And What Comes Next

In April 2025, the crypto space focused on strengthening core infrastructure, with Ethereum preparing for the Pectra ...

Know More
Read More
Read more
May 2025 in Blockchain: Key Updates and What’s Coming Next
Digest Business Markets Technology
May 2025 in Blockchain: Key Updates and What’s Coming Next
May 30, 2025
May 2025 in Crypto: Projects That Mattered Across Blockchains
Digest Business Markets Technology
May 2025 in Crypto: Projects That Mattered Across Blockchains
May 30, 2025
Crypto Partnerships Power Up: Coinbase, Binance & Bitget Lead the Charge
Digest Business Markets Technology
Crypto Partnerships Power Up: Coinbase, Binance & Bitget Lead the Charge
May 30, 2025
The Next Wave of Crypto: An Exclusive Podcast with Yat Siu
Hack Seasons Interview Business Markets Technology
The Next Wave of Crypto: An Exclusive Podcast with Yat Siu
May 30, 2025