ChatGPT technology continues to expand, concerns that Artificial Intelligence (AI) could replace humans have start gaining ground. As per latest study, which is a pre-print and yet to be peer-review strengthens such belief.
As per study, posted on 29th March 2023, shows that ChatGPT-4 outperform in neurosurgery exams by the American Board of Neurological Surgery and answer every question correctly.
ChatGPT (GPT-3.5) has shown near-passing performance on medical student board examinations, the performance of ChatGPT or its successor GPT-4 on specialise exams significantly outperform the former.
As per the study, “Performance of ChatGPT and GPT-4 on Neurosurgery Written Board Examinations” on MedRxiv, the pre-print server for health sciences, the idea was to assess the performance of ChatGPT and GPT-4 on a 500-question mock neurosurgical written board examination.
In medical student board examinations, among 12 question categories, GPT-4 significantly outperform users in each.
It outperform both users and ChatGPT for tumour questions.
ChatGPT was release in November 2022 and has gain massive interest in the technology call as generative artificial intelligence.
This technology is use to produce answers mimicking human conversations.
Microsoft-backed OpenAI, ChatGPT has been train on enormous volumes of data, which makes the application competent in producing, summarising and translating text with responding to inquiries and carrying out many other natural language tasks.
GPT-4 is the latest, next-generation AI language model that can read photos and explain what’s in them.
ChatGPT-5 rumored to launch at the end of 2023, will it achieve AGI?
— 2YoDoINDIA News Network (@2yodoindia) April 1, 2023
for more news visit https://t.co/98KV4yIruC#2YoDoINDIA #ChatGPT #ChatGPT5 #GPT5 #OpenAI pic.twitter.com/SkDjF8fLWg
GPT-4 outperformed average user by scoring 83.4%
The study show that ChatGPT (GPT-3.5) and GPT-4 achieve scores of 73.4% and 83.4%, respectively, relative to the user average of 73.7%.
Question bank users and both GPTs exceed last year’s passing threshold of 69%.
And scores between ChatGPT and question bank users were equivalent, GPT-4 outperform both.
The questions were in single best answer, multiple-choice format.
As per Study :
“Among 12 question categories, GPT-4 significantly outperformed users in each but performed comparably to ChatGPT in three (Functional, Other General, and Spine) and outperformed both users and ChatGPT for Tumour questions,”.
Increase word count and higher-order problem-solving were associate with lower accuracy for ChatGPT, but not for GPT-4.
Multimodal input was not available at the time of this study so, on questions with image content, ChatGPT and GPT-4 answer 49.5% and 56.8% of questions correctly based upon contextual clues alone.
India Working on Ethical Guidelines for AI in Medical Research
India’s apex medical research institution, Indian Council of Medical Research (ICMR) is busy understanding the impact of AI-run applications like ChatGPT on health research and is already forming “ethical guidelines” for its use.
The team of officers has conduct a small test over ChatGPT to understand its immediate implications.
They found that it is writing excellent stuff in terms of writing research papers but still needs human intervention.
While not everything is correct, the algorithm asks the user to rectify incorrect information as well which means that the programme is collecting the correct information and, one day, it will start throwing accurate results too for sure.
