A RECENT study has concluded that ChatGPT is actually getting dumber as time goes on.
The infamous chatbot was released in 2022 and caused some controversy for its ability to write just like a human.
1
This led to fears that some humans could lose their jobs to the chatbot as well as incidents in which school children and students used ChatGPT to cheat.
ChatGPT learns from interactions with users and it was originally thought that this would help it develop even more.
Standford University researchers are now claiming that the chatbot’s artificial intelligence is actually declining.
It comes after ChatGPT users have also complained that the current version of the bot isn’t as good as earlier versions.
The research paper focuses on GPT-4, which is responsible for powering ChatGPT Plus.
“We find that the performance and behavior of both GPT-3.5 and GPT-4 vary significantly across these two releases and that their performance on some tasks have gotten substantially worse over time,” the researchers wrote.
They challenged both versions of the ChatGPT to answer math problems, answer sensitive questions, and generate code.
The bots were also asked some visual reasoning questions.
Most read in News Tech
It’s unclear why the newer version of ChatGPT was performing worse in the study.
Human interaction isn’t necessarily a cause for the reported decline but OpenAI claims it’s also not due to software changes.
This is something disputed by Peter Welinder who is vice president of product and partnerships at OpenAI, which owns ChatGPT.
He recently tweeted: “No, we haven’t made GPT-4 dumber. Quite the opposite: we make each new version smarter than the previous one.
“Current hypothesis: When you use it more heavily, you start noticing issues you didn’t see before.”
The OpenAI expert added: “If you have examples where you believe it’s regressed, please reply to this thread and we’ll investigate.”
Several Twitter users responded with examples that they claim show that ChatGPT is getting dumber over time.
