AI chatbots unable to accurately summarise news, BBC finds

Technology correspondent

Four Chatbots Chatbots Chatbots The main artificial (AI) summarizes the inaccurate news stories, according to the research conducted by the BBC.
The BBC gave Chatgpt from Openai and Microsoft from Copilot and Google Gemini and AI Perplexity content from the BBC, then asked questions about the news.
She said that the resulting answers contain “great inaccuracy” and deformities.
In a blogDeborah Tunisia, CEO of BBC News and ongoing affairs, said that artificial intelligence brought “endless opportunities”, but companies that develop tools were “playing with fire.”
“We live in turbulent times, and how long will it take before the title that was passed by Amnesty International caused great harm in the real world?” She asked.
Technology companies that have Chatbots have been contacted to comment.
“withdraw”
in the studyThe BBC has requested Chatgpt, Copilot, Gemini and Perplexity to summarize 100 news stories and classify each answer.
She got journalists who were concerned with the subject of the article to assess the quality of answers from artificial intelligence assistants.
I found that 51 % of all the answers of artificial intelligence to the questions about the news were convinced that it had important issues of some kind.
In addition, 19 % of artificial intelligence answers that cited the BBC content provided realistic errors, such as incorrect realistic data, numbers and dates.
On her blog, Ms. Turness said that BBC was seeking to “open a new conversation with self -technology service providers” so that we can work together in a partnership to find solutions.
Technology companies called for “retreat” to the summary of artificial intelligence news, As Apple did after complaints From the BBC, Apple’s intelligence had been distorting news stories.
Some examples included the inadequacy that the BBC found:
- Gemini said incorrect
- Chatgpt and Copilot said that Rishi Sonak and Nicolas Storgion are still in their position even after they left.
- The BBC was confused in a story about the Middle East, saying that Iran initially showed “restraint” and described Israel’s actions as “aggressive”
In general, Microsoft’s Copilot and Google’s Gemini faced more important problems than Chatgpt and Perplexity from Openai, which is Jeff Bezos as one of its investors.
BBC usually prevents its content from AI Chatbots, but it has opened its website throughout the test period in December 2024.
The report said that in addition to containing realistic inequality, the chat restaurant “has struggled to distinguish between opinion, reality, and liberation, and it often failed to include the basic context.”
“The publishers should control whether their content is used and how artificial intelligence companies use how the assistants process the news along with the scale and scale of errors and inaccuracy they produce,” said Bete Archer.