Openai was accused with many The Contracting Parties of the AI training on the content protected by copyright without permission. Now a new paper With an AI Watchdog organization it makes the serious accusation that the company was increasingly based on non -public books, no permission to train more sophisticated AI models.
AI models are essentially complex prediction machines. They are trained in many data – books, movies, television broadcasts and so on – they learn patterns and new ways to move on from a simple exhortation. When a model “writes” an essay on a Greek tragedy or “pulls” Ghibli -type images, he just pulls out of his enormous knowledge to approach. It doesn’t reach anything new.
While a series of AI workshops, including Openai, have begun to embrace the data created by AI to train AI as they exhaust real world sources (mainly public fabric), few have completely avoided real world data. This is possible because training in purely synthetic data comes with dangers, such as deteriorating the performance of a model.
The new document, from the project AI Conclosures, a non-profit institution in 2024 by MOGUL MODE Masses Tim O’Reilly and economist Ilan Strauss, concludes that Openai is probably training the GPT-4O model in books by O’Reilly Media. (O’Reilly is O’Reilly Media CEO.)
In Chatgpt, GPT-4O is the default model. O’Reilly has no licensing agreement with Openai, says the document.
“The GPT-4O, Openai’s latest and most capable model, proves the strong recognition of Openiilly’s O’Reilly book content … compared to the previous model of the Openai GPT-3.5 Turbo,” wrote the co-authors of the paper. “On the contrary, GPT-3.5 Turbo shows greater relevant identification of O’Reilly O’Reilly book samples.”
Paper used a method called Scoopintroduced for the first time in an academic study in 2024, designed to detect copyright -protected content in the language training data. Also known as “Attack Conclusions”, the method tests whether a model can reliably distinguish the texts from humans from paraphrases created by the AI versions of the same text. If it can, it suggests that the model may have prior knowledge of the text from its training data.
Paper co-authors-o’reilly, Strauss and AI researcher Sruly Rosenblat-say that they examined the knowledge of the GPT-4O, GPT-3.5 and other OpenAI models about the cuts. They used 13,962 paragraphs from 34 O’Reilly books to assess the possibility that a particular passage had been included in the training set of a model.
According to the results of the document, the GPT-4O was “recognized” much more paywalled O’Reilly book content of Openai’s oldest models, specifically GPT-3.5 Turbo. This is even after the recording of possible confusing factors, the authors mentioned, such as the improvements in the ability of the younger models to understand if the text was a human writer.
“GPT-4O [likely] It recognizes, and thus has previously knowledgeable, many non-public O’Reilly books published before the training date, “the co-authors wrote.
They are not a smoking weapon, co-authors are careful to note. They acknowledge that their experimental method is not unmistakable and that Openai may have collected the quotes of books that have undergone paywalled from users who copy and paste it to chatgpt.
Further waters, co-authors did not evaluate OpenAI’s latest collection of models, which includes GPT-4.5 models and “reasoning” such as O3-MINI and O1. It is likely that these models were not trained in O’Reilly book data or trained in a smaller amount than GPT-4O.
This is no secret that Openai, which has supported the most relaxed restrictions on the development of models that use copyright -protected data, are looking for higher quality training data for some time. The company has arrived so much Leasing journalists to help perfection the exits of his models. This is a trend throughout the wider industry: AI companies hire experts in areas such as science and physics effectively have these experts to feed their knowledge into AI systems.
It should be noted that Openai pays at least some of the training data. The company has licensing offers with news publishers, social networks, media libraries and more. Openai also offers exception- mechanisms- Although you are incomplete – They allow copyright owners to highlight the content that would prefer the company that does not use for educational purposes.
Still, as Openai fights many costumes on training data practices and the treatment of copyright law in the US courts, O’Reilly paper is not the most flattering appearance.
Openai did not respond to a request for comments.
