Meta's Llama model has memorized Harry Potter and sex video bangladeshthe Sorcerer's Stoneso well that it can reproduce verbatim excerpts from 42 percent of the book, according to a new study.
Researchers from Stanford, Cornell, and West Virginia University analyzed dozens of books from the now-infamous Books3 dataset, a collection of pirated books used to train Meta's Llama models. Books3 is also at the center of a copyright infringement lawsuit against Meta,Kadrey v. Meta Platforms, Inc.The study's authors say their findings could have major implications for AI companies facing similar lawsuits.
According to the research paper, the Llama 3.1 model "memorizes some books, like Harry Potterand 1984, almost entirely." Specifically, the study found that Llama 3.1 has memorized 42 percent of the first Harry Potter book so well that it can reproduce verbatim excerpts at least 50 percent of the time. Overall, Llama 3.1 could reproduce excerpts from 91 percent of the book, though not as consistently.
"The extent of verbatim memorization of books from the Books3 dataset is more significant than previously described," said the paper. But the researchers also discovered that "memorization varies widely from model to model and from book to book within each model, as well as varying in different parts of individual books." For example, the study estimated that Llama 3.1 only memorized 0.13 percent of Sandman Slimby Richard Kadrey, one of the lead plaintiffs in the class action copyright suit against Meta.
So, while some of the paper's findings seem damning, don't call it a smoking gun for plaintiffs in AI copyright infringement cases.
"These results give everyone in the AI copyright debate something to latch on to," wrote journalist Timothy B. Lee in his Understanding AI newsletter. "Divergent results like these could cast doubt on whether it makes sense to lump J.K. Rowling, Richard Kadrey, and thousands of other authors together in a single mass lawsuit. And that could work in Meta’s favor, since most authors lack the resources to file individual lawsuits."
Why is Llama able to reproduce some books more than others? "I suspect that the difference is because Harry Potter is a much more famous book. It's widely quoted and I'm sure that substantial excerpts from it on third-party websites found their way into the training data on the web," said James Grimmelmann, a professor of digital and information law at Cornell University, who was cited in the paper.
What this also shows, Grimmelmann said, is that "AI companies can make choices that increase or reduce memorization. It's not an inevitable feature of AI; they have control over it."
Meta and other AI companies have argued that using copyrighted works to train their models is protected under fair use, a complex legal doctrine. However, the extent of memorization could complicate those arguments.
“Yes, I do think that the likelihood that LLMs are memorizing more than previously thought changes the copyright analysis,” Robert Brauneis, a professor with the George Washington University Law School, said in an email to Mashable. He concluded that the study’s findings could ultimately weaken Meta’s fair use argument.
We asked Meta for comment on the study's findings, and we'll update this article if we receive a response.
Disclosure: Ziff Davis, Mashable’s parent company, in April filed a lawsuit against OpenAI, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.
Topics Artificial Intelligence Meta
This app brings the Dynamic Island to Android phonesGuy scams his way into a free Outback steak by pretending his Valentine stood him up'Quordle' today: See each 'Quordle' answer and hints for September 22Build a massive library of PC games with a Humble Choice membership for just $12 per monthKenny G is trapped in a maze of roses, serenading Kim Kardashian for Valentine's DayNetflix's 'Drifting Home' is worth watching for the animation aloneThis raccoon influencer says they actually make good pets (but maybe stick to dogs)The future of aviation: Give up your supersonic air travel dreams'Quordle' today: See each 'Quordle' answer and hints for September 25Instagram is developing a way to protect users from cyberflashingThe best 'Due to personal reasons' memes to get you through the dayJames Earl Jones signs over rights to voice of Darth Vader setting plans in motion to retireTikTok officially rolls out its dislike button for comments'Bayonetta 3' feels as great as it always hasSamsung announces $200 Galaxy Watch Active made for fitness addictsIn weird career move, Sean Spicer is now talking about the Oscars on 'ExtraTV''Mario + Rabbids: Sparks of Hope' preview: New characters, same funApple Music will sponsor Super Bowl LVII's halftime show after Pepsi's exitElon Musk's Starlink internet service to provide access in Iran and U.S. school busesWordle today: Here's the answer, hints for September 24 A company is returning to the moon. Here's how it will avoid tipping again MapQuest is letting you name the Gulf of Mexico whatever you want 'Severance' Season 2, episode 6: What's with those documents Mr. Drummond finds? NRL 2025 livestream: How to watch National Rugby League for free Which laptops and smartphones are easiest to repair? See the rankings. Facebook Live videos will now auto Apple revokes iCloud's Advanced Data Protection in the UK over government privacy dispute 6 things we want to see in 'Avatar: Seven Havens' NYT Connections Sports Edition hints and answers for February 23: Tips to solve Connections #153 Rabbit just introduced a new Android AI agent. HP announces a security flaw (and fix) for many laser printers Wales vs. Ireland 2025 livestream: Watch Six Nations for free England vs. Scotland 2025 livestream: Watch Six Nations for free Oppo Find N5 is an incredibly thin, yet powerful foldable phone Government plane swoops over fuming volcano, captures vivid footage Elon Musk's X looks to raise exactly what Musk paid for it NYT Connections Sports Edition hints and answers for February 20: Tips to solve Connections #150 How to watch every 2025 Oscar Best Picture nominee Anker Prime Power Bank deal: Get it for $149.99 Best Apple deal: Save $300 on Apple Studio Display
2.8997s , 8611.7265625 kb
Copyright © 2025 Powered by 【sex video bangladesh】,Inspiration Information Network