AI is mrs. dalloway frisson of eroticismstealing your content. We know this is how AI companies have built their highly-valued businesses – by scraping the web and using your data to train their chatbots.
Web scraping isn't new. In the past, websites could rely on simple protocols like robots.txt to define what could, and could not, be used by web crawlers. Those guidelines were respected by the companies doing the scraping to, say, build results for search engines. AI companies, however, are not abiding by this social contract and are ignoring those instructions.
Cloudflare, a global network service that helps some of the biggest websites in the world deliver content to users, has devised a new plan to deal with AI companies' web scrapers. And the idea is as positively devious as it is ingenious.
In a new blog post, Cloudflare has shared how it's now "trapping misbehaving bots in an AI labyrinth." Basically, bots that don't follow the rules laid out for them via protocols such as robots.txt, a simple text file that lays out what web crawlers are allowed to do on a site, will be messed with in order to waste the time and resources of the company in charge of the bot.
"AI-generated content has exploded…at the same time, we’ve also seen an explosion of new crawlers used by AI companies to scrape data for model training," Cloudflare said in its post. "AI Crawlers generate more than 50 billion requests to the Cloudflare network every day, or just under 1% of all web requests we see."
Cloudflare says it previously just blocked AI web crawlers and scrapers. However, doing so alerted those behind the bots that their access had been denied, and as a result they would shift strategies in order to continue their scraping campaigns.
So, Cloudflare came up with an idea to build a honeypot: a series of fake webpages created with AI-generated content.
The fact that Cloudflare is utilizing AI-generated content to fight AI web scrapers isn't just for schadenfreude. When AI trains off of AI-generated content, it actually degradesthe AI model itself. The industry even has a term for it: "model collapse." Cloudflare is essentially making sure that bots that break the rules are punished for doing so.
Cloudflare's post gets into the technical detailsof building the AI labyrinth. But, the main gist of it is that Cloudflare devised things in a way where a human visitor shouldn't ever see these AI-generated honeypot pages. In addition, humans would notice the "AI-generated nonsense" on these pages. Bots, however, would fall down the rabbit hole, wasting computational resources as they go deeper and deeper through the multiple pages of AI-generated content.
Cloudflare customers are able to opt-in to using the AI labyrinth right now to protect their content from web scrapers.
Topics Artificial Intelligence
Golden State Warriors vs. Los Angeles Lakers 2025 livestream: Watch NBA online
The 15 best fiction books of 2024, according to BookTok
Whiting Awards 2021: Marwa Helal, Poetry
Samsung Galaxy Unpacked: What to expect from the January livestream
NYT Connections hints and answers for February 1: Tips to solve 'Connections' #601.
Poets on Couches: Cheswayo Mphanza Reads Gerald Stern by Cheswayo Mphanza
X to become the 'everything app' with a copy of Venmo
Blueprints for Another World by The Paris Review
Optogenetics: A Virtual Reality System for Controlling Living Cells
Isn’t That So by Friederike Mayröcker
NYT Connections hints and answers for February 5: Tips to solve 'Connections' #605.
Announcing The Winners of the 2017 Whiting Awards
At Home among the Birds: An Interview with Jonathan Meiburg by John Jeremiah Sullivan
The Sphere during CES 2024: Android vs. iPhone
Best air purifier deal: Save $300 on the Dyson HEPA Big + Quiet air purifier
The Tarot Is a Chameleon by Rhian Sasseen
Best beauty deal: Build your own Shark FlexStyle or SpeedStyle and save up to $50
2021 Whiting Awards: Sylvia Khoury, Drama
Google 'Ask for me:' AI that calls businesses on your behalf for pricing and availability
How to watch KU vs. OU basketball without cable: game time, streaming deals, and more
Tinder launches profile videos, Hot Takes, and an Explore pageHow to not let body shame keep you from LGBTQ Pride 2021The Morning News Roundup for April 23, 2014How to change fitness goals on Apple WatchTinder launches profile videos, Hot Takes, and an Explore pageShakespeare, HeartthrobShakespeare, HeartthrobThe Morning News Roundup for May 5, 2014Netflix has quietly released an iOS game controller appRecapping Dante: Canto 27 or Let’s Make a Deal with the PopeMarvel's VFX workers are pushing to unioniseHow to avoid flashing lights and photosensitive videos on TikTokGabriel Garcia Marquez, 1927Apple Watch 7 to get redesign, but big health updates may be coming laterRing treated cops like influencers in a bid to boost its brandThreesomes are seemingly more popular than ever in 2021Marvel's VFX workers are pushing to unioniseWhat We‘re Loving: Good Friday Riffs, Your New White HairThe 'queer aesthetic' is deeper than rainbow merchThe Morning News Roundup for April 24, 2014 The uncommon birds of George Edwards, born today in 1694 William Hazlitt on Meeting Poet Samuel Taylor Coleridge Dave Jorgenson's TikTok book is a fun, engaging read for aspiring TikTokkers Lonely Hunter by Sadie Stein Abraham Cahan’s “A Bintel Brief” letters illustrated ‘Barbie’ tops $1 billion and a new record for female directors George Plimpton’s Famous April Fools’ Day Joke A conspiracy theory about a party supply store went viral on TikTok. Then the police showed up. Sadie Stein on Smiling at Strangers in Public An Interview with Poet Mary Szybist Recapping Dante: Canto 24, or Serpent, Ashes, Rinse, Repeat What We’re Loving: Dead Poets, Dead Magazines, Dead Zoo Gang Amazon's Halo fitness tracker can now judge how your body moves Sadie Stein on Philip Larkin’s Poem “The Trees” The Morning News Roundup for March 31, 2014 Wordle today: Here's the answer and hints for August 5 AI automation still poses accessibility issues, especially for audio transcription The FCC just fined a robocall company $300 million The Morning News Roundup for April 8, 2014 Opening Day by Sadie Stein
1.7907s , 10194.953125 kb
Copyright © 2025 Powered by 【mrs. dalloway frisson of eroticism】,Unobstructed Information Network