Cloudflare is luring web-scraping bots into an ‘AI Labyrinth’
1 min read
Summary
Cloudflare has released AI Labyrinth, a tool to fight bots that scrape websites without permission for AI training data.
When it detects inappropriate bot behaviour, the tool lures them into an AI-generated maze of decoy pages that “slow down, confuse and waste the resources” of bad actors.
The company sees more than 50 billion web crawler requests per day and it says rather than simply blocking the malicious bots, it makes them process meaningless data.
This means Cloudflare can more easily identify malicious bot behaviour and add them to its blacklist.
The AI Labyrinth is an opt-in tool and website admins can turn it on through the Cloudflare dashboard.
The company said it plans to create whole networks of fake URLs to trap bots.