AI Scraping Surges While Referral Traffic to Publishers Plummets, Says TollBit Report
AI search engines like ChatGPT and Perplexity are aggressively scraping content but providing minimal referral traffic to publishers, according to TollBit’s Q4 2024 report. Compared to Google’s 8.63% CTR, AI search CTR was just 0.74%, and AI chatbots hit a mere 0.33%. Scraping activity from bots more than doubled, with ChatGPT-User bot up by 6,767%. Alarmingly, 40% more AI bots bypassed robots.txt. Publishers are increasingly concerned as AI tools consume their content without sending traffic back, disrupting traditional web monetization models. Legal challenges, like Chegg’s lawsuit against Google, hint at escalating tensions over AI’s role in content ecosystems.