New Threat Research Reveals AI crawlers make up almost 80% of AI bot traffic, Meta Leads AI Crawling As ChatGPT Dominates Real-Time Web Traffic
-
cross-posted from: https://programming.dev/post/36083939
New Fastly Threat Research Reveals AI crawlers make up almost 80% of AI bot traffic, Meta Leads AI Crawling As ChatGPT Dominates Real-Time Web Traffic | Fastly
SAN FRANCISCO – August 19, 2025 – Fastly, Inc. (NYSE: FSLY), a leader in global edge cloud platforms, today released its Q2 2025 Threat Insights Report, exposing a striking shift in the nature and scale of automated web traffic. Analysis of traffic from mid-April to mid-July shows that AI crawlers made up almost 80% of all AI bot traffic observed, with Meta generating more than half and eclipsing both Google and OpenAI combined.
(www.fastly.com)
-
cross-posted from: https://programming.dev/post/36083939
New Fastly Threat Research Reveals AI crawlers make up almost 80% of AI bot traffic, Meta Leads AI Crawling As ChatGPT Dominates Real-Time Web Traffic | Fastly
SAN FRANCISCO – August 19, 2025 – Fastly, Inc. (NYSE: FSLY), a leader in global edge cloud platforms, today released its Q2 2025 Threat Insights Report, exposing a striking shift in the nature and scale of automated web traffic. Analysis of traffic from mid-April to mid-July shows that AI crawlers made up almost 80% of all AI bot traffic observed, with Meta generating more than half and eclipsing both Google and OpenAI combined.
(www.fastly.com)
I couldn't click the cookie policy garbage because the AI chat bot obscured the buttons on that page.
Talk about AI slop
-
cross-posted from: https://programming.dev/post/36083939
New Fastly Threat Research Reveals AI crawlers make up almost 80% of AI bot traffic, Meta Leads AI Crawling As ChatGPT Dominates Real-Time Web Traffic | Fastly
SAN FRANCISCO – August 19, 2025 – Fastly, Inc. (NYSE: FSLY), a leader in global edge cloud platforms, today released its Q2 2025 Threat Insights Report, exposing a striking shift in the nature and scale of automated web traffic. Analysis of traffic from mid-April to mid-July shows that AI crawlers made up almost 80% of all AI bot traffic observed, with Meta generating more than half and eclipsing both Google and OpenAI combined.
(www.fastly.com)
Are they sure that the Meta traffic is AI bots? A lot of people share links in posts on Meta products, which scrape the links to generate a preview.
-
Are they sure that the Meta traffic is AI bots? A lot of people share links in posts on Meta products, which scrape the links to generate a preview.
Aren't those requests made from client devices?
-
Are they sure that the Meta traffic is AI bots? A lot of people share links in posts on Meta products, which scrape the links to generate a preview.
It would not surprise me to see that the traffic traced back to "scrapers". A user's perceived relevance often ties to the recency of the dataset.
-
Aren't those requests made from client devices?
They are for anything that's E2E encrypted such as Messenger and WhatsApp, so that the link isn't revealed to Meta servers.
As far as I know, for things like posts on Facebook, the server does the scraping. This is especially the case in the web version, since client-side scraping of arbitrary sites would require those sites to have an open CORS policy, which comes with security risks.
There's a Sharing Debugger tool on the Facebook developer site that lets you force rescrape a site.
-
cross-posted from: https://programming.dev/post/36083939
New Fastly Threat Research Reveals AI crawlers make up almost 80% of AI bot traffic, Meta Leads AI Crawling As ChatGPT Dominates Real-Time Web Traffic | Fastly
SAN FRANCISCO – August 19, 2025 – Fastly, Inc. (NYSE: FSLY), a leader in global edge cloud platforms, today released its Q2 2025 Threat Insights Report, exposing a striking shift in the nature and scale of automated web traffic. Analysis of traffic from mid-April to mid-July shows that AI crawlers made up almost 80% of all AI bot traffic observed, with Meta generating more than half and eclipsing both Google and OpenAI combined.
(www.fastly.com)
Soooo what's the other 20% if not crawlers?
-
Soooo what's the other 20% if not crawlers?
3 Indian tech workers in a trench coat.
-
cross-posted from: https://programming.dev/post/36083939
New Fastly Threat Research Reveals AI crawlers make up almost 80% of AI bot traffic, Meta Leads AI Crawling As ChatGPT Dominates Real-Time Web Traffic | Fastly
SAN FRANCISCO – August 19, 2025 – Fastly, Inc. (NYSE: FSLY), a leader in global edge cloud platforms, today released its Q2 2025 Threat Insights Report, exposing a striking shift in the nature and scale of automated web traffic. Analysis of traffic from mid-April to mid-July shows that AI crawlers made up almost 80% of all AI bot traffic observed, with Meta generating more than half and eclipsing both Google and OpenAI combined.
(www.fastly.com)
Meta actually leading the way with something, however negative it is!
-
Iran: GPS disruptions have continued for two months following the conflict with Israel, causing the suspension of ride-hailing apps, delivery platforms, and basic mapping services
Technology1
-
Brits can get around Discord's age verification thanks to Death Stranding's photo mode, bypassing the measure introduced with the UK's Online Safety Act. We tried it and it works—thanks, Kojima
Technology1
-
-
-
-
-
-
Tech experts are starting to doubt that ChatGPT and A.I. ‘hallucinations’ will ever go away: ‘This isn’t fixable’
Technology1