Giacomo Zecchini, Alice Alexandra Moore, Malte Ubl, and Ryan Siddle

The rise of the AI crawler

Vercel and MERJ find that AI crawlers now generate substantial web traffic but generally cannot render JavaScript and waste over one-third of requests on 404s. Sites that need AI visibility should server-render critical content and maintain disciplined URL hygiene.

Jun 25, 20252 min read