The rise of the AI crawler
Vercel and MERJ find that AI crawlers now generate substantial web traffic but generally cannot render JavaScript and waste over one-third of requests on 404s. Sites that need AI visibility should server-render critical content and maintain disciplined URL hygiene.