llms.txt Generator for Vercel Deployments
Shipping on Vercel? Audit your production deployment for AI crawler access, JSON-LD, and sitemap coverage, then commit public/llms.txt with proper UTF-8 headers.
Vercel serves any file inside public/llms.txt directly from its global Edge Network with instant invalidation on every git push.
Step-by-Step Vercel Setup
- 01
Scan your production Vercel custom domain above (not a preview *.vercel.app URL).
- 02
Download the generated llms.txt and commit it to public/llms.txt in your repository.
- 03
Optionally configure explicit text/plain; charset=utf-8 caching headers in vercel.json.
- 04
Check Vercel Firewall / Attack Challenge Mode settings to make sure legitimate AI search bots receive HTTP 200 rather than JS challenges.
{
"headers": [
{
"source": "/llms.txt",
"headers": [
{ "key": "Content-Type", "value": "text/plain; charset=utf-8" },
{ "key": "Cache-Control", "value": "public, max-age=3600, s-maxage=3600" }
]
}
]
}Recommended Vercel llms.txt Blueprint
Canonical production homepage, pricing, and product overview.
Framework guides, templates, and API references.
Changelog, privacy, and terms.
Common Vercel AI Search Pitfalls
Accidentally deploying with Attack Challenge Mode left permanently on, which blocks non-browser AI crawlers with a 429/403 challenge.
Using vercel.json catch-all SPA rewrites ('/(.*)' → '/index.html') that swallow /llms.txt and return HTML instead of plain text.
Leaving NEXT_PUBLIC_SITE_URL unset so sitemap.xml and canonicals point to localhost or preview URLs.
Vercel llms.txt FAQs
Why does my Vite/React SPA on Vercel return HTML at /llms.txt?
A catch-all rewrite in vercel.json can intercept /llms.txt if the static file isn't in public/ or if the rewrite ignores filesystem checks. Place llms.txt in public/ and use clean filesystem-first routing.
Does Vercel Edge Network cache /llms.txt automatically?
Yes, static files in public/llms.txt are distributed globally across Vercel's CDN and automatically updated on each deployment.
Should I block preview deployments (*.vercel.app) from AI crawlers?
Yes—Vercel already sends X-Robots-Tag: noindex on preview URLs. Always point your /llms.txt links exclusively to your canonical production custom domain.
Related Platform & GEO Guides
View all 24 guides →Free On-Demand Scanner. Automate When You Scale.
Generate and download /llms.txt free forever with zero login. Upgrade only when you want automated weekly syncs, crawler-block alerts, or agency client reports.
Everything you need to audit any public site and ship a clean /llms.txt today.
- Unlimited zero-login live domain scans
- 0–100 AI Search Visibility Score & breakdown
- 8-bot robots.txt AI crawler inspection
- Spec-compliant /llms.txt generator (Copy & Download)
- JSON-LD, canonical & semantic HTML audit
For SaaS teams, Shopify merchants, and publishers keeping AI search visibility continuously protected.
- Up to 3 monitored production domains
- Weekly auto-regenerated /llms.txt diffs & hosted URL
- Instant email/Slack alerts if any AI search bot gets blocked
- Sitemap & JSON-LD regression tracking
- Historical 0–100 GEO score trendline
Built for SEO agencies and web studios delivering client-ready GEO audits at scale.
- 25 client websites with weekly auto-monitoring
- White-label GEO Audit PDF exports for client pitches
- Multi-client AI crawler block alert digest
- Bulk /llms.txt regeneration across Shopify, WP & Webflow
- Priority onboarding & custom webhook notifications