LLMsTxtReady
Beehiiv / Substack / Ghost / Kit

llms.txt Generator for Newsletters & Indie Media

Turn your archive into an AI-cited authority while keeping full control over search vs training crawlers. Scan your publication and generate a curated /llms.txt.

Instant 1-click demos:
Where to Deploy /llms.txt on Newsletters & Media Publishers
/llms.txt at custom publication domain (Ghost, WordPress, Cloudflare Worker)

Newsletter creators with custom domains use /llms.txt to point AI assistants toward their best evergreen deep dives, subscriber value proposition, and sponsor/media kit.

Step-by-Step Newsletters & Media Publishers Setup

  1. 01

    Scan your custom newsletter domain above to audit robots.txt rules, sitemap coverage, and Article JSON-LD.

  2. 02

    Decide your crawler policy: allow OAI-SearchBot & PerplexityBot for referral discovery while optionally disallowing training bots like GPTBot/CCBot.

  3. 03

    Curate your top 15–25 evergreen issues inside the generated llms.txt so LLMs learn what topics you own.

  4. 04

    Deploy /llms.txt via Ghost/WordPress root or a Cloudflare Worker proxy on custom newsletter domains.

Publisher robots.txt Policy: Allow Citations, Opt Out of Training
# Allow live AI search citations that send referral clicks
User-agent: OAI-SearchBot
Allow: /

User-agent: PerplexityBot
Allow: /

# Opt out of bulk model training crawlers
User-agent: GPTBot
Disallow: /

User-agent: CCBot
Disallow: /

Recommended Newsletters & Media Publishers llms.txt Blueprint

## Core Pages

Newsletter pitch, publishing cadence, author bio, and subscribe page.

## Resources & Blog

Evergreen deep dives, annual roundups, and best-of issue guides.

## Optional

Sponsorship media kit, RSS feed, and privacy policy.

Common Newsletters & Media Publishers AI Search Pitfalls

Leaving default platform robots.txt untouched without checking whether live AI search bots are permitted.

Listing dozens of dated weekly news digests in llms.txt instead of evergreen pillar essays.

Publishing exclusively on a non-custom subdomain where you have zero control over root files or canonical brand ownership.

Newsletters & Media Publishers llms.txt FAQs

Can newsletter writers allow ChatGPT Search links without allowing model training?

Yes—OpenAI separates OAI-SearchBot (live search indexing with links) from GPTBot (training). Our scanner audits both bots independently so you can verify your exact policy.

Does llms.txt work with Beehiiv or Substack custom domains?

If your custom domain is proxied through Cloudflare, you can serve /llms.txt directly at the root using a lightweight Cloudflare Worker while keeping Beehiiv or Substack hosting your posts.

What makes a newsletter essay get cited by Perplexity?

Original data, clear section headings, concise definitions, visible publish dates, and Article JSON-LD markup dramatically increase citation frequency.

Transparent Pricing

Free On-Demand Scanner. Automate When You Scale.

Generate and download /llms.txt free forever with zero login. Upgrade only when you want automated weekly syncs, crawler-block alerts, or agency client reports.

Free Studio
$0/ forever

Everything you need to audit any public site and ship a clean /llms.txt today.

  • Unlimited zero-login live domain scans
  • 0–100 AI Search Visibility Score & breakdown
  • 8-bot robots.txt AI crawler inspection
  • Spec-compliant /llms.txt generator (Copy & Download)
  • JSON-LD, canonical & semantic HTML audit
Use Free Scanner Above
Most Popular
Growth
$19/ month

For SaaS teams, Shopify merchants, and publishers keeping AI search visibility continuously protected.

  • Up to 3 monitored production domains
  • Weekly auto-regenerated /llms.txt diffs & hosted URL
  • Instant email/Slack alerts if any AI search bot gets blocked
  • Sitemap & JSON-LD regression tracking
  • Historical 0–100 GEO score trendline
Agency
$59/ month

Built for SEO agencies and web studios delivering client-ready GEO audits at scale.

  • 25 client websites with weekly auto-monitoring
  • White-label GEO Audit PDF exports for client pitches
  • Multi-client AI crawler block alert digest
  • Bulk /llms.txt regeneration across Shopify, WP & Webflow
  • Priority onboarding & custom webhook notifications