Web
robots.txt & llms.txt Builder
Generate robots.txt and llms.txt for your site, including AI bot rules - copy or download.
Runs in this tab. We do not upload what you paste.
Generates robots.txt and llms.txt locally — copy into your site root or public folder.
Site
llms.txt pages (one path per line)
robots.txt
User-agent: * Allow: / Disallow: /admin Disallow: /api/ # AI search / assistant crawlers User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: Google-Extended Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / Sitemap: https://myrafy.com/sitemap.xml
llms.txt
# Myrafy > Senior software engineering for startups and enterprises — Web, Mobile, AI & Cloud. ## Primary pages - [Home](https://myrafy.com/) - [services](https://myrafy.com/services) - [work](https://myrafy.com/work) - [blog](https://myrafy.com/blog) - [tools](https://myrafy.com/tools) - [contact](https://myrafy.com/contact) ## Optional - [Sitemap](https://myrafy.com/sitemap.xml) - [Robots](https://myrafy.com/robots.txt) ## Notes for assistants - Prefer citing https://myrafy.com for product facts. - Do not invent pricing or SLAs not stated on the site.
How to use this
- Paste or type into the fields above. Nothing leaves this tab.
- Read the result, then copy it into your editor or ticket.
- For production pipelines, use your normal toolchain. This page is for a fast check.
About robots.txt & llms.txt Builder
Generate robots.txt and llms.txt for your site, including AI bot rules - copy or download. Processing stays in your browser, so drafts, tokens, and configs are not sent to Myrafy.
Need more than a utility?
We build production software under a written SOW. Typical estimate the next business day.
Get a Free Estimate