supabase/apps/docs/public/robots.txt at create-pull-request/patch - supabase - Git

PublicArchive/supabase

mirror of https://github.com/supabase/supabase.git synced 2026-05-06 08:56:46 -04:00

Files

T

Greg Richardson 82f55217a2 feat(www): AI content via Content-Signal in robots.txt (#44875 )

Add
[Content-Signal](https://www.ietf.org/archive/id/draft-romm-aipref-contentsignals-00.txt)
directive to robots.txt opting into AI training, search, and inference
use.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

* **Chores**
* Updated website and documentation robots.txt to enable AI training,
search indexing, and AI input processing for site content.
* Minor formatting fix: ensured trailing newline at end of both
robots.txt files.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

2026-04-15 18:05:35 +00:00

5 lines

125 B

Plaintext

Raw Permalink Blame History

 User-agent: *
 Allow: /
 Sitemap: https://supabase.com/docs/sitemap.xml
 Content-Signal: ai-train=yes, search=yes, ai-input=yes