Adds a robots.txt

This commit is contained in:
Alicia Sykes 2024-03-09 15:25:30 +00:00
parent 40611ea022
commit 38e5961dea

6
web/public/robots.txt Normal file
View file

@ -0,0 +1,6 @@
User-agent: *
Disallow: /search/*
Allow: /search/$
Allow: /sitemap
Sitemap: https://awesome-privacy.xyz/sitemap-index.xml