prehistoric-systems/edit
1
0
Fork 0
mirror of https://github.com/fmhy/edit.git synced 2026-03-11 08:55:38 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
edit/docs/public/robots.txt

7 lines
96 B
Text
Raw Normal View History

hello world, again
2024-08-07 12:23:35 +00:00
User-agent: *
update robots.txt (#3940) disallow crawlers from /assets/ they treat it as junk/bad content
2025-08-17 00:19:24 +00:00
Disallow: /assets/
Update robots.txt (#3941) * update robots.txt disallow crawlers from /assets/ they treat it as junk/bad content * Update robots.txt make it so image files in the base directory don't get indexed
2025-08-17 00:52:54 +00:00
Disallow: /*.png$
Disallow: /*.svg$
Disallow: /*.ico$
hello world, again
2024-08-07 12:23:35 +00:00
Allow: /
Reference in a new issue Copy permalink