hippofish/packages/backend/assets/robots.txt

15 lines
236 B
Text
Raw Normal View History

2023-09-05 16:58:20 +02:00
User-agent: *
Allow: /
2023-09-05 16:58:20 +02:00
# Uncomment the following to block CommonCrawl
#
# User-agent: CCBot
# User-agent: CCBot/2.0
# User-agent: CCBot/3.1
# Disallow: /
# Uncomment the following to block ChatGPT
#
# User-agent: GPTBot
# Disallow: /