askiiart/askiiart-net
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Add conf, update HTTP status codes script

Browse source
This commit is contained in:
askiiart 2023-12-05 16:52:03 -06:00
parent e3164fe1de
commit e068210fff
Signed by untrusted user who does not match committer: askiiart
GPG key ID: BC3800E55FB54D67
5 changed files with 4217 additions and 23 deletions
Download patch file Download diff file Expand all files Collapse all files

23
robots.txt
View file

@ -1,24 +1,3 @@
User-agent: *
Disallow: /wishlist.md
Disallow: /wishlist.html
User-agent: CCBot
Disallow: /
User-agent: ChatGPT-User
Disallow: /
User-agent: GPTBot
Disallow: /
User-agent: Google-Extended
Disallow: /
User-agent: Omgilibot
Disallow: /
User-agent: Omgili
Disallow: /
User-agent: FacebookBot
Disallow: /
Disallow: /wishlist.html