askiiart/askiiart-net
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Unblock GPTbot, it's now handled in nginx config

Browse source
This commit is contained in:
askiiart 2023-08-26 20:02:11 -05:00
parent f19afdf88c
commit 1894ea379a
No known key found for this signature in database
GPG key ID: 85505F3A2264FA01
1 changed files with 1 additions and 4 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
robots.txt
View file

@ -1,6 +1,3 @@
User-agent: *
Disallow: /wishlist.md
Disallow: /wishlist.html
User-agent: GPTBot
Disallow: /
Disallow: /wishlist.html