Unblock GPTbot, it's now handled in nginx config
This commit is contained in:
parent
f19afdf88c
commit
1894ea379a
1 changed files with 1 additions and 4 deletions
|
@ -1,6 +1,3 @@
|
||||||
User-agent: *
|
User-agent: *
|
||||||
Disallow: /wishlist.md
|
Disallow: /wishlist.md
|
||||||
Disallow: /wishlist.html
|
Disallow: /wishlist.html
|
||||||
|
|
||||||
User-agent: GPTBot
|
|
||||||
Disallow: /
|
|
Loading…
Reference in a new issue