forked from Ponysearch/Ponysearch
[mod] robots.txt update
This commit is contained in:
parent
ffc93ba256
commit
692c0bf5f0
1 changed files with 1 additions and 0 deletions
|
@ -226,6 +226,7 @@ def robots():
|
||||||
Allow: /
|
Allow: /
|
||||||
Allow: /about
|
Allow: /about
|
||||||
Disallow: /stats
|
Disallow: /stats
|
||||||
|
Disallow: /engines
|
||||||
""", mimetype='text/plain')
|
""", mimetype='text/plain')
|
||||||
|
|
||||||
|
|
||||||
|
|
Loading…
Reference in a new issue