mirror of
https://github.com/jointakahe/takahe.git
synced 2024-11-25 16:51:00 +00:00
6 lines
87 B
Text
6 lines
87 B
Text
|
User-Agent: *
|
||
|
|
|
||
|
|
# Don't allow any bot to crawl tags.
|
||
|
|
Disallow: /tags/
|
||
|
|
Disallow: /tags/*
|