mirror of
https://github.com/zedeus/nitter.git
synced 2025-03-04 10:01:24 +00:00
5 lines
74 B
Text
5 lines
74 B
Text
User-agent: *
|
|
Disallow: /
|
|
Crawl-delay: 1
|
|
User-agent: Twitterbot
|
|
Disallow:
|