live_beats/priv/static/robots.txt

mirror of https://github.com/fly-apps/live_beats.git synced 2024-11-04 15:39:33 +00:00
# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
#
# To ban all spiders from the entire site uncomment the next two lines:
# User-agent: *
# Disallow: /
Make it so 🚀 2021-09-02 18:00:57 +00:00			`# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file`
			`#`
			`# To ban all spiders from the entire site uncomment the next two lines:`
			`# User-agent: *`
			`# Disallow: /`