Formatting and Added a Sitemap to robots.txt

RoboticMind · web-flow · commit 31de433bb5c0 · 2019-05-31T17:41:48.000-04:00
Added a sitemap link and fixes some formatting. A sitemap link being in the robots.txt is recommended practice. Isn't strictly necessary but won't hurt to have.
diff --git a/robots.txt b/robots.txt
@@ -1,3 +1,6 @@
-# robotstxt.org/
-
+# All robots allowed
 User-agent: *
+Disallow:
+
+# Sitemap files
+Sitemap: https://gridcoin.us/sitemap.xml
