Skip to content

Commit c0daabd

Browse files
authored
Add robots.txt to manage web crawler access
1 parent 96467b0 commit c0daabd

1 file changed

Lines changed: 6 additions & 0 deletions

File tree

‎robots.txt‎

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
User-agent: *
2+
Disallow: /admin/
3+
Disallow: /private/
4+
Disallow: /netlify/
5+
Allow: /
6+
Sitemap: https://design.devtem.org/sitemap.xml

0 commit comments

Comments
 (0)