feat: Added robots.txt for api,web,embed and allowed /auth/signup and… (

#878) **Files Added** robots.txt in web, embed and api
implerhq · Nov 20, 2024 · 770fd18 · 770fd18
2 parents 6047946 + 8b94046
commit 770fd18
Show file tree

Hide file tree

Showing 3 changed files with 10 additions and 0 deletions.
diff --git a/apps/api/public/robots.txt b/apps/api/public/robots.txt
@@ -0,0 +1,3 @@
+# https://www.robotstxt.org/robotstxt.html
+User-agent: *
+Disallow:
diff --git a/apps/web/public/robots.txt b/apps/web/public/robots.txt
@@ -0,0 +1,4 @@
+User-agent: *    
+Disallow:
+Allow: /auth/signin
+Allow: /auth/signup
diff --git a/libs/embed/public/robots.txt b/libs/embed/public/robots.txt
@@ -0,0 +1,3 @@
+# https://www.robotstxt.org/robotstxt.html
+User-agent: *
+Disallow: