From 9e855ed91469a65c016aca1f334c4656dcb5008a Mon Sep 17 00:00:00 2001 From: CHARU AWASTHI <148922861+Charu19awasthi@users.noreply.github.com> Date: Tue, 5 Nov 2024 11:46:57 +0530 Subject: [PATCH] Create robots.txt robots.txt manages bot access, preventing indexing of irrelevant sections. --- robots.txt | 3 +++ 1 file changed, 3 insertions(+) create mode 100644 robots.txt diff --git a/robots.txt b/robots.txt new file mode 100644 index 0000000..389f59f --- /dev/null +++ b/robots.txt @@ -0,0 +1,3 @@ +User-agent: * +Allow: / +Sitemap: https://codeittool.netlify.app/sitemap.xml