From f11d7fe99263193d774ff9663632390e9ebec624 Mon Sep 17 00:00:00 2001 From: Sojan Jose Date: Sat, 10 Oct 2020 11:48:31 +0530 Subject: [PATCH] chore: Block Search bots from rendering widget (#1331) Search bots trying to render the widget ends up throwing errors. --- public/robots.txt | 7 ++++--- 1 file changed, 4 insertions(+), 3 deletions(-) diff --git a/public/robots.txt b/public/robots.txt index 3c9c7c01f..8f1a74043 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -1,5 +1,6 @@ # See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # -# To ban all spiders from the entire site uncomment the next two lines: -# User-agent: * -# Disallow: / + +User-agent: * +Disallow: /widget +