chore: Block Search bots from rendering widget (#1331)
Search bots trying to render the widget ends up throwing errors.
This commit is contained in:
parent
5d5d2f9779
commit
f11d7fe992
1 changed files with 4 additions and 3 deletions
|
@ -1,5 +1,6 @@
|
|||
# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
|
||||
#
|
||||
# To ban all spiders from the entire site uncomment the next two lines:
|
||||
# User-agent: *
|
||||
# Disallow: /
|
||||
|
||||
User-agent: *
|
||||
Disallow: /widget
|
||||
|
||||
|
|
Loading…
Reference in a new issue