From d936dd73fe50119dc6e486d63d583fcb64b91000 Mon Sep 17 00:00:00 2001 From: dumbmoron Date: Fri, 10 Nov 2023 18:27:18 +0100 Subject: [PATCH] fix robots.txt currently the robots.txt file is useless because it's interpreted as one path "/icons/ /fonts/ *.js *.css" (an example path that would be accepted -- and therefore disallowed for robots) by this regex would be `https://cobalt.tools/icons/ /fonts/ bla.js .css`, which is obviously nonsense & useless) --- src/front/robots.txt | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/src/front/robots.txt b/src/front/robots.txt index 43eb659b..602fb474 100644 --- a/src/front/robots.txt +++ b/src/front/robots.txt @@ -1,2 +1,5 @@ User-Agent: * -Disallow: /icons/ /fonts/ *.js *.css \ No newline at end of file +Disallow: /icons/ +Disallow: /fonts/ +Disallow: /*.js +Disallow: /*.css