mirror of
https://github.com/hugo-fixit/FixIt.git
synced 2026-08-24 15:28:57 +00:00
🔍 Feat(seo): update robots.txt
This commit is contained in:
@@ -4,6 +4,10 @@ Disallow: /images/
|
||||
Disallow: /js/
|
||||
Disallow: /css/
|
||||
|
||||
Disallow: /*offline/
|
||||
Disallow: /*404.html$
|
||||
Disallow: /*.md$
|
||||
|
||||
User-agent: MJ12bot
|
||||
Disallow: /
|
||||
|
||||
|
||||
Reference in New Issue
Block a user