leafee98/hugo-theme-flat
1
1
Fork 0
Code Issues Pull requests Packages Projects Releases Wiki Activity

allow whole site for spider at robots.txt

Browse source
This commit is contained in:
leafee98 2022-05-18 13:51:15 +08:00
parent 5b7390b5c2
commit e526a8d6ca
1 changed files with 1 additions and 5 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
layouts/robots.txt
View file

@ -1,8 +1,4 @@
User-agent: * User-agent: *
Allow: /posts/ Allow: *
Allow: /tags/
Allow: /categories/
Allow: /about/
Disallow: *
Sitemap: {{ .Site.BaseURL }}sitemap.xml Sitemap: {{ .Site.BaseURL }}sitemap.xml