Tệp robot.txt chuẩn cho blogspot 2018
POSTED ON
Tệp robot.txt chuẩn cho blogspot 2018 được chia sẻ bởi anh Nguyễn Tuấn của blogthuthuatwindows10.com
Tệp robots.txt cho mọi người tham khảo, tệp này chặn một số link không đẹp trên Google tìm kiếm.
Tệp robot.txt cho blog dưới 500 bài
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Allow: /
Allow: /search/label/
Disallow: *max-results=*
Disallow: *archive.html
Disallow: *?m=0
Disallow: /search?*
Disallow: *?showComment=*
Disallow: *?spref=fb
Disallow: *?spref=tw
Disallow: *?spref=gp
Disallow: *?utm_source=*
Sitemap: ĐỊA CHỈ BLOG/feeds/posts/default?orderby=UPDATED
Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=1&max-results=500
Disallow:
User-agent: *
Allow: /
Allow: /search/label/
Disallow: *max-results=*
Disallow: *archive.html
Disallow: *?m=0
Disallow: /search?*
Disallow: *?showComment=*
Disallow: *?spref=fb
Disallow: *?spref=tw
Disallow: *?spref=gp
Disallow: *?utm_source=*
Sitemap: ĐỊA CHỈ BLOG/feeds/posts/default?orderby=UPDATED
Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=1&max-results=500
Code chuẩn
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Allow: /
Allow: /search/label/
Disallow: *max-results=*
Disallow: *archive.html
Disallow: *?m=0
Disallow: /search?*
Disallow: *?showComment=*
Disallow: *?spref=fb
Disallow: *?spref=tw
Disallow: *?spref=gp
Disallow: *?utm_source=*
Sitemap: ĐỊA CHỈ BLOG/feeds/posts/default?orderby=UPDATED
Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=1&max-results=500
Disallow:
User-agent: *
Allow: /
Allow: /search/label/
Disallow: *max-results=*
Disallow: *archive.html
Disallow: *?m=0
Disallow: /search?*
Disallow: *?showComment=*
Disallow: *?spref=fb
Disallow: *?spref=tw
Disallow: *?spref=gp
Disallow: *?utm_source=*
Sitemap: ĐỊA CHỈ BLOG/feeds/posts/default?orderby=UPDATED
Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=1&max-results=500
Nhận xét