Tệp robot.txt chuẩn cho blogspot 2018

 

Tệp robot.txt chuẩn cho blogspot 2018 được chia sẻ bởi anh Nguyễn Tuấn của blogthuthuatwindows10.com

Tệp robots.txt cho mọi người tham khảo, tệp này chặn một số link không đẹp trên Google tìm kiếm.

Tệp robot.txt cho blog dưới 500 bài

User-agent: Mediapartners-Google
Disallow:
User-agent: *
Allow: /
Allow: /search/label/
Disallow: *max-results=*
Disallow: *archive.html
Disallow: *?m=0
Disallow: /search?*
Disallow: *?showComment=*
Disallow: *?spref=fb
Disallow: *?spref=tw
Disallow: *?spref=gp
Disallow: *?utm_source=*
Sitemap: ĐỊA CHỈ BLOG/feeds/posts/default?orderby=UPDATED
Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=1&max-results=500

 

Code chuẩn

User-agent: Mediapartners-Google
Disallow:
User-agent: *
Allow: /
Allow: /search/label/
Disallow: *max-results=*
Disallow: *archive.html
Disallow: *?m=0
Disallow: /search?*
Disallow: *?showComment=*
Disallow: *?spref=fb
Disallow: *?spref=tw
Disallow: *?spref=gp
Disallow: *?utm_source=*
Sitemap: ĐỊA CHỈ BLOG/feeds/posts/default?orderby=UPDATED
Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=1&max-results=500

 

robot.txt Với những blog trên 500 bài

 

User-agent: Mediapartners-Google
Disallow:
User-agent: *
Allow: /
Allow: /search/label/
Disallow: *max-results=*
Disallow: *archive.html
Disallow: *?m=0
Disallow: /search?*
Disallow: *?showComment=*
Disallow: *?spref=fb
Disallow: *?spref=tw
Disallow: *?spref=gp
Disallow: *?utm_source=*
Sitemap: ĐỊA CHỈ BLOG/feeds/posts/default?orderby=UPDATED
Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=1&max-results=500

Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=501&max-results=500
Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=1001&max-results=500
Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=1501&max-results=500

 

MÃcode

User-agent: Mediapartners-Google
Disallow:
User-agent: *
Allow: /
Allow: /search/label/
Disallow: *max-results=*
Disallow: *archive.html
Disallow: *?m=0
Disallow: /search?*
Disallow: *?showComment=*
Disallow: *?spref=fb
Disallow: *?spref=tw
Disallow: *?spref=gp
Disallow: *?utm_source=*
Sitemap: ĐỊA CHỈ BLOG/feeds/posts/default?orderby=UPDATED
Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=1&max-results=500

Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=501&max-results=500
Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=1001&max-results=500
Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=1501&max-results=500

 

 

Cùng chuyên mục:

Add Comment