If you are here is that you have heard about the "Robots.txt" as part of your SEO , and you are looking for an explanation / information. Do not worry, In this post I'll share you complete tutrial about how to create and add custom robot.txt file in blogger, thourgh robot.txt you can get better crawil and indexing in google search engine.
What the Robots.txt?It is a text file "txt" named "Robots", simply. It is used in the ranking to search engines, specifically to exclude certain content indexing by robots.
To summarize, an engine running on your page every day to add your content to the web, and you, with this file, you can prevent it directly to him. Indexing robots always consult the "robots.txt" file before action.
We will now see how to use it on our website / blog.
How to create a robots.txt file?
Nothing complicated this time around, you create a text document that you rename "Robots". Once completed, send the file to the root of your site.Example1
If you want to allow all the robot to access the site, type only this or do not add the file:
User-agent: *
Disallow:If you want to deny access to wholes robots:
User-agent: *
Disallow: /If you want to deny access to the forum or a URL ... and only allow Google.
User-agent: *
Disallow: / forum
User-agent: googlebot
Disallow:Example 2
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search
Allow: /
Sitemap: http://yoursite.blogspot.com/feeds/posts/default?orderby=UPDATEDYou have understood, this file allows great power and flexibility in the choice of content indexing or not. Caution, however, it is not a safety barrier against robots: ignore some very well.
How to add a robots.txt file in blogger?
- Go to Blogger Dashboard
- If you have multiple blogs, select which blog you want to add custom robot.txt
- Now look for settings>> Search Preferences
- In search preferences, section you scroll it down and you see this option Custom robots.txt ?
Congratulations! You've all made your blog after a few days, in order to improve the performance and indexing your blog.FINAL WORDS: If you need any help with this tutorial please ask via the comments. We see the following helpful article. Stay Blessed and smart blogging.
loading...
loading...
Author Name
Author Description!
Get Free Email Updates to your Inbox!
Post a Comment