If this is your first visit, be sure to check out the FAQ. You may have to register before you can post a question, answer, comment, vote: click the register link above to proceed or login if already registered. To start viewing messages, select the categories or tags that you want to visit from the selection below.

What is a robot.txt and how to block pages using robot.txt file?

+3 votes
asked Mar 25 in Other by Arthur (480 points)
0% Accept Rate

edited Apr 16 by Deep
I have been looking out for a simple tutorial on understanding the basics of seo robot.txt file, to see how does this robots.txt file actually works and how can I master the web pages in the search engines result page by editing this so called txt robots file. Before starting this myself  I wish someone would recommend me some website link  that has a simple tutorial on what is a robot.txt and how to block pages using it or answer here itself. I really don't understand Google robot file or any other search engine robots so I fear any  improper configuration would lead my website to get messed up and result in my site being ignored by Search Engines, which might also put a negative effect on seo of my web-site.

Please log in or register to answer this question.

Related questions

+4 votes
0 answers 13 views
+4 votes
1 answer 47 views
+7 votes
1 answer 70 views
+3 votes
0 answers 19 views
+3 votes
0 answers 30 views
Question Reply
Welcome to Question Reply, where you can Ask Questions and receive instant answers for free from other members of the community. Question Reply provides an opportunity for every one to come together to collaborate, learn and experience a difference.
Sharing knowledge is the best way to achieve immortality.