View Full Version : Using robots.txt effectively

02 Mar 2010, 02:23 PM
I have a basic website. A Home page with navigation to other pages. All total about 10 pages to my site. Ideally I want people to enter my site through the Home page.

What do other people do?

i) Use robots.txt so search engines don't see and use the other pages forcing search results to Home page only.

ii) Just let the search engines find what they can. Are Google & Yahoo smart enough to not present 8 results that are really all part of the same website?