PDA

View Full Version : Robots



dark_stranger
05 Feb 2008, 05:09 PM
How can i prevent search engines from indexing and displaying all my pages? and index/display just my homepage.

I have "<META NAME="ROBOTS" CONTENT="ALL">" in every page, would removing this from all pages apart from index.phh, would that work?

alvo
05 Feb 2008, 05:49 PM
It's easy, but a bit more complicated that doing just that. Here's an easy to understand description of how robots.txt works and how to set it up to do what you need: http://webdesign.about.com/od/promotion/ht/htrobotstxt.htm