Jump to content

Guidance on Robots.txt file set up


stumpy_dan

Recommended Posts

Hi there,

 

I am looking to reduce duplicate urls. I am open to advice but was going to start adding my hidden menu items to the Robots.txt file and Disallow them to help reduce duplicate url's

 

So one of my hidden menus is "scotland" i.s. http://www.ibikeride.com/scotland as an example. Is the syntax?

 

Disallow: /scotland/

or

Disallow: /scotland

 

I don't want to lose all the proceeding urls like http://www.ibikeride.com/scotland/2114-cyclone-gypsy-brae-bike-track

ta

Link to comment
×
×
  • Create New...