eTianbun Posted November 3, 2011 Share Posted November 3, 2011 Since the robots.txt will be uploaded into the root directory, is it possible to prevent search engines from indexing a directory (image-dir) inside the root sub-directory (sub-dir)? i mean something like this: user-agent:*disallow:/sub-dir/image-dir Is it possible this way or the engines will not index everything in the sub-dir (including image dir)? Link to comment Share on other sites More sharing options...
Ingolme Posted November 3, 2011 Share Posted November 3, 2011 That works. Don't forget to end the directory with a /You can find more information at http://www.robotstxt.org/ Link to comment Share on other sites More sharing options...
eTianbun Posted November 3, 2011 Author Share Posted November 3, 2011 What about if i do not end it with a slash (/), what will happen? Thanks for the reply! Link to comment Share on other sites More sharing options...
Ingolme Posted November 3, 2011 Share Posted November 3, 2011 It might consider it a file without an extension. It might not matter much, actually, but I'd put it just to make sure nothing goes wrong. Link to comment Share on other sites More sharing options...
eTianbun Posted November 3, 2011 Author Share Posted November 3, 2011 Yeah, good idea! Thanks... Link to comment Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.