trevor- Posted March 5, 2010 Share Posted March 5, 2010 I'm not sure where to put this, but I really need help with robots.txt I thought I made a right one, but it's been months now and google/other search engines are still not indexing what I want, and removing what I don't want.This is mine:User-Agent: *Disallow: /*What I to be viewed, but NOT cached:-Only my index (so the default http://domain.com, aka http://domain.com/htm)What I don't want to be viewed or cached:-Everything else. This includes all subdomains, I don't want them showing up in any searches-I also want to uncache deleted subdomains and undeleted directoriesAnyone know how I can do this? Also, I need something that will let only my first page (what I want to be viewed) be viewed and cached. Lastly, does google de-list you or make your site show up less when you have caching on your main page turned off? It seems to have knocked my site down a few ranks when I search for it exclusively now that the caching for that was turned off... Thanks! Link to comment Share on other sites More sharing options...
This topic is now archived and is closed to further replies.