I wrote a small spider in C#. All you need to do is "screen scrape" the target url. Then I parsed out the links within the page and inturn scraped them aswell, and so on and so on.Do a google search there are plenty of screen scrape libraries available for PHP