Jump to content

Web Spider


Matar
 Share

Recommended Posts

hi any one know about web spider thats used in search enginei am trying to make a search engine using php and mysql but i don't know anything about web spider any have a script to get the page content for exmaple small program when i give it the url , he will get the metatag information or get the h1 text ..etc kindly regardsmatar

Link to comment
Share on other sites

Guest !!*AStov

try http://www.phpdig.net/

PhpDig is a web spider and search engine written in PHP, using a MySQL database and flat file support. PhpDig builds a glossary with words found in indexed pages. On a search query, it displays a result page containing the search keys, ranked by occurrence.
Link to comment
Share on other sites

I wrote a small spider in C#. All you need to do is "screen scrape" the target url. Then I parsed out the links within the page and inturn scraped them aswell, and so on and so on.Do a google search there are plenty of screen scrape libraries available for PHP

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share

×
×
  • Create New...