virak Posted June 16, 2010 Share Posted June 16, 2010 Dear Everyone,My name is Sopheak Virak, i am posting from Cambodia country...I really need your help to guide me or give me some clue on how to creat Web Crawling... i mean i want to creat "Orkun2uBot" this bot will present to all website which is published under Country Domain(.com.kh, .gov.kh, org.kh).. just like GoogleBot, MsnBot, Yahoo!Slurp, methabot...etcPlease give me some clue...I am appreciate for your help.Best Regards,Virak Link to comment Share on other sites More sharing options...
Synook Posted June 16, 2010 Share Posted June 16, 2010 Do you know any programming languages? Link to comment Share on other sites More sharing options...
virak Posted June 16, 2010 Author Share Posted June 16, 2010 Do you know any programming languages?I can try with PHP, sir. Link to comment Share on other sites More sharing options...
trinistorm Posted June 21, 2010 Share Posted June 21, 2010 I can try with PHP, sir.I believe a lot of those robots were written in C and C++. Php may be a bit limited. Link to comment Share on other sites More sharing options...
NurAzije Posted June 22, 2010 Share Posted June 22, 2010 If you know PHP then try Perl, it is very powerful and similar to PHP syntax. Link to comment Share on other sites More sharing options...
virak Posted June 22, 2010 Author Share Posted June 22, 2010 I believe a lot of those robots were written in C and C++. Php may be a bit limited.Yes..correct sir.. most of robots written in C, C++.But i am the one who familiar with Php than other programing.kindly please give me some clue?Best Regards,Virak Link to comment Share on other sites More sharing options...
virak Posted June 22, 2010 Author Share Posted June 22, 2010 If you know PHP then try Perl, it is very powerful and similar to PHP syntax.Dear Sir,I tried with some Perl Scripts that talking about web crawler... but I still can't see the robot come out, when i process the code.Can you explain me more about that? I know that i still miss understand about how to create robot.Best Regards,Virak Link to comment Share on other sites More sharing options...
Synook Posted June 22, 2010 Share Posted June 22, 2010 What code did you try?A crawler basically: loads a page from a queue stores its contents, and whatever other data is necessary for the crawler's purpose finds all links and adds them to the queue loads the next page on the queue et cetera PHP is not ideal because it is not designed to run a single script for an extended period of time. Link to comment Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.