Meh... I only really see people use Python for projects that want to mix web and native development together seamlessly. Python is more of a gluing language, to glue projects together. PHP has eclipsed Python on the web/CGI scene but Python can run as a native program in the interpreter or even compiled into C/C++ further compiled into an executable/app. It's also more extendable then PHP, you can write your own modules/plug ins and through libraries or even writing some C++ to add to the interpreter[?]. It's popular as well as ruby because they are quick to develop with and enjoyable.It's a nice language, I prefer DD doesn't like it due to it's use of whitespace but I must say it's better then languages that use end statements. The only real annoyance with whitespace syntax is when using different text editors/interpretors as a tab is defined as different amounts of spaces in each.For a web crawler I would defiantly use Python over PHP. But then you have to take into account your platform you'll be running it on. If your web crawling from your PC then it's great with Python, but some web host don't even support Python.*NOTE: Becareful what version of Python you play with. Version 3, which is the newest, was a complete rewrite. The whole language's API and core functions were written. So V2 code isn't compatible with V3. Alot of people just use V2.*
