Python is Ugly but Damn She’s Beautiful

Code, Crawlers 2 Comments »
Remember the Python crawler NotSleepy built to suck up all your internets and find your affiliate IDs? Well we kept massaging the code and finally slapped that thing down on a fat pipe. WOW. The stats are rocking now. How about double time! Latest Stats: 35.6 ...

Why Basecamp Sucks…

Code 11 Comments »
NO


    BUG


    TRACKING


 

Easy Solution for Conflicting Rails Migration Version Numbering

Code, Ruby on Rails 1 Comment »
migrations numbers Thats a crappy blog post title but the best I could come up with! You know the scenario: you are about to commit your latest Rails code to subversion and you perform an update first. Rats. Someone has committed a new migration with the ...

Crazy Python Crawler

Code, Crawlers, Python 4 Comments »
Someone emailed me doubting my crawler could operate at the speeds I posted last week so here is a video I took this morning. I should have waited a few minutes after launching it before starting the video as it really starts cranking once all the threads get rocking ...

Big SEO’s with Crawlers: Lets See Your Stats

Code, Crawlers, Python 8 Comments »
OK I'm just ecstatic with my new crawler, I think nobody but Google has one better than me, and I'm ready for a good old fashion show-and-tell. Multi-threaded programming is a bear to deal with and I've written several crawlers in different languages. For years I've been plagued with ...
WP Theme & Icons by N.Design Studio
Entries RSS Comments RSS Login