Archive for July, 2008

A feature that Yahoo has that I wish Google had:

July 30th, 2008 tony No comments

can't spell

Google sometimes I know better than you and want to see results without you thinking for me.

Categories: Google Tags:

Ruby Could Replace my Python Crawler Pretty Soon

July 28th, 2008 tony 6 comments

One of my developers just sent me some truly incredible stats about Ruby 1.9 and its threading performance.

20 threads * 100,000 iterations
Ruby 1.9 = 1.54 s.
Ruby Enterprise = 3.01 s.
JRuby 1.1.2 = 5.82 s.
Jython 2.2.1 = 11.86 s.
Python 2.5.2 = 12.32 s.
Ruby 1.8.7 = 22.68

Since our attempt at testing Ruby as a crawler really wasn’t all that much slower than Python it could be really interesting to see what will happen with Ruby 1.9.

The blog post about the test (Its in Polish)

Categories: Code, Crawlers Tags:

I’m convinced Twitter needs a complete rewrite

July 3rd, 2008 tony 2 comments

… from scratch. Yeah the performance is incredibly horrible and I really feel like I could take a small chunk of that $15 million and immediately make the performance rock, but I am starting to feel like the developers who built it complete cocked it all up. The damn thing can’t even store my replies right and I’ve heard others complain of this. I take it is bad AJAX code and I think they should reconsider using AJAX for basic functions.

I replied to @benwills‘ tweet :


but if you click on the ” in reply to benwills” link in my reply it goes to the wrong tweet.

Categories: Uncategorized Tags: