Comments on: Crazy Python Crawler http://www.tonyspencer.com/2008/01/07/crazy-python-crawler/ It's Just Links Wed, 14 Sep 2011 13:47:04 +0000 http://wordpress.org/?v=2.9.1 hourly 1 By: tony http://www.tonyspencer.com/2008/01/07/crazy-python-crawler/comment-page-1/#comment-90873 tony Tue, 01 Jul 2008 02:13:03 +0000 http://www.tonyspencer.com/2008/01/07/crazy-python-crawler/#comment-90873 Hi Michael Unfortunately this crawler was developed for a client and as a result I have to obey the terms of my contract with them which does not allow me to release the code. Tony Hi Michael
Unfortunately this crawler was developed for a client and as a result I have to obey the terms of my contract with them which does not allow me to release the code.

Tony

]]> By: Michael http://www.tonyspencer.com/2008/01/07/crazy-python-crawler/comment-page-1/#comment-90826 Michael Mon, 30 Jun 2008 21:31:08 +0000 http://www.tonyspencer.com/2008/01/07/crazy-python-crawler/#comment-90826 Hello, are you willing to post your source code so that we can all learn from your technique. I would really like to take a look at it. Are you recognizing robots.txt or parsing meta data at all? Thanks! Hello, are you willing to post your source code so that we can all learn from your technique. I would really like to take a look at it. Are you recognizing robots.txt or parsing meta data at all? Thanks!

]]> By: roy http://www.tonyspencer.com/2008/01/07/crazy-python-crawler/comment-page-1/#comment-88634 roy Sat, 21 Jun 2008 04:19:48 +0000 http://www.tonyspencer.com/2008/01/07/crazy-python-crawler/#comment-88634 Hi please send that script to me. Hi please send that script to me.

]]> By: Russ Jones http://www.tonyspencer.com/2008/01/07/crazy-python-crawler/comment-page-1/#comment-48743 Russ Jones Fri, 11 Jan 2008 13:11:05 +0000 http://www.tonyspencer.com/2008/01/07/crazy-python-crawler/#comment-48743 Wow. Although, that ticking sound is never good. I would replace that drive immediately. Wow. Although, that ticking sound is never good. I would replace that drive immediately.

]]>