[nycbug-talk] mapreduce, hadoop, and UNIX

[Isaac Levy]

On Aug 25, 2007, at 2:54 PM, H. G. wrote:
>> On Aug 25, 2007, at 11:55 AM, H. G. wrote:
>> > You might want to look into Starfish, which is a MapReduce
>> > implementation for Ruby.
>> > ( http://rufy.com/starfish/doc/ )
> <snip>
>> Thanks!
>> As a long-time happy python user,
>> I'm constantly impressed by how fast the Ruby community tackles
>> various projects.
> <snip>
>> MapReduce strategy, in the end, may be the
>> simplest thing for me to maintain long-term.  Not sure yet  
>> though... :)
<snip>
> In that case, you may want to look at PYRO.  It doesn't do MapReduce,
> but using it you can emulate that functionality in Python.   
> Basically an
> option to be aware of if you're looking to do distributed computing  
> with
> Python.  ( http://pyro.sourceforge.net/ )

Wow!  Ok, that's yet another tool which may be perfect for my task at  
hand.  I seem to have it in my head that PYRO has been around a long  
time, totally worth a shot here... :)

I'm exited, now I've got a ton of stuff to try!

Rocket-
.ike