[nycbug-talk] hadoop - sharing a server?

Edward Capriolo edlinuxguru at gmail.com
Mon May 17 17:02:23 EDT 2010


You can jail anything of course. The issue with jailing hadoop is that it is
very IO heavy because data is constantly being spilled to disk. Even if your
jail can limit memory or processor ticks the real problem is jails do not
protect your disk. Now if you system is only being used for background batch
processing that is fine. However, if you are trying to run a "real time" ish
mysql instance and hadoop on the same they may not play together well if
they fight for the disk. Same is true with any jail/vm solution, but hadoop
batching likes to saturate things with load.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.nycbug.org/pipermail/talk/attachments/20100517/d2eb5aa1/attachment.html>


More information about the talk mailing list