[nycbug-talk] shared disks for heavy I/O

[Aleksandar Kacanski]

Hi Marco,
I am about to finish building 30 TB raw NAS for under 9k.
I can give you details if you are interested. I did not test it yet but I will as soon as new RAID SATA II adapters arrive in.
It seems it will be very descent but will see.
If you are interested in fiber GFS does perform well in that space but is not cheep solution.
I tried lustre but lustre is for bigger installation and required infiniband ...

--sasha

 --Aleksandar (Sasha) Kacanski



----- Original Message ----
From: Marco Scoffier <marco at metm.org>
To: NYCBUG <talk at lists.nycbug.org>
Sent: Sunday, May 3, 2009 4:54:14 PM
Subject: [nycbug-talk] shared disks for heavy I/O

Hello all,

I am looking for recommendations for a shared disk solution in the 3 to 
5TB range that can support heavy reading and writing.  Standalone ? 
Dedicated server ? Fiber channel ?  Budget is around $4000.  Has someone 
looked into this recently?  How does Gig-ethernet performance compare to 
other solutions in real world situations?

I am working with large data sets (presently 100G but eventually to 
become larger). I have to store intermediate steps of the 
computation to disk.  Often to speed things up I run parallel 
computations which each read and write 1 to 10G of data at the beginning 
and the end of the computation.  I have 2 16cpu servers with SATA disks 
which each exports its' disks to the other using NFS.  Very often all 
cpus on both systems are maxed at 100%.  Lately when ramping up the 
computations NFS has been locking up (even when only reading remotely 
and writing locally).  I/O has been slow (ls takes forever to return for 
eg.).  I think that we are probably asking too much of the current setup 
where we are both running computations and exporting NFS from the same 
machines.

Thanks,

Marco




_______________________________________________
talk mailing list
talk at lists.nycbug.org
http://lists.nycbug.org/mailman/listinfo/talk