[talk] Climate Mirror

[Robert Menes]

I'm down to help cobble together the needed hardware and help get it all
online. Would be good experience. :)

--Robert

On Dec 14, 2016 00:30, "Isaac (.ike) Levy" <ike at blackskyresearch.net> wrote:

Word,

> On Dec 13, 2016, at 9:36 PM, Mirimir <mirimir at riseup.net> wrote:
>
> On 12/13/2016 05:07 PM, Pete Wright wrote:
>> Not to go super political on this list - but I'm personally pretty keen
>> to preserve climate science related data-sets for future generations (as
>> well as our own).  So in that light - wondering if anyone has taken a
>> look at this:
>>
>> http://climatemirror.org/
>>
>> I'm investigating now to see if there are any datasets I can help mirror
>> - if anyone else on this list is interested let me know, maybe we can
>> make a large scale effort?

I’m 100% in.  Any job for a big ZFS server and a lot of disk makes me quite
happy :)

[x] Colo: If there is general consensus that this is worthwhile, NYC*BUG
does have colo space for a big isolated storage box.

[x] Admins: There is certainly enough admin experience around NYC*BUG to
keep some storage/mirrors online, and I’d be quite enthused to take lead to
get this one bootstrapped.

[?] Server(s): Acquiring the hardware, and a box of 8tb disks, well- that
may take a second to get a HW donation which works…

>
> Some of these datasets are humongous. Many TB.

In-deedy :)

> I wonder about
> alternatives to straight-up mirrors. I mean, a 100TB server is a
> nontrivial investment.

Nontrivial, but not impossible.  Shooting from the hip, based on a
brand-new supermicro storage without many frills:

- 3u supermicro with 24x SATA drive bays, 32g ram, a few cheap
bottom-of-curve CPU’s
$5000
- 20 pcs 8TB sata disks, $220 * 20
$4400

So lets say 9500 bucks.  I’m already thinking of vendors to ping for
straight donations.
(By December end, I know there will be some 3-year-old inventory that would
serve our purposes)


> Maybe torrents, IPFS, ...? Or a collaborative
> distributed file system. Perhaps using QFS, MFS or LFS?

While I just got pretty excited about NYC*BUG’s ability to take this on
whole hog, I ABSOLUTELY would love to see this explored further.

Could you propose something we could get involved in as a group from
NYC*BUG, perhaps something people can run to donate a small chunk of their
own smaller servers?

Best,
.ike


>
>> -pete
>>
>
> _______________________________________________
> talk mailing list
> talk at lists.nycbug.org
> http://lists.nycbug.org/mailman/listinfo/talk

_______________________________________________
talk mailing list
talk at lists.nycbug.org
http://lists.nycbug.org/mailman/listinfo/talk
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.nycbug.org/pipermail/talk/attachments/20161214/84d67a6c/attachment.html>