[Beowulf] BeeGFS usage question

[Christopher Samuel]

Hi all,

A few folks were chatting about HPC distributed filesystems over on the
Australian HPC sysadmin Slack and the question arose about whether
anyone is using BeeGFS for non-scratch (persistent) storage.

So, is anyone doing that?

Also, is anyone doing that with CephFS too?

All the best,
Chris

[Joe Landman]

Post by Christopher Samuel
Hi all,
A few folks were chatting about HPC distributed filesystems over on the
Australian HPC sysadmin Slack and the question arose about whether
anyone is using BeeGFS for non-scratch (persistent) storage.
So, is anyone doing that?

I have a number of (former) customers using it as primary storage. You
set up mirrored metadata, mirrored data, and you get a nice HA-like
system (they have some issues with HA daemons, but I understand this is
being worked on and will be delivered soon).

It is IMO excellent for this. Back it with zfs on the units, distribute
your metadata and mirror it.

Post by Christopher Samuel
Also, is anyone doing that with CephFS too?

Can be done, but I know very few people using it (again some former
prospective customers). CephFS is somewhat behind for this use case,
though it should be reasonably stable/performant.

Post by Christopher Samuel
All the best,
Chris

--
Joe Landman
e: ***@gmail.com
t: @hpcjoe
w: https://scalability.org
g: https://github.com/joelandman
_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf

[Jeffrey Layton]

Chris,

I've used BeeGFS on AWS before. I was mostly testing the installation
procedure and the performance. It's not really persistent storage since I
would bring up a cluster, run some tests, and then tear down the cluster. I
think the longest I had a cluster running was about 1-2 weeks (I was
running tests the whole time).

The performance was very good and it was easy to install. I used the rpm's
to install on CentOS 7 (storage and clients). I used xfs underneath since I
didn't want to try putting ZFS on the servers at the time (I was interested
in performance testing so I wanted to keep it simple).

Hope this helps.

Jeff


<https://www.avast.com/lp-safe-emailing-3177-a?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail&utm_term=oa-3177-a>
Virus-free.
www.avast.com
<https://www.avast.com/lp-safe-emailing-3177-a?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail&utm_term=oa-3177-a>
<#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

Post by Christopher Samuel
Hi all,
A few folks were chatting about HPC distributed filesystems over on the
Australian HPC sysadmin Slack and the question arose about whether
anyone is using BeeGFS for non-scratch (persistent) storage.
So, is anyone doing that?
Also, is anyone doing that with CephFS too?
All the best,
Chris
--
Christopher Samuel Senior Systems Administrator
Melbourne Bioinformatics - The University of Melbourne
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf