Discussion:
[Beowulf] New tools from FB and Uber
Lachlan Musicman
2018-10-30 17:27:23 UTC
Permalink
I always find it weird when companies I don't like release new toolsets
that make me begrudgingly think that they are not evil to the core.

FB has open sourced some interestimg kernel tools, including 'cgroups2' and
btfrs (!! Wasn't that already floss?)

https://code.fb.com/open-source/linux/

Uber has released a new player in cluster workload management, Peleton

https://eng.uber.com/peloton/

Enjoy your morning reading!

L.
Tim Cutts
2018-10-30 18:14:11 UTC
Permalink
I vaguely remember hearing about Btrfs from someone at Oracle, it seems the main developer has moved around a bit since!

Tim

On 30 Oct 2018, at 17:27, Lachlan Musicman <***@gmail.com<mailto:***@gmail.com>> wrote:

I always find it weird when companies I don't like release new toolsets that make me begrudgingly think that they are not evil to the core.

FB has open sourced some interestimg kernel tools, including 'cgroups2' and btfrs (!! Wasn't that already floss?)

https://code.fb.com/open-source/linux/<https://urldefense.proofpoint.com/v2/url?u=https-3A__code.fb.com_open-2Dsource_linux_&d=DwMFaQ&c=D7ByGjS34AllFgecYw0iC6Zq7qlm8uclZFI0SqQnqBo&r=gSesY1AbeTURZwExR_OGFZlp9YUzrLWyYpGmwAw4Q50&m=-a2YvSICaNpX2lP-v-ws4goPCSR91u9unjjnu9w0ljE&s=Nrn_ME99G_to4nKHiOzsPMwHJM0zCJ6wj0quTDHUmJo&e=>

Uber has released a new player in cluster workload management, Peleton

https://eng.uber.com/peloton/<https://urldefense.proofpoint.com/v2/url?u=https-3A__eng.uber.com_peloton_&d=DwMFaQ&c=D7ByGjS34AllFgecYw0iC6Zq7qlm8uclZFI0SqQnqBo&r=gSesY1AbeTURZwExR_OGFZlp9YUzrLWyYpGmwAw4Q50&m=-a2YvSICaNpX2lP-v-ws4goPCSR91u9unjjnu9w0ljE&s=SPX19YKHVrCjlHUgyKrzQIq2E7A_m_Uw1SJYQ-y85ug&e=>

Enjoy your morning reading!

L.

_______________________________________________
Beowulf mailing list, ***@beowulf.org<mailto:***@beowulf.org> sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit https://urldefense.proofpoint.com/v2/url?u=http-3A__www.beowulf.org_mailman_listinfo_beowulf&d=DwIGaQ&c=D7ByGjS34AllFgecYw0iC6Zq7qlm8uclZFI0SqQnqBo&r=gSesY1AbeTURZwExR_OGFZlp9YUzrLWyYpGmwAw4Q50&m=-a2YvSICaNpX2lP-v-ws4goPCSR91u9unjjnu9w0ljE&s=MIPPV9iI87YeSgCBy5_SHc5pqPq0lXy8eWxxxtEIAE8&e=
--
The Wellcome Sanger Institute is operated by Genome Research
Limited, a charity registered in England with number 1021457 and a
company registered in England with number 2742969, whose registered
office is 215 Euston Road, London, NW1 2BE.
Christopher Samuel
2018-10-31 00:04:49 UTC
Permalink
Post by Tim Cutts
I vaguely remember hearing about Btrfs from someone at Oracle, it
seems the main developer has moved around a bit since!
Yeah Chris Mason (and another) left Oracle for Fusion-IO in 2012 and
then shifted from there to Facebook in late 2013. Jens Axboe (the
kernel block layer maintainer) also moved from Fusio-IO to Facebook
shortly after (early 2014).

FB run btrfs on a bunch of their infrastructure which helped them find
problems at scale (from memory, I don't track it any more).

All the best,
Chris
--
Chris Samuel : http://www.csamuel.org/ : Melbourne, VIC
_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) vis
Gerald Henriksen
2018-10-30 23:56:46 UTC
Permalink
Post by Lachlan Musicman
FB has open sourced some interestimg kernel tools, including 'cgroups2' and
btfrs (!! Wasn't that already floss?)
Btrfs has been around for a while, and has even been in the Linux
kernel for a while.

I'm guessing that Facebook has had their own development branch which
they are now making public as that link differs from the development
branch that is shown on the kernel Btrfs page:

https://btrfs.wiki.kernel.org/index.php/Btrfs_source_repositories

Currently I believe only OpenSUSE ships it in a supported form, Red
Hat announced they are removing support and it won't be in future
releases.
_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.or
Tony Brian Albers
2018-10-31 06:24:43 UTC
Permalink
Post by Gerald Henriksen
Post by Lachlan Musicman
FB has open sourced some interestimg kernel tools, including
'cgroups2' and
btfrs (!! Wasn't that already floss?)
Btrfs has been around for a while, and has even been in the Linux
kernel for a while.
I'm guessing that Facebook has had their own development branch which
they are now making public as that link differs from the development
https://btrfs.wiki.kernel.org/index.php/Btrfs_source_repositories
Currently I believe only OpenSUSE ships it in a supported form, Red
Hat announced they are removing support and it won't be in future
releases.
_______________________________________________
It's been supported on Oracle Linux for a long time(since 6.3 I think)

/tony


--
-- 
Tony Albers
Systems Architect
Systems Director, National Cultural Heritage Cluster
Royal Danish Library, Victor Albecks Vej 1, 8000 Aarhus C, Denmark.
Tel: +45 2566 2383 / +45 8946 2316
_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowu
Loading...