[Beowulf] memory usage

[Michael Di Domenico]

does anyone know of a tool that looks at a process
(single/multi-threaded) and tells you how much memory it's using and
in which numa domain the allocated memory is sitting.
_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/b

[Skylar Thompson]

Assuming Linux, you can get that information out of /proc/<pid>/smaps and
numa_maps.

Skylar

Post by Michael Di Domenico
does anyone know of a tool that looks at a process
(single/multi-threaded) and tells you how much memory it's using and
in which numa domain the allocated memory is sitting.
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf

[Michael Di Domenico]

On Fri, Jun 22, 2018 at 2:28 PM, Skylar Thompson

Post by Skylar Thompson
Assuming Linux, you can get that information out of /proc/<pid>/smaps and
numa_maps.

the memory regions are in there for the used bits, but i don't have
anything that translates those regions to which cpu the region sits on
_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowu

[Skylar Thompson]

Post by Michael Di Domenico
On Fri, Jun 22, 2018 at 2:28 PM, Skylar Thompson

Post by Skylar Thompson
Assuming Linux, you can get that information out of /proc/<pid>/smaps and
numa_maps.

the memory regions are in there for the used bits, but i don't have
anything that translates those regions to which cpu the region sits on

I think the number before the = in the page count fields (Nn=pages) is the
NUMA node number. Not exactly the CPU, but the memory isn't allocated to a
specific CPU (modulo CPU cache).

Skylar

[Michael Di Domenico]

On Fri, Jun 22, 2018 at 2:44 PM, Skylar Thompson

Post by Skylar Thompson

Post by Michael Di Domenico
On Fri, Jun 22, 2018 at 2:28 PM, Skylar Thompson

Post by Skylar Thompson
Assuming Linux, you can get that information out of /proc/<pid>/smaps and
numa_maps.

the memory regions are in there for the used bits, but i don't have
anything that translates those regions to which cpu the region sits on

I think the number before the = in the page count fields (Nn=pages) is the
NUMA node number. Not exactly the CPU, but the memory isn't allocated to a
specific CPU (modulo CPU cache).

ah, spiffy. i glossed right over that in the manpage
_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/l

[Lawrence Stewart]

And of course

numactl -H

will tell you which numa nodes are associated with which CPUs, at least down to the socket level.

Post by Michael Di Domenico
On Fri, Jun 22, 2018 at 2:44 PM, Skylar Thompson

Post by Skylar Thompson

Post by Michael Di Domenico
On Fri, Jun 22, 2018 at 2:28 PM, Skylar Thompson

Post by Skylar Thompson
Assuming Linux, you can get that information out of /proc/<pid>/smaps and
numa_maps.

the memory regions are in there for the used bits, but i don't have
anything that translates those regions to which cpu the region sits on

I think the number before the = in the page count fields (Nn=pages) is the
NUMA node number. Not exactly the CPU, but the memory isn't allocated to a
specific CPU (modulo CPU cache).

ah, spiffy. i glossed right over that in the manpage
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf

_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.

[Chris Samuel]

Post by Michael Di Domenico
does anyone know of a tool that looks at a process
(single/multi-threaded) and tells you how much memory it's using and
in which numa domain the allocated memory is sitting.

numastat <pid>

For example:

# numastat 54032

Per-node process memory usage (in MBs) for PID 54032 (nbody6.gpu)
Node 0 Node 1 Total
--------------- --------------- ---------------
Huge 0.00 0.00 0.00
Heap 0.00 4.98 4.98
Stack 0.00 0.16 0.16
Private 0.34 940.02 940.37
---------------- --------------- --------------- ---------------
Total 0.34 945.17 945.51

All the best!
Chris

[Michael Di Domenico]

Post by Chris Samuel

Post by Michael Di Domenico
does anyone know of a tool that looks at a process
(single/multi-threaded) and tells you how much memory it's using and
in which numa domain the allocated memory is sitting.

numastat <pid>
# numastat 54032
Per-node process memory usage (in MBs) for PID 54032 (nbody6.gpu)
Node 0 Node 1 Total
--------------- --------------- ---------------
Huge 0.00 0.00 0.00
Heap 0.00 4.98 4.98
Stack 0.00 0.16 0.16
Private 0.34 940.02 940.37
---------------- --------------- --------------- ---------------
Total 0.34 945.17 945.51

awesome, that's exactly what i was looking for...
_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf

[Jörg Saßmannshausen]

Hi Michael,

out of curiosity: why do you want to / need to know which in numa domain the
allocated memory is sitting?
I simply try to understand what you are after here.

All the best from a sunny London!

Jörg

Post by Michael Di Domenico
does anyone know of a tool that looks at a process
(single/multi-threaded) and tells you how much memory it's using and
in which numa domain the allocated memory is sitting.
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf

_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/

[Michael Di Domenico]

On Sun, Jun 24, 2018 at 7:14 AM, Jörg Saßmannshausen

Post by Jörg Saßmannshausen
out of curiosity: why do you want to / need to know which in numa domain the
allocated memory is sitting?
I simply try to understand what you are after here.

I'm trying to prove that when a process is locked to a domain via some
mechanism, either numactl, mpi binding, etc, that it is in fact only
allocating memory on that domain. It's a trust but verify thing.
_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/li

[Jörg Saßmannshausen]

Hi Michael,

thanks.

Sorry I am a bit slow with replying right now.

All the best

Jörg

Post by Michael Di Domenico
On Sun, Jun 24, 2018 at 7:14 AM, Jörg Saßmannshausen

Post by Jörg Saßmannshausen
out of curiosity: why do you want to / need to know which in numa domain
the allocated memory is sitting?
I simply try to understand what you are after here.

I'm trying to prove that when a process is locked to a domain via some
mechanism, either numactl, mpi binding, etc, that it is in fact only
allocating memory on that domain. It's a trust but verify thing.
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf

_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.b