[Beowulf] Pdsh output to multiple windows

[Lux, Jim (337K)]

Pdsh does most of what I want, but there’s one thing that maybe it does (and I’ve not found it), or there’s some clever way to do this..

What I would like is to have the console output from the N ssh sessions return to separate windows..

Pdsh does a nice job of bringing it all back to one place, but it would be nice to have it divided up.. Say you’re doing pdsh to fire off a sequence of apt-get, or ls or something like that which returns multiple lines.. – since each node runs at a different rate, the lines come back randomly interspersed.

$pdsh -w b0[1-4] “ls -al /tmp/*”
Or
$pdsh -w b0[1-4] “echo temppwd | sudo -S apt-get update package”


I happen to be on a Mac, so there are apps like iTerm2 that apparently do this, but I’d like a bit more generic (any *nix)

I see ClusterSSH in a google search, but haven’t tried it yet. Apparently there’s a flavor called csshX for Mac OS X


Any ideas?

[Skylar Thompson]

I'm not sure how to do this with pdsh, but I know Ansible can capture
output per task. It doesn't get you output per window though at the point
it's split up per host, you could write that to a named pipe per host and
then read the output anywhere.

Skylar

Post by Lux, Jim (337K)
Pdsh does most of what I want, but there’s one thing that maybe it does
(and I’ve not found it), or there’s some clever way to do this..
What I would like is to have the console output from the N ssh sessions
return to separate windows..
Pdsh does a nice job of bringing it all back to one place, but it would be
nice to have it divided up.. Say you’re doing pdsh to fire off a sequence
of apt-get, or ls or something like that which returns multiple lines.. –
since each node runs at a different rate, the lines come back randomly
interspersed.
$pdsh -w b0[1-4] “ls -al /tmp/*”
Or
$pdsh -w b0[1-4] “echo temppwd | sudo -S apt-get update package”
I happen to be on a Mac, so there are apps like iTerm2 that apparently do
this, but I’d like a bit more generic (any *nix)
I see ClusterSSH in a google search, but haven’t tried it yet. Apparently
there’s a flavor called csshX for Mac OS X
Any ideas?
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf

[Chris Samuel]

Post by Lux, Jim (337K)
Pdsh does a nice job of bringing it all back to one place, but it
would be nice to have it divided up.. Say you’re doing pdsh to fire
off a sequence of apt-get, or ls or something like that which returns
multiple lines.. – since each node runs at a different rate, the
lines come back randomly interspersed.

xCAT has xcoll which collates all the input so you see each nodes output
grouped together, and condenses identical output into groups of nodes.

Now xcoll is an improved version of dshbak which was in IBM's CSM
and there is a version of that for pdsh output.

https://linux.die.net/man/1/dshbak

So if it's possible to hack that to pop up an xterm for each
nodes output then that might meet your criteria.

Best of luck!
Chris

[Tony Schreiner]

You may have tried this, but the pdsh package comes with dshbak. pdsh can
be piped to dshbak which will group the output by node.
You won't see it until all have completed

Post by Lux, Jim (337K)
Pdsh does a nice job of bringing it all back to one place, but it

Post by Lux, Jim (337K)
would be nice to have it divided up.. Say you’re doing pdsh to fire
off a sequence of apt-get, or ls or something like that which returns
multiple lines.. – since each node runs at a different rate, the
lines come back randomly interspersed.

xCAT has xcoll which collates all the input so you see each nodes output
grouped together, and condenses identical output into groups of nodes.
Now xcoll is an improved version of dshbak which was in IBM's CSM
and there is a version of that for pdsh output.
https://linux.die.net/man/1/dshbak
So if it's possible to hack that to pop up an xterm for each
nodes output then that might meet your criteria.
Best of luck!
Chris
--
Chris Samuel : http://www.csamuel.org/ : Melbourne, VIC
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf

[Dmitri Chubarov]

Hi, Jim,


when debugging MPI apps back then some ten years ago (not having access to
an Allinea or Etnus tools) we used to spawn xterms from mpirun command
line. It should in theory be possible to do the same with pdsh.

Dima

Post by Lux, Jim (337K)
Pdsh does most of what I want, but there’s one thing that maybe it does
(and I’ve not found it), or there’s some clever way to do this..
What I would like is to have the console output from the N ssh sessions
return to separate windows..
Pdsh does a nice job of bringing it all back to one place, but it would be
nice to have it divided up.. Say you’re doing pdsh to fire off a sequence
of apt-get, or ls or something like that which returns multiple lines.. –
since each node runs at a different rate, the lines come back randomly
interspersed.
$pdsh -w b0[1-4] “ls -al /tmp/*”
Or
$pdsh -w b0[1-4] “echo temppwd | sudo -S apt-get update package”
I happen to be on a Mac, so there are apps like iTerm2 that apparently do
this, but I’d like a bit more generic (any *nix)
I see ClusterSSH in a google search, but haven’t tried it yet. Apparently
there’s a flavor called csshX for Mac OS X
Any ideas?
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf

[Rob Taylor]

I have used clusterssh many times. (should be in the ubuntu repository).

It is dependent on xwindows, as it just spawns xterms and copies the
input stream to all the windows simultaneously. csshx on the mac works
similarly, but with the osx terminal app instead.

It sounds like clusterssh will do what you are looking for.

Be careful how many you do, your screen can get quite cluttered once you
get over 10 sessions going.

rgt

Post by Lux, Jim (337K)
Pdsh does most of what I want, but there’s one thing that maybe it
does (and I’ve not found it), or there’s some clever way to do this..
What I would like is to have the console output from the N ssh
sessions return to separate windows..
Pdsh does a nice job of bringing it all back to one place, but it
would be nice to have it divided up.. Say you’re doing pdsh  to fire
off a sequence of apt-get, or ls or something like that which returns
multiple lines.. – since each node runs at a different rate, the lines
come back randomly interspersed.
$pdsh -w b0[1-4] “ls -al /tmp/*”
Or
$pdsh -w b0[1-4] “echo temppwd | sudo -S apt-get update package”
I happen to be on a Mac, so there are apps like iTerm2 that apparently
do this, but I’d like a bit more generic (any *nix)
I see ClusterSSH in a google search, but haven’t tried it yet.
Apparently there’s a flavor called csshX for Mac OS X
Any ideas?
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf

[Lux, Jim (337K)]

Yes.. csshx seems to work – and point is well taken about multiple sessions. Fortunately, I have only 4 nodes to control.


From: Beowulf <beowulf-***@beowulf.org> on behalf of Rob Taylor <***@wi.mit.edu>
Date: Sunday, April 15, 2018 at 6:49 PM
To: "***@beowulf.org" <***@beowulf.org>
Subject: Re: [Beowulf] Pdsh output to multiple windows


I have used clusterssh many times. (should be in the ubuntu repository).

It is dependent on xwindows, as it just spawns xterms and copies the input stream to all the windows simultaneously. csshx on the mac works similarly, but with the osx terminal app instead.

It sounds like clusterssh will do what you are looking for.

Be careful how many you do, your screen can get quite cluttered once you get over 10 sessions going.

rgt
On 4/14/18 2:22 PM, Lux, Jim (337K) wrote:
Pdsh does most of what I want, but there’s one thing that maybe it does (and I’ve not found it), or there’s some clever way to do this..

What I would like is to have the console output from the N ssh sessions return to separate windows..

Pdsh does a nice job of bringing it all back to one place, but it would be nice to have it divided up.. Say you’re doing pdsh to fire off a sequence of apt-get, or ls or something like that which returns multiple lines.. – since each node runs at a different rate, the lines come back randomly interspersed.

$pdsh -w b0[1-4] “ls -al /tmp/*”
Or
$pdsh -w b0[1-4] “echo temppwd | sudo -S apt-get update package”


I happen to be on a Mac, so there are apps like iTerm2 that apparently do this, but I’d like a bit more generic (any *nix)

I see ClusterSSH in a google search, but haven’t tried it yet. Apparently there’s a flavor called csshX for Mac OS X


Any ideas?





_______________________________________________

Beowulf mailing list, ***@beowulf.org<mailto:***@beowulf.org> sponsored by Penguin Computing

To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf

[Tina Friedrich]

I was going to say clusterssh.

I think I've used that with up to 30 nodes simultaneously (multiple screens,
so they were readable).

(What I've actually used it most for is not as such ssh sessions, but IPMI
consoles; given it allows to define the ssh command, that was easy to set up,
and having something run serial consoles to multiple nodes with a window each
and the possibility to interact with all of them I found really quite useful
at times.)

Tina

Post by Rob Taylor
I have used clusterssh many times. (should be in the ubuntu repository).
It is dependent on xwindows, as it just spawns xterms and copies the
input stream to all the windows simultaneously. csshx on the mac works
similarly, but with the osx terminal app instead.
It sounds like clusterssh will do what you are looking for.
Be careful how many you do, your screen can get quite cluttered once you
get over 10 sessions going.
rgt

Pdsh does most of what I want, but there’s one thing that maybe it
does (and I’ve not found it), or there’s some clever way to do this..
What I would like is to have the console output from the N ssh
sessions return to separate windows..
Pdsh does a nice job of bringing it all back to one place, but it
would be nice to have it divided up.. Say you’re doing pdsh to fire
off a sequence of apt-get, or ls or something like that which returns
multiple lines.. – since each node runs at a different rate, the lines
come back randomly interspersed.
$pdsh -w b0[1-4] “ls -al /tmp/*”
Or
$pdsh -w b0[1-4] “echo temppwd | sudo -S apt-get update package”
I happen to be on a Mac, so there are apps like iTerm2 that apparently
do this, but I’d like a bit more generic (any *nix)
I see ClusterSSH in a google search, but haven’t tried it yet.
Apparently there’s a flavor called csshX for Mac OS X
Any ideas?
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf

[Carsten Aulbert]

Hi Jim

Post by Lux, Jim (337K)
Any ideas?

We use `dsh`[1] quite extensively with O(2500) nodes. It also
joins/intersperses lines, but you can optionally prefix them with the
host name for later splitting, e.g. running uptime for some machines yield:

a0201: 14:31:12 up 47 days, 23:28, 0 users, load average: 20.78,
22.49, 18.90
a0202: 14:31:12 up 47 days, 23:28, 0 users, load average: 121.68,
121.90, 122.31
a0203: 14:31:12 up 47 days, 23:28, 0 users, load average: 118.07,
117.09, 116.86
a0204: 14:31:12 up 47 days, 23:51, 0 users, load average: 117.48,
119.17, 124.13
a0205: 14:31:12 up 47 days, 23:28, 0 users, load average: 124.66,
124.77, 123.95
[...]

[1] http://www.netfort.gr.jp/~dancer/software/dsh.html