Discussion:
[Beowulf] Intel motherboard BMC
Jörg Saßmannshausen
2018-06-21 09:13:32 UTC
Permalink
Dear all,

I got a bit of a confusing situation with the BMC of some Intel motherboards
which we recently purchased and I am not quite sure what to make out of it.

We have install a generic user via the IPMI commands on the compute nodes and
I can access the BMC remotely, again via the IPMI command like this:

$ ipmitool -H node105-bmc -U username -P xxx power status

This is working, Also, this works:

$ ipmitool -H 10.0.1.105 -U username -P xxx power status

A nslookup of node105-bmc gives the right IP address as well.

However, if I want to use the GUI for the BMC, i.e. opening my browser and
put:

https://node105-bmc

in the URL, I get the loging page When I enter my login credentials then,
which are the same as above, I have a problem to log in *IF* I am using the
hostname as address but not *IF* I am using the IP address. Just to add to the
confusion more, on one node the hostname was working.
With problems I mean the browser tells me my login credentials are wrong which
does not happen when I am using the IP address.
Also, I can only use https and not http and for now I got the generic self
signed certificates. I want to change them at one point but right now that is
more on the bottom of my to-do list.

I find that really odd and I am not quite sure what is going on here. With all
the Supermicro kit I once had I never had these issues before. I was able to
log in regardless of using the hostname or IP address.
So clearly Intel does something here Supermicro did not (at the time).

The boards in question are Intel S2600BPB ones.

Has anybody seen this before?

I got a second issue with these boards. I usually do the normal PXE/NFS boot
and the setup is working well for the other, older Supermicro machines.
However, with the new Intel ones, this is crashing.
The procedure is you are selecting in the boot-menu you want to do a PXE boot
and not boot from the local hard drive.
It then boots the initramfs which seems to be fine. From what I can see, both
during the boot process and from the log files of the DHCP-server, it is
getting the right IP address.
However, when the initramfs hands over to the kernel, it crashes with:
kernel panic! attempt to kill init
and you literally have to pull the plug on the machine, i.e. a hard reset.

The only time I have seen that was when I did not specify the NIC and when I
had two NICs, it somehow decided to use the other one. I fixed that problem by
defining the interface in the boot-arguments and also the second NIC is not
connected anyway. It also has a InfiniBand card which does allow booting from
it. Again, it is not connected so in theory it should not matter.

I am stuck here. I am using a 4.x kernel for the PXE boot, so a fairly recent
one. As I said, it works for the older machines but not for the newer ones.

I upgraded the whole PXE/NFS boot and that is not working too.

Does anybody have any ideas here?

Sorry for asking 2 questions in one email but as they are related I hope that
is ok.

All the best from a sunny London

Jörg

_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) v
Tony Brian Albers
2018-06-21 09:20:51 UTC
Permalink
Does the BMC itself know its own hostname?

/tony
Post by Jörg Saßmannshausen
Dear all,
I got a bit of a confusing situation with the BMC of some Intel motherboards
which we recently purchased and I am not quite sure what to make out of it.
We have install a generic user via the IPMI commands on the compute nodes and
$ ipmitool -H node105-bmc -U username -P xxx power status
$ ipmitool -H 10.0.1.105 -U username -P xxx power status
A nslookup of node105-bmc gives the right IP address as well.
However, if I want to use the GUI for the BMC, i.e. opening my browser and
https://node105-bmc
in the URL, I get the loging page When I enter my login credentials then,
which are the same as above, I have a problem to log in *IF* I am using the
hostname as address but not *IF* I am using the IP address. Just to add to the
confusion more, on one node the hostname was working.
With problems I mean the browser tells me my login credentials are wrong which
does not happen when I am using the IP address.
Also, I can only use https and not http and for now I got the generic self
signed certificates. I want to change them at one point but right now that is
more on the bottom of my to-do list.
I find that really odd and I am not quite sure what is going on here. With all
the Supermicro kit I once had I never had these issues before. I was able to
log in regardless of using the hostname or IP address.
So clearly Intel does something here Supermicro did not (at the time).
The boards in question are Intel S2600BPB ones.
Has anybody seen this before?
I got a second issue with these boards. I usually do the normal PXE/NFS boot
and the setup is working well for the other, older Supermicro machines.
However, with the new Intel ones, this is crashing.
The procedure is you are selecting in the boot-menu you want to do a PXE boot
and not boot from the local hard drive.
It then boots the initramfs which seems to be fine. From what I can see, both
during the boot process and from the log files of the DHCP-server, it is
getting the right IP address.
kernel panic! attempt to kill init
and you literally have to pull the plug on the machine, i.e. a hard reset.
The only time I have seen that was when I did not specify the NIC and when I
had two NICs, it somehow decided to use the other one. I fixed that problem by
defining the interface in the boot-arguments and also the second NIC is not
connected anyway. It also has a InfiniBand card which does allow booting from
it. Again, it is not connected so in theory it should not matter.
I am stuck here. I am using a 4.x kernel for the PXE boot, so a fairly recent
one. As I said, it works for the older machines but not for the newer ones.
I upgraded the whole PXE/NFS boot and that is not working too.
Does anybody have any ideas here?
Sorry for asking 2 questions in one email but as they are related I hope that
is ok.
All the best from a sunny London
Jörg
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf
--
Tony Albers
Systems administrator, IT-development
Royal Danish Library, Victor Albecks Vej 1, 8000 Aarhus C, Denmark.
Tel: +45 2566 2383 / +45 8946 2316
_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo
John Hearns via Beowulf
2018-06-21 10:02:40 UTC
Permalink
Hello Jorg. As you know I have worked a lot with Supermicro machines.
I also installed Intel machines for Greenwich University, so I have
experience of setting up IPMI on them.
I will take time to try to understand your problem!
Also Intel provides excellent documentation for all its products. Really.
But you must get the correct part number and search for it.
I really recommend finding the BMC manual, as I recall that made things a
lot clearer.

One quick question - are you using the on-board ethernet interface for IPMI
or are you using the additional hardware module which has its own ethernet
port?
It also has a InfiniBand card which does allow booting from it.
You can PXE boot over a Mellanox Infiniband card. As you probably know this
involves installing extra firmware on the card.
In my last job we had an IB only cluster, so booting over IB had to work!
I guess you do nto need to flash the card, but to be honest running the
utility is not scary. You just have to get the exact firmware for your card.
Does the BMC itself know its own hostname?
/tony
Post by Jörg Saßmannshausen
Dear all,
I got a bit of a confusing situation with the BMC of some Intel
motherboards
Post by Jörg Saßmannshausen
which we recently purchased and I am not quite sure what to make out of
it.
Post by Jörg Saßmannshausen
We have install a generic user via the IPMI commands on the compute
nodes and
Post by Jörg Saßmannshausen
$ ipmitool -H node105-bmc -U username -P xxx power status
$ ipmitool -H 10.0.1.105 -U username -P xxx power status
A nslookup of node105-bmc gives the right IP address as well.
However, if I want to use the GUI for the BMC, i.e. opening my browser
and
Post by Jörg Saßmannshausen
https://node105-bmc
in the URL, I get the loging page When I enter my login credentials then,
which are the same as above, I have a problem to log in *IF* I am using
the
Post by Jörg Saßmannshausen
hostname as address but not *IF* I am using the IP address. Just to add
to the
Post by Jörg Saßmannshausen
confusion more, on one node the hostname was working.
With problems I mean the browser tells me my login credentials are wrong
which
Post by Jörg Saßmannshausen
does not happen when I am using the IP address.
Also, I can only use https and not http and for now I got the generic
self
Post by Jörg Saßmannshausen
signed certificates. I want to change them at one point but right now
that is
Post by Jörg Saßmannshausen
more on the bottom of my to-do list.
I find that really odd and I am not quite sure what is going on here.
With all
Post by Jörg Saßmannshausen
the Supermicro kit I once had I never had these issues before. I was
able to
Post by Jörg Saßmannshausen
log in regardless of using the hostname or IP address.
So clearly Intel does something here Supermicro did not (at the time).
The boards in question are Intel S2600BPB ones.
Has anybody seen this before?
I got a second issue with these boards. I usually do the normal PXE/NFS
boot
Post by Jörg Saßmannshausen
and the setup is working well for the other, older Supermicro machines.
However, with the new Intel ones, this is crashing.
The procedure is you are selecting in the boot-menu you want to do a PXE
boot
Post by Jörg Saßmannshausen
and not boot from the local hard drive.
It then boots the initramfs which seems to be fine. From what I can see,
both
Post by Jörg Saßmannshausen
during the boot process and from the log files of the DHCP-server, it is
getting the right IP address.
kernel panic! attempt to kill init
and you literally have to pull the plug on the machine, i.e. a hard
reset.
Post by Jörg Saßmannshausen
The only time I have seen that was when I did not specify the NIC and
when I
Post by Jörg Saßmannshausen
had two NICs, it somehow decided to use the other one. I fixed that
problem by
Post by Jörg Saßmannshausen
defining the interface in the boot-arguments and also the second NIC is
not
Post by Jörg Saßmannshausen
connected anyway. It also has a InfiniBand card which does allow booting
from
Post by Jörg Saßmannshausen
it. Again, it is not connected so in theory it should not matter.
I am stuck here. I am using a 4.x kernel for the PXE boot, so a fairly
recent
Post by Jörg Saßmannshausen
one. As I said, it works for the older machines but not for the newer
ones.
Post by Jörg Saßmannshausen
I upgraded the whole PXE/NFS boot and that is not working too.
Does anybody have any ideas here?
Sorry for asking 2 questions in one email but as they are related I hope
that
Post by Jörg Saßmannshausen
is ok.
All the best from a sunny London
Jörg
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
--
Tony Albers
Systems administrator, IT-development
Royal Danish Library, Victor Albecks Vej 1, 8000 Aarhus C, Denmark.
Tel: +45 2566 2383 / +45 8946 2316
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
John Hearns via Beowulf
2018-06-21 10:07:48 UTC
Permalink
Jorg, recalling my experience with Intel. I did not come across the problem
with IP address versus Hostname which you have.
However I do recall that I had to configure the Admin user and the
privilege level for that user on the LAN interface. In that case the
additional BMC modules were being used.

I might have the commands written up somewhere.
Post by John Hearns via Beowulf
Hello Jorg. As you know I have worked a lot with Supermicro machines.
I also installed Intel machines for Greenwich University, so I have
experience of setting up IPMI on them.
I will take time to try to understand your problem!
Also Intel provides excellent documentation for all its products. Really.
But you must get the correct part number and search for it.
I really recommend finding the BMC manual, as I recall that made things a
lot clearer.
One quick question - are you using the on-board ethernet interface for
IPMI or are you using the additional hardware module which has its own
ethernet port?
It also has a InfiniBand card which does allow booting from it.
You can PXE boot over a Mellanox Infiniband card. As you probably know
this involves installing extra firmware on the card.
In my last job we had an IB only cluster, so booting over IB had to work!
I guess you do nto need to flash the card, but to be honest running the
utility is not scary. You just have to get the exact firmware for your card.
Does the BMC itself know its own hostname?
/tony
Post by Jörg Saßmannshausen
Dear all,
I got a bit of a confusing situation with the BMC of some Intel
motherboards
Post by Jörg Saßmannshausen
which we recently purchased and I am not quite sure what to make out of
it.
Post by Jörg Saßmannshausen
We have install a generic user via the IPMI commands on the compute
nodes and
Post by Jörg Saßmannshausen
$ ipmitool -H node105-bmc -U username -P xxx power status
$ ipmitool -H 10.0.1.105 -U username -P xxx power status
A nslookup of node105-bmc gives the right IP address as well.
However, if I want to use the GUI for the BMC, i.e. opening my browser
and
Post by Jörg Saßmannshausen
https://node105-bmc
in the URL, I get the loging page When I enter my login credentials
then,
Post by Jörg Saßmannshausen
which are the same as above, I have a problem to log in *IF* I am using
the
Post by Jörg Saßmannshausen
hostname as address but not *IF* I am using the IP address. Just to add
to the
Post by Jörg Saßmannshausen
confusion more, on one node the hostname was working.
With problems I mean the browser tells me my login credentials are
wrong which
Post by Jörg Saßmannshausen
does not happen when I am using the IP address.
Also, I can only use https and not http and for now I got the generic
self
Post by Jörg Saßmannshausen
signed certificates. I want to change them at one point but right now
that is
Post by Jörg Saßmannshausen
more on the bottom of my to-do list.
I find that really odd and I am not quite sure what is going on here.
With all
Post by Jörg Saßmannshausen
the Supermicro kit I once had I never had these issues before. I was
able to
Post by Jörg Saßmannshausen
log in regardless of using the hostname or IP address.
So clearly Intel does something here Supermicro did not (at the time).
The boards in question are Intel S2600BPB ones.
Has anybody seen this before?
I got a second issue with these boards. I usually do the normal PXE/NFS
boot
Post by Jörg Saßmannshausen
and the setup is working well for the other, older Supermicro machines.
However, with the new Intel ones, this is crashing.
The procedure is you are selecting in the boot-menu you want to do a
PXE boot
Post by Jörg Saßmannshausen
and not boot from the local hard drive.
It then boots the initramfs which seems to be fine. From what I can
see, both
Post by Jörg Saßmannshausen
during the boot process and from the log files of the DHCP-server, it is
getting the right IP address.
kernel panic! attempt to kill init
and you literally have to pull the plug on the machine, i.e. a hard
reset.
Post by Jörg Saßmannshausen
The only time I have seen that was when I did not specify the NIC and
when I
Post by Jörg Saßmannshausen
had two NICs, it somehow decided to use the other one. I fixed that
problem by
Post by Jörg Saßmannshausen
defining the interface in the boot-arguments and also the second NIC is
not
Post by Jörg Saßmannshausen
connected anyway. It also has a InfiniBand card which does allow
booting from
Post by Jörg Saßmannshausen
it. Again, it is not connected so in theory it should not matter.
I am stuck here. I am using a 4.x kernel for the PXE boot, so a fairly
recent
Post by Jörg Saßmannshausen
one. As I said, it works for the older machines but not for the newer
ones.
Post by Jörg Saßmannshausen
I upgraded the whole PXE/NFS boot and that is not working too.
Does anybody have any ideas here?
Sorry for asking 2 questions in one email but as they are related I
hope that
Post by Jörg Saßmannshausen
is ok.
All the best from a sunny London
Jörg
_______________________________________________
Computing
Post by Jörg Saßmannshausen
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
--
Tony Albers
Systems administrator, IT-development
Royal Danish Library, Victor Albecks Vej 1, 8000 Aarhus C, Denmark.
Tel: +45 2566 2383 / +45 8946 2316
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
Jörg Saßmannshausen
2018-06-21 10:25:27 UTC
Permalink
Hi John,

thanks for the reply. I am aware you can install user and admin level, erm,
users on the BMC. I only install admin-level users as there is only a need for
an admin to access the BMC GUI.
However, that does not explain why the IP address is working and the hostname
is not.

The only way to get the users installed was using the ipmitool command once
the node was up and running. I tried in the BIOS but that was not working. I
got told you will need to enable the 'root' user first before you can install
users but in the BIOS there was no option for that or we did not find it.

I guess it is the usual learning initial curve here for me. I actually did
look into the documentation but I could not find anything we were doing wrong
at the time. Quite often I found it is a really minor, but important bit one
is missing out and later you think: why did I miss that.

Thanks for your suggestions!

Jörg
Post by John Hearns via Beowulf
Jorg, recalling my experience with Intel. I did not come across the problem
with IP address versus Hostname which you have.
However I do recall that I had to configure the Admin user and the
privilege level for that user on the LAN interface. In that case the
additional BMC modules were being used.
I might have the commands written up somewhere.
Post by John Hearns via Beowulf
Hello Jorg. As you know I have worked a lot with Supermicro machines.
I also installed Intel machines for Greenwich University, so I have
experience of setting up IPMI on them.
I will take time to try to understand your problem!
Also Intel provides excellent documentation for all its products. Really.
But you must get the correct part number and search for it.
I really recommend finding the BMC manual, as I recall that made things a
lot clearer.
One quick question - are you using the on-board ethernet interface for
IPMI or are you using the additional hardware module which has its own
ethernet port?
It also has a InfiniBand card which does allow booting from it.
You can PXE boot over a Mellanox Infiniband card. As you probably know
this involves installing extra firmware on the card.
In my last job we had an IB only cluster, so booting over IB had to work!
I guess you do nto need to flash the card, but to be honest running the
utility is not scary. You just have to get the exact firmware for your
card.>
Does the BMC itself know its own hostname?
/tony
Post by Jörg Saßmannshausen
Dear all,
I got a bit of a confusing situation with the BMC of some Intel
motherboards
Post by Jörg Saßmannshausen
which we recently purchased and I am not quite sure what to make out of
it.
Post by Jörg Saßmannshausen
We have install a generic user via the IPMI commands on the compute
nodes and
Post by Jörg Saßmannshausen
$ ipmitool -H node105-bmc -U username -P xxx power status
$ ipmitool -H 10.0.1.105 -U username -P xxx power status
A nslookup of node105-bmc gives the right IP address as well.
However, if I want to use the GUI for the BMC, i.e. opening my browser
and
Post by Jörg Saßmannshausen
https://node105-bmc
in the URL, I get the loging page When I enter my login credentials
then,
Post by Jörg Saßmannshausen
which are the same as above, I have a problem to log in *IF* I am using
the
Post by Jörg Saßmannshausen
hostname as address but not *IF* I am using the IP address. Just to add
to the
Post by Jörg Saßmannshausen
confusion more, on one node the hostname was working.
With problems I mean the browser tells me my login credentials are
wrong which
Post by Jörg Saßmannshausen
does not happen when I am using the IP address.
Also, I can only use https and not http and for now I got the generic
self
Post by Jörg Saßmannshausen
signed certificates. I want to change them at one point but right now
that is
Post by Jörg Saßmannshausen
more on the bottom of my to-do list.
I find that really odd and I am not quite sure what is going on here.
With all
Post by Jörg Saßmannshausen
the Supermicro kit I once had I never had these issues before. I was
able to
Post by Jörg Saßmannshausen
log in regardless of using the hostname or IP address.
So clearly Intel does something here Supermicro did not (at the time).
The boards in question are Intel S2600BPB ones.
Has anybody seen this before?
I got a second issue with these boards. I usually do the normal PXE/NFS
boot
Post by Jörg Saßmannshausen
and the setup is working well for the other, older Supermicro machines.
However, with the new Intel ones, this is crashing.
The procedure is you are selecting in the boot-menu you want to do a
PXE boot
Post by Jörg Saßmannshausen
and not boot from the local hard drive.
It then boots the initramfs which seems to be fine. From what I can
see, both
Post by Jörg Saßmannshausen
during the boot process and from the log files of the DHCP-server, it is
getting the right IP address.
kernel panic! attempt to kill init
and you literally have to pull the plug on the machine, i.e. a hard
reset.
Post by Jörg Saßmannshausen
The only time I have seen that was when I did not specify the NIC and
when I
Post by Jörg Saßmannshausen
had two NICs, it somehow decided to use the other one. I fixed that
problem by
Post by Jörg Saßmannshausen
defining the interface in the boot-arguments and also the second NIC is
not
Post by Jörg Saßmannshausen
connected anyway. It also has a InfiniBand card which does allow
booting from
Post by Jörg Saßmannshausen
it. Again, it is not connected so in theory it should not matter.
I am stuck here. I am using a 4.x kernel for the PXE boot, so a fairly
recent
Post by Jörg Saßmannshausen
one. As I said, it works for the older machines but not for the newer
ones.
Post by Jörg Saßmannshausen
I upgraded the whole PXE/NFS boot and that is not working too.
Does anybody have any ideas here?
Sorry for asking 2 questions in one email but as they are related I
hope that
Post by Jörg Saßmannshausen
is ok.
All the best from a sunny London
Jörg
_______________________________________________
Computing
Post by Jörg Saßmannshausen
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
--
Tony Albers
Systems administrator, IT-development
Royal Danish Library, Victor Albecks Vej 1, 8000 Aarhus C, Denmark.
Tel: +45 2566 2383 / +45 8946 2316
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://w
John Hearns via Beowulf
2018-06-21 11:48:10 UTC
Permalink
Jorg, the notes I have for setting up Intel BMCs are not of any use to you,
sorry. See below.

Regarding the PXE booting, t is easy to use the syscfg utility to print out
and to set the boot order.
But I do not think this is your problem.
https://www.intel.com/content/dam/support/us/en/documents/server-products/server-boards/Intel_Syscfg_UserGuide_V1.02.pdf

The IPMI interfaces have three LAN Channels – 1, 2, 3

LAN Channel 3 is the one used by the AXXRMM4LITE add-on management module

http://ark.intel.com/products/55168/Remote-Management-Module-AXXRMM4LITE

To configure LAN channel 3:

*module load ipmitool *

*ipmitool lan print 1* (to show the configuration of Channel 1)

*ipmitool lan set 3 ipaddr 172.16.202.XXX * (to set the IP address the same
as Channel 1)

*ipmitool lan set 3 netmask 255.255.255.0*

*ipmitool lan print 1* (to show the configuration of Channel 1)


The Bright Cluster manager uses user number 4 to access the IPMI interface.
This user is named ‘bright’. You should set the level of access for user 4
on LAN Channel 3:

*module load ipmitool ; ipmitool user priv 4 0x4 3*

*module load ipmitool ; ipmitool channel setaccess 3 4 callin=on ipmi=on
link=on privilege=4*

*ipmitool channel getaccess 3 4*
Post by Jörg Saßmannshausen
Hi John,
thanks for the reply. I am aware you can install user and admin level, erm,
users on the BMC. I only install admin-level users as there is only a need for
an admin to access the BMC GUI.
However, that does not explain why the IP address is working and the hostname
is not.
The only way to get the users installed was using the ipmitool command once
the node was up and running. I tried in the BIOS but that was not working. I
got told you will need to enable the 'root' user first before you can install
users but in the BIOS there was no option for that or we did not find it.
I guess it is the usual learning initial curve here for me. I actually did
look into the documentation but I could not find anything we were doing wrong
at the time. Quite often I found it is a really minor, but important bit one
is missing out and later you think: why did I miss that.
Thanks for your suggestions!
Jörg
Post by John Hearns via Beowulf
Jorg, recalling my experience with Intel. I did not come across the
problem
Post by John Hearns via Beowulf
with IP address versus Hostname which you have.
However I do recall that I had to configure the Admin user and the
privilege level for that user on the LAN interface. In that case the
additional BMC modules were being used.
I might have the commands written up somewhere.
Post by John Hearns via Beowulf
Hello Jorg. As you know I have worked a lot with Supermicro machines.
I also installed Intel machines for Greenwich University, so I have
experience of setting up IPMI on them.
I will take time to try to understand your problem!
Also Intel provides excellent documentation for all its products.
Really.
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
But you must get the correct part number and search for it.
I really recommend finding the BMC manual, as I recall that made
things a
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
lot clearer.
One quick question - are you using the on-board ethernet interface for
IPMI or are you using the additional hardware module which has its own
ethernet port?
It also has a InfiniBand card which does allow booting from it.
You can PXE boot over a Mellanox Infiniband card. As you probably know
this involves installing extra firmware on the card.
In my last job we had an IB only cluster, so booting over IB had to
work!
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
I guess you do nto need to flash the card, but to be honest running the
utility is not scary. You just have to get the exact firmware for your
card.>
Does the BMC itself know its own hostname?
/tony
Post by Jörg Saßmannshausen
Dear all,
I got a bit of a confusing situation with the BMC of some Intel
motherboards
Post by Jörg Saßmannshausen
which we recently purchased and I am not quite sure what to make
out of
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
it.
Post by Jörg Saßmannshausen
We have install a generic user via the IPMI commands on the compute
nodes and
Post by Jörg Saßmannshausen
$ ipmitool -H node105-bmc -U username -P xxx power status
$ ipmitool -H 10.0.1.105 -U username -P xxx power status
A nslookup of node105-bmc gives the right IP address as well.
However, if I want to use the GUI for the BMC, i.e. opening my
browser
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
and
Post by Jörg Saßmannshausen
https://node105-bmc
in the URL, I get the loging page When I enter my login credentials
then,
Post by Jörg Saßmannshausen
which are the same as above, I have a problem to log in *IF* I am
using
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
the
Post by Jörg Saßmannshausen
hostname as address but not *IF* I am using the IP address. Just to
add
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
to the
Post by Jörg Saßmannshausen
confusion more, on one node the hostname was working.
With problems I mean the browser tells me my login credentials are
wrong which
Post by Jörg Saßmannshausen
does not happen when I am using the IP address.
Also, I can only use https and not http and for now I got the
generic
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
self
Post by Jörg Saßmannshausen
signed certificates. I want to change them at one point but right
now
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
that is
Post by Jörg Saßmannshausen
more on the bottom of my to-do list.
I find that really odd and I am not quite sure what is going on
here.
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
With all
Post by Jörg Saßmannshausen
the Supermicro kit I once had I never had these issues before. I was
able to
Post by Jörg Saßmannshausen
log in regardless of using the hostname or IP address.
So clearly Intel does something here Supermicro did not (at the
time).
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
The boards in question are Intel S2600BPB ones.
Has anybody seen this before?
I got a second issue with these boards. I usually do the normal
PXE/NFS
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
boot
Post by Jörg Saßmannshausen
and the setup is working well for the other, older Supermicro
machines.
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
However, with the new Intel ones, this is crashing.
The procedure is you are selecting in the boot-menu you want to do a
PXE boot
Post by Jörg Saßmannshausen
and not boot from the local hard drive.
It then boots the initramfs which seems to be fine. From what I can
see, both
Post by Jörg Saßmannshausen
during the boot process and from the log files of the DHCP-server,
it
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
is
getting the right IP address.
However, when the initramfs hands over to the kernel, it crashes
kernel panic! attempt to kill init
and you literally have to pull the plug on the machine, i.e. a hard
reset.
Post by Jörg Saßmannshausen
The only time I have seen that was when I did not specify the NIC
and
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
when I
Post by Jörg Saßmannshausen
had two NICs, it somehow decided to use the other one. I fixed that
problem by
Post by Jörg Saßmannshausen
defining the interface in the boot-arguments and also the second
NIC is
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
not
Post by Jörg Saßmannshausen
connected anyway. It also has a InfiniBand card which does allow
booting from
Post by Jörg Saßmannshausen
it. Again, it is not connected so in theory it should not matter.
I am stuck here. I am using a 4.x kernel for the PXE boot, so a
fairly
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
recent
Post by Jörg Saßmannshausen
one. As I said, it works for the older machines but not for the
newer
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
ones.
Post by Jörg Saßmannshausen
I upgraded the whole PXE/NFS boot and that is not working too.
Does anybody have any ideas here?
Sorry for asking 2 questions in one email but as they are related I
hope that
Post by Jörg Saßmannshausen
is ok.
All the best from a sunny London
Jörg
_______________________________________________
Computing
Post by Jörg Saßmannshausen
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
--
Tony Albers
Systems administrator, IT-development
Royal Danish Library, Victor Albecks Vej 1, 8000 Aarhus C, Denmark.
Tel: +45 2566 2383 / +45 8946 2316
_______________________________________________
Computing
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
Jonathan Engwall
2018-06-21 13:19:00 UTC
Permalink
This sounds so much like a common JavaScript problem. I thought this might
be valuable here:
https://www.gnu.org/software/freeipmi/freeipmi-hostrange.txt
When test a JavaScript file the browser will shortcut to running the file
not the browser itself via a "server" resulting in s omething like this:
///localhost/3000/myNewApp
For what it's worth.
All meaning according to the rest of your shop the cluster is dead.
Post by John Hearns via Beowulf
Jorg, the notes I have for setting up Intel BMCs are not of any use to
you, sorry. See below.
Regarding the PXE booting, t is easy to use the syscfg utility to print
out and to set the boot order.
But I do not think this is your problem.
https://www.intel.com/content/dam/support/us/en/documents/
server-products/server-boards/Intel_Syscfg_UserGuide_V1.02.pdf
The IPMI interfaces have three LAN Channels – 1, 2, 3
LAN Channel 3 is the one used by the AXXRMM4LITE add-on management module
http://ark.intel.com/products/55168/Remote-Management-Module-AXXRMM4LITE
*module load ipmitool *
*ipmitool lan print 1* (to show the configuration of Channel 1)
*ipmitool lan set 3 ipaddr 172.16.202.XXX * (to set the IP address the
same as Channel 1)
*ipmitool lan set 3 netmask 255.255.255.0*
*ipmitool lan print 1* (to show the configuration of Channel 1)
The Bright Cluster manager uses user number 4 to access the IPMI
interface. This user is named ‘bright’. You should set the level of access
*module load ipmitool ; ipmitool user priv 4 0x4 3*
*module load ipmitool ; ipmitool channel setaccess 3 4 callin=on ipmi=on
link=on privilege=4*
*ipmitool channel getaccess 3 4*
On 21 June 2018 at 12:25, Jörg Saßmannshausen <
Post by Jörg Saßmannshausen
Hi John,
thanks for the reply. I am aware you can install user and admin level, erm,
users on the BMC. I only install admin-level users as there is only a need for
an admin to access the BMC GUI.
However, that does not explain why the IP address is working and the hostname
is not.
The only way to get the users installed was using the ipmitool command once
the node was up and running. I tried in the BIOS but that was not working. I
got told you will need to enable the 'root' user first before you can install
users but in the BIOS there was no option for that or we did not find it.
I guess it is the usual learning initial curve here for me. I actually did
look into the documentation but I could not find anything we were doing wrong
at the time. Quite often I found it is a really minor, but important bit one
is missing out and later you think: why did I miss that.
Thanks for your suggestions!
Jörg
Post by John Hearns via Beowulf
Jorg, recalling my experience with Intel. I did not come across the
problem
Post by John Hearns via Beowulf
with IP address versus Hostname which you have.
However I do recall that I had to configure the Admin user and the
privilege level for that user on the LAN interface. In that case the
additional BMC modules were being used.
I might have the commands written up somewhere.
Post by John Hearns via Beowulf
Hello Jorg. As you know I have worked a lot with Supermicro machines.
I also installed Intel machines for Greenwich University, so I have
experience of setting up IPMI on them.
I will take time to try to understand your problem!
Also Intel provides excellent documentation for all its products.
Really.
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
But you must get the correct part number and search for it.
I really recommend finding the BMC manual, as I recall that made
things a
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
lot clearer.
One quick question - are you using the on-board ethernet interface for
IPMI or are you using the additional hardware module which has its own
ethernet port?
It also has a InfiniBand card which does allow booting from it.
You can PXE boot over a Mellanox Infiniband card. As you probably know
this involves installing extra firmware on the card.
In my last job we had an IB only cluster, so booting over IB had to
work!
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
I guess you do nto need to flash the card, but to be honest running
the
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
utility is not scary. You just have to get the exact firmware for your
card.>
Does the BMC itself know its own hostname?
/tony
Post by Jörg Saßmannshausen
Dear all,
I got a bit of a confusing situation with the BMC of some Intel
motherboards
Post by Jörg Saßmannshausen
which we recently purchased and I am not quite sure what to make
out of
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
it.
Post by Jörg Saßmannshausen
We have install a generic user via the IPMI commands on the compute
nodes and
Post by Jörg Saßmannshausen
I can access the BMC remotely, again via the IPMI command like
$ ipmitool -H node105-bmc -U username -P xxx power status
$ ipmitool -H 10.0.1.105 -U username -P xxx power status
A nslookup of node105-bmc gives the right IP address as well.
However, if I want to use the GUI for the BMC, i.e. opening my
browser
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
and
Post by Jörg Saßmannshausen
https://node105-bmc
in the URL, I get the loging page When I enter my login credentials
then,
Post by Jörg Saßmannshausen
which are the same as above, I have a problem to log in *IF* I am
using
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
the
Post by Jörg Saßmannshausen
hostname as address but not *IF* I am using the IP address. Just
to add
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
to the
Post by Jörg Saßmannshausen
confusion more, on one node the hostname was working.
With problems I mean the browser tells me my login credentials are
wrong which
Post by Jörg Saßmannshausen
does not happen when I am using the IP address.
Also, I can only use https and not http and for now I got the
generic
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
self
Post by Jörg Saßmannshausen
signed certificates. I want to change them at one point but right
now
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
that is
Post by Jörg Saßmannshausen
more on the bottom of my to-do list.
I find that really odd and I am not quite sure what is going on
here.
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
With all
Post by Jörg Saßmannshausen
the Supermicro kit I once had I never had these issues before. I
was
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
able to
Post by Jörg Saßmannshausen
log in regardless of using the hostname or IP address.
So clearly Intel does something here Supermicro did not (at the
time).
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
The boards in question are Intel S2600BPB ones.
Has anybody seen this before?
I got a second issue with these boards. I usually do the normal
PXE/NFS
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
boot
Post by Jörg Saßmannshausen
and the setup is working well for the other, older Supermicro
machines.
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
However, with the new Intel ones, this is crashing.
The procedure is you are selecting in the boot-menu you want to do
a
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
PXE boot
Post by Jörg Saßmannshausen
and not boot from the local hard drive.
It then boots the initramfs which seems to be fine. From what I can
see, both
Post by Jörg Saßmannshausen
during the boot process and from the log files of the DHCP-server,
it
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
is
getting the right IP address.
However, when the initramfs hands over to the kernel, it crashes
kernel panic! attempt to kill init
and you literally have to pull the plug on the machine, i.e. a hard
reset.
Post by Jörg Saßmannshausen
The only time I have seen that was when I did not specify the NIC
and
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
when I
Post by Jörg Saßmannshausen
had two NICs, it somehow decided to use the other one. I fixed that
problem by
Post by Jörg Saßmannshausen
defining the interface in the boot-arguments and also the second
NIC is
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
not
Post by Jörg Saßmannshausen
connected anyway. It also has a InfiniBand card which does allow
booting from
Post by Jörg Saßmannshausen
it. Again, it is not connected so in theory it should not matter.
I am stuck here. I am using a 4.x kernel for the PXE boot, so a
fairly
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
recent
Post by Jörg Saßmannshausen
one. As I said, it works for the older machines but not for the
newer
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
ones.
Post by Jörg Saßmannshausen
I upgraded the whole PXE/NFS boot and that is not working too.
Does anybody have any ideas here?
Sorry for asking 2 questions in one email but as they are related I
hope that
Post by Jörg Saßmannshausen
is ok.
All the best from a sunny London
Jörg
_______________________________________________
Computing
Post by Jörg Saßmannshausen
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
--
Tony Albers
Systems administrator, IT-development
Royal Danish Library, Victor Albecks Vej 1, 8000 Aarhus C, Denmark.
Tel: +45 2566 2383 / +45 8946 2316
_______________________________________________
Computing
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
Jörg Saßmannshausen
2018-06-21 14:22:47 UTC
Permalink
Hi,

I am not sure why, if it is a java-script problem, it would work with the
older Supermicro nodes but not with the new Intel ones.

I got more and more the feeling it is probably a simple configuration somewhere
but we are looking at the wrong place here.

All the best

Jörg
Post by Jonathan Engwall
This sounds so much like a common JavaScript problem. I thought this might
https://www.gnu.org/software/freeipmi/freeipmi-hostrange.txt
When test a JavaScript file the browser will shortcut to running the file
///localhost/3000/myNewApp
For what it's worth.
All meaning according to the rest of your shop the cluster is dead.
Post by John Hearns via Beowulf
Jorg, the notes I have for setting up Intel BMCs are not of any use to
you, sorry. See below.
Regarding the PXE booting, t is easy to use the syscfg utility to print
out and to set the boot order.
But I do not think this is your problem.
https://www.intel.com/content/dam/support/us/en/documents/
server-products/server-boards/Intel_Syscfg_UserGuide_V1.02.pdf
The IPMI interfaces have three LAN Channels – 1, 2, 3
LAN Channel 3 is the one used by the AXXRMM4LITE add-on management module
http://ark.intel.com/products/55168/Remote-Management-Module-AXXRMM4LITE
*module load ipmitool *
*ipmitool lan print 1* (to show the configuration of Channel 1)
*ipmitool lan set 3 ipaddr 172.16.202.XXX * (to set the IP address the
same as Channel 1)
*ipmitool lan set 3 netmask 255.255.255.0*
*ipmitool lan print 1* (to show the configuration of Channel 1)
The Bright Cluster manager uses user number 4 to access the IPMI
interface. This user is named ‘bright’. You should set the level of access
*module load ipmitool ; ipmitool user priv 4 0x4 3*
*module load ipmitool ; ipmitool channel setaccess 3 4 callin=on ipmi=on
link=on privilege=4*
*ipmitool channel getaccess 3 4*
On 21 June 2018 at 12:25, Jörg Saßmannshausen <
Post by Jörg Saßmannshausen
Hi John,
thanks for the reply. I am aware you can install user and admin level, erm,
users on the BMC. I only install admin-level users as there is only a need for
an admin to access the BMC GUI.
However, that does not explain why the IP address is working and the hostname
is not.
The only way to get the users installed was using the ipmitool command once
the node was up and running. I tried in the BIOS but that was not working. I
got told you will need to enable the 'root' user first before you can install
users but in the BIOS there was no option for that or we did not find it.
I guess it is the usual learning initial curve here for me. I actually did
look into the documentation but I could not find anything we were doing wrong
at the time. Quite often I found it is a really minor, but important bit one
is missing out and later you think: why did I miss that.
Thanks for your suggestions!
Jörg
Am Donnerstag, 21. Juni 2018, 12:07:48 BST schrieb John Hearns via
Post by John Hearns via Beowulf
Jorg, recalling my experience with Intel. I did not come across the
problem
Post by John Hearns via Beowulf
with IP address versus Hostname which you have.
However I do recall that I had to configure the Admin user and the
privilege level for that user on the LAN interface. In that case the
additional BMC modules were being used.
I might have the commands written up somewhere.
Post by John Hearns via Beowulf
Hello Jorg. As you know I have worked a lot with Supermicro machines.
I also installed Intel machines for Greenwich University, so I have
experience of setting up IPMI on them.
I will take time to try to understand your problem!
Also Intel provides excellent documentation for all its products.
Really.
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
But you must get the correct part number and search for it.
I really recommend finding the BMC manual, as I recall that made
things a
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
lot clearer.
One quick question - are you using the on-board ethernet interface for
IPMI or are you using the additional hardware module which has its own
ethernet port?
It also has a InfiniBand card which does allow booting from it.
You can PXE boot over a Mellanox Infiniband card. As you probably know
this involves installing extra firmware on the card.
In my last job we had an IB only cluster, so booting over IB had to
work!
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
I guess you do nto need to flash the card, but to be honest running
the
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
utility is not scary. You just have to get the exact firmware for your
card.>
Does the BMC itself know its own hostname?
/tony
Post by Jörg Saßmannshausen
Dear all,
I got a bit of a confusing situation with the BMC of some Intel
motherboards
Post by Jörg Saßmannshausen
which we recently purchased and I am not quite sure what to make
out of
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
it.
Post by Jörg Saßmannshausen
We have install a generic user via the IPMI commands on the compute
nodes and
Post by Jörg Saßmannshausen
I can access the BMC remotely, again via the IPMI command like
$ ipmitool -H node105-bmc -U username -P xxx power status
$ ipmitool -H 10.0.1.105 -U username -P xxx power status
A nslookup of node105-bmc gives the right IP address as well.
However, if I want to use the GUI for the BMC, i.e. opening my
browser
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
and
Post by Jörg Saßmannshausen
https://node105-bmc
in the URL, I get the loging page When I enter my login credentials
then,
Post by Jörg Saßmannshausen
which are the same as above, I have a problem to log in *IF* I am
using
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
the
Post by Jörg Saßmannshausen
hostname as address but not *IF* I am using the IP address. Just
to add
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
to the
Post by Jörg Saßmannshausen
confusion more, on one node the hostname was working.
With problems I mean the browser tells me my login credentials are
wrong which
Post by Jörg Saßmannshausen
does not happen when I am using the IP address.
Also, I can only use https and not http and for now I got the
generic
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
self
Post by Jörg Saßmannshausen
signed certificates. I want to change them at one point but right
now
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
that is
Post by Jörg Saßmannshausen
more on the bottom of my to-do list.
I find that really odd and I am not quite sure what is going on
here.
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
With all
Post by Jörg Saßmannshausen
the Supermicro kit I once had I never had these issues before. I
was
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
able to
Post by Jörg Saßmannshausen
log in regardless of using the hostname or IP address.
So clearly Intel does something here Supermicro did not (at the
time).
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
The boards in question are Intel S2600BPB ones.
Has anybody seen this before?
I got a second issue with these boards. I usually do the normal
PXE/NFS
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
boot
Post by Jörg Saßmannshausen
and the setup is working well for the other, older Supermicro
machines.
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
However, with the new Intel ones, this is crashing.
The procedure is you are selecting in the boot-menu you want to do
a
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
PXE boot
Post by Jörg Saßmannshausen
and not boot from the local hard drive.
It then boots the initramfs which seems to be fine. From what I can
see, both
Post by Jörg Saßmannshausen
during the boot process and from the log files of the DHCP-server,
it
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
is
getting the right IP address.
However, when the initramfs hands over to the kernel, it crashes
kernel panic! attempt to kill init
and you literally have to pull the plug on the machine, i.e. a hard
reset.
Post by Jörg Saßmannshausen
The only time I have seen that was when I did not specify the NIC
and
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
when I
Post by Jörg Saßmannshausen
had two NICs, it somehow decided to use the other one. I fixed that
problem by
Post by Jörg Saßmannshausen
defining the interface in the boot-arguments and also the second
NIC is
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
not
Post by Jörg Saßmannshausen
connected anyway. It also has a InfiniBand card which does allow
booting from
Post by Jörg Saßmannshausen
it. Again, it is not connected so in theory it should not matter.
I am stuck here. I am using a 4.x kernel for the PXE boot, so a
fairly
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
recent
Post by Jörg Saßmannshausen
one. As I said, it works for the older machines but not for the
newer
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
ones.
Post by Jörg Saßmannshausen
I upgraded the whole PXE/NFS boot and that is not working too.
Does anybody have any ideas here?
Sorry for asking 2 questions in one email but as they are related I
hope that
Post by Jörg Saßmannshausen
is ok.
All the best from a sunny London
Jörg
_______________________________________________
Computing
Post by Jörg Saßmannshausen
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
--
Tony Albers
Systems administrator, IT-development
Royal Danish Library, Victor Albecks Vej 1, 8000 Aarhus C, Denmark.
Tel: +45 2566 2383 / +45 8946 2316
_______________________________________________
Computing
Post by John Hearns via Beowulf
Post by John Hearns via Beowulf
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.o
Jörg Saßmannshausen
2018-06-21 10:17:15 UTC
Permalink
Hi Tony,

nope. The GUI gives me a hostname, something like BMC23453234 and it is
greyed-out so I cannot change it. The string after BMC is basically the MAC
address without any hyphens or so.

However, given I can go to the login page and given I then get rejected by the
webserver and redirected to another page, I am not quite sure how that could
affect my ability to log in. Something I am missing here?

All the best

Jörg
Post by Tony Brian Albers
Does the BMC itself know its own hostname?
/tony
Post by Jörg Saßmannshausen
Dear all,
I got a bit of a confusing situation with the BMC of some Intel
motherboards which we recently purchased and I am not quite sure what to
make out of it.
We have install a generic user via the IPMI commands on the compute nodes
$ ipmitool -H node105-bmc -U username -P xxx power status
$ ipmitool -H 10.0.1.105 -U username -P xxx power status
A nslookup of node105-bmc gives the right IP address as well.
However, if I want to use the GUI for the BMC, i.e. opening my browser and
https://node105-bmc
in the URL, I get the loging page When I enter my login credentials then,
which are the same as above, I have a problem to log in *IF* I am using the
hostname as address but not *IF* I am using the IP address. Just to add to
the confusion more, on one node the hostname was working.
With problems I mean the browser tells me my login credentials are wrong
which does not happen when I am using the IP address.
Also, I can only use https and not http and for now I got the generic self
signed certificates. I want to change them at one point but right now that
is more on the bottom of my to-do list.
I find that really odd and I am not quite sure what is going on here. With
all the Supermicro kit I once had I never had these issues before. I was
able to log in regardless of using the hostname or IP address.
So clearly Intel does something here Supermicro did not (at the time).
The boards in question are Intel S2600BPB ones.
Has anybody seen this before?
I got a second issue with these boards. I usually do the normal PXE/NFS
boot and the setup is working well for the other, older Supermicro
machines. However, with the new Intel ones, this is crashing.
The procedure is you are selecting in the boot-menu you want to do a PXE
boot and not boot from the local hard drive.
It then boots the initramfs which seems to be fine. From what I can see,
both during the boot process and from the log files of the DHCP-server,
it is getting the right IP address.
kernel panic! attempt to kill init
and you literally have to pull the plug on the machine, i.e. a hard reset.
The only time I have seen that was when I did not specify the NIC and when
I had two NICs, it somehow decided to use the other one. I fixed that
problem by defining the interface in the boot-arguments and also the
second NIC is not connected anyway. It also has a InfiniBand card which
does allow booting from it. Again, it is not connected so in theory it
should not matter.
I am stuck here. I am using a 4.x kernel for the PXE boot, so a fairly
recent one. As I said, it works for the older machines but not for the
newer ones.>
I upgraded the whole PXE/NFS boot and that is not working too.
Does anybody have any ideas here?
Sorry for asking 2 questions in one email but as they are related I hope
that is ok.
All the best from a sunny London
Jörg
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http
Chris Samuel
2018-06-21 10:26:42 UTC
Permalink
Post by Jörg Saßmannshausen
However, given I can go to the login page and given I then get rejected by
the webserver and redirected to another page, I am not quite sure how that
could affect my ability to log in. Something I am missing here?
A web browser will send an HTTP "Host:" header for the website it is looking
for, so perhaps the web app on the BMC will only honour logins where that
matches what it thinks its hostname is (or its IP address).

You could test that by adding the hostname it thinks it has to your /etc/hosts
and then using that hostname to access it. I'd be a little surprised if it
worked, but not too much given the general quality of BMCs...

cheers,
Chris
--
Chris Samuel : http://www.csamuel.org/ : Melbourne, VIC

_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/lis
Jörg Saßmannshausen
2018-06-21 13:57:07 UTC
Permalink
Hi Chris,

ok, you can change the 'hostname' of the BMC in the BIOS, but not in the GUI,
which I found interesting but here you go.
I changed it and I still got the same issue: I can login using the IP address
but not the hostname. Here login, with the correct credentials, will be
refused.
Also, on the host which is running firefox, the hostname and its IP address are
in /etc/hosts and both the forward and backward IP lookup work correctly.

So it was a good idea, but does not solve the problem.

Thanks for your help!

Jörg
Post by Chris Samuel
Post by Jörg Saßmannshausen
However, given I can go to the login page and given I then get rejected by
the webserver and redirected to another page, I am not quite sure how that
could affect my ability to log in. Something I am missing here?
A web browser will send an HTTP "Host:" header for the website it is looking
for, so perhaps the web app on the BMC will only honour logins where that
matches what it thinks its hostname is (or its IP address).
You could test that by adding the hostname it thinks it has to your
/etc/hosts and then using that hostname to access it. I'd be a little
surprised if it worked, but not too much given the general quality of
BMCs...
cheers,
Chris
_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo
Jörg Saßmannshausen
2018-06-21 13:59:36 UTC
Permalink
Hi John,

interesting idea, but how does it work when the IP address has not been set
yet?

Regarding hostname/IP for the GUI: see my email to Chris.

Thanks!

Jörg
It is worth saying that Intel have an excellent free to download tool
called syscfg which lets you set BIOS and IPMI from the command line
To get BIOS settings the same on all nodes on a cluster you just cget the
correct settings on one node, copy this file to all nodes,
syscfg then reboot. Simples.
https://downloadcenter.intel.com/download/26971/Save-and-Restore-System-Conf
iguration-Utility-syscfg-
Regarding your web server problem, is your DHCP server giving the correct
hostnames to the IPMI cards when they request an address?
I do not see how that could matter, but maybe?
Post by Jörg Saßmannshausen
Hi John,
further the last email: I am using the onboard interface for the BMC/IPMI
(shared link) so there is only one physical network cable between the
switch
and the compute node.
Regarding PXE boot: I don't want to boot over IB. Right now I even don't
have
an IB network. I was just wondering whether for some reason at one stage
of
the boot process the kernel recognises the IB card and then tries to boot
from
there and shuts off the other NIC which could explain that behaviour.
However, even disabling it in the BIOS did not solve the problem.
I guess I will need to do some debugging here but without some good ideas
I am
a bit stuck as I already have tried the usual suspects.
All the best
Jörg
Am Donnerstag, 21. Juni 2018, 12:02:40 BST schrieb John Hearns via
Post by John Hearns via Beowulf
Hello Jorg. As you know I have worked a lot with Supermicro machines.
I also installed Intel machines for Greenwich University, so I have
experience of setting up IPMI on them.
I will take time to try to understand your problem!
Also Intel provides excellent documentation for all its products.
Really.
But you must get the correct part number and search for it.
I really recommend finding the BMC manual, as I recall that made things
a
lot clearer.
One quick question - are you using the on-board ethernet interface for
IPMI
Post by John Hearns via Beowulf
or are you using the additional hardware module which has its own
ethernet
Post by John Hearns via Beowulf
port?
It also has a InfiniBand card which does allow booting from it.
You can PXE boot over a Mellanox Infiniband card. As you probably know
this
Post by John Hearns via Beowulf
involves installing extra firmware on the card.
In my last job we had an IB only cluster, so booting over IB had to
work!
I guess you do nto need to flash the card, but to be honest running the
utility is not scary. You just have to get the exact firmware for your
card.
Post by John Hearns via Beowulf
Does the BMC itself know its own hostname?
/tony
Post by Jörg Saßmannshausen
Dear all,
I got a bit of a confusing situation with the BMC of some Intel
motherboards
Post by Jörg Saßmannshausen
which we recently purchased and I am not quite sure what to make out
of
Post by John Hearns via Beowulf
it.
Post by Jörg Saßmannshausen
We have install a generic user via the IPMI commands on the compute
nodes and
Post by Jörg Saßmannshausen
$ ipmitool -H node105-bmc -U username -P xxx power status
$ ipmitool -H 10.0.1.105 -U username -P xxx power status
A nslookup of node105-bmc gives the right IP address as well.
However, if I want to use the GUI for the BMC, i.e. opening my
browser
Post by John Hearns via Beowulf
and
Post by Jörg Saßmannshausen
https://node105-bmc
in the URL, I get the loging page When I enter my login credentials then,
which are the same as above, I have a problem to log in *IF* I am
using
Post by John Hearns via Beowulf
the
Post by Jörg Saßmannshausen
hostname as address but not *IF* I am using the IP address. Just to
add
Post by John Hearns via Beowulf
to the
Post by Jörg Saßmannshausen
confusion more, on one node the hostname was working.
With problems I mean the browser tells me my login credentials are
wrong
Post by John Hearns via Beowulf
which
Post by Jörg Saßmannshausen
does not happen when I am using the IP address.
Also, I can only use https and not http and for now I got the
generic
self
Post by Jörg Saßmannshausen
signed certificates. I want to change them at one point but right
now
that is
Post by Jörg Saßmannshausen
more on the bottom of my to-do list.
I find that really odd and I am not quite sure what is going on
here.
With all
Post by Jörg Saßmannshausen
the Supermicro kit I once had I never had these issues before. I was
able to
Post by Jörg Saßmannshausen
log in regardless of using the hostname or IP address.
So clearly Intel does something here Supermicro did not (at the
time).
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
The boards in question are Intel S2600BPB ones.
Has anybody seen this before?
I got a second issue with these boards. I usually do the normal
PXE/NFS
Post by John Hearns via Beowulf
boot
Post by Jörg Saßmannshausen
and the setup is working well for the other, older Supermicro
machines.
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
However, with the new Intel ones, this is crashing.
The procedure is you are selecting in the boot-menu you want to do a
PXE
Post by John Hearns via Beowulf
boot
Post by Jörg Saßmannshausen
and not boot from the local hard drive.
It then boots the initramfs which seems to be fine. From what I can
see,
Post by John Hearns via Beowulf
both
Post by Jörg Saßmannshausen
during the boot process and from the log files of the DHCP-server,
it is
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
getting the right IP address.
However, when the initramfs hands over to the kernel, it crashes
kernel panic! attempt to kill init
and you literally have to pull the plug on the machine, i.e. a hard
reset.
Post by Jörg Saßmannshausen
The only time I have seen that was when I did not specify the NIC
and
when I
Post by Jörg Saßmannshausen
had two NICs, it somehow decided to use the other one. I fixed that
problem by
Post by Jörg Saßmannshausen
defining the interface in the boot-arguments and also the second NIC
is
Post by John Hearns via Beowulf
not
Post by Jörg Saßmannshausen
connected anyway. It also has a InfiniBand card which does allow
booting
Post by John Hearns via Beowulf
from
Post by Jörg Saßmannshausen
it. Again, it is not connected so in theory it should not matter.
I am stuck here. I am using a 4.x kernel for the PXE boot, so a
fairly
Post by John Hearns via Beowulf
recent
Post by Jörg Saßmannshausen
one. As I said, it works for the older machines but not for the
newer
ones.
Post by Jörg Saßmannshausen
I upgraded the whole PXE/NFS boot and that is not working too.
Does anybody have any ideas here?
Sorry for asking 2 questions in one email but as they are related I
hope
Post by John Hearns via Beowulf
that
Post by Jörg Saßmannshausen
is ok.
All the best from a sunny London
Jörg
_______________________________________________
Computing
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
--
Tony Albers
Systems administrator, IT-development
Royal Danish Library, Victor Albecks Vej 1, 8000 Aarhus C, Denmark.
Tel: +45 2566 2383 / +45 8946 2316
_______________________________________________
Computing
Post by John Hearns via Beowulf
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailma
John Hearns via Beowulf
2018-06-21 14:16:11 UTC
Permalink
Jorg, this is probably veering very off topic.
Intel make available the source code for those BMC cards - which surprised
me.
I saw Redfish mentioned https://www.supermicro.com/solutions/Redfish.cfm
Maybe the Redfish standard makes the cards behave differently to old-style
BMC cards
Post by Jörg Saßmannshausen
Hi John,
interesting idea, but how does it work when the IP address has not been set
yet?
Regarding hostname/IP for the GUI: see my email to Chris.
Thanks!
Jörg
It is worth saying that Intel have an excellent free to download tool
called syscfg which lets you set BIOS and IPMI from the command line
To get BIOS settings the same on all nodes on a cluster you just cget the
correct settings on one node, copy this file to all nodes,
syscfg then reboot. Simples.
https://downloadcenter.intel.com/download/26971/Save-and-
Restore-System-Conf
iguration-Utility-syscfg-
Regarding your web server problem, is your DHCP server giving the correct
hostnames to the IPMI cards when they request an address?
I do not see how that could matter, but maybe?
On 21 June 2018 at 12:29, Jörg Saßmannshausen <
Post by Jörg Saßmannshausen
Hi John,
further the last email: I am using the onboard interface for the
BMC/IPMI
Post by Jörg Saßmannshausen
(shared link) so there is only one physical network cable between the
switch
and the compute node.
Regarding PXE boot: I don't want to boot over IB. Right now I even
don't
Post by Jörg Saßmannshausen
have
an IB network. I was just wondering whether for some reason at one
stage
Post by Jörg Saßmannshausen
of
the boot process the kernel recognises the IB card and then tries to
boot
Post by Jörg Saßmannshausen
from
there and shuts off the other NIC which could explain that behaviour.
However, even disabling it in the BIOS did not solve the problem.
I guess I will need to do some debugging here but without some good
ideas
Post by Jörg Saßmannshausen
I am
a bit stuck as I already have tried the usual suspects.
All the best
Jörg
Am Donnerstag, 21. Juni 2018, 12:02:40 BST schrieb John Hearns via
Post by John Hearns via Beowulf
Hello Jorg. As you know I have worked a lot with Supermicro machines.
I also installed Intel machines for Greenwich University, so I have
experience of setting up IPMI on them.
I will take time to try to understand your problem!
Also Intel provides excellent documentation for all its products.
Really.
But you must get the correct part number and search for it.
I really recommend finding the BMC manual, as I recall that made
things
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
a
lot clearer.
One quick question - are you using the on-board ethernet interface
for
Post by Jörg Saßmannshausen
IPMI
Post by John Hearns via Beowulf
or are you using the additional hardware module which has its own
ethernet
Post by John Hearns via Beowulf
port?
It also has a InfiniBand card which does allow booting from it.
You can PXE boot over a Mellanox Infiniband card. As you probably
know
Post by Jörg Saßmannshausen
this
Post by John Hearns via Beowulf
involves installing extra firmware on the card.
In my last job we had an IB only cluster, so booting over IB had to
work!
I guess you do nto need to flash the card, but to be honest running
the
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
utility is not scary. You just have to get the exact firmware for
your
Post by Jörg Saßmannshausen
card.
Post by John Hearns via Beowulf
Does the BMC itself know its own hostname?
/tony
Post by Jörg Saßmannshausen
Dear all,
I got a bit of a confusing situation with the BMC of some Intel
motherboards
Post by Jörg Saßmannshausen
which we recently purchased and I am not quite sure what to make
out
Post by Jörg Saßmannshausen
of
Post by John Hearns via Beowulf
it.
Post by Jörg Saßmannshausen
We have install a generic user via the IPMI commands on the
compute
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
nodes and
Post by Jörg Saßmannshausen
I can access the BMC remotely, again via the IPMI command like
$ ipmitool -H node105-bmc -U username -P xxx power status
$ ipmitool -H 10.0.1.105 -U username -P xxx power status
A nslookup of node105-bmc gives the right IP address as well.
However, if I want to use the GUI for the BMC, i.e. opening my
browser
Post by John Hearns via Beowulf
and
Post by Jörg Saßmannshausen
https://node105-bmc
in the URL, I get the loging page When I enter my login
credentials
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
then,
which are the same as above, I have a problem to log in *IF* I am
using
Post by John Hearns via Beowulf
the
Post by Jörg Saßmannshausen
hostname as address but not *IF* I am using the IP address. Just
to
Post by Jörg Saßmannshausen
add
Post by John Hearns via Beowulf
to the
Post by Jörg Saßmannshausen
confusion more, on one node the hostname was working.
With problems I mean the browser tells me my login credentials
are
Post by Jörg Saßmannshausen
wrong
Post by John Hearns via Beowulf
which
Post by Jörg Saßmannshausen
does not happen when I am using the IP address.
Also, I can only use https and not http and for now I got the
generic
self
Post by Jörg Saßmannshausen
signed certificates. I want to change them at one point but right
now
that is
Post by Jörg Saßmannshausen
more on the bottom of my to-do list.
I find that really odd and I am not quite sure what is going on
here.
With all
Post by Jörg Saßmannshausen
the Supermicro kit I once had I never had these issues before. I
was
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
able to
Post by Jörg Saßmannshausen
log in regardless of using the hostname or IP address.
So clearly Intel does something here Supermicro did not (at the
time).
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
The boards in question are Intel S2600BPB ones.
Has anybody seen this before?
I got a second issue with these boards. I usually do the normal
PXE/NFS
Post by John Hearns via Beowulf
boot
Post by Jörg Saßmannshausen
and the setup is working well for the other, older Supermicro
machines.
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
However, with the new Intel ones, this is crashing.
The procedure is you are selecting in the boot-menu you want to
do a
Post by Jörg Saßmannshausen
PXE
Post by John Hearns via Beowulf
boot
Post by Jörg Saßmannshausen
and not boot from the local hard drive.
It then boots the initramfs which seems to be fine. From what I
can
Post by Jörg Saßmannshausen
see,
Post by John Hearns via Beowulf
both
Post by Jörg Saßmannshausen
during the boot process and from the log files of the
DHCP-server,
Post by Jörg Saßmannshausen
it is
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
getting the right IP address.
However, when the initramfs hands over to the kernel, it crashes
kernel panic! attempt to kill init
and you literally have to pull the plug on the machine, i.e. a
hard
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
reset.
Post by Jörg Saßmannshausen
The only time I have seen that was when I did not specify the NIC
and
when I
Post by Jörg Saßmannshausen
had two NICs, it somehow decided to use the other one. I fixed
that
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
problem by
Post by Jörg Saßmannshausen
defining the interface in the boot-arguments and also the second
NIC
Post by Jörg Saßmannshausen
is
Post by John Hearns via Beowulf
not
Post by Jörg Saßmannshausen
connected anyway. It also has a InfiniBand card which does allow
booting
Post by John Hearns via Beowulf
from
Post by Jörg Saßmannshausen
it. Again, it is not connected so in theory it should not matter.
I am stuck here. I am using a 4.x kernel for the PXE boot, so a
fairly
Post by John Hearns via Beowulf
recent
Post by Jörg Saßmannshausen
one. As I said, it works for the older machines but not for the
newer
ones.
Post by Jörg Saßmannshausen
I upgraded the whole PXE/NFS boot and that is not working too.
Does anybody have any ideas here?
Sorry for asking 2 questions in one email but as they are
related I
Post by Jörg Saßmannshausen
hope
Post by John Hearns via Beowulf
that
Post by Jörg Saßmannshausen
is ok.
All the best from a sunny London
Jörg
_______________________________________________
Computing
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
--
Tony Albers
Systems administrator, IT-development
Royal Danish Library, Victor Albecks Vej 1, 8000 Aarhus C, Denmark.
Tel: +45 2566 2383 / +45 8946 2316
_______________________________________________
Computing
Post by John Hearns via Beowulf
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
John Hearns via Beowulf
2018-06-21 14:23:49 UTC
Permalink
https://www.thomas-krenn.com/de/wiki/Redfish

For what it is worth, the source code shows the BMC card is running the
lighthttpd web server
The configuration file contains
## where to send error-messages to
server.errorlog = "/tmp/httpd/lighttpd_error.log"
server.breakagelog = "/tmp/httpd/cgi_stderr.log"

Goodness knows how you would find these log files on a BMC card though.
Post by John Hearns via Beowulf
Jorg, this is probably veering very off topic.
Intel make available the source code for those BMC cards - which surprised
me.
I saw Redfish mentioned https://www.supermicro.com/solutions/Redfish.cfm
Maybe the Redfish standard makes the cards behave differently to old-style
BMC cards
On 21 June 2018 at 15:59, Jörg Saßmannshausen <
Post by Jörg Saßmannshausen
Hi John,
interesting idea, but how does it work when the IP address has not been set
yet?
Regarding hostname/IP for the GUI: see my email to Chris.
Thanks!
Jörg
It is worth saying that Intel have an excellent free to download tool
called syscfg which lets you set BIOS and IPMI from the command line
To get BIOS settings the same on all nodes on a cluster you just cget
the
correct settings on one node, copy this file to all nodes,
syscfg then reboot. Simples.
https://downloadcenter.intel.com/download/26971/Save-and-Res
tore-System-Conf
iguration-Utility-syscfg-
Regarding your web server problem, is your DHCP server giving the
correct
hostnames to the IPMI cards when they request an address?
I do not see how that could matter, but maybe?
On 21 June 2018 at 12:29, Jörg Saßmannshausen <
Post by Jörg Saßmannshausen
Hi John,
further the last email: I am using the onboard interface for the
BMC/IPMI
Post by Jörg Saßmannshausen
(shared link) so there is only one physical network cable between the
switch
and the compute node.
Regarding PXE boot: I don't want to boot over IB. Right now I even
don't
Post by Jörg Saßmannshausen
have
an IB network. I was just wondering whether for some reason at one
stage
Post by Jörg Saßmannshausen
of
the boot process the kernel recognises the IB card and then tries to
boot
Post by Jörg Saßmannshausen
from
there and shuts off the other NIC which could explain that behaviour.
However, even disabling it in the BIOS did not solve the problem.
I guess I will need to do some debugging here but without some good
ideas
Post by Jörg Saßmannshausen
I am
a bit stuck as I already have tried the usual suspects.
All the best
Jörg
Am Donnerstag, 21. Juni 2018, 12:02:40 BST schrieb John Hearns via
Post by John Hearns via Beowulf
Hello Jorg. As you know I have worked a lot with Supermicro
machines.
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
I also installed Intel machines for Greenwich University, so I have
experience of setting up IPMI on them.
I will take time to try to understand your problem!
Also Intel provides excellent documentation for all its products.
Really.
But you must get the correct part number and search for it.
I really recommend finding the BMC manual, as I recall that made
things
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
a
lot clearer.
One quick question - are you using the on-board ethernet interface
for
Post by Jörg Saßmannshausen
IPMI
Post by John Hearns via Beowulf
or are you using the additional hardware module which has its own
ethernet
Post by John Hearns via Beowulf
port?
It also has a InfiniBand card which does allow booting from it.
You can PXE boot over a Mellanox Infiniband card. As you probably
know
Post by Jörg Saßmannshausen
this
Post by John Hearns via Beowulf
involves installing extra firmware on the card.
In my last job we had an IB only cluster, so booting over IB had to
work!
I guess you do nto need to flash the card, but to be honest running
the
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
utility is not scary. You just have to get the exact firmware for
your
Post by Jörg Saßmannshausen
card.
Post by John Hearns via Beowulf
Does the BMC itself know its own hostname?
/tony
Post by Jörg Saßmannshausen
Dear all,
I got a bit of a confusing situation with the BMC of some Intel
motherboards
Post by Jörg Saßmannshausen
which we recently purchased and I am not quite sure what to
make out
Post by Jörg Saßmannshausen
of
Post by John Hearns via Beowulf
it.
Post by Jörg Saßmannshausen
We have install a generic user via the IPMI commands on the
compute
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
nodes and
Post by Jörg Saßmannshausen
I can access the BMC remotely, again via the IPMI command like
$ ipmitool -H node105-bmc -U username -P xxx power status
$ ipmitool -H 10.0.1.105 -U username -P xxx power status
A nslookup of node105-bmc gives the right IP address as well.
However, if I want to use the GUI for the BMC, i.e. opening my
browser
Post by John Hearns via Beowulf
and
Post by Jörg Saßmannshausen
https://node105-bmc
in the URL, I get the loging page When I enter my login
credentials
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
then,
which are the same as above, I have a problem to log in *IF* I
am
Post by Jörg Saßmannshausen
using
Post by John Hearns via Beowulf
the
Post by Jörg Saßmannshausen
hostname as address but not *IF* I am using the IP address.
Just to
Post by Jörg Saßmannshausen
add
Post by John Hearns via Beowulf
to the
Post by Jörg Saßmannshausen
confusion more, on one node the hostname was working.
With problems I mean the browser tells me my login credentials
are
Post by Jörg Saßmannshausen
wrong
Post by John Hearns via Beowulf
which
Post by Jörg Saßmannshausen
does not happen when I am using the IP address.
Also, I can only use https and not http and for now I got the
generic
self
Post by Jörg Saßmannshausen
signed certificates. I want to change them at one point but
right
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
now
that is
Post by Jörg Saßmannshausen
more on the bottom of my to-do list.
I find that really odd and I am not quite sure what is going on
here.
With all
Post by Jörg Saßmannshausen
the Supermicro kit I once had I never had these issues before.
I was
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
able to
Post by Jörg Saßmannshausen
log in regardless of using the hostname or IP address.
So clearly Intel does something here Supermicro did not (at the
time).
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
The boards in question are Intel S2600BPB ones.
Has anybody seen this before?
I got a second issue with these boards. I usually do the normal
PXE/NFS
Post by John Hearns via Beowulf
boot
Post by Jörg Saßmannshausen
and the setup is working well for the other, older Supermicro
machines.
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
However, with the new Intel ones, this is crashing.
The procedure is you are selecting in the boot-menu you want to
do a
Post by Jörg Saßmannshausen
PXE
Post by John Hearns via Beowulf
boot
Post by Jörg Saßmannshausen
and not boot from the local hard drive.
It then boots the initramfs which seems to be fine. From what I
can
Post by Jörg Saßmannshausen
see,
Post by John Hearns via Beowulf
both
Post by Jörg Saßmannshausen
during the boot process and from the log files of the
DHCP-server,
Post by Jörg Saßmannshausen
it is
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
getting the right IP address.
However, when the initramfs hands over to the kernel, it crashes
kernel panic! attempt to kill init
and you literally have to pull the plug on the machine, i.e. a
hard
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
reset.
Post by Jörg Saßmannshausen
The only time I have seen that was when I did not specify the
NIC
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
and
when I
Post by Jörg Saßmannshausen
had two NICs, it somehow decided to use the other one. I fixed
that
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
problem by
Post by Jörg Saßmannshausen
defining the interface in the boot-arguments and also the
second NIC
Post by Jörg Saßmannshausen
is
Post by John Hearns via Beowulf
not
Post by Jörg Saßmannshausen
connected anyway. It also has a InfiniBand card which does allow
booting
Post by John Hearns via Beowulf
from
Post by Jörg Saßmannshausen
it. Again, it is not connected so in theory it should not
matter.
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
I am stuck here. I am using a 4.x kernel for the PXE boot, so a
fairly
Post by John Hearns via Beowulf
recent
Post by Jörg Saßmannshausen
one. As I said, it works for the older machines but not for the
newer
ones.
Post by Jörg Saßmannshausen
I upgraded the whole PXE/NFS boot and that is not working too.
Does anybody have any ideas here?
Sorry for asking 2 questions in one email but as they are
related I
Post by Jörg Saßmannshausen
hope
Post by John Hearns via Beowulf
that
Post by Jörg Saßmannshausen
is ok.
All the best from a sunny London
Jörg
_______________________________________________
Computing
Post by John Hearns via Beowulf
Post by Jörg Saßmannshausen
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
--
Tony Albers
Systems administrator, IT-development
Royal Danish Library, Victor Albecks Vej 1, 8000 Aarhus C,
Denmark.
Post by Jörg Saßmannshausen
Post by John Hearns via Beowulf
Tel: +45 2566 2383 / +45 8946 2316
_______________________________________________
Computing
Post by John Hearns via Beowulf
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
_______________________________________________
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf
Prentice Bisbal
2018-06-21 15:09:58 UTC
Permalink
Post by Jörg Saßmannshausen
However, if I want to use the GUI for the BMC, i.e. opening my browser and
https://node105-bmc
in the URL, I get the loging page When I enter my login credentials then,
which are the same as above, I have a problem to log in *IF* I am using the
hostname as address but not *IF* I am using the IP address. Just to add to the
confusion more, on one node the hostname was working.
With problems I mean the browser tells me my login credentials are wrong which
does not happen when I am using the IP address.
Also, I can only use https and not http and for now I got the generic self
signed certificates. I want to change them at one point but right now that is
more on the bottom of my to-do list.
This sounds like some sort of naming issue, reminiscent of not having
NameVirtualHosts setup properly in Apache.

Are the names for any of these hosts in DNS? Not that they should be, or
need to be, but I'm taking a WAG and guessing that if this machine
doesn't have it's own hostname configured, it's doing some sort of
lookup on the hostname and failing. Since it works on that one host, you
can do a hostname lookup and see if that hostname is in DNS for some
reason.

Prentice

_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mail
Peter Kjellström
2018-06-21 15:42:29 UTC
Permalink
On Thu, 21 Jun 2018 10:13:32 +0100
Jörg Saßmannshausen <sassy-***@sassy.formativ.net> wrote:

...
Post by Jörg Saßmannshausen
I got a second issue with these boards. I usually do the normal
PXE/NFS boot and the setup is working well for the other, older
Supermicro machines. However, with the new Intel ones, this is
crashing.
We have a working pxe (ipxe) setup with this motherboard and vanilla
centos-7.4. Shall we start comparing details off-list?

/Peter K
Post by Jörg Saßmannshausen
The procedure is you are selecting in the boot-menu you
want to do a PXE boot and not boot from the local hard drive.
It then boots the initramfs which seems to be fine. From what I can
see, both during the boot process and from the log files of the
DHCP-server, it is getting the right IP address.
kernel panic! attempt to kill init
and you literally have to pull the plug on the machine, i.e. a hard reset.
The only time I have seen that was when I did not specify the NIC and
when I had two NICs, it somehow decided to use the other one. I fixed
that problem by defining the interface in the boot-arguments and also
the second NIC is not connected anyway. It also has a InfiniBand card
which does allow booting from it. Again, it is not connected so in
theory it should not matter.
I am stuck here. I am using a 4.x kernel for the PXE boot, so a
fairly recent one. As I said, it works for the older machines but not
for the newer ones.
I upgraded the whole PXE/NFS boot and that is not working too.
Does anybody have any ideas here?
Sorry for asking 2 questions in one email but as they are related I
hope that is ok.
All the best from a sunny London
Jörg
_______________________________________________
Computing To change your subscription (digest mode or unsubscribe)
visit http://www.beowulf.org/mailman/listinfo/beowulf
_______________________________________________
Beowulf mailing list, ***@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beow
Continue reading on narkive:
Search results for '[Beowulf] Intel motherboard BMC' (Questions and Answers)
3
replies
what is USB and CPU ports?
started 2010-04-11 08:10:31 UTC
desktops
Loading...