-- MikeGore - 14 Apr 2011

SuperMicro LOM - IPMI

Relate TWIKI Pages

Other References

Security Notice

  • Warning IPMIview tool stores your cached account/passwords in plain text so be very careful with permissions!
    • Cached account info /opt/SUPERMICRO/IPMIView/.\account.properties
      • Note the funny .\ - you have to escape the \
      • Example: cd */opt/SUPERMICRO/IPMIView/.\\

Access Methods

ILOM utilities - and Firmware

Linux and Windows Software

Direct Download Locations

ASIMOV mirror of SUPERMICRO utilities

  • cd /opt/SUPERMICRO/

Update script on ASIMOV

We can

  • Login as *cscf-adm
  • cd /opt/SUPERMICRO
  • ./download
    • Downloads these sections - listed above under Direct Download Locations
      • /CDR-0010_2.10_IPMI_Server_Managment
      • /CDR-SIMIPMI_1.13_for_SIM_IPMI
      • /utility/IPMIView/

Documents

On ASIMOV

Network Naming and Address assignments for LOM interfaces

IPMI Configuration and setting IP address:

  • It can be done in the BIOS or by software (IPMI tools) and ipmicfg (see below)
  • Connect a LAN cable to the onboard LAN1 port or the dedicated IPMI LAN port.
  • Note 1: If you decide to use the IPMI-dedicated LAN port for your network connections, be sure to connect an RJ45 cable to your dedicated LAN port before you activate the BMC (at first power-on or cold reset). Otherwise, the BMC will look for a shared LAN port to connect to if the IPMI-dedicated LAN cable is not detected upon BMC activation.
  • Note 2: If you you decide later to use the IPMI-dedicated LAN port for a network connection, perform a BMC cold reset or power cycle reset for the dedicated LAN to be detected.

Configuring from BIOS:

  • Press the < Del > key at bootup to enter the BIOS Setup utility.
  • Select Advanced and press to enter the Advanced menu.
A- Enabling COM Port for SOL (IPMI)
  • From the Advanced menu, select Remote Access and press .
  • Make sure that the COM port for SOL (COM2 or COM3) is enabled (marked with "*"). If not, Select the port for SOL and press . (For IPMI to work properly, BIOS will set the console redirection on this port by default.)
B. Enabling All Onboard USB ports
  • From the Advanced menu, select Advanced Chipset Control and press .
  • From the Advanced Chipset Control submenu, select South Bridge Control and press .
  • Make sure that all onboard USB ports are enabled (highlighted). If not, Select USB Functions and press or select the number of onboard USB ports or press to enable all onboard USB ports. (This is required for KVM to work properly.)
C. Configuring IP and MAC Addresses using BIOS
  • From the Advanced menu, select IPMI Configuration and press .
  • From the IPMI Configuration submenu, select Set LAN Configuration and press to set IP address.
To access the Baseboard Management Controller/ILOM (IPMI) install the IPMIView utility (see furhter).

Configuring by software.

Install ipmicfg from SuperMicro

Configure IPMI device settings from the host system running linux

ipmicfg install from ASIMOV

  • sudo bash
  • mkdir -p /opt/SUPERMICRO/IPMICFG
  • cd /opt/SUPERMICRO/
  • rsync -a cscf-adm@asimov:/opt/SUPERMICRO/IPMICFG .
    • Older link: * rsync -a cscf-adm@asimov:/opt/SUPERMICRO/CDR-SIMIPMI_1.13_for_SIM_IPMI/IPMI_Solution/Utility/IPMICFG/Linux/ .

ipmicfg usage

  • Setting static IP address
  • ./ipmicfg-linux.x86_64.static -m (to see the MAC address, copy it and update E & I / DNS)
  • ./ipmicfg-linux.x86_64.static -dhcp off (disable dhcp, will set static IP)
  • ./ipmicfg-linux.x86_64.static -m 172.19.96.xxx
  • ./ipmicfg-linux.x86_64.static -k (Subnet maks should be set automatically to 255.255.255.0)
  • ./ipmicfg-linux.x86_64.static -g 172.19.96.1
  • ./ipmicfg-linux.x86_64.static -r (This will perform a cold reset of the BMC)
    • *Wait few minutes before accessing the BMC. To access the Baseboard Management Controller/ILOM (IPMI) install the IPMIView utility (see furhter). *
  • Help
  • ./ipmicfg-linux.x86_64.static --help
IPMICFG-Linux Version 1.56 (Build 120517) Copyright 2010 Super Micro Computer, Inc.
Usage: IPMICFG-Linux params (Example: IPMICFG-Linux -m 192.168.1.123)
  -m                    Show IP and MAC
  -m IP                 Set IP (format:###.###.###.###)
  -a MAC                Set MAC (format: ##:##:##:##:##:##)
  -k                    Show Subnet Mask
  -k Mask               Set Subnet Mask (format:###.###.###.###)
  -dhcp                 Get the DHCP status
  -dhcp on              Enable the DHCP
  -dhcp off             Disable the DHCP
  -g                    Show Gateway IP
  -g IP                 Set Gateway IP (format:###.###.###.###)
  -dns                  Show DNS Server IP
  -dns IP IP            Set DNS Server1 & Server2 IP (format:###.###.###.###)
  -r                    BMC cold reset
  -garp on              Enable the Gratuitous ARP
  -garp off             Disable the Gratuitous ARP
  -fd                   Reset to the factory default
  -fde                  Reset to the factory default(clear FRU&LAN)
  -ver                  Get Firmware revision
  -vlan                 Get VLAN status
  ...

IPMIView

Note: We simlink *utility/IPMIView to IPMIView

ipmitool - utility for controlling IPMI-enabled devices

  • See IpmiTool - this is an Ubuntu package

IPMI SOL - Serial over LAN IPMI

Documentation

  • *utility/IPMIView/IPMIView20.pdf

ASIMOV Install

Web Access for LOM

  • Requires Windows with IE web browser
  • Open a browser to the lom address, ex: lom-host.cs.uwaterloo.ca
    • Login with cscf-adm account and accept the security notice
    • It will load a Java application - after this you can control power or request a console

IPMI viewing software - SuperMicro LOM

  • The following is for Ubuntu Linux

Manual Download and Install

  • ftp://ftp.supermicro.com/utility/IPMIView/Linux
  • bash ./IPMIView20-Linux_v2.9.3_Build111215.bin
    • install in /opt/SUPERMICRO/IPMIView
    • Create a script: /usr/local/bin/IPMIview - note the small "v"
             #!/bin/bash
             #
             cd /opt/SUPERMICRO/IPMIView
             java -Djava.library.path=/opt/SUPERMICRO/IPMIView -jar /opt/SUPERMICRO/IPMIView/IPMIView20.jar
             
    • chmod 755 /usr/local/bin/IPMIview*
    • change ownership of */opt/SUPERMICRO/IPMIView so you can write to it if required

Using IPMI View

Searching for IPMI devices

  • Under the menu item Session click on the search icon
    • Enter the start and end addresses for the devices you want to access along with the subnet mask
    • After the search save the list - the tool will remember them for next time you use the IPMI tool

IPMI View - Scanning for nodes Example

  • Provides: remote console and power managment of the cluster
  • Notes: See IPMI for Ubuntu Linux utility
  • Head Node: lom-m160.cs
  • Nodes: lom-m160-N.cs
  • Access: cscf-adm - password in safe - 2011
  • Documentation: TWIKI page IPMI
  • Start IPMI View utility
  • All LOM interfaces live on network 172.19.96
    • Start IPMI View Search* using addresses 172.19.96.227 to 172.19.96.246
    • Save the LOM interfaces the utility finds
    • OK to exit
  • Double click on the node you wish to manage - on left hand side under IPMI Domain
  • Login: cscf-adm - password in safe - 2011
  • Open KVM Console
  • Open the Soft Keyboard* so you can send special characters that your local OS may intercept

Accessing an IPMI device

  • Double clicking on a new entry will launch a new tab with your sessions options

IPMI functions

  • Login,Event Log,Sensors,BMC settings,Users,Text Console, KVM Console

Login

  • Enter the userid and password - see password safe
    • Default SuperMicro userid is ADMIN and so is the password - CHANGE THIS

IPM

  • This gives you reset and power control

Users

  • You can create users and change passwords
    • Done forget to change the new users privileges to Administrator if that is your intentions
    • ALWAYS change the default ADMIN users password!

KVM console

  • This gives you console access

Soft Keyboard

  • You will need this when sending certain key sequences that you local OS intercepts!
    • ie F12 - typical BIOS network boot option

Stop ICON

  • Click on tghis to close the IPMI session - useful if you the session gets stuck

Virtual Media

  • CD-ROM image on Windows Share - Example
  • Enter:
    • Share Host: 129.97.15.251
    • Share name: rawiso
    • Path to Image: /linux_utils/RIP/RIP13.7/RIPLinuX-13.7-new.iso
    • User: cscf-adm
    • Password: ....... - see password safe for Windows 2011 or later
  • SET botton to mount
  • Note: you should see the mount summary in the upper left of Virtual Media Status

Utilities and Firmware

Note ALL SuperMicro IPMI utilities and Firmware are copied on AISMOV*

  • ASIMOV /opt/SUPERMICRO/
    • ./download will freshen the download files - only downloads newer files

ILOM integrated on Motherboards

Downloads

Documents
Firmware

ILOM Addon Cards

  • *SIM IPMI WITH KVM-Over-LAN Support: Models: AOC-SIMLP-3+, AOC-SIMLP-B+, AOC-SIMSO+, AOC-SIM1U+, AOC-SIM1U-3B+ AOC-SIMLC+
  • SIM IPMI SIMBL

Downloads

Documents
  • /opt/SUPERMICRO/CDR-SIMIPMI_1.13_for_SIM_IPMI/Manuals

Firmware

Example AOC-SIMLP Add on Card

Firmware and Reset procedure

Documents

  • cd /opt/SUPERMICRO/CDR-SIMIPMI_1.13_for_SIM_IPMI/
  • ./Manuals/Note-SIMLP.pdf
  • ./Manuals/IPMIView20.pdf
  • ./Manuals/AOC-SIMLP.pdf

Firmware Update

  • cd /opt/SUPERMICRO/CDR-SIMIPMI_1.13_for_SIM_IPMI/
  • ./FIRMWARE/load_ipmi_driver.sh
  • ./FIRMWARE/updatefw.x86_64 -f FIRMWARE/ubsim160.bin

Factory Reset

  • cd /opt/SUPERMICRO/CDR-SIMIPMI_1.13_for_SIM_IPMI/IPMI_Solution/Utility/IPMICFG/Linux/
  • rmmod ipmi_devintf ipmi_si ipmi_msghandler
    • *We have to remove modules loaded for firmware flashing *
  • ./ipmicfg-linux.x86_64.static -fd
    • Set to Factory Default
  • RESET TO FACTORY SETTINGS and PASSWORDS
    • Default users is ADMIN, password is ADMIN
    • PLEASE CHANGE PASSWORD and add cscf-adm user
  • Help
    • ./ipmicfg-linux.x86_64.static -help
Topic revision: r17 - 2013-07-24 - MikeGore
Information in this area is meant for use by CSCF staff and is not official documentation, but anybody who is interested is welcome to use it if they find it useful.


Edit

 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2014 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback