iLoIpmiComparison
iLO vs. IPMI
Remote Server Management
Phil Hollenback, www.hollenback.net
Intro
IPMI: Intelligent Platform Management Interface
- Standard interface developed by Intel
 - Supported on servers from many vendors
 This support is often in the form of a separate card attached to motherboard
- Add-on at time of system purchase
 
- Current Version is 2.0, which differs significantly from old (and installed everywhere) v1.5
 
iLO: Integrated Lights Out
- Developed by Compaq many years ago, then enhanced by HP
 - Standard on all 200- and 300- series Proliant Servers
 - Current version is 1.89
 
Both
- Separate management processor inside the system
 As long as system is connected to power this management processor is alive
- In IPMI this is called the Baseboard Management Controller or BMC
 
- Allow remote access when system is turned off or crashed
 
Setup
iLO
- BIOS for basics of net connectivity and access
 Web Interface for everything else
- Requires Java on the client
 
IPMI: varies by vendor.
Typically basic setup performed in BIOS similar to iLO
- network
 - admin user / password
 
Further config via IPMI interface on local machine or on the net
- In linux all access is via IPMITool
 
Security
Users
iLO
- users can be managed in bios
 - users can be managed in web interface (iLO has built-in web server)
 - Can authenticate users via your LDAP server.
 
IPMI
- Admin user can be configured in bios
 - Use ipmitool to add/manage additional users (if needed)
 - No built-in web browser
 - Some vendors (SuperMicro) have added their own proprietary web interfaces
 
Encryption
iLO
- Web interface is via https
 - SSH is enabled by default and user keys can be stored in the iLO.
 
IPMI
- No encryption in v1.5 (big installed base of servers)
 - SSL, etc. in v2.0
 
Network Model
- Old iLO requires separate physical network port on system
 IPMI and new iLO share primary ethernet with first ethernet port
Only first ethernet port
- Can be a problem if your network driver swaps the port order
 
- Both have a separate MAC and IP address on shared port setup
 IPMI v2.0 and recent iLO support vlans
- Segregate server management traffic
 
Server Power Control
Management controller can change power state of system
- hard power down (remove power to system)
 - soft reset (simulate overtemp in ACPI to force system to do an OS shutdown (iLO only)
 - hard reset (interrupt power to system)
 - power on
 
Both examples performed from another system with network connectivity to test machine:
iLO
$ ssh server-ilo-address ... enter password... </>hpiLO-> power power: server power is currently: On </>hpiLO-> power warm ... warm reboot of system...
IPMI
$ ipmitool -I lan -H server-ipmi-address -U admin -a chassis power soft
You can flash the system status led too
- So you can direct someone to find a machine in a rack of similar systems
 
Remote Console
iLO: Ready out of the box
- ssh to iLO address and run command remcons
 - or use java app in web interface
 
You get the exact system console (text only), including bios
Have to configure OS to use text console also
- In Linux add 
console=ttyS1,115200n8 console=tty0 
- In Linux add 
 
IPMI
- Not official part of v1.5 standard
 - Serial Over Lan is supposed to redirect serial console to a proxy server
 Proxy server has to be running on a different system
- Dell proxy server for Linux
 - Then you can telnet to port 623 of that system and it translates the console display from IPMI on other server
 - Upgly hack and I've never seen it work!
 
- Supposedly v2.0 defines a standard console
 - Vendors such as SuperMicro use java and a web server similar to iLO, but not standardized either
 
Sensors
iLO
- Can't see current fan, cpu readings
 - Will alert over snmp or in event log if values go out of spec
 - Will auto-shutdown on thermal failure
 
IPMI
- Direct Access to sensors:
 
$ ipmitool -I lan -H server-ipmi-address -U admin sensor get "Ambient Temp" Password: ...enter bmc admin user password... Sensor ID : Ambient Temp (0x8) Entity ID : 7.1 Sensor Type (Analog) : Temperature Sensor Reading : 21 (+/- -124) degrees C Status : ok Lower Non-Recoverable : na Lower Critical : 3.000 Lower Non-Critical : 8.000 Upper Non-Critical : 42.000 Upper Critical : 47.000 Upper Non-Recoverable : na
Other Alternatives
Serial Console Server
- Very reliable
 - Lots of extra cabling
 - Additonal hardware (console server) required
 - Serial port settings are fiddly
 - But very powerful with conserver
 
VNC / Remote Desktop
- Only works at OS level
 - Gives graphical interface
 - Lots of network traffic
 
Conclusion
- IPMI is the way of the future
 - iLO is being replaced by more powerful iLO 2 (which also uses IPMI) on new servers
 - Server systems will probably all converge on IPMI 3 or something.
 
Further Reading
- iLO at HP: http://h18000.www1.hp.com/products/servers/management/ilo/index.html
 - IPMI Spec: http://developer.intel.com/design/servers/ipmi/
 - IPMITool for Linux: http://ipmitool.sourceforge.net
 - Conserver: http://www.conserver.com
 - Dell proxy server for Linux: http://lists.us.dell.com/pipermail/linux-poweredge/2005-December/023974.html
 - Managing Dell Servers with IPMI: http://www.dell.com/downloads/global/power/ps4q04-20040204-Murphy.pdf
 - Optimizing Console Redirection: http://www.dell.com/downloads/global/power/ps4q05-20040205-Hoke-OE.pdf
 - This Page: http://www.hollenback.net/index.php/iLoIpmiComparison
 

