White Paper: Trina Bunting Pseries Advanced Technical Support
White Paper: Trina Bunting Pseries Advanced Technical Support
White Paper: Trina Bunting Pseries Advanced Technical Support
Trina Bunting
pSeries Advanced Technical Support
October 2004
Table of Contents
I.
Introduction
Prerequisites
II.
III.
IV.
10
AIX 5L Installation
11
11
12
13
14
16
Limitations
19
V.
VI.
20
20
IX.
22
References
bctrJS20AIX5Linstallwp101504.doc
Page - 2
I.
Introduction
This white paper explains how to install AIX 5L V5.2 (ML4) onto an IBM
BladeCenter JS20 using the following install procedures:
It also covers how to install the prerequisite firmware level required to install AIX 5L as
well as how to backup the JS20.
Prerequisites
The following prerequisites are necessary to install AIX 5L on the JS20:
This document assumes the Serial Over LAN (SOL) feature is already setup on the
BladeCenter. The BladeCenter JS20 Type 8842 Installation and Users Guide describes
how to setup the components needed for SOL functionality. There is also a whitepaper
on JS20 SOL setup called Enabling and Configuring SOL (Serial Over LAN) on an 8842
BladeServer. These documents can be found at http://www307.ibm.com/pc/support/site.wss/product.do?template=/productpage/landingpages/produ
ctPageLandingPage.vm&brandind=8&familyind=157722&machineind=158427&modeli
nd=0&partnumberind=0&subcategoryind=0&doctypeind=8&doccategoryind=0&operati
ngsystemind=49977&validate=true.
bctrJS20AIX5Linstallwp101504.doc
Page - 3
II.
The minimum JS20 firmware level that supports AIX 5L is FW04310120 (or higher).
Older firmware levels must be updated before installing AIX 5L. Version 1.0 BQ8T16A
of the Integrated Systems Management Processor (ISMP) firmware is the minimum
supported level for use with system firmware level FW04310120. Unpredictable results
may be experienced if an older version of ISMP code is installed. This version of ISMP
firmware must be installed before updating the system firmware.
If you have firmware level bFW0419000 or lower, AIX 5L is not supported. If you have
Linux installed, you can update the firmware using the update_flash command. If you
do not have Linux installed, then you will need to install it before you can update
your firmware and load AIX 5L. This should only affect clients that originally ordered
Linux with their JS20 but now want to install AIX 5L. Clients that order AIX 5L with
their JS20 will not have this problem because the firmware will be automatically loaded
by IBM. These clients will be able to install AIX 5L without having to install Linux first.
This firmware can be downloaded via the support Web site at:
http://www-307.ibm.com/pc/support/site.wss/document.do?lndocid=MIGR-55553.
Please refer to the IBM Support Web site at http://www.ibm.com/pc/support/ for the
current version of the JS20 Installation and User's Guide, the Hardware Maintenance
Manual and Troubleshooting Guide.
bctrJS20AIX5Linstallwp101504.doc
Page - 4
For more information on setting up Serial Over LAN, refer to the BladeCenter JS20 Type
8842 Installation and User Guide or a white paper describing JS20 SOL setup, Enabling
and Configuring SOL (Serial Over LAN) on an 8842 Blade Server white paper,
IBM
BladeCenter, BladeCenter JS20.
To start a SOL session telnet (using Windows telnet client or PUTTY [Windows SSH
Client Program]) to the MM, and provide the userid/password, the default is
USERID/PASSW0RD (note: all upper case, with a zero). To bring up a console for a
blade, enter this command at the prompt: console T blade[x] where x is a number 114, indicating which blade in the chassis to select. The SOL session buffers up to 8KB of
data, so when the session is started, any buffered data will scroll past.
To set the environment, so all commands are directed to a specific blade, enter: env T
system:blade[x], where x is a number 1-14. Then one just needs to enter: console, to
start an SOL session on blade x. To terminate an SOL session, press ESC, then shift-9 (a
left parenthesis).
Telnet sessions with the BladeCenter Management Module have a default timeout value
of 120 seconds (2 minutes). If there is no telnet or SOL traffic within the timeout
interval, the telnet session and any SOL session associated with this telnet session will
terminate. To change this value telnet to the MM and type the following at the system
prompt system>:
telnetcfg -T system:mm[x]
env -T system:mm[x]
telnetcfg -t 0
bctrJS20AIX5Linstallwp101504.doc
Page - 5
bctrJS20AIX5Linstallwp101504.doc
Page - 6
NEW FIRMWARE:
5. Your system firmware has been successfully updated to a version that supports
AIX 5L. You may now install AIX 5L.
0>
bctrJS20AIX5Linstallwp101504.doc
Page - 7
chosen-network-type = ethernet,auto,none,auto
server
IP =
0.0.0.0
requested filename =
client
IP =
0.0.0.0
client
HW addr =
0 d 60 1e 9 1d
gateway IP =
0.0.0.0
device
/pci@8000000f8000000/pci@0/ethernet@1,1
loc-code U1234.123.1234567-P1-T7
BOOTP R = 1
FILE: js20-flash
Load Addr=0x0000000000004000, Max Size=0x0000000000bfc000
FINAL Packet Count = 4235
FINAL File Size = 2167840 bytes.
load-base=0x4000
real-base=0xc00000
Elapsed time since release of system processors: 0 mins 50 secs
4. Flash program will start and prompt you if you want to flash, enter y
****************************
* IBM FLASH UPDATE UTILITY *
* JS20BLADE FIRMWARE ONLY *
****************************
CUR FIRMWARE: Tue Mar 23 11:00:14 2004
NEW FIRMWARE:
bctrJS20AIX5Linstallwp101504.doc
Page - 8
The program will ask you if you want to promote the firmware, enter n
DO YOU WANT TO PROMOTE FLASH (y/n): <-- press n here
PRESS ANY KEY TO REBOOT SYSTEM
will reboot.
6. Stop at the Open Firmware prompt and net boot from eth1 again (repeat steps 2 and
3).
To stop at OF prompt, watch for progress code D5BB and press 8 (Note: you only have 5
seconds to press 8
D099
D5BB 5 <-- press 8 here
0 >
0 > boot /pci@8000000f8000000/pci@0/ethernet@1,1 <-- boot from
eth1
7. Verify system booted from new firmware by verifying that Current firmware (CUR)
matches the NEW firmware version. Enter n to the update flash question.
****************************
* IBM FLASH UPDATE UTILITY *
* JS20BLADE FIRMWARE ONLY *
****************************
CUR FIRMWARE:
NEW FIRMWARE:
Your system firmware has been successfully updated to a version that supports
AIX 5L.
bctrJS20AIX5Linstallwp101504.doc
Page - 9
[openprom........]
[FW04310120......]
.......
ibm,fw-bank
5400
ibm,fw-temp-bank
46573034 33313031
363a3039 2c203037
00
ibm,fw-perm-bank
46573034 33313031
363a3039 2c203037
[T...............]
32302c20 31373a31
2f32362f 32303034
[FW04310120, 17:1]
[6:09, 07/26/2004]
[................]
32302c20 31373a31
2f32362f 32303034
[bFW0416000, 12:1]
[1:11, 04/13/2004]
bctrJS20AIX5Linstallwp101504.doc
Page - 10
V.
AIX 5L Installation
There are several ways to install AIX 5L on the JS20. These methods include a manual
installation from CD-ROM, installing using the SMS Menus or performing a network
installation using Network Installation Manager. General information for AIX 5L
installation is available in the AIX 5L Version 5.2 Installation Guide and Reference.
On the SOL console, you should see the bring-up codes scrolling past while the
JS20 initializes.
7. Follow the AIX 5L installation instructions for a New and Complete Overwrite
Installation in the AIX 5L Version 5.2 Installation Guide and Reference.
Note: When installing AIX 5L from a CD-ROM, the installation appears to hang after
installing filesets from Volume 1. At this point, the installation is verifying the installed
filesets, which can take approximately 50 minutes. This is due to the speed of the
CD-ROM in the media tray. The last thing that appears on the screen is:
Validating RPM packages selections . . .
Cdrecord
######################################################
bctrJS20AIX5Linstallwp101504.doc
Page - 11
Mkisofs
######################################################
bctrJS20AIX5Linstallwp101504.doc
Page - 12
bctrJS20AIX5Linstallwp101504.doc
Page - 13
To perform a network install, you will need to configure a NIM master if you do not
already have one configured. For instructions on how to create a NIM master, see
Configuring the NIM Master and Creating Basic Installation Resources.
Note: This procedure requires shutting down and reinstalling the base operating system.
When you reinstall any operating system, schedule your downtime when it least impacts
your workload to protect yourself from a possible loss of data or functionality. Before
you perform a new and complete overwrite installation, ensure you have reliable backups
of your data and any customized applications or volume groups. This procedure also
requires a second Ethernet switch module in slot 2 of the BladeCenter chassis.
bctrJS20AIX5Linstallwp101504.doc
Page - 14
c. Find the JS20 blade that you plan to install and the MAC address that
corresponds to the adapter you will use to perform the installation. Write
this MAC address down.
2. Specify the MAC Address when you define the JS20 blade as a NIM client. If you
are using the smitty nim_mkmac command, specify the MAC address on the
Network Adapter Hardware Address SMIT screen. Do not include the colons (":")
when you are specifying the MAC address. If the client is already defined, you
can change the MAC address with the smitty nim_chmac command.
3. Set up your NIM master to install the JS20 blade, by completing the following
steps:
a. Run the smitty nim_bosinst command.
b. Select the JS20 blade that is defined as your target .
c. Select the type of install that you want to perform and select the
installation resources that you want to use to install the JS20 blade.
You can also prepare the JS20 blade to install using the bos_inst NIM operation
on the command line. For more information on using the bos_inst operation, see
bos_inst.
4. Power off the JS20 blade. If you do not want the JS20 blade to reboot
automatically, set Initiate reboot and installation now? to no in the SMIT
screen and press Enter.
bctrJS20AIX5Linstallwp101504.doc
Page - 15
lsnim -l js20_nim_name
For example, if the JS20 blade was defined as JS20blade1, run the following command:
lsnim -l JS20blade1
Note: If you run the AIX 5L bootlist command to set the IP parameters for a network
adapter and reboot the system, the IP parameters will be stored in NVRAM. When you
reboot the JS20 blade from the MM with the boot sequence set to Network-BOOTP,
the JS20 blade attempts to use the IP parameters stored in NVRAM instead of performing
a broadcast bootp. To perform a broadcast bootp, run the bootlist command specifying
0.0.0.0 for each IP parameter and reboot from AIX 5L using the shutdown -Fr command.
For example, to perform a broadcast bootp over ent1, run the following commands.
# bootlist -m normal ent1 client=0.0.0.0 bserver=0.0.0.0 gateway=0.0.0.0 hdisk0
# shutdown -Fr
If you are unable to log into the AIX 5L system, then follow the instructions for
performing a directed bootp via the Open Firmware prompt, but specify "0.0.0.0" for
each IP address. Once the JS20 blade installs successfully, the boot IP parameters are
reset to "0.0.0.0".
bctrJS20AIX5Linstallwp101504.doc
Page - 16
_______.________.________.________
Name server
_______.________.________.________
Domain Name
Gateway
_______.________.________.________
3. Define the JS20 blade as a NIM client on your NIM master by running the smitty
nim_mkmac command on the NIM master. This command creates a client
definition for your JS20 blade. You can also define the JS20 blade using the
define NIM operation on the command line.
4. If you want to set the JS20 blade's name server and domain name after the
installation, use a resolv_conf resource. For more information on creating a
resolv_conf resource, see resolv_conf Resource.
5. Set up your NIM master to install the JS20 blade, by running the smitty
nim_bosinst command. Select the JS20 blade that you defined earlier as your
target. Then select the type of install that you want to perform and select the
installation resources that you want to use to install the JS20 blade. You can also
prepare the JS20 blade to install using the bos_inst NIM operation on the
command line.
Notes:
a. If the JS20 blade is powered off or has never been installed, set Initiate
reboot and installation now? to no and press enter in the SMIT interface.
b. If the JS20 blade is powered on and running AIX 5L, set Initiate reboot
and installation now? to yes in the SMIT interface. If you choose this
option, a directed bootp is initiated by default and you can skip step 2.
Before you run this command, ensure that the JS20 blade is a registered
NIM client. To do this, run smitty niminit on the JS20 blade. Then specify
the hostname of your NIM master and the interface you want to use for the
installation. You can also initialize the JS20 blade using the niminit
command on the command line.
bctrJS20AIX5Linstallwp101504.doc
Page - 17
5. Select the JS20 blade that you are installing and click Power On Blade.
6. Open a Serial Over LAN connection to the JS20 blade by telnetting into the MM
and running the console command. For example, if the JS20 blade is in slot 3, you
would run the following command:
console -T blade[3]
If you are using ent1, then you would run a command similar to the
following:
boot
/pci@8000000f8000000/pci@0/ethernet@1,1:bootp,192.168.2.10,
,192.168.1.11,192.168.1.1
Note: You must specify the full device path name with this command. To
determine the full path to your device, list the device tree by running the
ls command at the Open Firmware prompt. This command displays
output similar to the following:
0 > ls
000000c87f18: /ibm,serial
000000c88840: /chosen
000000c88a98: /packages
...
000000d31488: /vdevice
000000d327a8:
/vty@0
000000d32f88:
/IBM,sp@4000
000000d33f10:
/rtc@4001
000000d34a18: /pci@8000000f8000000
000000d384d0:
/pci@0
000000d4bbd0:
/ethernet@1
000000d5af50:
/ethernet@1,1
000000d3be00:
/pci@3
000000d6a350:
/usb@0
000000d845f8:
/hub@1
000000d854b8:
/usb@0,1
000000d9f760:
/hub@1
000000d3f798:
/pci@1f
000000d45ed8:
/ide@4,1
000000d47b10:
/disk@0
bctrJS20AIX5Linstallwp101504.doc
Page - 18
The highlighted items are the path to the second ethernet adapter. You
would pass this information to the boot command to initiate a network
boot from the second ethernet adapter
9. After you run the boot command, the network installation begins. Output similar
to the following is displayed on the Serial over LAN connection:
BOOTP: chosen-network-type =
ethernet,auto,none,auto
BOOTP: server
IP =
192.168.2.10
BOOTP: requested filename =
BOOTP: client
IP =
192.168.1.11
BOOTP: client
HW addr =
0 d 60 1e c cb
BOOTP: gateway IP =
192.168.1.1
BOOTP: device
/pci@8000000f8000000/pci@0/ethernet@1,1
BOOTP: loc-code U8842.P1Z.23A0984-P1-T7
BOOTP R = 1
FILE: /tftpboot/js20blade1.austin.ibm.com
Load Addr=0x0000000000004000, Max
Size=0x0000000000bfc000
FINAL Packet Count = 21131
FINAL File Size = 10818623 bytes.
load-base=0x4000
real-base=0xc00000
Elapsed time since release of system
processors: 2 mins 28 secs
VI. Limitations
SOL Restrictions
SOL uses the first (Planar Ethernet 1) network interface of the 8842 Blade Server to
communicate. When this network interface attempts to use bootp, the network interface is
reset. This causes any current SOL session to be dropped and become Not Ready.
Therefore, you must not attempt to configure or use bootp on the first (Planar Ethernet 1)
network interface. If you require bootp, you must use the second (Planar Ethernet 2)
network interface. In order for the second network interface of the 8842 Blade Server to
function, you must also install a supported ESM (Ethernet Switch Module) in I/O Module
Bay 2.
In order for the second network interface of the JS20 Blade Server to function, a
supported ESM (Ethernet Switch Module) must be installed in I/O Module Bay 2. The
first network interface is dedicated for SOL by default, if any attempt is made to
configure it, perform a NIM install or to run on the network, an AIX 5L error will be
returned. By this technical limitation, the SOL and the first network interface are
mutually exclusive. The sol_running ODM attribute is user modifiable to override the
SOL default and enable (Planar Ethernet 1) network interface 1 to use Ethernet but as
bctrJS20AIX5Linstallwp101504.doc
Page - 19
described above. Refer to the Installing Fixes section of this document for more
information.
Media Tray
AIX 5L will not automatically detect the CD-ROM from the media tray when you assign
it to another blade. For example, if you have the CD-ROM from the media tray assigned
to blade #1 then you decide to use it on blade #2, the new blade shows cd0 is in a defined
state. The original blade (blade #1) still shows cd0 as available. You should be able to
run cfgmgr to make cd0 available on blade #2. It will also still show available on blade
#1. You can run rmdev l cd0 to make the device unavailable on blade #1.
bctrJS20AIX5Linstallwp101504.doc
Page - 20
generations of client mksysb. The r flag removes the old mksysb before creating a new
one.
#!/bin/ksh
#
# get_mksysb [-r] [-n] [-m 'machines to get mksysb from']
#
# get mksysb from each client machine specified with -m. If no
# machines specified, get mksysb from ALL machines. -r flag says
# remove oldest existing mksysb for the machines being backed up.
# use -n no_make flag with -r to remove a generation of mksysb,
# without creating a new one.
remove_old=
machine_list=
no_make=
while getopts rnm: option
do
case $option in
r) remove_old=1;;
m) machine_list="$OPTARG";;
n) no_make=1;;
esac
done
# if machine_list is null at this point, set it to ALL clients
if [ -z "$machine_list" ]; then
machine_list=`lsnim -c machines | grep -v master | awk '{print
$1}'`
fi
echo machine list is $machine_list
cd /export/mksysb
for m in $machine_list
do
if [ ! -z "$remove_old" ]; then
echo removing old file / nim resource $(ls -lt $m* | tail 1 | awk '{print
$9}')
nim -o remove $(ls -lt $m* | tail -1 | awk '{print $9}')
rm $(ls -lt $m* | tail -1 | awk '{print $9}')
fi
# if no_make is null, go ahead and make the mksysb
if [ -z "$no_make" ]; then
filename="$m"_`date +%Y%m%d%H%M`
echo new file / nim resource is $filename
echo machine to backup is $m
nim -o define -t mksysb -aserver=master -amk_image=yes \
-alocation=/export/mksysb/$filename \
-asource=$m $filename
fi
done
bctrJS20AIX5Linstallwp101504.doc
Page - 21
IX. References
The following documents are listed on the IBM PC support Web site (http://www307.ibm.com/pc/support/site.wss/product.do?template=/productpage/landingpages/produ
ctPageLandingPage.vm&brandind=8&familyind=157722&machineind=158427&modeli
nd=0&partnumberind=0&subcategoryind=0&doctypeind=8&doccategoryind=0&operati
ngsystemind=49977&validate=true):
1.
2.
3.
4.
bctrJS20AIX5Linstallwp101504.doc
Page - 22
IBM Corporation
Marketing Communications
Systems and Technology Group
Route 100
Somers, New York 10589
Produced in the United States of America
October 2004
All Rights Reserved
This document was developed for products and/or
services offered in the United States. IBM may not
offer the products, features, or services discussed
in this document in other countries.
The information may be subject to change without
notice. Consult your local IBM business contact for
information on the products, features and services
available in your area.
bctrJS20AIX5Linstallwp101504.doc
Page - 23