Managing Your pSeries Server

AIX Network Installation Management Steve Knudson [email protected] August 8, 2005

NIM Configuration
pSeries Advanced Technical Support

Setting up NIM Master

Why NIM? Typical Directory Structure, filesets for NIM master Initial Master Config - smitty nim Making the lppsource Making the spot Making a minimal mksysb image Or, nim_master_setup the easy way

Enabling Client Installs

Define Client Machine Define optional bosinst_data resource Define optional image_data resource Define optional script resource Prepare for Client Install - smitty nim_bosinst

Client Network Boot

Why NIM?
pSeries Advanced Technical Support

An LPAR machine - How to handle different AIX images, each in an LPAR? Install devices (CD, tape) not present in every LPAR, not elegant or convenient to move them from LPAR to LPAR (also a negative in the event of emergency restore) NIM the long standard convention for installing nodes in SP Reasonable for one LPAR to be NIM server to other LPARs Or standalone NIM master can be on same or different subnet as LPARs TSM Sysback also available for AIX 5L, an alternative or wrapper to NIM NIM standard part of AIX, no additional charge

Typical Directory Structure, filesets for NIM master

pSeries Advanced Technical Support

/export/53 lppsource_53ML2 spot_53ML2 (don't create this one - it will be created for you) /export/mksysb /export/res Install these filesets on NIM master, and reboot bos.net.tcp.server bos.net.nfs.server bos.sysmgt.nim.master bos.sysmgt.nim.spot (aside: in older versions of AIX, the mksysb image to install on clients could not contain nim master and spot filesets. Alleviated at 433 and later.)

Typical Directory Structure, filesets for NIM master

pSeries Advanced Technical Support

lppsource directory to hold installp images from AIX 53 install CDs approx 5 GB spot - shared product object tree - an installed copy of the /usr filesystem (clients use command from here during install process). Built from images in the lppsource approx 600 MB /export/mksysb directory for the mksysb image files to install on clients approx 1.5 GB per image res directory for miscellaneous resources; optional, bosinst_data, image_data, or scripts

Initial Master Config - smitty nim

pSeries Advanced Technical Support
smitty nim / Configure the NIM Environment / Advanced Configuration / Initialize the NIM Master Only Configure Network Installation Management Master Fileset Type or select values in entry fields. Press Enter AFTER making all desired changes. [Entry Fields] [ether_9_19_126] [en0] [yes] +

* Network Name * Primary Network Install Interface Allow Machines to Register Themselves as Clients? Alternate Port Numbers for Network Communications (reserved values will be used if left blank) Client Registration Client Communications

[] []

# #

Initial Master Config - smitty nim

pSeries Advanced Technical Support

Network name - any name you choose. Perhaps you include the subnet address in the name, e.g., Ether_9_19_126 Network Install Interface - e.g., en0 Allow machines to Register Themselves - yes

Making the lppsource

pSeries Advanced Technical Support

smitty bffcreate
Copy Software to Hard Disk for Future Installation Type or select values in entry fields. Press Enter AFTER making all desired changes. [Entry Fields] /dev/cd0 [all] + [/export/53/lppsource_53ML2] [/tmp] yes + yes

* INPUT device / directory for software * SOFTWARE package to copy * DIRECTORY for storing software package DIRECTORY for temporary storage during copying EXTEND file systems if space needed? Process multiple volumes?

Making the lppsource

pSeries Advanced Technical Support
To save space in lppsource, after spinning all CDs, you might: cd /export/53/lppsource_53ML2/installp/ppc rm OpenGL.* rm PEX_PHIGS* mkdir save mv *[Ee][Nn]_[Uu][Ss]* save rm various language help, msg, loc, html filesets mv save/* . inutoc . Also a means to trim lppsource: Define the lppsource, then use the lppmgr operation on it

Making the lppsource

pSeries Advanced Technical Support
Create an LPP_SOURCE Type or select values in entry fields. Press Enter AFTER making all desired changes. [Entry Fields] master []

mitty nim / Configure the NIM Environment / Advanced Configuration / Create Basic Installation Resources / Create a New LPP_SOURCE

* Resource SERVER Input device for installation images (specify the device on the resource server) * LPP_SOURCE Name * LPP_SOURCE Directory Architecture of Resource Create new filesystem for LPP_SOURCE? Filesystem SIZE (MB) VOLUME GROUP for new filesystem Remove all newly added NIM definitions and filesystems if any part of this operation fails?

[lppsource_53ML2] [/export/53/lppsource_53ML2]+ [] + [no] + [650] # [rootvg] + [no] +

Making the lppsource

pSeries Advanced Technical Support
LPP_SOURCE Name - NIM does not like dot in resource names, use underbar LPP_SOURCE Directory - the directory you bffcreated the install CDs into Create new filesystem for LPP_SOURCE? [no] - (you already have it in /export/53, and you created a directory lppsource_53ML2) backspace over the Filesystem size and volume group fields; blank them out

Making the spot

pSeries Advanced Technical Support
smitty nim / Configure the NIM Environment / Advanced Configuration / Create Basic Installation Resources / Create a New SPOT

Create a SPOT Type or select values in entry fields. Press Enter AFTER making all desired changes. [Entry Fields] master [lppsource_53ML2] [spot_53ML2] [/export/53] [no] [350] [rootvg] [no]

* Resource SERVER * Input device for installation images (specify the device on the resource server) * SPOT Name * SPOT Directory Create new filesystem for SPOT? Filesystem SIZE (MB) VOLUME GROUP for new filesystem Remove all newly added NIM definitions and filesystems if any part of this operation fails?

+ + # + +

Making the spot

pSeries Advanced Technical Support
Input device - use F4 to select the lppsource just created as input device SPOT name - any name you choose, e.g., spot_53ML2 SPOT directory - spot_53ML2 directory will be created in /export/53 Create new filesystem for SPOT? [no] (put it in the /export/53 filesystem that already exists)

backspace over the Filesystem size and volume group fields; blank them out

Making a minimal mksysb image

pSeries Advanced Technical Support

Build up a particular nim client as desired

Install any additional filesets desired
bos.sysmgt.nim.client (should already be installed on pre-loaded machines) bos.adt.samples bos.alt_disk_install.boot_images, bos.alt_disk_install.rte bos.content_list bos.perf.tools, bos.perf.libperfstat, perfagent.tools, perfagent.server if licensed

Set root password, relevant root .profile content

set

-o vi export PS1='`whoami`@`hostname` "$PWD" >' chmod u+x /.profile

Other misc changes on client

edit

/etc/exclude.rootvg, insert /smit.log, /smit.script, others

errclear 0 cd /var/adm/ras ; >nim.script ; >suma.log ; >bootlog ; >nimlog ; \ >conslog ; >nimsh.log ; >bosinstlog ; >devinst.log ; >nim.installp

Set autorestart to true, and cpuguard to enable:

chdev

-l sys0 -a autorestart=true -a cpuguard=enable

At the client, Register with the nim master

smitty

niminit, point at nim master to register on

Making a minimal mksysb image (cont.)

pSeries Advanced Technical Support

Back on the NIM master...

Point at the nim client (just registered) and pull mksysb image from it
smitty nim/ Perform NIM Administration Tasks / Manage Resources / Define a Resource / select mksysb
* * * * Resource Name Resource Type Server of Resource Location of Resource Comments Source for Replication -ORSystem Backup Image Creation Options: CREATE system backup image? NIM CLIENT to backup PREVIEW only? IGNORE space requirements? EXPAND /tmp if needed? Create MAP files? Number of BLOCKS to write in a single output (leave blank to use system default) Use local EXCLUDE file? (specify no to include all files in backup) -OREXCLUDE_FILES resource (leave blank to include all files in backup) [minimal_53ML2] mksysb [master] + [/export/mksysb/minimal_53ML2] / [] [] +

yes [nimclientname] no no no no [] yes []

+ + + + + + # + +

NIM Master setup the easy way

pSeries Advanced Technical Support
Preloaded machine includes bos.sysmgt.nim.client, which includes /usr/sbin/nim_master_setup script. With CD number 1 in drive, nim_master_setup -a file_system=/export -a volume_group=nimvg \ -a disk='hdisk16 hdisk19'
installs bos.sysmgt.nim.master bos.sysmgt.nim.spot makes a mksysb image does initial master config lsnim command shows the following nim resources configured:
root@master / # lsnim master machines boot resources nim_script resources master_net networks generic_sysb resources resolv_res resources bid_tty_ow resources bid_lft_ow resources 530lpp_res resources 530spot_res resources basic_res_grp groups master boot nim_script ent mksysb resolv_conf bosinst_data bosinst_data lpp_source spot res_group

NIM Master setup the easy way (cont.)

pSeries Advanced Technical Support
That was so easy, why do it the hard way?
lppsource created from all 8 CDs has more comprehensive content (bos.alt_disk_install.rte, perfagent.tools, for example) you get to control the naming of resources But if you only have a half day to make an impression, think nim_master_setup

pSeries Advanced Technical Support

your notes here:

NIM Configuration
pSeries Advanced Technical Support

Setting up NIM Master

Why NIM? Typical Directory Structure, filesets for NIM master Initial Master Config - smitty nim Making the lppsource Making the spot Making a minimal mksysb image Or, nim_master_setup the easy way

Enabling Client Installs

Define Client Machine Define optional bosinst_data resource Define optional image_data resource Define optional script resource Prepare for Client Install - smitty nim_bosinst

Client Network Boot

Define Client Machine

pSeries Advanced Technical Support
smitty nim / Perform NIM Administration Tasks / Manage Machines / Define a Machine Define a Machine Type or select values in entry fields. Press Enter AFTER making all desired changes. [Entry Fields] [regatta00] [standalone] [chrp] [mp] tp ether_9_19_126 regatta00 [0] [ent0] [] [] [] []

* NIM Machine Name * Machine Type * Hardware Platform Type Kernel to use for Network Boot Primary Network Install Interface * Cable Type * NIM Network * Host Name Network Adapter Hardware Address Network Adapter Logical Device Name IPL ROM Emulation Device CPU Id Machine Group Comments

+ + + +

+/ +

Define Client Machine

pSeries Advanced Technical Support
Hardware Platform Type - set to chrp, not rs6k or rspc Kernel to use for Network Boot - set to mp (AIX 5.3 discontinued shipment of up kernel 5.3 ships only MP 32bit or MP 64bit) Cable Type - most likely tp, not bnc or dix Network Adapter Hardware Address - optional field
more flexible to specify IP parameters on SMS menus during nim client boot. You must specify IP parameters if nim client and nim master are on different IP subnets

Network Adapter Logical Device name - optional field - note this is an adapter name (entx) not an interface name (not enx or etx) Earlier, when configuring the server, we allowed machines to register themselves. A running AIX instance (machine or LPAR) can become a client, can define itself to this server, by doing a smitty niminit.

Define optional bosinst_data resource

copy template file from spot to the /export/res, and modify as desired cp /export/53/spot_53ML2/usr/lpp/bosinst/bosinst.template /export/res/bosinst.template.53ML2 cp /export/res/bosinst.template.53ML2 bosinst.regatta00.53ML2 Specify things like
CONSOLE = /dev/tty0 INSTALL_METHOD = overwrite or migrate (never found any use for "preservation") PROMPT = no (if you specify no prompt, you must include target_disk_data stanzas) BOSINST_DEBUG = no (yes if you have to - you'll need a thinkpad running hyperterm on serial connection to /dev/tty0 to capture the scrolling debug output
# target_disk_data: # PVID = <physical volume identifier> # SAN_DISKID = <ww_name//lun_id> # CONNECTION = <parent//connwhere> # LOCATION = # SIZE_MB = # HDISKNAME =

pSeries Advanced Technical Support

<--- (should be able to get this from SMS - Display Configuration - lets try in the lab)

Specify one type, AIX Location code for Power4 clients, PHYSLOC for Power5 clients
target_disk_data: LOCATION = 4M-08-00-8,0 target_disk_data: PHYSICAL_LOCATION = U7311.D20.10575EA-P1-C06-T1-L12-L0

Avoid using HDISKNAME! These can move around, and you might (sooner or later will) be sorry!

Define optional bosinst_data resource

pSeries Advanced Technical Support
smitty nim / perform NIM adminstration tasks / Manage Resources / Define a Resource / bosinst_data

Define a Resource Type or select values in entry fields. Press Enter AFTER making all desired changes. [Entry Fields] [bosinst_regatta00_53ML2] bosinst_data [master] + [/export/res/bosinst.regatta00.53ML2] [] []

* * * *

Resource Name Resource Type Server of Resource Location of Resource Comments Source for Replication

Resource Name - your choice (again, no dots) Server of Resource - specify master Location of Resource - full path name to the file - typically, a NIM "resource" is a pointer to a file You can modify the underlying file before or after the NIM resource is defined on it

Define optional image_data resource

pSeries Advanced Technical Support
Template file is <spot>/usr/lpp/bosinst/image.template. Copy to /export/res, and modify to taste, or retrieve the /image.data file from the original minimal mksysb image. This will have accurate sizes for all LVs in the minimal mksysb Specify things like logical volume policy
SHRINK=no EXACT_FIT=no

lv_data: (for each logical volume in rootvg)

COPIES= 1 ( or 2, 3 to mirror. make sure you have enough target disk stanzas in the bosinst_data resource) LPs= nn (the number of logical partitions) PP= nn (if mirroring, this is an exact 2x or 3x of LPs)

fs_data: (haven't ever needed to modify an fs_data stanza) IF you don't specify an image_data resource, NIM will use the file embedded in the mksysb image. Typical use of a "side" image.data file is when mksysb is mirrored, but the new install is to be nonmirrored, or vice-versa.

Define optional image_data resource

pSeries Advanced Technical Support
smitty nim / perform NIM adminstration tasks / Manage Resources / Define a Resource / image_data

Define a Resource Type or select values in entry fields. Press Enter AFTER making all desired changes. [Entry Fields] [image_data_minimal_53ML2] image_data [master] + [/export/res/image.data.minimal.53ML2] [] []

* * * *

Resource Name Resource Type Server of Resource Location of Resource Comments Source for Replication

Resource Name - you might want a name that resembles the mksysb image it works with Server of Resource - specify master Location of Resource - full path name to the file - typically, a NIM "resource" is a pointer to a file You can modify the underlying file before or after the NIM resource is defined on it

Define optional script resource

pSeries Advanced Technical Support

script can be defined as NIM resource two types of script resources script - runs at the end of the client install process fb_script - runs after the client install completes, after first reboot. Some things should not be done during the client process; e.g., if you are changing IP config of the client, do that in a fb_script. fb_scripts are placed on the client in /etc/firstboot, to be run by the fbcheck entry in /etc/inittab when the client reboots

optional script resource

pSeries Advanced Technical Support
smitty nim / perform NIM adminstration tasks / Manage Resources / Define a Resource / script

Define a Resource Type or select values in entry fields. Press Enter AFTER making all desired changes. [Entry Fields] [my_nim_script] script [master] + [/export/res/my.nim.script] [] []

* * * *

Resource Name Resource Type Server of Resource Location of Resource Comments Source for Replication

You know the drill...

Prepare for Client Install

pSeries Advanced Technical Support
smitty nim_bosinst / select target machine / Select Installation Type - mksysb / select the mksysb resource to use / select the SPOT to use / select the LPP_SOURCE to use
Install the Base Operating System on Standalone Clients Type or select values in entry fields. Press Enter AFTER making all desired changes. [TOP] * Installation Target * Installation TYPE * SPOT * LPP_SOURCE MKSYSB BOSINST_DATA to use during installation IMAGE_DATA to use during installation RESOLV_CONF to use for network configuration Customization SCRIPT to run after installation ACCEPT new license agreements? Remain NIM client after install? PRESERVE NIM definitions for resources on [Entry Fields] regatta00 mksysb spot_53ML2 lppsource_53ML2 minimal_53ML2 [] [] [] [] [yes] [yes] [yes] + + + + + +

Prepare for Client Install

pSeries Advanced Technical Support
this target? FORCE PUSH the installation? Initiate reboot and installation now? -ORSet bootlist for installation at the next reboot? Additional BUNDLES to install -ORAdditional FILESETS to install (and 21 more lines that I usually ignore) [no] [no] [no] + + +

[] []

BOSINST_DATA, IMAGE_DATA, SCRIPT are files that can be defined as NIM resources optionally to be included in installs. ACCEPT new license agreements? tab it to yes both places on panel, don't hold up my install Remain NIM client after install? - leave set to yes, or the client install process will not finish correctly Initiate reboot and installation now? - tab to no, can't do a reboot on an LPAR that isn't running

Prepare for Client Install

pSeries Advanced Technical Support
Before doing smitty nim_bosinst, unexport any of the NIM directory structure you have exported by hand. When smitty nim_bosinst completes, take a look at resources made available from server to client
showmount -e export list for wlm: /export/images/minimal_53ML2 /export/53/lppsource_53ML2/installp/ppc /export/53/spot_53ML2/usr

regatta00.dsc.ibm.com regatta00.dsc.ibm.com regatta00.dsc.ibm.com

If using bosinst_data, image_data, or other NIM resources, additional exports appear in the showmount output
ls -la /tftpboot drwxrwxr-x 2 root drwxr-xr-x 20 root -rw-r--r-1 root lrwxrwxrwx 1 root -rw-r--r-1 root system system system system system 512 1024 7774079 32 1018 Oct Oct Sep Oct Oct 01 01 18 01 01 16:25 14:48 16:01 15:21 15:21 . .. spot_53ML2.chrp.mp.ent regatta00.dsc.ibm.com -> /tftpboot/spot_53ML2.chrp.mp.ent regatta00.dsc.ibm.com.info

Prepare for Client Install

pSeries Advanced Technical Support
After smitty nim_bosinst, you can also check the status of the machine, and other NIM resources:
lsnim -l regatta00 wlm / # lsnim -l regatta00 regatta00: class = machines type = standalone platform = chrp netboot_kernel = mp if1 = ether0 regatta00 0004ac7cdb89 cable_type1 = tp Cstate = BOS installation has been enabled prev_state = ready for a NIM operation Mstate = not running boot = boot lpp_source = lppsource_53ML2 mksysb = minimal_53ML2 nim_script = nim_script spot = spot_53ML2 control = master

lsnim -l lppsource_53ML2 lppsource_53ML2: class = resources type = lpp_source Rstate = ready for use prev_state = unavailable for use location = /export/53/lppsource_53 simages = yes alloc_count = 1 server = master arch = chrp

Prepare for Client Install

pSeries Advanced Technical Support
With each machine you enable for install, alloc_count increases for various NIM resources If you have a machine enabled for install, and need to back out...
nim -o reset -aforce=yes <nimclienthostname> nim -Fo deallocate -asubclass=all <nimclienthostname> nim -o change -a cpuid="" <nimclienthostname>

Client Network Boot

pSeries Advanced Technical Support

Boot client machine (LPAR) to SMS

LED E1F1, and "keyboard" word prompt on console, hit number 1(or Partition Profile may already stop at SMS)

Select Boot device, set IP parameters Exit from SMS, allow boot from Ethernet Adapter bootp request / reply, tftp of boot image from NIM master to Client network install of OS over NFS

Set IP Parameters
pSeries Advanced Technical Support
On HMC, profile / properties / Other / Boot mode SMS, activate, open terminal window Select 3, Remote Initial Program Load Setup

Version RH012222B d11_e07 (c) Copyright IBM Corp/ 1997 All rights reserved. ----------------------------------------------------------------------------------Utilities 1 2 3 4 5 6 7 8 Password Utilities NOT available in LPAR mode Display Error Log Remote Initial Program Load Setup SCSI Utilities Select Console NOT available in LPAR mode MultiBoot Select Language OK Prompt

.------. |X=Exit| `------' ===>

Set IP Parameters
pSeries Advanced Technical Support
set IP Parameters ( NIM client IP, Nim master IP, Gateway IP addresses, nim client netmask) set Adapter Parameters (Ethernet speed and full-duplex yes or no) test ping if desired X back to Utilites Menu
Version RH012222B d11_e07 (c) Copyright IBM Corp/ 1997 All rights reserved. ----------------------------------------------------------------------------------Network Paramters 1 IP Parameters 2 Adapter Parameters 3 Ping

.------. |X=Exit| `------' ===>

Boot client machine (LPAR) to SMS

pSeries Advanced Technical Support
Choose 6 MultiBoot
Version RH012222B d11_e07 (c) Copyright IBM Corp/ 1997 All rights reserved. ----------------------------------------------------------------------------------Utilities 1 2 3 4 5 6 7 8 Password Utilities NOT available in LPAR mode Display Error Log Remote Initial Program Load Setup SCSI Utilities Select Console NOT available in LPAR mode MultiBoot Select Language OK Prompt

.------. |X=Exit| `------' ===>

Select Boot Device

pSeries Advanced Technical Support
Choose 4, then Configure 1st Boot Device, (Ethernet adapter specified earlier in Remote Initial Program Load Setup) , and X X X back to Utilities Menu
Version RH012222B d11_e07 (c) Copyright IBM Corp/ 1997 All rights reserved. ----------------------------------------------------------------------------------MultiBoot 1 2 3 4 5 6 Select Software Software Default Select Install Device Select Boot Devices OK Prompt MultiBoot Startup <OFF>

.------. |X=Exit| `------' ===>

BOOTP request/reply, tftpboot

pSeries Advanced Technical Support
Starting Software Please Wait...

PING: waiting 30 seconds for 10/100 Ethernet Switch to connect... (might actually say wait 60 sec) BOOTP S = 2 File: /tftpboot/regatta00.dsc.ibm.com Load Addr=0x4000 Max Size=0xbfc000 FINAL Packet count = 15184 FINAL File Size = 7774079 bytes.

Welcome to AIX...

At NIM master, to see traffic to and from client:

tcpdump -I -i en0 port bootps tcpdump -I -i en0 host <clienthostname> and port `rpcinfo -p |grep nfs |grep tcp |tail -1 \ | awk '{print $4}'`

Network Install
pSeries Advanced Technical Support
Installing Base Operating System If you used the system key to select SERVICE mode, turn the system key to the NORMAL position any time before the installation ends.

Please wait...

Approximate % tasks complete

Elapsed time (in minutes)

14

16% of mksysb data restored

At nim master, see this status from client console - lsnim -l regatta00

Miscellaneous Reference
pSeries Advanced Technical Support
Drive NIM thru Websm
On pSeries machine
Install

webserver (apache, IBM HTTPServer, etc) Install websm /usr/websm/bin/wsmserver -enable (sets up port 9090 for websm)

On Windows PC
point

browser at http://pSeries.fulldomain.com/pc_client/pc_client.html Java applet downloads and installs "Web-Based System Manager PC Client" application launch PC client application, login to any Websm installed pSeries machine, not just the one you installed from Version sensitive - if you upgrade websm on pSeries, plan to uninstall the PC Client app, and reinstall it from the updated pSeries machine
hmc.fulldomain.com

router pseries.fulldomain.com

Most recently, Windows PC can pull websm PC client from any Power4 or Power5 HMC on the network. You need not configure HTTPServer on AIX. Point PC browser at

Miscellaneous Reference
pSeries Advanced Technical Support
General guidelines (best practices?) for maintaining nim clients, nim master
Keep the SPOT and lppsource up to date with the APARS applied to the machines they are to be allocated to during a mksysb restore. Example: When APAR IY12345 is applied to node machine1, the lppsource used to restore machine1 should be updated with the APAR as well if it does not already contain the filesets. The SPOT should be updated as well. nim Fo check commands should be run against the resources as a standard health check after the updates. A generic "untouchable" SPOT and lppsource should be kept on the NIM master as launching points for creating new SPOTS and lppsources. These should be at a consistent maintenance level as close as possible to the level of the mksysbs being served out. These resources are not there to be used to serve out mksysbs but rather as catalysts for problem determination and to help recover from corrupt lppsources or SPOTs. These resources should not be updated themselves but rather copies should be made and the copies should be updated. This saves time during debugging and rebuilding of SPOTs and lppsources as creating the base lppsource and SPOT are extremely time intensive. Try to keep the levels of the mksysbs machines being served by a given SPOT and lppsource at consistent levels. This helps insure consistent, compatible code content between mksysb image, SPOT and lppsource. Example: machine1 and machine2 are at 433 ML-06 machine3 and machine4 are at 432 ML-01. It is recommended that machine1 and machine2 share a SPOT and lppsource at 433 ML-06 and that machine3 and machine4 share a SPOT and lppsource at 432 ML-01. For the best results, the SPOTs and lppsources should be at the same level or higher than the mksysb image being installed.

Miscellaneous Reference
pSeries Advanced Technical Support
General guidelines (best practices?) for maintaining nim clients, nim master
The NIM master should be at the same level or higher than the highest level of mksysb it is serving. In the above example, the machine serving the lppsource and SPOT should be at the 433-07ML or greater. For a true disaster recovery scenario, a test machine should be installed with whatever mksysb image, lppsource and SPOT are to be used to restore a given machine. It is the best way to be comfortable that a mksysb image is restorable.

Miscellaneous Reference
pSeries Advanced Technical Support
Useful Commands
lsnim lsnim -l <machinename>
# lsnim -l nim6 nim6: class type platform netboot_kernel if1 cable_type1 Cstate prev_state Mstate boot bosinst_data installp_bundle lpp_source mksysb nim_script script spot cpuid control = = = = = = = = = = = = = = = = = = = machines standalone chrp up ethernet0 nim6 000629DC8443 ent1 tp BOS installation has been enabled ready for a NIM operation currently running boot bosinst_initial bundle_gnu lppsource_aix433 mksysb_minimal nim_script itab_mkmaster spot_aix433 000F252D4C00 master

Miscellaneous Reference
pSeries Advanced Technical Support
Useful Commands
To reset an NIM client machine, remove a NIM client definition nim -o reset -aforce=yes clientnode nim -Fo deallocate -asubclass=all clientnode nim -o change -a cpuid="" clientnode nim -o remove clientnode To check / set the bootlist on a running machine bootlist -m normal -o (check) bootlist -m normal ent0 (set first boot device to ent0 adapter) To check levels of AIX installed on any machine: oslevel instfix -i |grep ML To see what you lack from a given maintenance level instfix -icqk 5300-02_AIX_ML | grep ":-:" To check nfs exports from NIM master to the client for install: showmount -e To check for correct linking of bootimage for client, info file for client: ls -la /tftpboot

Miscellaneous Reference
pSeries Advanced Technical Support
Troubleshooting NIM
BOOTP S = 1 FILE: /tftpboot/clientname BOOTP: read-first-block failed:0 message - We have seen the bootp request from client to master, and reply from master to client. The client also knows the boot image file name coming from the master. But the tftp of that boot image to the client is failing. We reviewed ip and nic settings on the client, stopped and restarted tftp service on the master. Ultimately, rebooting the nim master resolved this problem. Problem was resolved on another experience by stopping and restarting tftpd on the nim master: stopsrc -s tftpd lssrc -s tftpd (verify daemon is inoperative) startsrc -s tftpd This problem has also been observed in a situation where nim master was originally setup on a subnet that was not routable within the customer enterprise. Even after putting another interface of nim master on a routable subnet, the info file built for client in the bosinst operation still gives an unroutable address for the nim master. bootp succeeds, but tftp of the boot image fails. Support has a chancy document to mofidy the configuration of if1 on the master to remedy this. Might be easier to just nim -o unconfig master, then reconfigure master on the routable subnet.

Miscellaneous Reference
pSeries Advanced Technical Support
Client hangs at LED 0611 - Indicates that some nfs resource that should be exported from the nim master is not available to the nim client. Mostly likely cause is that a parent directory was already exported to the client. the nim_bosinst process doesn't always give errors when starting off this way. Check exports on the server, they should look something like this: # exportfs /export/aix433/images/mksysb.minimal -ro,root=nim6:,access=nim6: /export/aix433/lppsource -ro,root=nim6:,access=nim6: /export/aix433/spot/spot_aix433/usr -ro,root=nim6:,access=nim6: /export/aix433/res/bundle.gnu -ro,root=nim6:,access=nim6: /export/aix433/res/itab.mkmaster -ro,root=nim6:,access=nim6: /export/aix433/res/bosinst.initial.B50 -ro,root=nim6:,access=nim6: /export/nim/scripts/nim6.script -ro,root=nim6:,access=nim6: If the exports are substantially different from these, then you can also get this led 611 when nim power off client node master resolves client on the nim master: hostnames in /etc/hosts. nim -o reset -aforce=yes clientnode Entries there should be nim -Fo deallocate -asubclass=all clientnode ipaddr fullyqualifiedname shortname exportfs -ua edit /etc/exports, remove inappropriate entries nim_bosinst the client node again

Miscellaneous Reference
pSeries Advanced Technical Support
Client crashes just past bootp, tftp of boot image 888 102 700 0c5 888 102 605 0c5 For the same reason as led 611 hang on previous page. A parent directory was nfs exported on the nim master, and the bosinst operation was unable to make appropriate exports of lppsource and spot. Historically, when this occurs, bosinst will give an obvious "WARNING: Parent directory already exported." But in this one customer scenario, we received no such warning in the smitty nim_bosinst. BOOTP Request Failed Abort !20A80004! !20EE000B! Prior to configure of nim master, customer had unknowingly removed bootps and tftp services from /etc/inetd.conf on nim master. Sure wish initial nim master config checked this....

Miscellaneous Reference
pSeries Advanced Technical Support
0042-008 NIMState: Request denied method_req - These messages appear during client install when the cpuid (uname -m) of the client machine does not match the cpuid that the nim master "remembers" for this client. "lsnim -l machine | grep cpuid" on the nim master will show what uname the master retains for this client. You can change the uname value on the nim master to match the new client machine, "nim -o change -a cpuid=<newvalue> client" Client hangs at LED 0608 - After bootp and tftp of boot image, client hangs at 608, and causes high rate of network traffic. Change 10/100 install adapter from auto / auto to explicit rate on network, eg 10Mbps / half duplex. Power off client, boot back into SMS menus, utilities, remote ipl setup. Actually, we have found that 100Mbit and Auto works best with IBM/AIX 10/100 adapters and HP Ethernet switches. Explicitly setting the adapters to 100_FULL_DUPLEX led to very slow installs. Client sends out bootp requests, server does not respond - Found that server was missing bos.net.tcp.server, bos.net.nfs.server filesets. Oddly, bos.sysmgt.nim.spot, and bos.sysmgt.nim.master don't prereq these server filesets. And you can configure nim master, lppsource, spot, client machines, and even make the exports to the client. Install the two server filesets and reboot. To prevent this experience, we included the two server filesets into the minimal mksysb image, and the posti.mkmaster script also does a test install of these two filesets.

Miscellaneous Reference
pSeries Advanced Technical Support
0042-001, 0042-006 nimclient: (To_Master) rcmd Error 0 This error appeared on a nim client console during install from a nim server at bos.sysmgt.nim.server.5.1.0.25. It is believed related to the nimesis process being parent to many defunct processes. A change to the thread scope of nimesis in included in APAR IY29854. Workaround was stopsrc -s nimesis, ultimately kill -9 on nimesis processes, and a reboot of server required. Validation failed: the "test method" client interface service does not exist - Client machine was defined as chrp, should have been defined as rspc

Miscellaneous Reference
pSeries Advanced Technical Support

Minimal mksysb image on a standalone machine

Install AIX 51 on a machine with no graphics adapter (don't include excess X11), with a single disk in rootvg Install the following additional filesets
X11.apps.aixterm X11.apps.xterm bos.net.tcp.server bos.net.nfs.server bos.adt.samples bos.acct bos.up bos.mp bos.sysmgt.trace perfagent.tools

errclear 0 set root passwd edit /etc/hosts, add "ipaddress nimmasterhostname" edit /etc/netsvc.conf, add "hosts=local,bind"

Miscellaneous Reference
pSeries Advanced Technical Support

Minimal mksysb image on a standalone machine - continued:

edit /etc/exclude.rootvg, insert
/smit.log /smit.script /stub /.sh_history /.rhosts others as necessary

edit /etc/rc.net, insert the following near the end of the file
/usr/sbin/no -o tcp_sendspace=262144 /usr/sbin/no -o tcp_recvspace=262144 /usr/sbin/no -o udp_recvspace=65536 /usr/sbin/no -o udp_sendspace=32768 /usr/sbin/no -o rfc1323=1 /usr/sbin/nfso -o nfs_socketsize=200000 /usr/sbin/nfso -o nfs_tcp_socketsize=200000

at very end of /etc/rc.net, comment out the stanza that turns off extendednetstats others no options as necessary

Miscellaneous Reference
pSeries Advanced Technical Support

Minimal mksysb image on a standalone machine - continued:

customize root's /.profile as you desire, then chmod u+x /.profile smitty storage, make a nimvg on non-root hdisk, then add a /stub filesystem in nimvg and mount /stub after mounting /stub, edit /etc/filesystems and remove the /stub stanza ifconfig en0 down ; ifconfig en0 detach ; ifconfig et0 down ; ifconfig et0 detach ; rmde -l en0 -d ; rmdev -l et0 -d ifconfig en1 down ; ifconfig en1 detach ; ifconfig et1 down ; ifconfig et1 detach ; rmde -l en1 -d ; rmdev -l et1 -d mkszfile, then edit /image.data, blank out the USER_VG entry (should contain nimvg smitty mksysb, to /stub/mksysb.minimal, exclude files yes, make new image.data file no cfgmgr to put the en, et interfaces back on the machine Bring up an interface to rcp back to nimmaster, e.g., ifconfig en0 198.233.5.216 netmask 255.255.255.0 up rcp -p /stub/mksysb.minimal nimmaster:/nim/aix51/images/mksysb.minimal rcp -p /image.data nimmaster:/nim/aix51/res/mksysb.minimal.image.data