Shared Ethernet Adapter Configuration

Scenario: dual vios setup completed, we want to configure two different Shared Ethernet Adapters to separate management and production traffic.

ioserver:padmin # lsdev -type adapter
name status description
ent0 Available PCIe2 4-Port Adapter (10GbE SFP+) (e4148a1614109304)
ent1 Available PCIe2 4-Port Adapter (10GbE SFP+) (e4148a1614109304)
ent2 Available PCIe2 4-Port Adapter (1GbE RJ45) (e4148a1614109404)
ent3 Available PCIe2 4-Port Adapter (1GbE RJ45) (e4148a1614109404)
ent4 Available PCIe2 4-Port Adapter (10GbE SFP+) (e4148a1614109304)
ent5 Available PCIe2 4-Port Adapter (10GbE SFP+) (e4148a1614109304)
ent6 Available PCIe2 4-Port Adapter (1GbE RJ45) (e4148a1614109404)
ent7 Available PCIe2 4-Port Adapter (1GbE RJ45) (e4148a1614109404)
ent8 Available Virtual I/O Ethernet Adapter (l-lan)
ent9 Available Virtual I/O Ethernet Adapter (l-lan)
ent10 Available Virtual I/O Ethernet Adapter (l-lan)

ioserver:padmin # for x in 0 1 2 3 4 5 6 7; do echo "ENT$x ==============================" ; lsattr -El ent$x | egrep "flow_ctrl|jumbo|large|chksum_offload" ; done
ENT0 ==============================
chksum_offload yes Request checksum offload True
flow_ctrl yes Request flow control True
flow_ctrl_rx yes Receive pause frames True
flow_ctrl_tx yes Transmit pause frames True
jumbo_frames no Request jumbo frames True
jumbo_size 9014 Requested jumbo frame size False
large_receive yes Request Rx TCP segment aggregation True
large_send yes Request Tx TCP segment offload True
ENT1 ==============================
chksum_offload yes Request checksum offload True
flow_ctrl yes Request flow control True
flow_ctrl_rx yes Receive pause frames True
flow_ctrl_tx yes Transmit pause frames True
jumbo_frames no Request jumbo frames True
jumbo_size 9014 Requested jumbo frame size False
large_receive yes Request Rx TCP segment aggregation True
large_send yes Request Tx TCP segment offload True
ENT2 ==============================
chksum_offload yes Request checksum offload True
flow_ctrl yes Request flow control True
flow_ctrl_rx yes Receive pause frames True
flow_ctrl_tx yes Transmit pause frames True
jumbo_frames no Request jumbo frames True
jumbo_size 9014 Requested jumbo frame size False
large_receive yes Request Rx TCP segment aggregation True
large_send yes Request Tx TCP segment offload True
ENT3 ==============================
chksum_offload yes Request checksum offload True
flow_ctrl yes Request flow control True
flow_ctrl_rx yes Receive pause frames True
flow_ctrl_tx yes Transmit pause frames True
jumbo_frames no Request jumbo frames True
jumbo_size 9014 Requested jumbo frame size False
large_receive yes Request Rx TCP segment aggregation True
large_send yes Request Tx TCP segment offload True
ENT4 ==============================
chksum_offload yes Request checksum offload True
flow_ctrl yes Request flow control True
flow_ctrl_rx yes Receive pause frames True
flow_ctrl_tx yes Transmit pause frames True
jumbo_frames no Request jumbo frames True
jumbo_size 9014 Requested jumbo frame size False
large_receive yes Request Rx TCP segment aggregation True
large_send yes Request Tx TCP segment offload True
ENT5 ==============================
chksum_offload yes Request checksum offload True
flow_ctrl yes Request flow control True
flow_ctrl_rx yes Receive pause frames True
flow_ctrl_tx yes Transmit pause frames True
jumbo_frames no Request jumbo frames True
jumbo_size 9014 Requested jumbo frame size False
large_receive yes Request Rx TCP segment aggregation True
large_send yes Request Tx TCP segment offload True
ENT6 ==============================
chksum_offload yes Request checksum offload True
flow_ctrl yes Request flow control True
flow_ctrl_rx yes Receive pause frames True
flow_ctrl_tx yes Transmit pause frames True
jumbo_frames no Request jumbo frames True
jumbo_size 9014 Requested jumbo frame size False
large_receive yes Request Rx TCP segment aggregation True
large_send yes Request Tx TCP segment offload True
ENT7 ==============================
chksum_offload yes Request checksum offload True
flow_ctrl yes Request flow control True
flow_ctrl_rx yes Receive pause frames True
flow_ctrl_tx yes Transmit pause frames True
jumbo_frames no Request jumbo frames True
jumbo_size 9014 Requested jumbo frame size False
large_receive yes Request Rx TCP segment aggregation True
large_send yes Request Tx TCP segment offload True

ioserver:padmin # for x in 0 1 4 5; do chdev -l ent$x -a jumbo_frames=yes; done
ent0 changed
ent1 changed
ent4 changed
ent5 changed

Sea su mgmt

Now it is possible to define the shared ethernet adapter using the physical (ent2) adapter and virtual (ent8 ent9) to bridge data and sea control channel.

En10 will be used just to assign an ip address to the vios server.

mkvdev -sea ent2 -vadapter ent8 -default ent8 -defaultid 606 -attr ha_mode=auto ctl_chan=ent9
chdev -dev ent11 -attr health_time=60 link_time=10
chdev -dev ent11 -attr large_receive=yes

mktcpip -hostname vios1 -inetaddr 192.168.61.77 -interface en10 -netmask 255.255.255.0 -gateway 10.15.61.1
mktcpip -hostname vios2 -inetaddr 192.168.61.78 -interface en10 -netmask 255.255.255.0 -gateway 10.15.61.1

Dimensionamento dei profili LPAR

CPU

Processing units : indica il numero dei core installati in macchina , in assenza di altri processor pools definiti sono tutti assegnati ad uno shared processor pool.

  • Cap o no cap :

A livello di profilo della Lpar possiamo definire sostanzialmente due modalità:

Uncapped

in questa modalità il profilo prevede l’impostazione di un valore di minimum cpu, ovvero il valore minimo garantito alla lpar, in mancanza del quale la lpar non si avvia, il desired ossia il valore di default assegnato alla lpar in presenza di cicli disponibili, ed il maximum che in questo caso perde di significato dal momento che la partizione uncapped può attingere dalloshared processor pool del server in caso di necessità seguendo un meccanismo di priorità basato su un “peso” assegnato al profilo della partizione.

Capped

        in questo caso i valori minimum e desired sono identici al caso precedente ed il maximum si comporta come limite massimo del valore assegnato , sia esso processing unit, virtual cpus , ecc.

  • Virtual cpus e processing units:

Una regola fondamentale per il disegno di un profilo lpar riguarda il rapporto tra le physical processing units e le virtual cpus; infatti è bene fare in modo che il numero delle desired vcpus coincida con il maximum processing units . Per esempio se ho 1 vp posso usare solo fino 1 PU anche se la partizione è uncapped e magari lo shared processor pool potrebbe permettere alla lpar di scalare il numero di cpu utilizzabili; il numero delle vcpus rappresenta il limite fino a cui attingere risorse libere quando richiesto, oltre il valore di “entitled capacity”.

Nota: si rimanda al documento allegato

P7_virtualization_bestpractice.doc

prelevato al link:

https://www.ibm.com/developerworks/community/wikis/form/anonymous/api/wiki/61ad9cf2-c6a3-4d2c-b779-61ff0266d32a/page/64c8d6ed-6421-47b5-a1a7-d798e53e7d9a/attachment/f9ddb657-2662-41d4-8fd8-77064cc92e48/media/p7_virtualization_bestpractice.doc

May the NIMADM be with you

NIMADM or Network Installation Manager Alternate Disk Migration, is a facility that helps you to seamlessly clone and upgrade your lpar to a new AIX release.

In the following example lpar01 is at 7100-05-05-1939 level, we ‘d like to upgrade it to 7200-03-03-1914 with the least possible downtime .

The entire nimadm process splits into 12 phases that allows to fully customize the target environment.

root@nim01:/download/AIX/PTF/# nimadm -l lpp-aix720303-FULL -c lpar01-int -s spot-aix720303 -d hdisk0 -Y
Initializing the NIM master.
Initializing NIM client lpar01-int.

Verifying alt_disk_migration eligibility.
Initializing log: /var/adm/ras/alt_mig/lpar01-int_alt_mig.log
Starting Alternate Disk Migration.


Restoring device ODM database.

+—————————————————————————–+
Executing nimadm phase 7.
+—————————————————————————–+
nimadm: There is no user customization script specified for this phase.

+—————————————————————————–+
Executing nimadm phase 8.
+—————————————————————————–+
Creating client boot image.
bosboot: Boot image is 59393 512 byte blocks.
Writing boot image to client’s alternate boot disk hdisk0.

+—————————————————————————–+
Executing nimadm phase 9.
+—————————————————————————–+
Unmounting client mounts on the NIM master.
forced unmount of /lpar01-int_alt/alt_inst/var/adm/ras/livedump
forced unmount of /lpar01-int_alt/alt_inst/var
forced unmount of /lpar01-int_alt/alt_inst/usr
forced unmount of /lpar01-int_alt/alt_inst/tmp
forced unmount of /lpar01-int_alt/alt_inst/opt/ocsinventory
forced unmount of /lpar01-int_alt/alt_inst/opt/netbackup
forced unmount of /lpar01-int_alt/alt_inst/opt/nagios
forced unmount of /lpar01-int_alt/alt_inst/opt/freeware/webmin
forced unmount of /lpar01-int_alt/alt_inst/opt/bmc
forced unmount of /lpar01-int_alt/alt_inst/opt/IBM
forced unmount of /lpar01-int_alt/alt_inst/opt
forced unmount of /lpar01-int_alt/alt_inst/logs
forced unmount of /lpar01-int_alt/alt_inst/home
forced unmount of /lpar01-int_alt/alt_inst/admin
forced unmount of /lpar01-int_alt/alt_inst

+—————————————————————————–+
Executing nimadm phase 10.
+—————————————————————————–+
Unexporting alt_inst filesystems on client lpar01-int:

+—————————————————————————–+
Executing nimadm phase 11.
+—————————————————————————–+
Cloning altinst_rootvg on client, Phase 3.
Client alt_disk_install command: alt_disk_copy -M 7.2 -P3 -d “hdisk0”

Verifying altinst_rootvg…
Modifying ODM on cloned disk.
forced unmount of /alt_inst/var/adm/ras/livedump
forced unmount of /alt_inst/var/adm/ras/livedump
forced unmount of /alt_inst/var
forced unmount of /alt_inst/var
forced unmount of /alt_inst/usr
forced unmount of /alt_inst/usr
forced unmount of /alt_inst/tmp
forced unmount of /alt_inst/tmp
forced unmount of /alt_inst/opt/ocsinventory
forced unmount of /alt_inst/opt/ocsinventory
forced unmount of /alt_inst/opt/netbackup
forced unmount of /alt_inst/opt/netbackup
forced unmount of /alt_inst/opt/nagios
forced unmount of /alt_inst/opt/nagios
forced unmount of /alt_inst/opt/freeware/webmin
forced unmount of /alt_inst/opt/freeware/webmin
forced unmount of /alt_inst/opt/bmc
forced unmount of /alt_inst/opt/bmc
forced unmount of /alt_inst/opt/IBM
forced unmount of /alt_inst/opt/IBM
forced unmount of /alt_inst/opt
forced unmount of /alt_inst/opt
forced unmount of /alt_inst/logs
forced unmount of /alt_inst/logs
forced unmount of /alt_inst/home
forced unmount of /alt_inst/home
forced unmount of /alt_inst/admin
forced unmount of /alt_inst/admin
forced unmount of /alt_inst
forced unmount of /alt_inst
Changing logical volume names in volume group descriptor area.
Fixing LV control blocks…
Fixing file system superblocks…
Bootlist is set to the boot disk: hdisk0 blv=hd5

+—————————————————————————–+
Executing nimadm phase 12.
+—————————————————————————–+
Cleaning up alt_disk_migration on the NIM master.
Cleaning up alt_disk_migration on client lpar01-int.