ESXi6 kernel log (dmesg)

Understanding SCSI device/target NMP errors/conditions in ESX/ESXi 4.x and ESXi 5.x/6.0 (1030381)

2016-10-27T12:50:47.496Z cpu7:32798)ScsiDeviceIO: 2651: Cmd(0x439d80358400) 0x1a, CmdSN 0x1d1f2 from world 0 to dev “mpx.vmhba33:C0:T0:L0” failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

Host Status = 0x0 = OK
Device Status = 0x2 = Check Condition
Plugin Status = 0x0 = OK

Sense Key = 0x5 = ILLEGAL REQUEST
Additional Sense Code/ASC Qualifier = 0x24/0x0 =INVALID FIELD IN CDB
For a complete list of possible Sense Keys, see SCSI Sense Keys
For a complete list of Additional Sense Code/ASC Qualifier pairings, see ASC-NUM.TXT

How ESXi identify disk

Identifying disks when working with VMware ESXi/ESX (1014953)

 

These are the definitions for some of identifiers and their conventions:
  • naa.<NAA>:<Partition> or eui.<EUI>:<Partition>

    NAA stands for Network Addressing Authority identifier. EUI stands for Extended Unique Identifier. The number is guaranteed to be unique to that LUN. The NAA or EUI identifier is the preferred method of identifying LUNs and the number is generated by the storage device. Since the NAA or EUI is unique to the LUN, if the LUN is presented the same way across all ESXi hosts, the NAA or EUI identifier remains the same. For more information on these standards, see the SPC-3 documentation from the InterNational Committee for Information Technology Standards (T10).

    The <Partition> represents the partition number on the LUN or Disk. If the <Partition> is specified as 0, it identifies the entire disk instead of only one partition. This identifier is generally used for operations with utilities such as vmkfstools.

 

mpx.vmhba<Adapter>:C<Channel>:T<Target>:L<LUN> or mpx.vmhba<Adapter>:C<Channel>:T<Target>:L<LUN>:<Partition>

Some devices do not provide the NAA number described above. In these circumstances, an MPX Identifier is generated by ESXi to represent the LUN or disk. The identifier takes the form similar to that of the canonical name of previous versions of ESXi with the mpx. prefix. This identifier can be used in the exact same way as the NAA Identifier described above.

HP P410/Raid5 benchmark

Test Environment

ProLiant MicroServer Gen8
E3 1230V2@3.3G
16GB RAM
3 WD Red NAS 4T/ @HP P410 Raid5

Software:
HP ESXi 6.0.0U2
Virtual:
Debian 8/X64
8 CPU/ 4G RAM

 

Benchmark Tool

FIO (Flexible I/O Tester)

Google Compute SSD FIO Script

https://wiki.mikejung.biz/Benchmarking#Linux_Benchmarking_Tools

 

Result:

# Full write pass

1 process
 Run status group 0 (all jobs):
 WRITE: io=20480MB, aggrb=267620KB/s, minb=267620KB/s, maxb=267620KB/s, mint=78363msec, maxt=78363msec

 Disk stats (read/write):
 sda: ios=0/41090, merge=0/194, ticks=0/17786888, in_queue=17813224, util=99.70%
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=128

4 process / Random Read

Run status group 0 (all jobs):
 READ: io=45580KB, aggrb=1500KB/s, minb=1500KB/s, maxb=1500KB/s, mint=30379msec, maxt=30379msec

Disk stats (read/write):
 sda: ios=11312/12, merge=0/7, ticks=4291100/444, in_queue=4331296, util=99.76%
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=128
# 4 Process / Random Write
Run status group 0 (all jobs):
 WRITE: io=113208KB, aggrb=3689KB/s, minb=3689KB/s, maxb=3689KB/s, mint=30684msec, maxt=30684msec

Disk stats (read/write):
 sda: ios=0/28298, merge=0/0, ticks=0/4648448, in_queue=4649856, util=99.76%

Remove GPT from a disk under ubuntu

Suppose /dev/sdb is the device to be cleand

 

sudo apt-get install gdisk

sudo gdisk /dev/sdb

> Enter 2,  select GPT

> Enter  ?,  get command list

> Enter x,   expert mode

> Enter ?,  get command list

> Enter z,   destroy GPT

 

# create dos partition table, and partition

sudo fdisk /dev/sdb

# format the dos partition,   say /dev/sdb1

sudo mkfs.msdos /dev/sdb1

SD Card Bug of iLO4 2.4.0/2.4.4

ISSUE:

Upgrade to iLO4 2.4.0 (SPP 2016040), found  The server was failed to boot ESX from SD Card.   The same issue existed in iLO4 2.4.4

Root Cause:

iLO4 2.4.x will damage the partition table of SD Card/USB Flash,Not Clear it is damaged during the executing phase or stopping phase

 

Solution :

Rollback iLO4 to 2.3.0 (SPP 2015100)
Create USB Key of SPP 2015100
    Boot with the USB
    Downgrade the iLO4 firmware with interactive method
Reformat the SD Card/USB Flash
Retrieve the SD Card from server
    Format it into empty status in PC (Linux)
    Delete the partition table
    Create DOS partition table
    Create a DOS partition (0x0b)
   Format the DOS partition
   Insert the empty SD Card into Gen8

 

Reinstall ESX into SD Card

 Format the SD Card with FAT32
   Power outage of the server
   Lauch iOL remote console
   Insert CD of  ESX iso image file
   Reboot with CD to install ESX

 

 Lessons

Never trust a Company not in stable state

 

 

 How to format Micro SD Card in MicroServer Gen8:

Download gparted live CD at

http://downloads.sourceforge.net/gparted/gparted-live-0.26.1-5-i686.iso

And Launch it from iLO client

 

RBICL

RIBCL

Remote Insight Board Command Language

An XML-based scripting language, used to configure iLO on the network, during initial deployment, or from an already iLO setup deployed host.

 

Two basic ways in order to configure iLO online:

 

  • Locally, with the HPONCFG command utility.

  • Remotely, with the CPQLOCFG command utility