Hello,
with UbuntuServer16.04 we see the (two) paths to a SAN-LUN in different(!) multipath maps.
With UbuntuServer14.04.4 the same LUN is put in one multipath map as expected.
Please note the differences in the WWNs in ID_SCSI_SERIAL, ID_WWN & Co. seen below for 16.04 and 14.04.
Well, https://www.redhat.com/archives/dm-devel/2016-April/msg00395.html sounds related.
In my understanding I would expect the WWN (600d023100000047000000000e710648) with enough information for multipathing to identify the LUN - including:
vendor code: 00D023
controller ID: 47
logical drive ID: (00)0e710648
partition in logical drive: (00)
and not
3200000d023500047 and
3200000d023700047
Are there any (new multipath) setups required for 16.04 with which we may overcome this issue? E.g. special vendor settings in multipath.conf?
For now we activating the depricated
getuid_callout "/lib/udev/scsi_id --whitelisted --device=/dev/%n"
May this workaround break intended default behaviour in the future?
With best regards
Many thanks
Uwe
----------------------------------------------------------------------------------
Details for 16.04:
# lsb_release --short --description;uname -a
Ubuntu 16.04 LTS
Linux brauhaus 4.4.0-22-generic #40-Ubuntu SMP Thu May 12 22:03:46 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
# dpkg -s multipath-tools kpartx|grep Version
Version: 0.5.0+git1.656f8865-5ubuntu2
Version: 0.5.0+git1.656f8865-5ubuntu2
# multipath -l
3200000d023500047 dm-4 IFT,S16F-R1430
size=2.0T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=0 status=active
`- 5:0:0:31 sdc 8:32 active undef running
3200000d023700047 dm-5 IFT,S16F-R1430
size=2.0T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=0 status=active
`- 6:0:1:31 sdd 8:48 active undef running
(00047 is part of the SAN RAID controller ID)
# udevadm info --query=all --name=/dev/sdc|grep 00047
S: disk/by-id/scsi-3200000d023500047
S: disk/by-id/wwn-0x200000d023500047
S: disk/by-path/pci-0000:03:00.0-fc-0x210000d023500047-lun-31
E: DEVLINKS=/dev/disk/by-id/wwn-0x200000d023500047 /dev/disk/by-id/scsi-3200000d023500047 /dev/disk/by-path/pci-0000:03:00.0-fc-0x210000d023500047-lun-31
E: ID_PATH=pci-0000:03:00.0-fc-0x210000d023500047-lun-31
E: ID_PATH_TAG=pci-0000_03_00_0-fc-0x210000d023500047-lun-31
E: ID_SERIAL=3200000d023500047
E: ID_SERIAL_SHORT=200000d023500047
E: ID_WWN=0x200000d023500047
E: ID_WWN_WITH_EXTENSION=0x200000d023500047
E: SCSI_IDENT_LUN_NAA=200000d023500047
E: SCSI_IDENT_SERIAL=000047000000000E710648
# udevadm info --query=all --name=/dev/sdd|grep 00047
S: disk/by-id/scsi-3200000d023700047
S: disk/by-id/wwn-0x200000d023700047
S: disk/by-path/pci-0000:04:00.0-fc-0x220000d023700047-lun-31
E: DEVLINKS=/dev/disk/by-id/scsi-3200000d023700047 /dev/disk/by-id/wwn-0x200000d023700047 /dev/disk/by-path/pci-0000:04:00.0-fc-0x220000d023700047-lun-31
E: ID_PATH=pci-0000:04:00.0-fc-0x220000d023700047-lun-31
E: ID_PATH_TAG=pci-0000_04_00_0-fc-0x220000d023700047-lun-31
E: ID_SERIAL=3200000d023700047
E: ID_SERIAL_SHORT=200000d023700047
E: ID_WWN=0x200000d023700047
E: ID_WWN_WITH_EXTENSION=0x200000d023700047
E: SCSI_IDENT_LUN_NAA=200000d023700047
E: SCSI_IDENT_SERIAL=000047000000000E710648
# cat /var/log/syslog
...
May 27 15:24:32 brauhaus systemd[1]: dev-disk-by\x2did-scsi\x2d3200000d023500047.device: Dev dev-disk-by\x2did-scsi\x2d3200000d023500047.device appeared twice with different sysfs paths /sys/devices/pci0000:00/0000:00:05.0/0000:03:00.0/host5/rport-5:0-0/target5:0:0/5:0:0:31/block/sdc and /sys/devices/virtual/block/dm-4
May 27 15:24:32 brauhaus systemd[1]: dev-disk-by\x2did-wwn\x2d0x200000d023500047.device: Dev dev-disk-by\x2did-wwn\x2d0x200000d023500047.device appeared twice with different sysfs paths /sys/devices/pci0000:00/0000:00:05.0/0000:03:00.0/host5/rport-5:0-0/target5:0:0/5:0:0:31/block/sdc and /sys/devices/virtual/block/dm-4
May 27 15:24:32 brauhaus systemd[1]: dev-disk-by\x2did-scsi\x2d3200000d023700047.device: Dev dev-disk-by\x2did-scsi\x2d3200000d023700047.device appeared twice with different sysfs paths /sys/devices/pci0000:00/0000:00:07.0/0000:04:00.0/host6/rport-6:0-1/target6:0:1/6:0:1:31/block/sdd and /sys/devices/virtual/block/dm-5
May 27 15:24:32 brauhaus systemd[1]: dev-disk-by\x2did-wwn\x2d0x200000d023700047.device: Dev dev-disk-by\x2did-wwn\x2d0x200000d023700047.device appeared twice with different sysfs paths /sys/devices/pci0000:00/0000:00:07.0/0000:04:00.0/host6/rport-6:0-1/target6:0:1/6:0:1:31/block/sdd and /sys/devices/virtual/block/dm-5
...
# udevadm info --query=all --name=/dev/mapper/3200000d023500047
P: /devices/virtual/block/dm-4
N: dm-4
L: 50
S: disk/by-id/dm-name-3200000d023500047
S: disk/by-id/dm-uuid-mpath-3200000d023500047
S: disk/by-id/scsi-3200000d023500047
S: disk/by-id/wwn-0x200000d023500047
S: mapper/3200000d023500047
E: DEVLINKS=/dev/mapper/3200000d023500047 /dev/disk/by-id/wwn-0x200000d023500047 /dev/disk/by-id/dm-name-3200000d023500047 /dev/disk/by-id/dm-uuid-mpath-3200000d023500047 /dev/disk/by-id/scsi-3200000d023500047
E: DEVNAME=/dev/dm-4
E: DEVPATH=/devices/virtual/block/dm-4
E: DEVTYPE=disk
E: DM_ACTIVATION=1
E: DM_NAME=3200000d023500047
E: DM_STATE=ACTIVE
E: DM_SUSPENDED=0
E: DM_TABLE_STATE=LIVE
E: DM_TYPE=scsi
E: DM_UDEV_DISABLE_LIBRARY_FALLBACK_FLAG=1
E: DM_UDEV_PRIMARY_SOURCE_FLAG=1
E: DM_UDEV_RULES=1
E: DM_UUID=mpath-3200000d023500047
E: DM_WWN=0x200000d023500047
E: ID_PART_TABLE_TYPE=gpt
E: ID_PART_TABLE_UUID=7b9cc08c-2737-48d6-abc5-5b41c51396f2
E: MAJOR=252
E: MINOR=4
E: SUBSYSTEM=block
E: TAGS=:systemd:
E: USEC_INITIALIZED=55495112
# udevadm info --query=all --name=/dev/mapper/3200000d023700047
P: /devices/virtual/block/dm-5
N: dm-5
L: 50
S: disk/by-id/dm-name-3200000d023700047
S: disk/by-id/dm-uuid-mpath-3200000d023700047
S: disk/by-id/scsi-3200000d023700047
S: disk/by-id/wwn-0x200000d023700047
S: mapper/3200000d023700047
E: DEVLINKS=/dev/disk/by-id/scsi-3200000d023700047 /dev/mapper/3200000d023700047 /dev/disk/by-id/dm-uuid-mpath-3200000d023700047 /dev/disk/by-id/wwn-0x200000d023700047 /dev/disk/by-id/dm-name-3200000d023700047
E: DEVNAME=/dev/dm-5
E: DEVPATH=/devices/virtual/block/dm-5
E: DEVTYPE=disk
E: DM_ACTIVATION=1
E: DM_NAME=3200000d023700047
E: DM_STATE=ACTIVE
E: DM_SUSPENDED=0
E: DM_TABLE_STATE=LIVE
E: DM_TYPE=scsi
E: DM_UDEV_DISABLE_LIBRARY_FALLBACK_FLAG=1
E: DM_UDEV_PRIMARY_SOURCE_FLAG=1
E: DM_UDEV_RULES=1
E: DM_UUID=mpath-3200000d023700047
E: DM_WWN=0x200000d023700047
E: ID_PART_TABLE_TYPE=gpt
E: ID_PART_TABLE_UUID=7b9cc08c-2737-48d6-abc5-5b41c51396f2
E: MAJOR=252
E: MINOR=5
E: SUBSYSTEM=block
E: TAGS=:systemd:
E: USEC_INITIALIZED=55531513
# but:
# for d in /dev/sdc /dev/sdd /dev/mapper/3200000d023500047 /dev/mapper/3200000d023700047; do echo "$d:'$(/lib/udev/scsi_id --whitelisted --device=$d)'"; done
/dev/sdc:'3600d023100000047000000000e710648'
/dev/sdd:'3600d023100000047000000000e710648'
/dev/mapper/3200000d023500047:'3600d023100000047000000000e710648'
/dev/mapper/3200000d023700047:'3600d023100000047000000000e710648'
----------------------------------------------------------------------------------
Details for 14.04:
# lsb_release --short --description;uname -a
Ubuntu 14.04.4 LTS
Linux ppc712 4.2.0-36-generic #41~14.04.1-Ubuntu SMP Tue Apr 19 17:03:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
# dpkg -s multipath-tools multipath-tools-boot kpartx kpartx-boot|grep Version
Version: 0.4.9-3ubuntu7.11
Version: 0.4.9-3ubuntu7.11
Version: 0.4.9-3ubuntu7.11
Version: 0.4.9-3ubuntu7.11
(00047 is part of the SAN RAID controller ID,
000e710648 the Partition and ID of the SAN RAID logical drive)
# multipath -l
3600d023100000047000000000e710648 dm-14 IFT ,S16F-R1430
size=2.0T features='0' hwhandler='0' wp=rw
|-+- policy='round-robin 0' prio=-1 status=active
| `- 2:0:1:31 sdg 8:96 active undef running
`-+- policy='round-robin 0' prio=-1 status=enabled
`- 9:0:1:31 sdh 8:112 active undef running
# udevadm info --query=all --name=/dev/sdg|grep 00047
S: disk/by-id/scsi-3600d023100000047000000000e710648
S: disk/by-id/wwn-0x600d023100000047000000000e710648
S: disk/by-path/pci-0000:03:00.0-fc-0x210000d023500047-lun-31
E: DEVLINKS=/dev/disk/by-id/scsi-3600d023100000047000000000e710648 /dev/disk/by-id/wwn-0x600d023100000047000000000e710648 /dev/disk/by-path/pci-0000:03:00.0-fc-0x210000d023500047-lun-31
E: ID_PATH=pci-0000:03:00.0-fc-0x210000d023500047-lun-31
E: ID_PATH_TAG=pci-0000_03_00_0-fc-0x210000d023500047-lun-31
E: ID_SCSI_SERIAL=000047000000000E710648
E: ID_SERIAL=3600d023100000047000000000e710648
E: ID_SERIAL_SHORT=600d023100000047000000000e710648
E: ID_WWN=0x600d023100000047
E: ID_WWN_WITH_EXTENSION=0x600d023100000047000000000e710648
# udevadm info --query=all --name=/dev/sdh|grep 00047
S: disk/by-id/scsi-3600d023100000047000000000e710648
S: disk/by-id/wwn-0x600d023100000047000000000e710648
S: disk/by-path/pci-0000:0b:00.0-fc-0x220000d023700047-lun-31
E: DEVLINKS=/dev/disk/by-id/scsi-3600d023100000047000000000e710648 /dev/disk/by-id/wwn-0x600d023100000047000000000e710648 /dev/disk/by-path/pci-0000:0b:00.0-fc-0x220000d023700047-lun-31
E: ID_PATH=pci-0000:0b:00.0-fc-0x220000d023700047-lun-31
E: ID_PATH_TAG=pci-0000_0b_00_0-fc-0x220000d023700047-lun-31
E: ID_SCSI_SERIAL=000047000000000E710648
E: ID_SERIAL=3600d023100000047000000000e710648
E: ID_SERIAL_SHORT=600d023100000047000000000e710648
E: ID_WWN=0x600d023100000047
E: ID_WWN_WITH_EXTENSION=0x600d023100000047000000000e710648
# udevadm info --query=all --name=/dev/mapper/3600d023100000047000000000e710648
P: /devices/virtual/block/dm-14
N: dm-14
L: 95
S: disk/by-id/dm-name-3600d023100000047000000000e710648
S: disk/by-id/dm-uuid-mpath-3600d023100000047000000000e710648
S: disk/by-id/scsi-3600d023100000047000000000e710648
S: mapper/3600d023100000047000000000e710648
E: DEVLINKS=/dev/disk/by-id/dm-name-3600d023100000047000000000e710648 /dev/disk/by-id/dm-uuid-mpath-3600d023100000047000000000e710648 /dev/disk/by-id/scsi-3600d023100000047000000000e710648 /dev/mapper/3600d023100000047000000000e710648
E: DEVNAME=/dev/dm-14
E: DEVPATH=/devices/virtual/block/dm-14
E: DEVTYPE=disk
E: DM_NAME=3600d023100000047000000000e710648
E: DM_STATE=ACTIVE
E: DM_SUSPENDED=0
E: DM_TABLE_STATE=LIVE
E: DM_TYPE=scsi
E: DM_UDEV_PRIMARY_SOURCE_FLAG=1
E: DM_UDEV_RULES=1
E: DM_UUID=mpath-3600d023100000047000000000e710648
E: ID_PART_TABLE_TYPE=gpt
E: MAJOR=252
E: MINOR=14
E: SUBSYSTEM=block
E: USEC_INITIALIZED=9845724573
# for d in /dev/sdg /dev/sdh /dev/mapper/3600d023100000047000000000e710648; do echo "$d:'$(/lib/udev/scsi_id --whitelisted --device=$d)'"; done
/dev/sdg:'3600d023100000047000000000e710648'
/dev/sdh:'3600d023100000047000000000e710648'
/dev/mapper/3600d023100000047000000000e710648:'3600d023100000047000000000e710648'
