Fuel for OpenStack

No Hypervisor in dashboard horizon with Mirantis 9.2

Asked by Damien on 2017-04-05

Hello,

I deployed Mitaka with Mirantis 9.2 and the configuration below:

- 2 controllers node
- 3 storage node
- 1 Telemetry node
- 1 compute node

But I have no hypervisor in the horizon dashboard available
I have only one computing host

Here is the error message below on the compute node

2017-04-05 15:32:30.160 31188 INFO nova.virt.driver [-] Loading compute driver 'libvirt.LibvirtDriver'
2017-04-05 15:32:30.200 31188 INFO os_brick.initiator.connector [-] Init DISCO connector
2017-04-05 15:32:30.356 31188 WARNING oslo_config.cfg [req-053b4558-e407-4d2d-b35d-a5611c1acb31 - - - - -] Option "network_device_mtu" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future.
2017-04-05 15:32:30.359 31188 WARNING oslo_config.cfg [req-053b4558-e407-4d2d-b35d-a5611c1acb31 - - - - -] Option "auth_plugin" from group "neutron" is deprecated. Use option "auth_type" from group "neutron".
2017-04-05 15:32:30.361 31188 WARNING oslo_config.cfg [req-053b4558-e407-4d2d-b35d-a5611c1acb31 - - - - -] Option "block_migration_flag" from group "libvirt" is deprecated for removal. Its value may be silently ignored in the future.
2017-04-05 15:32:30.362 31188 WARNING oslo_config.cfg [req-053b4558-e407-4d2d-b35d-a5611c1acb31 - - - - -] Option "live_migration_flag" from group "libvirt" is deprecated for removal. Its value may be silently ignored in the future.
2017-04-05 15:32:30.365 31188 INFO nova.service [-] Starting compute node (version 13.1.3)
2017-04-05 15:32:30.373 31188 INFO nova.virt.libvirt.driver [-] Connection event '1' reason 'None'
2017-04-05 15:32:30.532 31188 WARNING nova.virt.libvirt.driver [req-ae75e88a-1872-401d-a1d3-ff4cd24d7905 - - - - -] Cannot update service status on host "Virt32-Compute01.hosted2.provectio.local" since it is not registered.
2017-04-05 15:32:30.537 31188 INFO nova.virt.libvirt.host [req-ae75e88a-1872-401d-a1d3-ff4cd24d7905 - - - - -] Libvirt host capabilities <capabilities>

  <host>
    <uuid>fdfcd539-0e4c-4bd6-a94b-fd455988040c</uuid>
    <cpu>
      <arch>x86_64</arch>
      <model>Haswell-noTSX</model>
      <vendor>Intel</vendor>
      <topology sockets='1' cores='6' threads='2'/>
      <feature name='invtsc'/>
      <feature name='abm'/>
      <feature name='pdpe1gb'/>
      <feature name='rdrand'/>
      <feature name='f16c'/>
      <feature name='osxsave'/>
      <feature name='dca'/>
      <feature name='pdcm'/>
      <feature name='xtpr'/>
      <feature name='tm2'/>
      <feature name='est'/>
      <feature name='smx'/>
      <feature name='vmx'/>
      <feature name='ds_cpl'/>
      <feature name='monitor'/>
      <feature name='dtes64'/>
      <feature name='pbe'/>
      <feature name='tm'/>
      <feature name='ht'/>
      <feature name='ss'/>
      <feature name='acpi'/>
      <feature name='ds'/>
      <feature name='vme'/>
      <pages unit='KiB' size='4'/>
      <pages unit='KiB' size='2048'/>
      <pages unit='KiB' size='1048576'/>
    </cpu>
    <power_management>
      <suspend_mem/>
      <suspend_disk/>
      <suspend_hybrid/>
    </power_management>
    <migration_features>
      <live/>
      <uri_transports>
        <uri_transport>tcp</uri_transport>
        <uri_transport>rdma</uri_transport>
      </uri_transports>
    </migration_features>
    <topology>
      <cells num='2'>
        <cell id='0'>
          <memory unit='KiB'>24582920</memory>
          <pages unit='KiB' size='4'>6145730</pages>
          <pages unit='KiB' size='2048'>0</pages>
          <pages unit='KiB' size='1048576'>0</pages>
          <distances>
            <sibling id='0' value='10'/>
            <sibling id='1' value='21'/>
          </distances>
          <cpus num='12'>
            <cpu id='0' socket_id='0' core_id='0' siblings='0,12'/>
            <cpu id='2' socket_id='0' core_id='1' siblings='2,14'/>
            <cpu id='4' socket_id='0' core_id='2' siblings='4,16'/>
            <cpu id='6' socket_id='0' core_id='3' siblings='6,18'/>
            <cpu id='8' socket_id='0' core_id='4' siblings='8,20'/>
            <cpu id='10' socket_id='0' core_id='5' siblings='10,22'/>
            <cpu id='12' socket_id='0' core_id='0' siblings='0,12'/>
            <cpu id='14' socket_id='0' core_id='1' siblings='2,14'/>
            <cpu id='16' socket_id='0' core_id='2' siblings='4,16'/>
            <cpu id='18' socket_id='0' core_id='3' siblings='6,18'/>
            <cpu id='20' socket_id='0' core_id='4' siblings='8,20'/>
            <cpu id='22' socket_id='0' core_id='5' siblings='10,22'/>
          </cpus>
        </cell>
        <cell id='1'>
          <memory unit='KiB'>24761224</memory>
          <pages unit='KiB' size='4'>6190306</pages>
          <pages unit='KiB' size='2048'>0</pages>
          <pages unit='KiB' size='1048576'>0</pages>
          <distances>
            <sibling id='0' value='21'/>
            <sibling id='1' value='10'/>
          </distances>
          <cpus num='12'>
            <cpu id='1' socket_id='1' core_id='0' siblings='1,13'/>
            <cpu id='3' socket_id='1' core_id='1' siblings='3,15'/>
            <cpu id='5' socket_id='1' core_id='2' siblings='5,17'/>
            <cpu id='7' socket_id='1' core_id='3' siblings='7,19'/>
            <cpu id='9' socket_id='1' core_id='4' siblings='9,21'/>
            <cpu id='11' socket_id='1' core_id='5' siblings='11,23'/>
            <cpu id='13' socket_id='1' core_id='0' siblings='1,13'/>
            <cpu id='15' socket_id='1' core_id='1' siblings='3,15'/>
            <cpu id='17' socket_id='1' core_id='2' siblings='5,17'/>
            <cpu id='19' socket_id='1' core_id='3' siblings='7,19'/>
            <cpu id='21' socket_id='1' core_id='4' siblings='9,21'/>
            <cpu id='23' socket_id='1' core_id='5' siblings='11,23'/>
          </cpus>
        </cell>
      </cells>
    </topology>
    <secmodel>
      <model>apparmor</model>
      <doi>0</doi>
    </secmodel>
    <secmodel>
      <model>dac</model>
      <doi>0</doi>
      <baselabel type='kvm'>+110:+115</baselabel>
      <baselabel type='qemu'>+110:+115</baselabel>
    </secmodel>
  </host>

  <guest>
    <os_type>hvm</os_type>
    <arch name='i686'>
      <wordsize>32</wordsize>
      <emulator>/usr/bin/qemu-system-i386</emulator>
      <machine maxCpus='255'>pc-i440fx-wily</machine>
      <machine canonical='pc-i440fx-wily' maxCpus='255'>ubuntu</machine>
      <machine maxCpus='255'>pc-0.12</machine>
      <machine maxCpus='255'>pc-i440fx-2.4</machine>
      <machine maxCpus='255'>pc-1.3</machine>
      <machine maxCpus='255'>pc-q35-1.6</machine>
      <machine maxCpus='255'>pc-q35-1.5</machine>
      <machine maxCpus='1'>xenpv</machine>
      <machine maxCpus='255'>pc-i440fx-1.6</machine>
      <machine maxCpus='255'>pc-q35-2.2</machine>
      <machine maxCpus='255'>pc-i440fx-vivid</machine>
      <machine canonical='pc-i440fx-vivid' maxCpus='255'>ubuntu</machine>
      <machine maxCpus='255'>pc-0.11</machine>
      <machine maxCpus='255'>pc-q35-2.1</machine>
      <machine maxCpus='255'>pc-i440fx-2.3</machine>
      <machine maxCpus='255'>pc-0.10</machine>
      <machine maxCpus='255'>pc-i440fx-trusty</machine>
      <machine maxCpus='255'>pc-1.2</machine>
      <machine maxCpus='255'>pc-i440fx-2.2</machine>
      <machine maxCpus='1'>isapc</machine>
      <machine maxCpus='255'>pc-i440fx-1.7</machine>
      <machine maxCpus='255'>pc-q35-1.4</machine>
      <machine maxCpus='128'>xenfv</machine>
      <machine maxCpus='255'>pc-q35-2.5</machine>
      <machine canonical='pc-q35-2.5' maxCpus='255'>q35</machine>
      <machine maxCpus='255'>pc-0.15</machine>
      <machine maxCpus='255'>pc-i440fx-utopic</machine>
      <machine maxCpus='255'>pc-i440fx-1.5</machine>
      <machine maxCpus='255'>pc-0.14</machine>
      <machine maxCpus='255'>pc-q35-2.0</machine>
      <machine maxCpus='255'>pc-i440fx-1.4</machine>
      <machine maxCpus='255'>pc-i440fx-2.5</machine>
      <machine canonical='pc-i440fx-2.5' maxCpus='255'>pc</machine>
      <machine maxCpus='255'>pc-1.1</machine>
      <machine maxCpus='255'>pc-q35-1.7</machine>
      <machine maxCpus='255'>pc-i440fx-2.1</machine>
      <machine maxCpus='255'>pc-1.0</machine>
      <machine maxCpus='255'>pc-i440fx-2.0</machine>
      <machine maxCpus='255'>pc-q35-2.4</machine>
      <machine maxCpus='255'>pc-q35-2.3</machine>
      <machine maxCpus='255'>pc-0.13</machine>
      <domain type='qemu'/>
      <domain type='kvm'>
        <emulator>/usr/bin/kvm-spice</emulator>
        <machine maxCpus='255'>pc-i440fx-wily</machine>
        <machine canonical='pc-i440fx-wily' maxCpus='255'>ubuntu</machine>
        <machine maxCpus='255'>pc-i440fx-2.4</machine>
        <machine maxCpus='255'>pc-1.3</machine>
        <machine maxCpus='255'>pc-0.12</machine>
        <machine maxCpus='255'>pc-q35-1.6</machine>
        <machine maxCpus='255'>pc-q35-1.5</machine>
        <machine maxCpus='255'>pc-i440fx-1.6</machine>
        <machine maxCpus='255'>pc-q35-2.2</machine>
        <machine maxCpus='255'>pc-i440fx-1.7</machine>
        <machine maxCpus='255'>pc-i440fx-vivid</machine>
        <machine canonical='pc-i440fx-vivid' maxCpus='255'>ubuntu</machine>
        <machine maxCpus='255'>pc-0.11</machine>
        <machine maxCpus='1'>xenpv</machine>
        <machine maxCpus='255'>pc-q35-2.1</machine>
        <machine maxCpus='255'>pc-0.10</machine>
        <machine maxCpus='255'>pc-1.2</machine>
        <machine maxCpus='255'>pc-i440fx-2.2</machine>
        <machine maxCpus='1'>isapc</machine>
        <machine maxCpus='255'>pc-i440fx-2.3</machine>
        <machine maxCpus='255'>pc-i440fx-trusty</machine>
        <machine maxCpus='255'>pc-q35-1.4</machine>
        <machine maxCpus='128'>xenfv</machine>
        <machine maxCpus='255'>pc-q35-2.5</machine>
        <machine canonical='pc-q35-2.5' maxCpus='255'>q35</machine>
        <machine maxCpus='255'>pc-0.15</machine>
        <machine maxCpus='255'>pc-i440fx-utopic</machine>
        <machine maxCpus='255'>pc-i440fx-1.5</machine>
        <machine maxCpus='255'>pc-q35-2.0</machine>
        <machine maxCpus='255'>pc-i440fx-1.4</machine>
        <machine maxCpus='255'>pc-i440fx-2.5</machine>
        <machine canonical='pc-i440fx-2.5' maxCpus='255'>pc</machine>
        <machine maxCpus='255'>pc-0.14</machine>
        <machine maxCpus='255'>pc-1.1</machine>
        <machine maxCpus='255'>pc-i440fx-2.1</machine>
        <machine maxCpus='255'>pc-q35-1.7</machine>
        <machine maxCpus='255'>pc-1.0</machine>
        <machine maxCpus='255'>pc-i440fx-2.0</machine>
        <machine maxCpus='255'>pc-q35-2.4</machine>
        <machine maxCpus='255'>pc-q35-2.3</machine>
        <machine maxCpus='255'>pc-0.13</machine>
      </domain>
    </arch>
    <features>
      <cpuselection/>
      <deviceboot/>
      <disksnapshot default='on' toggle='no'/>
      <acpi default='on' toggle='yes'/>
      <apic default='on' toggle='no'/>
      <pae/>
      <nonpae/>
    </features>
  </guest>

  <guest>
    <os_type>hvm</os_type>
    <arch name='x86_64'>
      <wordsize>64</wordsize>
      <emulator>/usr/bin/qemu-system-x86_64</emulator>
      <machine maxCpus='255'>pc-i440fx-wily</machine>
      <machine canonical='pc-i440fx-wily' maxCpus='255'>ubuntu</machine>
      <machine maxCpus='255'>pc-i440fx-2.4</machine>
      <machine maxCpus='255'>pc-1.3</machine>
      <machine maxCpus='255'>pc-0.12</machine>
      <machine maxCpus='255'>pc-q35-1.6</machine>
      <machine maxCpus='255'>pc-q35-1.5</machine>
      <machine maxCpus='255'>pc-i440fx-1.6</machine>
      <machine maxCpus='255'>pc-q35-2.2</machine>
      <machine maxCpus='255'>pc-i440fx-1.7</machine>
      <machine maxCpus='255'>pc-i440fx-vivid</machine>
      <machine canonical='pc-i440fx-vivid' maxCpus='255'>ubuntu</machine>
      <machine maxCpus='255'>pc-0.11</machine>
      <machine maxCpus='1'>xenpv</machine>
      <machine maxCpus='255'>pc-q35-2.1</machine>
      <machine maxCpus='255'>pc-0.10</machine>
      <machine maxCpus='255'>pc-1.2</machine>
      <machine maxCpus='255'>pc-i440fx-2.2</machine>
      <machine maxCpus='1'>isapc</machine>
      <machine maxCpus='255'>pc-i440fx-2.3</machine>
      <machine maxCpus='255'>pc-i440fx-trusty</machine>
      <machine maxCpus='255'>pc-q35-1.4</machine>
      <machine maxCpus='128'>xenfv</machine>
      <machine maxCpus='255'>pc-q35-2.5</machine>
      <machine canonical='pc-q35-2.5' maxCpus='255'>q35</machine>
      <machine maxCpus='255'>pc-0.15</machine>
      <machine maxCpus='255'>pc-i440fx-utopic</machine>
      <machine maxCpus='255'>pc-i440fx-1.5</machine>
      <machine maxCpus='255'>pc-q35-2.0</machine>
      <machine maxCpus='255'>pc-i440fx-1.4</machine>
      <machine maxCpus='255'>pc-i440fx-2.5</machine>
      <machine canonical='pc-i440fx-2.5' maxCpus='255'>pc</machine>
      <machine maxCpus='255'>pc-0.14</machine>
      <machine maxCpus='255'>pc-1.1</machine>
      <machine maxCpus='255'>pc-i440fx-2.1</machine>
      <machine maxCpus='255'>pc-q35-1.7</machine>
      <machine maxCpus='255'>pc-1.0</machine>
      <machine maxCpus='255'>pc-i440fx-2.0</machine>
      <machine maxCpus='255'>pc-q35-2.4</machine>
      <machine maxCpus='255'>pc-q35-2.3</machine>
      <machine maxCpus='255'>pc-0.13</machine>
      <domain type='qemu'/>
      <domain type='kvm'>
        <emulator>/usr/bin/kvm-spice</emulator>
        <machine maxCpus='255'>pc-i440fx-wily</machine>
        <machine canonical='pc-i440fx-wily' maxCpus='255'>ubuntu</machine>
        <machine maxCpus='255'>pc-i440fx-2.4</machine>
        <machine maxCpus='255'>pc-1.3</machine>
        <machine maxCpus='255'>pc-0.12</machine>
        <machine maxCpus='255'>pc-q35-1.6</machine>
        <machine maxCpus='255'>pc-q35-1.5</machine>
        <machine maxCpus='255'>pc-i440fx-1.6</machine>
        <machine maxCpus='255'>pc-q35-2.2</machine>
        <machine maxCpus='255'>pc-i440fx-1.7</machine>
        <machine maxCpus='255'>pc-i440fx-vivid</machine>
        <machine canonical='pc-i440fx-vivid' maxCpus='255'>ubuntu</machine>
        <machine maxCpus='255'>pc-0.11</machine>
        <machine maxCpus='1'>xenpv</machine>
        <machine maxCpus='255'>pc-q35-2.1</machine>
        <machine maxCpus='255'>pc-0.10</machine>
        <machine maxCpus='255'>pc-1.2</machine>
        <machine maxCpus='255'>pc-i440fx-2.2</machine>
        <machine maxCpus='1'>isapc</machine>
        <machine maxCpus='255'>pc-i440fx-2.3</machine>
        <machine maxCpus='255'>pc-i440fx-trusty</machine>
        <machine maxCpus='255'>pc-q35-1.4</machine>
        <machine maxCpus='128'>xenfv</machine>
        <machine maxCpus='255'>pc-q35-2.5</machine>
        <machine canonical='pc-q35-2.5' maxCpus='255'>q35</machine>
        <machine maxCpus='255'>pc-0.15</machine>
        <machine maxCpus='255'>pc-i440fx-utopic</machine>
        <machine maxCpus='255'>pc-i440fx-1.5</machine>
        <machine maxCpus='255'>pc-q35-2.0</machine>
        <machine maxCpus='255'>pc-i440fx-1.4</machine>
        <machine maxCpus='255'>pc-i440fx-2.5</machine>
        <machine canonical='pc-i440fx-2.5' maxCpus='255'>pc</machine>
        <machine maxCpus='255'>pc-0.14</machine>
        <machine maxCpus='255'>pc-1.1</machine>
        <machine maxCpus='255'>pc-i440fx-2.1</machine>
        <machine maxCpus='255'>pc-q35-1.7</machine>
        <machine maxCpus='255'>pc-1.0</machine>
        <machine maxCpus='255'>pc-i440fx-2.0</machine>
        <machine maxCpus='255'>pc-q35-2.4</machine>
        <machine maxCpus='255'>pc-q35-2.3</machine>
        <machine maxCpus='255'>pc-0.13</machine>
      </domain>
    </arch>
    <features>
      <cpuselection/>
      <deviceboot/>
      <disksnapshot default='on' toggle='no'/>
      <acpi default='on' toggle='yes'/>
      <apic default='on' toggle='no'/>
    </features>
  </guest>

</capabilities>

2017-04-05 15:32:30.541 31188 WARNING nova.virt.libvirt.driver [req-ae75e88a-1872-401d-a1d3-ff4cd24d7905 - - - - -] Removing the VIR_MIGRATE_PERSIST_DEST flag from live_migration_flag as Nova ensures the VM is persisted on the destination host
2017-04-05 15:32:31.335 31188 ERROR nova.compute.manager [req-ae75e88a-1872-401d-a1d3-ff4cd24d7905 - - - - -] No compute node record for host Virt32-Compute01.hosted2.provectio.local
2017-04-05 15:32:31.338 31188 WARNING nova.compute.monitors [req-ae75e88a-1872-401d-a1d3-ff4cd24d7905 - - - - -] Excluding nova.compute.monitors.cpu monitor virt_driver. Not in the list of enabled monitors (CONF.compute_monitors).
2017-04-05 15:32:31.339 31188 INFO nova.compute.resource_tracker [req-ae75e88a-1872-401d-a1d3-ff4cd24d7905 - - - - -] Auditing locally available compute resources for node Virt32-Compute01.hosted2.provectio.local
2017-04-05 15:37:31.351 31188 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server 10.36.0.52:5673 closed the connection. Check login credentials: Socket closed
2017-04-05 15:37:31.352 31188 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Socket closed
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager [req-ae75e88a-1872-401d-a1d3-ff4cd24d7905 - - - - -] Error updating resources for node Virt32-Compute01.hosted2.provectio.local.
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager Traceback (most recent call last):
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 6473, in update_available_resource_for_node
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager rt.update_available_resource(context)
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager File "/usr/lib/python2.7/dist-packages/nova/compute/resource_tracker.py", line 546, in update_available_resource
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager resources = self.driver.get_available_resource(self.nodename)
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 5396, in get_available_resource
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager disk_info_dict = self._get_local_gb_info()
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 5033, in _get_local_gb_info
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager info = LibvirtDriver._get_rbd_driver().get_pool_info()
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/storage/rbd_utils.py", line 380, in get_pool_info
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager with RADOSClient(self) as client:
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/storage/rbd_utils.py", line 107, in __init__
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager self.cluster, self.ioctx = driver._connect_to_rados(pool)
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/storage/rbd_utils.py", line 138, in _connect_to_rados
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager client.connect()
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager File "/usr/lib/python2.7/dist-packages/rados.py", line 429, in connect
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager raise make_ex(ret, "error connecting to the cluster")
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager TimedOut: error connecting to the cluster
2017-04-05 15:37:31.358 31188 ERROR nova.compute.manager
2017-04-05 15:37:32.398 31188 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 10.36.0.52:5673 via [amqp] client
2017-04-05 15:38:06.817 31188 INFO nova.compute.manager [req-fd7a0633-a3c9-43a6-b939-e4b5fe730b09 - - - - -] Running instance usage audit for host Virt32-Compute01.hosted2.provectio.local from 2017-04-05 14:00:00 to 2017-04-05 15:00:00. 0 instances.
2017-04-05 15:38:07.010 31188 ERROR nova.compute.manager [req-fd7a0633-a3c9-43a6-b939-e4b5fe730b09 - - - - -] No compute node record for host Virt32-Compute01.hosted2.provectio.local
2017-04-05 15:38:07.012 31188 INFO nova.compute.resource_tracker [req-fd7a0633-a3c9-43a6-b939-e4b5fe730b09 - - - - -] Auditing locally available compute resources for node Virt32-Compute01.hosted2.provectio.local
2017-04-05 15:43:07.023 31188 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server 10.36.0.57:5673 closed the connection. Check login credentials: Socket closed
2017-04-05 15:43:07.024 31188 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server 10.36.0.52:5673 closed the connection. Check login credentials: Socket closed
2017-04-05 15:43:07.025 31188 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Socket closed
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager [req-fd7a0633-a3c9-43a6-b939-e4b5fe730b09 - - - - -] Error updating resources for node Virt32-Compute01.hosted2.provectio.local.
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager Traceback (most recent call last):
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 6473, in update_available_resource_for_node
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager rt.update_available_resource(context)
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager File "/usr/lib/python2.7/dist-packages/nova/compute/resource_tracker.py", line 546, in update_available_resource
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager resources = self.driver.get_available_resource(self.nodename)
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 5396, in get_available_resource
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager disk_info_dict = self._get_local_gb_info()
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 5033, in _get_local_gb_info
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager info = LibvirtDriver._get_rbd_driver().get_pool_info()
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/storage/rbd_utils.py", line 380, in get_pool_info
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager with RADOSClient(self) as client:
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/storage/rbd_utils.py", line 107, in __init__
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager self.cluster, self.ioctx = driver._connect_to_rados(pool)
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/storage/rbd_utils.py", line 138, in _connect_to_rados
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager client.connect()
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager File "/usr/lib/python2.7/dist-packages/rados.py", line 429, in connect
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager raise make_ex(ret, "error connecting to the cluster")
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager TimedOut: error connecting to the cluster
2017-04-05 15:43:07.031 31188 ERROR nova.compute.manager
2017-04-05 15:43:08.046 31188 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 10.36.0.52:5673 via [amqp] client
2017-04-05 15:43:08.055 31188 INFO nova.compute.manager [req-fd7a0633-a3c9-43a6-b939-e4b5fe730b09 - - - - -] Updating bandwidth usage cache
2017-04-05 15:43:08.065 31188 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 10.36.0.57:5673 via [amqp] client
2017-04-05 15:43:08.154 31188 INFO nova.compute.manager [req-fd7a0633-a3c9-43a6-b939-e4b5fe730b09 - - - - -] Bandwidth usage not supported by hypervisor.
2017-04-05 15:44:08.539 31188 ERROR nova.compute.manager [req-fd7a0633-a3c9-43a6-b939-e4b5fe730b09 - - - - -] No compute node record for host Virt32-Compute01.hosted2.provectio.local
2017-04-05 15:44:08.540 31188 INFO nova.compute.resource_tracker [req-fd7a0633-a3c9-43a6-b939-e4b5fe730b09 - - - - -] Auditing locally available compute resources for node Virt32-Compute01.hosted2.provectio.local