Eucalyptus NC pending and terminate

Asked by pawelo210

I want to aks you about help. I have a problem to run instance on server with Node Controller. I attached nc.log with details.

Question information

Language:
English Edit question
Status:
Expired
For:
Ubuntu eucalyptus Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
pawelo210 (pawelo210) said :
#1

[Mon Aug 14 13:11:55 2017][001471][EUCAINFO ] StartNetwork(): SUCCESS return from vnetStartNetwork 0
[Mon Aug 14 13:11:55 2017][001471][EUCAINFO ] StartNetwork(): done
[Mon Aug 14 13:11:55 2017][001471][EUCAINFO ] doRunInstance() invoked (id=i-59730A0A cores=2 disk=10 memory=1024)
[Mon Aug 14 13:11:55 2017][001471][EUCAINFO ] image=emi-2C750D0E at http://192.168.0.50:8773/services/Walrus/uecimage/image.manifest.xml
[Mon Aug 14 13:11:55 2017][001471][EUCAINFO ] krnel=eki-402D0D8E at http://192.168.0.50:8773/services/Walrus/ueckernel/image.manifest.xml
[Mon Aug 14 13:11:55 2017][001471][EUCAINFO ] rmdsk=eri-51A90E04 at http://192.168.0.50:8773/services/Walrus/uecramdisk/image.manifest.xml
[Mon Aug 14 13:11:55 2017][001471][EUCAINFO ] vlan=10 priMAC=D0:0D:59:73:0A:0A privIp=172.19.1.2
[Mon Aug 14 13:11:55 2017][001471][EUCADEBUG ] state change for instance i-59730A0A: Unknown -> Staging (Pending)
[Mon Aug 14 13:11:55 2017][001471][EUCAINFO ] network started for instance i-59730A0A
[Mon Aug 14 13:11:55 2017][001471][EUCAINFO ] retrieving images for instance i-59730A0A (disk limit=10240MB)...
[Mon Aug 14 13:11:55 2017][001471][EUCAINFO ] walrus_request(): downloading /var/lib/eucalyptus/instances//admin/i-59730A0A/kernel-digest
[Mon Aug 14 13:11:55 2017][001471][EUCAINFO ] from http://192.168.0.50:8773/services/Walrus/ueckernel/image.manifest.xml
[Mon Aug 14 13:11:55 2017][001471][EUCADEBUG ] walrus_request(): writing GET output to /var/lib/eucalyptus/instances//admin/i-59730A0A/kernel-digest on 'Mon Aug 14 13:11:55 2017'
[Mon Aug 14 13:11:55 2017][001471][EUCADEBUG ] walrus_request(): wrote 7272 bytes in 0 writes
[Mon Aug 14 13:11:55 2017][001471][EUCAINFO ] walrus_request(): saved image in /var/lib/eucalyptus/instances//admin/i-59730A0A/kernel-digest
[Mon Aug 14 13:11:55 2017][001471][EUCAINFO ] downloading and preparing image into /var/lib/eucalyptus/instances//admin/i-59730A0A/kernel...
[Mon Aug 14 13:11:55 2017][001471][EUCAINFO ] walrus_request(): downloading /var/lib/eucalyptus/instances//admin/i-59730A0A/kernel
[Mon Aug 14 13:11:55 2017][001471][EUCAINFO ] from http://192.168.0.50:8773/services/Walrus/ueckernel/image.manifest.xml
[Mon Aug 14 13:11:55 2017][001471][EUCADEBUG ] walrus_request(): writing GET/GetDecryptedImage output to /var/lib/eucalyptus/instances//admin/i-59730A0A/kernel on 'Mon Aug 14 13:11:55 2017'
[Mon Aug 14 13:11:57 2017][001471][EUCADEBUG ] doDescribeResource() invoked
[Mon Aug 14 13:11:57 2017][001471][EUCADEBUG ] doDescribeInstances() invoked
[Mon Aug 14 13:11:57 2017][001471][EUCADEBUG ] doDescribeInstances(): instanceId=i-59730A0A publicIp=0.0.0.0 privateIp=172.19.1.2 mac=D0:0D:59:73:0A:0A vlan=10 networkIndex=2
[Mon Aug 14 13:12:04 2017][001471][EUCADEBUG ] doDescribeResource() invoked
[Mon Aug 14 13:12:04 2017][001471][EUCADEBUG ] doDescribeInstances() invoked
[Mon Aug 14 13:12:04 2017][001471][EUCADEBUG ] doDescribeInstances(): instanceId=i-59730A0A publicIp=0.0.0.0 privateIp=172.19.1.2 mac=D0:0D:59:73:0A:0A vlan=10 networkIndex=2
[Mon Aug 14 13:12:11 2017][001471][EUCADEBUG ] doDescribeResource() invoked
[Mon Aug 14 13:12:11 2017][001471][EUCADEBUG ] doDescribeInstances() invoked
[Mon Aug 14 13:12:11 2017][001471][EUCADEBUG ] doDescribeInstances(): instanceId=i-59730A0A publicIp=0.0.0.0 privateIp=172.19.1.2 mac=D0:0D:59:73:0A:0A vlan=10 networkIndex=2
[Mon Aug 14 13:12:18 2017][001471][EUCADEBUG ] doDescribeResource() invoked
[Mon Aug 14 13:12:19 2017][001471][EUCADEBUG ] doDescribeInstances() invoked
[Mon Aug 14 13:12:19 2017][001471][EUCADEBUG ] doDescribeInstances(): instanceId=i-59730A0A publicIp=0.0.0.0 privateIp=172.19.1.2 mac=D0:0D:59:73:0A:0A vlan=10 networkIndex=2
[Mon Aug 14 13:12:25 2017][001471][EUCADEBUG ] doDescribeResource() invoked
[Mon Aug 14 13:12:26 2017][001471][EUCADEBUG ] doDescribeInstances() invoked
[Mon Aug 14 13:12:26 2017][001471][EUCADEBUG ] doDescribeInstances(): instanceId=i-59730A0A publicIp=0.0.0.0 privateIp=172.19.1.2 mac=D0:0D:59:73:0A:0A vlan=10 networkIndex=2
[Mon Aug 14 13:12:33 2017][001471][EUCADEBUG ] doDescribeResource() invoked
[Mon Aug 14 13:12:33 2017][001471][EUCADEBUG ] doDescribeInstances() invoked
[Mon Aug 14 13:12:33 2017][001471][EUCADEBUG ] doDescribeInstances(): instanceId=i-59730A0A publicIp=0.0.0.0 privateIp=172.19.1.2 mac=D0:0D:59:73:0A:0A vlan=10 networkIndex=2
[Mon Aug 14 13:12:40 2017][001471][EUCADEBUG ] doDescribeResource() invoked
[Mon Aug 14 13:12:41 2017][001471][EUCADEBUG ] doDescribeInstances() invoked
[Mon Aug 14 13:12:41 2017][001471][EUCADEBUG ] doDescribeInstances(): instanceId=i-59730A0A publicIp=0.0.0.0 privateIp=172.19.1.2 mac=D0:0D:59:73:0A:0A vlan=10 networkIndex=2
[Mon Aug 14 13:12:47 2017][001471][EUCADEBUG ] doDescribeResource() invoked
[Mon Aug 14 13:12:48 2017][001471][EUCADEBUG ] doDescribeInstances() invoked
[Mon Aug 14 13:12:48 2017][001471][EUCADEBUG ] doDescribeInstances(): instanceId=i-59730A0A publicIp=0.0.0.0 privateIp=172.19.1.2 mac=D0:0D:59:73:0A:0A vlan=10 networkIndex=2
[Mon Aug 14 13:13:21 2017][001471][EUCADEBUG ] doDescribeResource() invoked
[Mon Aug 14 13:13:22 2017][001471][EUCADEBUG ] doDescribeInstances() invoked
[Mon Aug 14 13:13:22 2017][001471][EUCADEBUG ] doDescribeInstances(): instanceId=i-59730A0A publicIp=0.0.0.0 privateIp=172.19.1.2 mac=D0:0D:59:73:0A:0A vlan=10 networkIndex=2
[Mon Aug 14 13:13:28 2017][001471][EUCADEBUG ] doDescribeResource() invoked
[Mon Aug 14 13:13:29 2017][001471][EUCADEBUG ] doDescribeInstances() invoked
[Mon Aug 14 13:13:29 2017][001471][EUCADEBUG ] doDescribeInstances(): instanceId=i-59730A0A publicIp=0.0.0.0 privateIp=172.19.1.2 mac=D0:0D:59:73:0A:0A vlan=10 networkIndex=2
[Mon Aug 14 13:13:36 2017][001471][EUCADEBUG ] doDescribeResource() invoked
[Mon Aug 14 13:13:36 2017][001471][EUCADEBUG ] doDescribeInstances() invoked
                                                                                                                                            6669,1 85%
.
.
.
[Mon Aug 14 13:18:23 2017][001471][EUCADEBUG ] walrus_request(): wrote 0 bytes in 1 writes
[Mon Aug 14 13:18:23 2017][001471][EUCAINFO ] walrus_request(): saved image in /var/lib/eucalyptus/instances//admin/i-59730A0A/kernel
[Mon Aug 14 13:18:23 2017][001471][EUCAINFO ] vrun(): [cp -a /var/lib/eucalyptus/instances//admin/i-59730A0A/kernel /var/lib/eucalyptus/instances//eucalyptus/cache/eki-402D0D8E/kernel]
[Mon Aug 14 13:18:24 2017][001471][EUCADEBUG ] doDescribeResource() invoked
[Mon Aug 14 13:18:25 2017][001471][EUCADEBUG ] doDescribeInstances() invoked
[Mon Aug 14 13:18:25 2017][001471][EUCADEBUG ] doDescribeInstances(): instanceId=i-59730A0A publicIp=0.0.0.0 privateIp=172.19.1.2 mac=D0:0D:59:73:0A:0A vlan=10 networkIndex=2
[Mon Aug 14 13:20:04 2017][001471][EUCAINFO ] vrun(): [cp -a /var/lib/eucalyptus/instances//admin/i-59730A0A/kernel-digest /var/lib/eucalyptus/instances//eucalyptus/cache/eki-402D0D8E/kernel-digest]
[Mon Aug 14 13:20:04 2017][001471][EUCAINFO ] walrus_request(): downloading /var/lib/eucalyptus/instances//admin/i-59730A0A/ramdisk-digest
[Mon Aug 14 13:20:04 2017][001471][EUCAINFO ] from http://192.168.0.50:8773/services/Walrus/uecramdisk/image.manifest.xml
[Mon Aug 14 13:20:04 2017][001471][EUCADEBUG ] walrus_request(): writing GET output to /var/lib/eucalyptus/instances//admin/i-59730A0A/ramdisk-digest on 'Mon Aug 14 13:20:04 2017'
[Mon Aug 14 13:20:04 2017][001471][EUCADEBUG ] walrus_request(): wrote 7274 bytes in 0 writes
[Mon Aug 14 13:20:04 2017][001471][EUCAINFO ] walrus_request(): saved image in /var/lib/eucalyptus/instances//admin/i-59730A0A/ramdisk-digest
[Mon Aug 14 13:20:04 2017][001471][EUCAINFO ] downloading and preparing image into /var/lib/eucalyptus/instances//admin/i-59730A0A/ramdisk...
[Mon Aug 14 13:20:04 2017][001471][EUCAINFO ] walrus_request(): downloading /var/lib/eucalyptus/instances//admin/i-59730A0A/ramdisk
[Mon Aug 14 13:20:04 2017][001471][EUCAINFO ] from http://192.168.0.50:8773/services/Walrus/uecramdisk/image.manifest.xml
[Mon Aug 14 13:20:04 2017][001471][EUCADEBUG ] walrus_request(): writing GET/GetDecryptedImage output to /var/lib/eucalyptus/instances//admin/i-59730A0A/ramdisk on 'Mon Aug 14 13:20:04 2017'
[Mon Aug 14 13:26:04 2017][001471][EUCADEBUG ] doDescribeResource() invoked
[Mon Aug 14 13:26:05 2017][001471][EUCADEBUG ] doDescribeInstances() invoked
[Mon Aug 14 13:26:05 2017][001471][EUCADEBUG ] doDescribeInstances(): instanceId=i-59730A0A publicIp=0.0.0.0 privateIp=172.19.1.2 mac=D0:0D:59:73:0A:0A vlan=10 networkIndex=2
[Mon Aug 14 13:26:10 2017][001471][EUCADEBUG ] walrus_request(): wrote 0 bytes in 1 writes
[Mon Aug 14 13:26:10 2017][001471][EUCAINFO ] walrus_request(): saved image in /var/lib/eucalyptus/instances//admin/i-59730A0A/ramdisk
[Mon Aug 14 13:26:10 2017][001471][EUCAINFO ] vrun(): [cp -a /var/lib/eucalyptus/instances//admin/i-59730A0A/ramdisk /var/lib/eucalyptus/instances//eucalyptus/cache/eri-51A90E04/ramdisk]
[Mon Aug 14 13:26:11 2017][001471][EUCADEBUG ] doDescribeResource() invoked
[Mon Aug 14 13:26:12 2017][001471][EUCADEBUG ] doDescribeInstances() invoked
[Mon Aug 14 13:26:12 2017][001471][EUCADEBUG ] doDescribeInstances(): instanceId=i-59730A0A publicIp=0.0.0.0 privateIp=172.19.1.2 mac=D0:0D:59:73:0A:0A vlan=10 networkIndex=2
[Mon Aug 14 13:27:51 2017][001471][EUCAINFO ] vrun(): [cp -a /var/lib/eucalyptus/instances//admin/i-59730A0A/ramdisk-digest /var/lib/eucalyptus/instances//eucalyptus/cache/eri-51A90E04/ramdisk-digest]
[Mon Aug 14 13:27:51 2017][001471][EUCAINFO ] walrus_request(): downloading /var/lib/eucalyptus/instances//admin/i-59730A0A/disk-digest
[Mon Aug 14 13:27:51 2017][001471][EUCAINFO ] from http://192.168.0.50:8773/services/Walrus/uecimage/image.manifest.xml
[Mon Aug 14 13:27:52 2017][001471][EUCADEBUG ] walrus_request(): writing GET output to /var/lib/eucalyptus/instances//admin/i-59730A0A/disk-digest on 'Mon Aug 14 13:27:51 2017'
[Mon Aug 14 13:27:52 2017][001471][EUCADEBUG ] walrus_request(): wrote 7317 bytes in 0 writes
[Mon Aug 14 13:27:52 2017][001471][EUCAINFO ] walrus_request(): saved image in /var/lib/eucalyptus/instances//admin/i-59730A0A/disk-digest
[Mon Aug 14 13:27:52 2017][001471][EUCAFATAL ] error: insufficient disk capacity remaining (2048MB) in VM Type of instance i-59730A0A for component disk
[Mon Aug 14 13:27:52 2017][001471][EUCAERROR ] get_cached_file() failed (errno=0)
[Mon Aug 14 13:27:52 2017][001471][EUCAFATAL ] Failed to prepare images for instance i-59730A0A (error=1)
[Mon Aug 14 13:27:52 2017][001471][EUCADEBUG ] state change for instance i-59730A0A: Staging -> Shutoff (Extant)
[Mon Aug 14 13:27:52 2017][001471][EUCADEBUG ] doDescribeResource() invoked
[Mon Aug 14 13:27:52 2017][001471][EUCADEBUG ] doDescribeInstances() invoked
[Mon Aug 14 13:27:52 2017][001471][EUCADEBUG ] doDescribeInstances(): instanceId=i-59730A0A publicIp=0.0.0.0 privateIp=172.19.1.2 mac=D0:0D:59:73:0A:0A vlan=10 networkIndex=2
[Mon Aug 14 13:27:56 2017][001471][EUCAERROR ] libvirt: Domain not found: no domain with matching name 'i-59730A0A' (code=42)
[Mon Aug 14 13:27:56 2017][001471][EUCAINFO ] cleaning up state for instance i-59730A0A
[Mon Aug 14 13:27:56 2017][001471][EUCAINFO ] vrun(): [rm -rf /var/lib/eucalyptus/instances//admin/i-59730A0A/]
[Mon Aug 14 13:27:56 2017][001471][EUCAINFO ] stopping the network (vlan=10)
[Mon Aug 14 13:27:56 2017][001471][EUCADEBUG ] state change for instance i-59730A0A: Shutoff -> Teardown (Teardown)
[Mon Aug 14 13:27:59 2017][001471][EUCADEBUG ] doDescribeResource() invoked
[Mon Aug 14 13:27:59 2017][001471][EUCADEBUG ] doDescribeInstances() invoked
[Mon Aug 14 13:27:59 2017][001471][EUCADEBUG ] doDescribeInstances(): instanceId=i-59730A0A publicIp=0.0.0.0 priv

Revision history for this message
pawelo210 (pawelo210) said :
#2

I saw in NC.log some interesting info like this:

[Mon Aug 14 13:27:52 2017][001471][EUCAFATAL ] error: insufficient disk capacity remaining (2048MB) in VM Type of instance i-59730A0A for component disk

but I installed Eucalyptus NC on computer with 300 GB disk.

Revision history for this message
actionparsnip (andrew-woodhead666) said :
#3
Revision history for this message
pawelo210 (pawelo210) said :
#4

More details:
1) Result of command: euca-describe-availability-zones verbose on server with Cloud Host
AVAILABILITYZONE UECcluster1 192.168.0.50
AVAILABILITYZONE |- vm types free / max cpu ram disk
AVAILABILITYZONE |- m1.small 0002 / 0002 1 192 2
AVAILABILITYZONE |- m1.large 0001 / 0001 2 512 10
AVAILABILITYZONE |- c1.medium 0001 / 0001 2 1024 10
AVAILABILITYZONE |- m1.xlarge 0001 / 0001 2 1024 20
AVAILABILITYZONE |- c1.xlarge 0000 / 0000 4 2048 20

2) Result of command df -h on NC server with IP 10.0.0.2

Filesystem Size Used Avail Use% Mounted on /dev/mapper/UECserver2-root
                           292G 844M 276G 1% /
none 983M 236K 982M 1% /dev
none 989M 0 989M 0% /dev/shm
none 989M 80K 989M 1% /var/run
none 989M 0 989M 0% /var/lock
/dev/sda1 228M 23M 194M 11% /boot

Revision history for this message
Launchpad Janitor (janitor) said :
#5

This question was expired because it remained in the 'Open' state without activity for the last 15 days.