nova-volume startup issues

Asked by Mandeep Singh

Hi,
I have setup nova-volume service on a node different than my controller & compute nodes (accessible vice-versa). I have also setup nova-volumes group. When I start the nova-volume service, it keeps on trying to start with the following message in the logs:-

2011-04-15 18:03:14,953 DEBUG nova [-] Serving nova-volume from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:283
2011-04-15 18:03:14,953 DEBUG nova [-] Full set of FLAGS: from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:284
2011-04-15 18:03:14,955 DEBUG nova [-] storage_availability_zone : nova from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,956 DEBUG nova [-] help : None from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,956 DEBUG nova [-] ec2_dmz_host : 192.168.10.37 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,956 DEBUG nova [-] compute_topic : compute from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,957 DEBUG nova [-] glance_port : 9292 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,957 DEBUG nova [-] rabbit_password : guest from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,957 DEBUG nova [-] s3_dmz : 192.168.10.37 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,957 DEBUG nova [-] aws_access_key_id : admin from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,957 DEBUG nova [-] enable_new_services : True from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,958 DEBUG nova [-] my_ip : 192.168.10.37 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,959 DEBUG nova [-] quota_max_injected_files : 5 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,959 DEBUG nova [-] zone_capabilities : ['hypervisor=xenserver;kvm', 'os=linux;windows'] from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,959 DEBUG nova [-] logdir : /var/log/nova from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,960 DEBUG nova [-] sqlite_db : nova.sqlite from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,960 DEBUG nova [-] iscsi_target_prefix : iqn.2010-10.org.openstack: from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,963 DEBUG nova [-] blades_per_shelf : 16 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,963 DEBUG nova [-] osapi_max_limit : 1000 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,964 DEBUG nova [-] aoe_eth_dev : eth0 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,965 DEBUG nova [-] rabbit_port : 5672 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,965 DEBUG nova [-] rabbit_max_retries : 12 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,965 DEBUG nova [-] ec2_listen : 0.0.0.0 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,965 DEBUG nova [-] logfile : None from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,965 DEBUG nova [-] ajax_console_proxy_url : http://127.0.0.1:8000 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,965 DEBUG nova [-] ajax_console_proxy_topic : ajax_proxy from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,967 DEBUG nova [-] quota_cores : 20 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,967 DEBUG nova [-] rabbit_userid : guest from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,967 DEBUG nova [-] volume_topic : volume from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,968 DEBUG nova [-] volume_name_template : volume-%08x from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,968 DEBUG nova [-] lock_path : /var/lock/nova from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,969 DEBUG nova [-] iscsi_num_targets : 100 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,969 DEBUG nova [-] osapi_listen_port : 8774 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,970 DEBUG nova [-] connection_type : libvirt from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,970 DEBUG nova [-] default_project : openstack from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,970 DEBUG nova [-] s3_port : 3333 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,970 DEBUG nova [-] logging_context_format_string : %(asctime)s %(levelname)s %(name)s [%(request_id)s %(user)s %(project)s] %(message)s from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,970 DEBUG nova [-] instance_name_template : instance-%08x from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,971 DEBUG nova [-] ec2_host : 192.168.10.37 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,971 DEBUG nova [-] quota_metadata_items : 128 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,971 DEBUG nova [-] logging_debug_format_suffix : from (pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,972 DEBUG nova [-] console_manager : nova.console.manager.ConsoleProxyManager from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,973 DEBUG nova [-] ? : None from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,973 DEBUG nova [-] default_log_levels : ['amqplib=WARN', 'sqlalchemy=WARN', 'boto=WARN', 'eventlet.wsgi.server=WARN'] from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,973 DEBUG nova [-] osapi_scheme : http from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,973 DEBUG nova [-] sql_connection : mysql://root:root@192.168.11.10/nova from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,973 DEBUG nova [-] console_topic : console from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,975 DEBUG nova [-] use_local_volumes : True from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,975 DEBUG nova [-] host : glance-node from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,977 DEBUG nova [-] quota_max_injected_file_content_bytes : 10240 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,977 DEBUG nova [-] db_backend : sqlalchemy from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,977 DEBUG nova [-] sql_retry_interval : 10 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,978 DEBUG nova [-] volume_driver : nova.volume.driver.ISCSIDriver from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,979 DEBUG nova [-] s3_host : 192.168.11.10 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,979 DEBUG nova [-] scheduler_topic : scheduler from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,979 DEBUG nova [-] verbose : True from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,979 DEBUG nova [-] sql_max_retries : 12 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,981 DEBUG nova [-] num_iscsi_scan_tries : 3 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,981 DEBUG nova [-] default_instance_type : m1.small from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,981 DEBUG nova [-] num_shelves : 100 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,982 DEBUG nova [-] periodic_interval : 60 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,983 DEBUG nova [-] vpn_key_suffix : -vpn from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,983 DEBUG nova [-] null_kernel : nokernel from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,984 DEBUG nova [-] helpshort : None from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,986 DEBUG nova [-] volume_group : nova-volumes from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,986 DEBUG nova [-] logging_exception_prefix : (%(name)s): TRACE: from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,986 DEBUG nova [-] report_interval : 10 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,986 DEBUG nova [-] scheduler_manager : nova.scheduler.manager.SchedulerManager from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,987 DEBUG nova [-] ec2_port : 8773 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,987 DEBUG nova [-] osapi_port : 8774 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,987 DEBUG nova [-] auth_token_ttl : 3600 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,988 DEBUG nova [-] quota_volumes : 10 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,989 DEBUG nova [-] ec2_listen_port : 8773 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,989 DEBUG nova [-] ec2_scheme : http from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,989 DEBUG nova [-] vpn_image_id : ami-cloudpipe from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,990 DEBUG nova [-] quota_floating_ips : 10 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,991 DEBUG nova [-] state_path : /var/lib/nova from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,991 DEBUG nova [-] sql_idle_timeout : 3600 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,991 DEBUG nova [-] glance_host : 192.168.10.37 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,991 DEBUG nova [-] default_image : ami-11111 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,991 DEBUG nova [-] aws_secret_access_key : admin from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,991 DEBUG nova [-] osapi_listen : 0.0.0.0 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,993 DEBUG nova [-] helpxml : None from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,993 DEBUG nova [-] fake_network : False from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,993 DEBUG nova [-] osapi_extensions_path : /var/lib/nova/extensions from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,995 DEBUG nova [-] quota_gigabytes : 1000 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,995 DEBUG nova [-] region_list : [] from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,995 DEBUG nova [-] network_manager : nova.network.manager.VlanManager from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,997 DEBUG nova [-] enable_zone_routing : False from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,997 DEBUG nova [-] osapi_host : 192.168.10.37 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,997 DEBUG nova [-] zone_name : nova from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,997 DEBUG nova [-] logging_default_format_string : %(asctime)s %(levelname)s %(name)s [-] %(message)s from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,999 DEBUG nova [-] quota_max_injected_file_path_bytes : 255 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:14,999 DEBUG nova [-] fake_rabbit : False from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,000 DEBUG nova [-] num_shell_tries : 3 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,001 DEBUG nova [-] rabbit_host : 192.168.11.10 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,001 DEBUG nova [-] use_syslog : False from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,001 DEBUG nova [-] osapi_path : /v1.0/ from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,001 DEBUG nova [-] ec2_path : /services/Cloud from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,003 DEBUG nova [-] rbd_pool : rbd from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,003 DEBUG nova [-] rabbit_retry_interval : 10 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,003 DEBUG nova [-] node_availability_zone : nova from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,004 DEBUG nova [-] db_driver : nova.db.api from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,006 DEBUG nova [-] iscsi_ip_prefix : 192.168.10 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,006 DEBUG nova [-] volume_manager : nova.volume.manager.VolumeManager from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,006 DEBUG nova [-] rpc_thread_pool_size : 1024 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,006 DEBUG nova [-] api_paste_config : api-paste.ini from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,007 DEBUG nova [-] rabbit_virtual_host : / from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,008 DEBUG nova [-] quota_instances : 10 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,008 DEBUG nova [-] image_service : nova.image.glance.GlanceImageService from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,008 DEBUG nova [-] control_exchange : nova from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,009 DEBUG nova [-] ajax_console_proxy_port : 8000 from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,009 DEBUG nova [-] compute_manager : nova.compute.manager.ComputeManager from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,009 DEBUG nova [-] network_topic : network from (pid=17524) serve /usr/lib/pymodules/python2.6/nova/service.py:287
2011-04-15 18:03:15,009 AUDIT nova [-] Starting volume node (version 2011.2-workspace:tarmac-20110415024701-a9bdb77vaatk99lh)
2011-04-15 18:03:15,009 DEBUG nova.utils [-] Running cmd (subprocess): sudo vgs --noheadings -o name from (pid=17524) execute /usr/lib/pymodules/python2.6/nova/utils.py:150
2011-04-15 18:03:15,196 DEBUG nova.utils [-] backend <module 'nova.db.sqlalchemy.api' from '/usr/lib/pymodules/python2.6/nova/db/sqlalchemy/api.pyc'> from (pid=17524) __get_backend /usr/lib/pymodules/python2.6/nova/utils.py:427
2011-04-15 18:03:20,420 CRITICAL nova [-] (OperationalError) (1054, "Unknown column 'instances_1.instance_type_id' in 'field list'") 'SELECT volumes.created_at AS volumes_created_at, volumes.updated_at AS volumes_updated_at, volumes.deleted_at AS volumes_deleted_at, volumes.deleted AS volumes_deleted, volumes.id AS volumes_id, volumes.user_id AS volumes_user_id, volumes.project_id AS volumes_project_id, volumes.host AS volumes_host, volumes.size AS volumes_size, volumes.availability_zone AS volumes_availability_zone, volumes.instance_id AS volumes_instance_id, volumes.mountpoint AS volumes_mountpoint, volumes.attach_time AS volumes_attach_time, volumes.status AS volumes_status, volumes.attach_status AS volumes_attach_status, volumes.scheduled_at AS volumes_scheduled_at, volumes.launched_at AS volumes_launched_at, volumes.terminated_at AS volumes_terminated_at, volumes.display_name AS volumes_display_name, volumes.display_description AS volumes_display_description, volumes.provider_location AS volumes_provider_location, volumes.provider_auth AS volumes_provider_auth, instances_1.created_at AS instances_1_created_at, instances_1.updated_at AS instances_1_updated_at, instances_1.deleted_at AS instances_1_deleted_at, instances_1.deleted AS instances_1_deleted, instances_1.id AS instances_1_id, instances_1.admin_pass AS instances_1_admin_pass, instances_1.user_id AS instances_1_user_id, instances_1.project_id AS instances_1_project_id, instances_1.image_id AS instances_1_image_id, instances_1.kernel_id AS instances_1_kernel_id, instances_1.ramdisk_id AS instances_1_ramdisk_id, instances_1.launch_index AS instances_1_launch_index, instances_1.key_name AS instances_1_key_name, instances_1.key_data AS instances_1_key_data, instances_1.state AS instances_1_state, instances_1.state_description AS instances_1_state_description, instances_1.memory_mb AS instances_1_memory_mb, instances_1.vcpus AS instances_1_vcpus, instances_1.local_gb AS instances_1_local_gb, instances_1.hostname AS instances_1_hostname, instances_1.host AS instances_1_host, instances_1.instance_type_id AS instances_1_instance_type_id, instances_1.user_data AS instances_1_user_data, instances_1.reservation_id AS instances_1_reservation_id, instances_1.mac_address AS instances_1_mac_address, instances_1.scheduled_at AS instances_1_scheduled_at, instances_1.launched_at AS instances_1_launched_at, instances_1.terminated_at AS instances_1_terminated_at, instances_1.availability_zone AS instances_1_availability_zone, instances_1.display_name AS instances_1_display_name, instances_1.display_description AS instances_1_display_description, instances_1.launched_on AS instances_1_launched_on, instances_1.locked AS instances_1_locked, instances_1.os_type AS instances_1_os_type \nFROM volumes LEFT OUTER JOIN instances AS instances_1 ON volumes.instance_id = instances_1.id AND volumes.deleted = %s \nWHERE volumes.host = %s AND volumes.deleted = %s' (False, 'glance-node', False)
(nova): TRACE: Traceback (most recent call last):
(nova): TRACE: File "/usr/bin/nova-volume", line 48, in <module>
(nova): TRACE: service.serve()
(nova): TRACE: File "/usr/lib/pymodules/python2.6/nova/service.py", line 290, in serve
(nova): TRACE: x.start()
(nova): TRACE: File "/usr/lib/pymodules/python2.6/nova/service.py", line 84, in start
(nova): TRACE: self.manager.init_host()
(nova): TRACE: File "/usr/lib/pymodules/python2.6/nova/volume/manager.py", line 85, in init_host
(nova): TRACE: volumes = self.db.volume_get_all_by_host(ctxt, self.host)
(nova): TRACE: File "/usr/lib/pymodules/python2.6/nova/db/api.py", line 825, in volume_get_all_by_host
(nova): TRACE: return IMPL.volume_get_all_by_host(context, host)
(nova): TRACE: File "/usr/lib/pymodules/python2.6/nova/db/sqlalchemy/api.py", line 98, in wrapper
(nova): TRACE: return f(*args, **kwargs)
(nova): TRACE: File "/usr/lib/pymodules/python2.6/nova/db/sqlalchemy/api.py", line 1682, in volume_get_all_by_host
(nova): TRACE: filter_by(deleted=can_read_deleted(context)).\
(nova): TRACE: File "/usr/lib/pymodules/python2.6/sqlalchemy/orm/query.py", line 1453, in all
(nova): TRACE: return list(self)
(nova): TRACE: File "/usr/lib/pymodules/python2.6/sqlalchemy/orm/query.py", line 1565, in __iter__
(nova): TRACE: return self._execute_and_instances(context)
(nova): TRACE: File "/usr/lib/pymodules/python2.6/sqlalchemy/orm/query.py", line 1570, in _execute_and_instances
(nova): TRACE: mapper=self._mapper_zero_or_none())
(nova): TRACE: File "/usr/lib/pymodules/python2.6/sqlalchemy/orm/session.py", line 735, in execute
(nova): TRACE: clause, params or {})
(nova): TRACE: File "/usr/lib/pymodules/python2.6/sqlalchemy/engine/base.py", line 1157, in execute
(nova): TRACE: params)
(nova): TRACE: File "/usr/lib/pymodules/python2.6/sqlalchemy/engine/base.py", line 1237, in _execute_clauseelement
(nova): TRACE: return self.__execute_context(context)
(nova): TRACE: File "/usr/lib/pymodules/python2.6/sqlalchemy/engine/base.py", line 1268, in __execute_context
(nova): TRACE: context.parameters[0], context=context)
(nova): TRACE: File "/usr/lib/pymodules/python2.6/sqlalchemy/engine/base.py", line 1367, in _cursor_execute
(nova): TRACE: context)
(nova): TRACE: File "/usr/lib/pymodules/python2.6/sqlalchemy/engine/base.py", line 1360, in _cursor_execute
(nova): TRACE: context)
(nova): TRACE: File "/usr/lib/pymodules/python2.6/sqlalchemy/engine/default.py", line 288, in do_execute
(nova): TRACE: cursor.execute(statement, parameters)
(nova): TRACE: File "/usr/lib/pymodules/python2.6/MySQLdb/cursors.py", line 166, in execute
(nova): TRACE: self.errorhandler(self, exc, value)
(nova): TRACE: File "/usr/lib/pymodules/python2.6/MySQLdb/connections.py", line 35, in defaulterrorhandler
(nova): TRACE: raise errorclass, errorvalue
(nova): TRACE: OperationalError: (OperationalError) (1054, "Unknown column 'instances_1.instance_type_id' in 'field list'") 'SELECT volumes.created_at AS volumes_created_at, volumes.updated_at AS volumes_updated_at, volumes.deleted_at AS volumes_deleted_at, volumes.deleted AS volumes_deleted, volumes.id AS volumes_id, volumes.user_id AS volumes_user_id, volumes.project_id AS volumes_project_id, volumes.host AS volumes_host, volumes.size AS volumes_size, volumes.availability_zone AS volumes_availability_zone, volumes.instance_id AS volumes_instance_id, volumes.mountpoint AS volumes_mountpoint, volumes.attach_time AS volumes_attach_time, volumes.status AS volumes_status, volumes.attach_status AS volumes_attach_status, volumes.scheduled_at AS volumes_scheduled_at, volumes.launched_at AS volumes_launched_at, volumes.terminated_at AS volumes_terminated_at, volumes.display_name AS volumes_display_name, volumes.display_description AS volumes_display_description, volumes.provider_location AS volumes_provider_location, volumes.provider_auth AS volumes_provider_auth, instances_1.created_at AS instances_1_created_at, instances_1.updated_at AS instances_1_updated_at, instances_1.deleted_at AS instances_1_deleted_at, instances_1.deleted AS instances_1_deleted, instances_1.id AS instances_1_id, instances_1.admin_pass AS instances_1_admin_pass, instances_1.user_id AS instances_1_user_id, instances_1.project_id AS instances_1_project_id, instances_1.image_id AS instances_1_image_id, instances_1.kernel_id AS instances_1_kernel_id, instances_1.ramdisk_id AS instances_1_ramdisk_id, instances_1.launch_index AS instances_1_launch_index, instances_1.key_name AS instances_1_key_name, instances_1.key_data AS instances_1_key_data, instances_1.state AS instances_1_state, instances_1.state_description AS instances_1_state_description, instances_1.memory_mb AS instances_1_memory_mb, instances_1.vcpus AS instances_1_vcpus, instances_1.local_gb AS instances_1_local_gb, instances_1.hostname AS instances_1_hostname, instances_1.host AS instances_1_host, instances_1.instance_type_id AS instances_1_instance_type_id, instances_1.user_data AS instances_1_user_data, instances_1.reservation_id AS instances_1_reservation_id, instances_1.mac_address AS instances_1_mac_address, instances_1.scheduled_at AS instances_1_scheduled_at, instances_1.launched_at AS instances_1_launched_at, instances_1.terminated_at AS instances_1_terminated_at, instances_1.availability_zone AS instances_1_availability_zone, instances_1.display_name AS instances_1_display_name, instances_1.display_description AS instances_1_display_description, instances_1.launched_on AS instances_1_launched_on, instances_1.locked AS instances_1_locked, instances_1.os_type AS instances_1_os_type \nFROM volumes LEFT OUTER JOIN instances AS instances_1 ON volumes.instance_id = instances_1.id AND volumes.deleted = %s \nWHERE volumes.host = %s AND volumes.deleted = %s' (False, 'glance-node', False)
(nova): TRACE:

Question information

Language:
English Edit question
Status:
Solved
For:
OpenStack Compute (nova) Edit question
Assignee:
No assignee Edit question
Solved by:
Vish Ishaya
Solved:
Last query:
Last reply:
Revision history for this message
Masanori Itoh (itohm) said :
#1

Hi Mandeep,

Do you have this issue if you run nova-volume on the same node with nova-api etc. ?
In other word, running a single node installation successful?

I'm suspecting that there could be sqlalchemy version mismatch among nodes.
For example, the node on which nova-volume runs has a bit (but critically) older version
sqlalchemy or related python lpackages.

Thanks,
Masanori

Revision history for this message
Mandeep Singh (mandeep-singh) said :
#2

Thanks Masanori. I updated the packages on all the nodes and recreated the DB. This solved the above mentioned issue an I was able to successfully create a volume but now I am getting another issue, when I do euca-attach-volume -i i-00000001 -d /dev/sdb vol-00000001:

 ERROR nova [-] Exception during message handling
(nova): TRACE: Traceback (most recent call last):
(nova): TRACE: File "/usr/lib/pymodules/python2.6/nova/rpc.py", line 188, in _receive
(nova): TRACE: rval = node_func(context=ctxt, **node_args)
(nova): TRACE: File "/usr/lib/pymodules/python2.6/nova/compute/manager.py", line 105, in decorated_function
(nova): TRACE: function(self, context, instance_id, *args, **kwargs)
(nova): TRACE: File "/usr/lib/pymodules/python2.6/nova/compute/manager.py", line 743, in attach_volume
(nova): TRACE: volume_id)
(nova): TRACE: File "/usr/lib/pymodules/python2.6/nova/volume/manager.py", line 164, in setup_compute_volume
(nova): TRACE: path = self.driver.discover_volume(context, volume_ref)
(nova): TRACE: File "/usr/lib/pymodules/python2.6/nova/volume/driver.py", line 446, in discover_volume
(nova): TRACE: iscsi_properties = self._get_iscsi_properties(volume)
(nova): TRACE: File "/usr/lib/pymodules/python2.6/nova/volume/driver.py", line 407, in _get_iscsi_properties
(nova): TRACE: (volume['name']))
(nova): TRACE: Error: Could not find iSCSI export for volume volume-00000001
(nova): TRACE:

Revision history for this message
Best Vish Ishaya (vishvananda) said :
#3

did you set --iscsi_ip_prefix to a useful value? The discovery code needs to know which ip to try to connect on and it currently uses that flag. If your local network is 192.168.1.0/24 for example, try setting the prefix to 192.168.1

Vish

On Apr 17, 2011, at 10:21 PM, Mandeep Singh wrote:

> Question #152930 on OpenStack Compute (nova) changed:
> https://answers.launchpad.net/nova/+question/152930
>
> Mandeep Singh gave more information on the question:
> Thanks Masanori. I updated the packages on all the nodes and recreated
> the DB. This solved the above mentioned issue an I was able to
> successfully create a volume but now I am getting another issue, when I
> do euca-attach-volume -i i-00000001 -d /dev/sdb vol-00000001:
>
> ERROR nova [-] Exception during message handling
> (nova): TRACE: Traceback (most recent call last):
> (nova): TRACE: File "/usr/lib/pymodules/python2.6/nova/rpc.py", line 188, in _receive
> (nova): TRACE: rval = node_func(context=ctxt, **node_args)
> (nova): TRACE: File "/usr/lib/pymodules/python2.6/nova/compute/manager.py", line 105, in decorated_function
> (nova): TRACE: function(self, context, instance_id, *args, **kwargs)
> (nova): TRACE: File "/usr/lib/pymodules/python2.6/nova/compute/manager.py", line 743, in attach_volume
> (nova): TRACE: volume_id)
> (nova): TRACE: File "/usr/lib/pymodules/python2.6/nova/volume/manager.py", line 164, in setup_compute_volume
> (nova): TRACE: path = self.driver.discover_volume(context, volume_ref)
> (nova): TRACE: File "/usr/lib/pymodules/python2.6/nova/volume/driver.py", line 446, in discover_volume
> (nova): TRACE: iscsi_properties = self._get_iscsi_properties(volume)
> (nova): TRACE: File "/usr/lib/pymodules/python2.6/nova/volume/driver.py", line 407, in _get_iscsi_properties
> (nova): TRACE: (volume['name']))
> (nova): TRACE: Error: Could not find iSCSI export for volume volume-00000001
> (nova): TRACE:
>
> --
> You received this question notification because you are a member of Nova
> Core, which is an answer contact for OpenStack Compute (nova).

Revision history for this message
Mandeep Singh (mandeep-singh) said :
#4

Thanks Vish Ishaya, that solved my question.