RabbitMQ not starting after reboot

Asked by Kanthi Kiran N

Hi All,

I had a successful setup of Single node OpenStack(cactus release) setup with Dashboard(vnc) until i restarted the system accidentally. Upon reboot I am unable to use the same. I realised that RabbitMQ is not starting. Please suggest. Following are the logs.

----------------------------------------------------------------------------------------------------------
root@openstack-manual:~# tail -f /var/log/rabbitmq/startup_err
Erlang has closed
Error: {node_start_failed,normal}

Crash dump was written to: erl_crash.dump
init terminating in do_boot ()

---------------------------------------------------------------------------

root@openstack-manual:~# /etc/init.d/rabbitmq-server status
Status of all running nodes...
Error: no_nodes_running
root@openstack-manual:~#

-------------------------------------------------------------------------

root@openstack-manual:~# /etc/init.d/rabbitmq-server start
Starting rabbitmq-server: FAILED - check /var/log/rabbitmq/startup_log, _err
rabbitmq-server.
root@openstack-manual:~#
------------------------------------------------------------------
root@openstack-manual:~# tail -f /var/log/nova/nova-compute.log

2011-06-16 06:06:11,890 ERROR nova.rpc [-] AMQP server on 192.168.138.150:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.
2011-06-16 06:06:21,896 ERROR nova.rpc [-] AMQP server on 192.168.138.150:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.
2011-06-16 06:06:31,902 ERROR nova.rpc [-] AMQP server on 192.168.138.150:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.
2011-06-16 06:06:41,908 ERROR nova.rpc [-] AMQP server on 192.168.138.150:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.

--------------------------------------------------------------------------------------------------

root@openstack-manual:~# sudo rabbitmqctl status
Status of node 'rabbit@openstack-manual' ...
Error: unable to connect to node 'rabbit@openstack-manual': nodedown
diagnostics:
- nodes and their ports on openstack-manual: [{rabbitmqctl5269,53222}]
- current node: 'rabbitmqctl5269@openstack-manual'
- current node home dir: /var/lib/rabbitmq
- current node cookie hash: ylvrsznLiVQs+ufqjiN+2g==
root@openstack-manual:~#

-----------------------------------------------------------------------------------------------------

Question information

Language:
English Edit question
Status:
Solved
For:
OpenStack Compute (nova) Edit question
Assignee:
No assignee Edit question
Solved by:
Vish Ishaya
Solved:
Last query:
Last reply:
Revision history for this message
Best Vish Ishaya (vishvananda) said :
#1

You probably have a corrupted mnesia database. If you delete /var/lib/rabbit/mnesia you should be able to start rabbit again.

Vish

On Jun 17, 2011, at 1:35 AM, Kanthi Kiran N wrote:

> New question #161781 on OpenStack Compute (nova):
> https://answers.launchpad.net/nova/+question/161781
>
> Hi All,
>
> I had a successful setup of Single node OpenStack(cactus release) setup with Dashboard(vnc) until i restarted the system accidentally. Upon reboot I am unable to use the same. I realised that RabbitMQ is not starting. Please suggest. Following are the logs.
>
> ----------------------------------------------------------------------------------------------------------
> root@openstack-manual:~# tail -f /var/log/rabbitmq/startup_err
> Erlang has closed
> Error: {node_start_failed,normal}
>
> Crash dump was written to: erl_crash.dump
> init terminating in do_boot ()
>
>
> ---------------------------------------------------------------------------
>
> root@openstack-manual:~# /etc/init.d/rabbitmq-server status
> Status of all running nodes...
> Error: no_nodes_running
> root@openstack-manual:~#
>
> -------------------------------------------------------------------------
>
> root@openstack-manual:~# /etc/init.d/rabbitmq-server start
> Starting rabbitmq-server: FAILED - check /var/log/rabbitmq/startup_log, _err
> rabbitmq-server.
> root@openstack-manual:~#
> ------------------------------------------------------------------
> root@openstack-manual:~# tail -f /var/log/nova/nova-compute.log
>
> 2011-06-16 06:06:11,890 ERROR nova.rpc [-] AMQP server on 192.168.138.150:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.
> 2011-06-16 06:06:21,896 ERROR nova.rpc [-] AMQP server on 192.168.138.150:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.
> 2011-06-16 06:06:31,902 ERROR nova.rpc [-] AMQP server on 192.168.138.150:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.
> 2011-06-16 06:06:41,908 ERROR nova.rpc [-] AMQP server on 192.168.138.150:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.
>
> --------------------------------------------------------------------------------------------------
>
> root@openstack-manual:~# sudo rabbitmqctl status
> Status of node 'rabbit@openstack-manual' ...
> Error: unable to connect to node 'rabbit@openstack-manual': nodedown
> diagnostics:
> - nodes and their ports on openstack-manual: [{rabbitmqctl5269,53222}]
> - current node: 'rabbitmqctl5269@openstack-manual'
> - current node home dir: /var/lib/rabbitmq
> - current node cookie hash: ylvrsznLiVQs+ufqjiN+2g==
> root@openstack-manual:~#
>
> -----------------------------------------------------------------------------------------------------
>
>
> --
> You received this question notification because you are a member of Nova
> Core, which is an answer contact for OpenStack Compute (nova).

Revision history for this message
Kanthi Kiran N (nkanthikiran) said :
#2

Thank You Vish. It worked

Revision history for this message
Kanthi Kiran N (nkanthikiran) said :
#3

Thanks Vish Ishaya, that solved my question.