Service does not configure bridge on controller

Hi,

I am setting up a two node OpenStack configuration using the OpenStack Basic Installation guide (I am merging the network node into the controller node). After following the guide, I was able to configure quantum and everything seemed to be working okay. I have three NICs on the machine: one for management, one for data, and one for public bridge. After configuration, I saw that the bridge interface was assigned the ip address 7.7.7.8 and two tap interfaces were created for demo-net (10.5.5.1 and 10.5.5.2).

The problems started when I rebooted the machine. Looking at ifconfig, I could no longer see the bridge interface or the tap interfaces. Digging into the logs I saw some errors in quantum with the AMQP server and authentication. Here are the errors:

==================================

root@irad-controller:/var/log/quantum# grep ERROR *
dhcp-agent.log:2013-01-11 11:10:12 ERROR [quantum.openstack.common.rpc.common] AMQP server on 192.168.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
dhcp-agent.log:2013-01-11 11:10:13 ERROR [quantum.openstack.common.rpc.common] AMQP server on 192.168.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds.
dhcp-agent.log:2013-01-11 11:11:16 ERROR [quantum.openstack.common.rpc.common] Timed out waiting for RPC response: timed out
dhcp-agent.log:2013-01-11 11:11:16 ERROR [quantum.agent.dhcp_agent] Unable to sync network state.
l3-agent.log:2013-01-11 11:07:23 ERROR [quantum.agent.l3_agent] external network bridge 'br-ex' does not exist
l3-agent.log:2013-01-11 11:10:14 ERROR [quantum.agent.l3_agent] Error running l3_nat daemon_loop
openvswitch-agent.log:2013-01-11 11:10:15 ERROR [quantum.openstack.common.rpc.common] AMQP server on 192.168.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
openvswitch-agent.log:2013-01-11 11:11:16 ERROR [quantum.openstack.common.rpc.common] Timed out waiting for RPC response: timed out

Here are the detailed log messages for the l3 errors:

2013-01-11 11:07:23 DEBUG [quantum.agent.linux.utils] Running command: ip -o link show br-ex
2013-01-11 11:07:23 DEBUG [quantum.agent.linux.utils]
Command: ['ip', '-o', 'link', 'show', 'br-ex']
Exit code: 1
Stdout: ''
Stderr: 'Device "br-ex" does not exist.\n'
2013-01-11 11:07:23 ERROR [quantum.agent.l3_agent] external network bridge 'br-ex' does not exist

2013-01-11 11:10:14 DEBUG [quantumclient.client] REQ: curl -i http://192.168.0.1:35357/v2.0/tokens -X POST -H "Content-Type: appli$

2013-01-11 11:10:14 DEBUG [quantumclient.client] REQ BODY: {"auth": {"tenantName": "service", "passwordCredentials": {"username": $

2013-01-11 11:10:14 DEBUG [quantumclient.client] RESP:{'date': 'Fri, 11 Jan 2013 16:10:14 GMT', 'transfer-encoding': 'chunked', 's$

2013-01-11 11:10:14 DEBUG [quantumclient.client] RESP BODY:{"error": {"message": "An unexpected error prevented the server from fu$

2013-01-11 11:10:14 ERROR [quantum.agent.l3_agent] Error running l3_nat daemon_loop
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/quantum/agent/l3_agent.py", line 170, in daemon_loop
    self.do_single_loop()
  File "/usr/lib/python2.7/dist-packages/quantum/agent/l3_agent.py", line 201, in do_single_loop
    target_ex_net_id = self._fetch_external_net_id()
  File "/usr/lib/python2.7/dist-packages/quantum/agent/l3_agent.py", line 182, in _fetch_external_net_id
    ex_nets = self.qclient.list_networks(**params)['networks']
  File "/usr/lib/python2.7/dist-packages/quantumclient/v2_0/client.py", line 102, in with_params
    ret = self.function(instance, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/quantumclient/v2_0/client.py", line 244, in list_networks
    return self.get(self.networks_path, params=_params)
  File "/usr/lib/python2.7/dist-packages/quantumclient/v2_0/client.py", line 525, in get
    headers=headers, params=params)
  File "/usr/lib/python2.7/dist-packages/quantumclient/v2_0/client.py", line 510, in retry_request
    headers=headers, params=params)
  File "/usr/lib/python2.7/dist-packages/quantumclient/v2_0/client.py", line 447, in do_request
    resp, replybody = self.httpclient.do_request(action, method, body=body)
  File "/usr/lib/python2.7/dist-packages/quantumclient/client.py", line 139, in do_request
    self.authenticate()
  File "/usr/lib/python2.7/dist-packages/quantumclient/client.py", line 199, in authenticate
    raise exceptions.Unauthorized(message=body)
Unauthorized: {"error": {"message": "An unexpected error prevented the server from fulfilling your request. (OperationalError) (2002,$

==================================

When I check to see if br-ex exists this is what I see:

root@irad-controller:/var/log/quantum# ovs-vsctl list-br
br-ex
br-int
br-tun

So it looks like it exists.

I'm not sure what is causing the AMQP problems as nothing else seems to have a problem communicating with the service (for example there are no errors in the nova logs).

Any help would be greatly appreciated, Thank you!