VlanManager: nova-compute node creates vlan on default eth instead of --vlan_interface

Asked by Giuseppe Civitella

Hi all,

I've got a 2 nodes openstack setup were I'm testing a VlanManager network: both the nodes are natty 11.04 64bit running Diablo milestone (2011.3~d3-0ubuntu0~ppa1~natty1).
One of the node runs the nova-sheduler and the nova-network services.
It has the following network related flags:
--network_manager=nova.network.manager.VlanManager
--flat_network_dhcp_start=10.12.1.1
--flat_network_dns=212.29.129.3
--fixed_range=10.12.0.0/16
--iscsi_ip_prefix=10.10.11.
--vlan_interface=eth0
--flat_interface=eth0
--public_interface=eth1

The other runs nova-compute and has the following network related flags:
--network_manager=nova.network.manager.VlanManager
--flat_network_dhcp_start=10.12.1.1
--flat_network_dns=212.29.129.3
--fixed_range=10.12.0.0/16
--iscsi_ip_prefix=10.10.11.
--vlan_interface=eth4
--flat_interface=eth4
--public_interface=eth1
--logdir=/var/log/nova
--state_path=/var/lib/nova
--verbose

If I check the registered vlan config on this node I got:
root@beta:~# nova-manage config list|grep vlan
--vlan_interface=eth4
--vlan_start=100

If i look in the nova-compute.log, at service startup i can see:
2011-08-24 10:18:59,542 DEBUG nova [-] find_host_timeout : 30 from (pid=3460) serve /usr/lib/pymodules/python2.7/nova/service.py:366
2011-08-24 10:18:59,542 DEBUG nova [-] vlan_interface : eth4 from (pid=3460) serve /usr/lib/pymodules/python2.7/nova/service.py:366
2011-08-24 10:18:59,542 DEBUG nova [-] aws_access_key_id : admin from (pid=3460) serve /usr/lib/pymodules/python2.7/nova/service.py:366

But when i deploy a vm from a project who is placed on vlan 12, in the same log I can see:
2011-08-24 10:21:45,862 DEBUG nova.linux_net [-] Starting VLAN inteface vlan12 from (pid=3460) ensure_vlan /usr/lib/pymodules/python2.7/nova/network/linux_net.py:466
2011-08-24 10:21:45,862 DEBUG nova.utils [-] Running cmd (subprocess): sudo vconfig set_name_type VLAN_PLUS_VID_NO_PAD from (pid=3460) execute /usr/lib/pymodules/python2.7/nova/utils.py:143
2011-08-24 10:21:45,907 DEBUG nova.utils [-] Running cmd (subprocess): sudo vconfig add eth0 12 from (pid=3460) execute /usr/lib/pymodules/python2.7/nova/utils.py:143
2011-08-24 10:21:45,921 DEBUG nova.utils [-] Running cmd (subprocess): sudo ip link set vlan12 up from (pid=3460) execute /usr/lib/pymodules/python2.7/nova/utils.py:143
2011-08-24 10:21:45,937 DEBUG nova.utils [-] Attempting to grab semaphore "ensure_bridge" for method "ensure_bridge"... from (pid=3460) inner /usr/lib/pymodules/python2.7/nova/utils.py:600
2011-08-24 10:21:45,937 DEBUG nova.utils [-] Attempting to grab file lock "ensure_bridge" for method "ensure_bridge"... from (pid=3460) inner /usr/lib/pymodules/python2.7/nova/utils.py:605
2011-08-24 10:21:45,938 DEBUG nova.utils [-] Running cmd (subprocess): ip link show dev br12 from (pid=3460) execute /usr/lib/pymodules/python2.7/nova/utils.py:143
2011-08-24 10:21:45,943 DEBUG nova.utils [-] Result was 255 from (pid=3460) execute /usr/lib/pymodules/python2.7/nova/utils.py:161
2011-08-24 10:21:45,944 DEBUG nova.linux_net [-] Starting Bridge interface for vlan12 from (pid=3460) ensure_bridge /usr/lib/pymodules/python2.7/nova/network/linux_net.py:489

the compute node uses eth0 to create the vlan instead of eth4.
In this case eth0 is both the default value and the controller node's vlan_interface value.
Am i missing some further flag in my nova.conf?

Thanks
Giuseppe

Question information

Language:
English Edit question
Status:
Solved
For:
OpenStack Compute (nova) Edit question
Assignee:
No assignee Edit question
Solved by:
Vish Ishaya
Solved:
Last query:
Last reply:
Revision history for this message
Best Vish Ishaya (vishvananda) said :
#1

Vlan interface is only used when creating the network. After that it will use whatever interface is in the networks table. This will be a problem if you have the other machines plugged into a different interface. Can you file a bug on this? We should still support different interfaces on each host.

On Aug 24, 2011, at 2:41 AM, Giuseppe Civitella wrote:

> New question #169041 on OpenStack Compute (nova):
> https://answers.launchpad.net/nova/+question/169041
>
> Hi all,
>
> I've got a 2 nodes openstack setup were I'm testing a VlanManager network: both the nodes are natty 11.04 64bit running Diablo milestone (2011.3~d3-0ubuntu0~ppa1~natty1).
> One of the node runs the nova-sheduler and the nova-network services.
> It has the following network related flags:
> --network_manager=nova.network.manager.VlanManager
> --flat_network_dhcp_start=10.12.1.1
> --flat_network_dns=212.29.129.3
> --fixed_range=10.12.0.0/16
> --iscsi_ip_prefix=10.10.11.
> --vlan_interface=eth0
> --flat_interface=eth0
> --public_interface=eth1
>
> The other runs nova-compute and has the following network related flags:
> --network_manager=nova.network.manager.VlanManager
> --flat_network_dhcp_start=10.12.1.1
> --flat_network_dns=212.29.129.3
> --fixed_range=10.12.0.0/16
> --iscsi_ip_prefix=10.10.11.
> --vlan_interface=eth4
> --flat_interface=eth4
> --public_interface=eth1
> --logdir=/var/log/nova
> --state_path=/var/lib/nova
> --verbose
>
> If I check the registered vlan config on this node I got:
> root@beta:~# nova-manage config list|grep vlan
> --vlan_interface=eth4
> --vlan_start=100
>
> If i look in the nova-compute.log, at service startup i can see:
> 2011-08-24 10:18:59,542 DEBUG nova [-] find_host_timeout : 30 from (pid=3460) serve /usr/lib/pymodules/python2.7/nova/service.py:366
> 2011-08-24 10:18:59,542 DEBUG nova [-] vlan_interface : eth4 from (pid=3460) serve /usr/lib/pymodules/python2.7/nova/service.py:366
> 2011-08-24 10:18:59,542 DEBUG nova [-] aws_access_key_id : admin from (pid=3460) serve /usr/lib/pymodules/python2.7/nova/service.py:366
>
> But when i deploy a vm from a project who is placed on vlan 12, in the same log I can see:
> 2011-08-24 10:21:45,862 DEBUG nova.linux_net [-] Starting VLAN inteface vlan12 from (pid=3460) ensure_vlan /usr/lib/pymodules/python2.7/nova/network/linux_net.py:466
> 2011-08-24 10:21:45,862 DEBUG nova.utils [-] Running cmd (subprocess): sudo vconfig set_name_type VLAN_PLUS_VID_NO_PAD from (pid=3460) execute /usr/lib/pymodules/python2.7/nova/utils.py:143
> 2011-08-24 10:21:45,907 DEBUG nova.utils [-] Running cmd (subprocess): sudo vconfig add eth0 12 from (pid=3460) execute /usr/lib/pymodules/python2.7/nova/utils.py:143
> 2011-08-24 10:21:45,921 DEBUG nova.utils [-] Running cmd (subprocess): sudo ip link set vlan12 up from (pid=3460) execute /usr/lib/pymodules/python2.7/nova/utils.py:143
> 2011-08-24 10:21:45,937 DEBUG nova.utils [-] Attempting to grab semaphore "ensure_bridge" for method "ensure_bridge"... from (pid=3460) inner /usr/lib/pymodules/python2.7/nova/utils.py:600
> 2011-08-24 10:21:45,937 DEBUG nova.utils [-] Attempting to grab file lock "ensure_bridge" for method "ensure_bridge"... from (pid=3460) inner /usr/lib/pymodules/python2.7/nova/utils.py:605
> 2011-08-24 10:21:45,938 DEBUG nova.utils [-] Running cmd (subprocess): ip link show dev br12 from (pid=3460) execute /usr/lib/pymodules/python2.7/nova/utils.py:143
> 2011-08-24 10:21:45,943 DEBUG nova.utils [-] Result was 255 from (pid=3460) execute /usr/lib/pymodules/python2.7/nova/utils.py:161
> 2011-08-24 10:21:45,944 DEBUG nova.linux_net [-] Starting Bridge interface for vlan12 from (pid=3460) ensure_bridge /usr/lib/pymodules/python2.7/nova/network/linux_net.py:489
>
> the compute node uses eth0 to create the vlan instead of eth4.
> In this case eth0 is both the default value and the controller node's vlan_interface value.
> Am i missing some further flag in my nova.conf?
>
> Thanks
> Giuseppe
>
> --
> You received this question notification because you are a member of Nova
> Core, which is an answer contact for OpenStack Compute (nova).

Revision history for this message
Giuseppe Civitella (gcivitella) said :
#2

Thanks a lot.
Problem solved

Revision history for this message
Giuseppe Civitella (gcivitella) said :
#3

Thanks Vish Ishaya, that solved my question.