Ask Your Question
0

Essex - Quantum - OVS - Multi-Node Architecture -> Working Partially !

asked 2012-06-08 11:11:56 -0500

emilienm gravatar image

Hi Stackers,

I will be the more precise as possible.

I'm working in a multi-node architecture with Ubuntu 12.04 / Essex up to date.

My architecture is clean and all was working in VLAN-Manager Mode. From now, I switch to Quantum Manager.

My docs references :

http://docs.openstack.org/trunk/openstack-network/admin/content/index.html (http://docs.openstack.org/trunk/opens...) http://openvswitch.org/openstack/documentation/ (http://openvswitch.org/openstack/docu...)

  • Node 1 : Controller

MySQL, Rabbit-MQ, nova-volume, nova-api, nova-network, nova-schedule, quantum-server with OVS plugin

nova.conf : http://paste.openstack.org/show/18401/

ovs-vsctl add-br br-int ovs-vsctl add-port br-int eth1

ovs-vsctl br-set-external-id br-int bridge br-int (useful ?) [Edit : I've rebuilt by bridge without this command]

I use default mode of Quantum (Without tunneling).

nova-manage network create --label=public --fixed_range_v4=192.168.15.0/24

DNSMASQ is running well on controller node (which is also nova-network).

/etc/network/interfaces with eth1 :

[..]

iface eth1 inet manual up ifconfig $IFACE 0.0.0.0 up up ip link set $IFACE promisc on down ip link set $IFACE promisc off down ifconfig $IFACE down

  • Node 2 : Compute1 and Node 3 Compute2 :

nova.conf -> same as controller

nova-compute.conf -> http://paste.openstack.org/show/18403/


I explain now some stuff I've seen :

  • When I create an instance, it's does not get an IP address from DNSMASQ. After many hours to looking for why, I can see I'm not alone to be in this situation. I did not find someone in the OpenStack community with Essex + Quantum + OVS working in Multi-Node Architecture ! That's why I'm doing an investigation as I can, and I think to have localized the issue.

  • On the compute node :

root@compute1:~# ovs-vsctl show Bridge br-int Port "eth1" Interface "eth1" Port br-int Interface br-int type: internal Port "tap771bf804-eb" tag: 4095 Interface "tap771bf804-eb" ovs_version: "1.4.0+build0"

My first question :

Why we have a 4095 tag for the TAP interface (which is vNIC of VM) ?

What I found :

If I delete TAP interface after VM creation, and I recreate it, my VM gets an IP !!! :

ovs-vsctl del-port tap771bf804-eb ovs-vsctl add-port br-int tap771bf804-eb

After that, if my VM asks for an IP, she gets an IP.

I know that's not clean, but I try to find what's wrong with OVS Plugin in https://github.com/openstack/quantum/blob/master/quantum/plugins/openvswitch/agent/ovs_quantum_agent.py (https://github.com/openstack/quantum/...)

Maybe a issue with :

self.int_br.add_flow(priority=2, in_port=p.ofport, actions="drop")

?

  • Other problem now, I can connect to the VM with this tips, but I can't connect from other hosts than my controller (ans nova-network as well). And also my VM does not have Internet.

Second question :

What's wrong with IPtables ? My security groups allow SSH + ICMP.

I think to have isolated the issue, but now we have to debug it and to understand what's wrong with OVS + Quantum in multi-node architecture.

Thank's for help, and please let me know ...

(more)
edit retag flag offensive close merge delete

29 answers

Sort by ยป oldest newest most voted
0

answered 2012-06-15 23:11:59 -0500

emilienm gravatar image

Hi,

The discussion is here : https://bugs.launchpad.net/quantum/+bug/1012223 (https://bugs.launchpad.net/quantum/+b...)

It will be handled as part of a blueprint ( https://blueprints.launchpad.net/quantum/+spec/provider-networks (https://blueprints.launchpad.net/quan...) )

Regards

edit flag offensive delete link more
0

answered 2012-06-15 22:49:13 -0500

gbaratto-3 gravatar image

Hi Dan, Emilien...

Check out this cisco global setting:

vlan dot1q tag native

If your native vlan is "1" and "vlan dot1q tag native" = false the packet going out of the port is gonna have its tag removed.

Dan, it would be great if we could specify various ranges of vlans, instead of just min, and max, so, we can better utilise a switch with existing vlans. Something like:

Allowed_vlans = 3-5,8,10,500-2000

Cheers, g.

edit flag offensive delete link more
0

answered 2012-06-12 17:01:06 -0500

danwent gravatar image

that would be great. i created a bug here: https://bugs.launchpad.net/quantum/+bug/1012223 (https://bugs.launchpad.net/quantum/+b...)

one thing to be aware of is that there is a review almost complete for quantum to switch over to the new openstack.common config, so it might be best to wait until those config related changes are in: https://review.openstack.org/#/c/8101/

edit flag offensive delete link more
0

answered 2012-06-12 16:04:56 -0500

danwent gravatar image

Yeah, assuming all VLANs are available is a bad idea in general. For a long time we've been meaning to add a configuration option to the ovs plugin config to let the user specify VLAN_MIN and VLAN_MAX.

edit flag offensive delete link more
0

answered 2012-06-12 08:50:13 -0500

emilienm gravatar image

Also what do you think to add a new flag in ovs_quantum_plugin.ini in which we can specify a value for the native VLAN ?

edit flag offensive delete link more
0

answered 2012-06-12 08:29:36 -0500

emilienm gravatar image

Problem fixed.

I change the VLAN_ID in the database, restart the agent and it's working now.

Dan, do think it's a good idea to change VLAN_MIN = 1 to VLAN_MIN = 2 ?

Thank's for your help, I've learnt a lot of stuffs.

edit flag offensive delete link more
0

answered 2012-06-11 22:19:44 -0500

emilienm gravatar image

If I resume the situation :

root@controller:~# tcpdump -nnei eth1 | grep fa:16:3e:38:08:c8 22:15:00.567171 fa:16:3e:38:08:c8 > ff:ff:ff:ff:ff:ff, ethertype IPv4 (0x0800), length 342: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from fa:16:3e:38:08:c8, length 300

root@controller:~# tcpdump -nnei gw-48f95c51-8d Nothing...

root@compute1:~# tcpdump -nnei eth1 | grep fa:16:3e:38:08:c8 22:14:24.537103 fa:16:3e:38:08:c8 > 33:33:00:00:00:16, ethertype IPv6 (0x86dd), length 90: :: > ff02::16: HBH ICMP6, multicast listener report v2, 1 group record(s), length 28

Notes : - gw-48f95c51-8d is my gateway hosted on controller (also Nova-Network & Quantum-Server) - fa:16:3e:38:08:c8 is the MAC of my VMs wich request an IP address.

OVS conf : #22

So I think we can say the issue is on the controller between gw-* & eth1 on br-int or with the physical switch (investigation in progress)

edit flag offensive delete link more
0

answered 2012-06-11 21:36:27 -0500

emilienm gravatar image

Following to my last message, you can see I'm using VLAN 7 now :

root@controller:~# ovs-vsctl show Bridge br-int Port "eth1" Interface "eth1" Port br-int Interface br-int type: internal Port "gw-48f95c51-8d" tag: 7 Interface "gw-48f95c51-8d" type: internal

root@compute1:~# ovs-vsctl show Bridge br-int Port "eth1" Interface "eth1" Port br-int Interface br-int type: internal Port "tap6fb71cab-af" tag: 7 Interface "tap6fb71cab-af"

edit flag offensive delete link more
0

answered 2012-06-11 18:16:23 -0500

emilienm gravatar image

I have Cisco Hardware. Maybe the IOS blocks VLAN 1 by security ?

We check tomorrow the switch, and I will let you know here if something is new.

If VLAN 1 is the problem, maybe should I hack https://github.com/openstack/quantum/blob/master/quantum/plugins/openvswitch/agent/ovs_quantum_agent.py (https://github.com/openstack/quantum/...) and change default VLAN ?

edit flag offensive delete link more
0

answered 2012-06-11 17:48:33 -0500

emilienm gravatar image

I can see a lot of VLAN tagged traffic on ETH1 Controller node :

root@controller:~# tcpdump -n -e -vv -ttt -i eth1 00:00:00.000000 00:10:db:ff:10:01 > ff:ff:ff:ff:ff:ff, ethertype 802.1Q (0x8100), length 64: vlan 4019, p 0, ethertype ARP, Ethernet (len 6), IPv4 (len 4), Request who-has X.X.X.X tell X.X.X.X, length 46

(...)

But not the traffic coming from my VM :-(

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2012-06-08 11:11:56 -0500

Seen: 454 times

Last updated: Jun 15 '12