Ask Your Question
0

newton - controller br-ex get random mac address

asked 2017-03-30 16:06:44 -0600

jfsaucier gravatar image

updated 2017-03-31 06:09:35 -0600

Hi,

I have deployed my overcloud with tripleO using the bonds-with-vlans template. Here is my network-environment.yaml :

resource_registry:
  OS::TripleO::BlockStorage::Net::SoftwareConfig: /home/stack/templates/nics/cinder-storage.yaml
  OS::TripleO::Compute::Net::SoftwareConfig: /home/stack/templates/nics/compute.yaml
  OS::TripleO::Controller::Net::SoftwareConfig: /home/stack/templates/nics/controller.yaml
  OS::TripleO::ObjectStorage::Net::SoftwareConfig: /home/stack/templates/nics/swift-storage.yaml
  OS::TripleO::CephStorage::Net::SoftwareConfig: /home/stack/templates/nics/ceph-storage.yaml

parameter_defaults:
  NeutronExternalNetworkBridge: "''"

  InternalApiNetCidr: 172.18.0.0/24
  TenantNetCidr: 172.19.0.0/24
  StorageNetCidr: 172.20.0.0/24
  StorageMgmtNetCidr: 172.21.0.0/24
  ManagementNetCidr: 172.22.0.0/24
  ExternalNetCidr: 192.168.200.0/24

  InternalApiAllocationPools: [{'start': '172.18.0.10', 'end': '172.18.0.200'}]
  TenantAllocationPools: [{'start': '172.19.0.10', 'end': '172.19.0.200'}]
  StorageAllocationPools: [{'start': '172.20.0.10', 'end': '172.20.0.200'}]
  StorageMgmtAllocationPools: [{'start': '172.21.0.10', 'end': '172.21.0.200'}]
  ManagementAllocationPools: [{'start': '172.22.0.10', 'end': '172.22.0.200'}]
  ExternalAllocationPools: [{'start': '192.168.200.100', 'end': '192.168.200.200'}]

  ExternalInterfaceDefaultRoute: 192.168.200.1
  ControlPlaneDefaultRoute: 172.16.0.1
  EC2MetadataIp: 172.16.0.1
  DnsServers: ["10.100.0.254"]

  InternalApiNetworkVlanID: 201
  StorageNetworkVlanID: 202
  StorageMgmtNetworkVlanID: 203
  TenantNetworkVlanID: 204
  ManagementNetworkVlanID: 205
  ExternalNetworkVlanID: 100

  BondInterfaceOvsOptions:
    "bond_mode=active-backup lacp=off other_config:bond-miimon-interval=100"

And here is my deploy command :

openstack overcloud deploy --templates \
  -e /usr/share/openstack-tripleo-heat-templates/environments/network-isolation.yaml \
  -e /home/stack/templates/network-environment.yaml \
  --control-flavor control \
  --compute-flavor compute \
  --control-scale 3 \
  --compute-scale 3 \
  --ntp-server pool.ntp.org \
  --neutron-network-type vxlan \
  --neutron-tunnel-types vxlan

My deployment always fail with the following error :

2017-03-30 19:16:33Z [overcloud.ControllerAllNodesValidationDeployment.0]: SIGNAL_IN_PROGRESS  Signal: deployment 27e1be93-870b-4f95-94ce-b4d0c301fbdd failed (1)
2017-03-30 19:16:33Z [overcloud.ControllerAllNodesValidationDeployment.1]: SIGNAL_IN_PROGRESS  Signal: deployment 147a6d10-d11f-4c15-bf50-911c58933bf7 failed (1)
2017-03-30 19:16:33Z [overcloud.ControllerAllNodesValidationDeployment.1]: CREATE_FAILED  Error: resources[1]: Deployment to server failed: deploy_status_code : Deployment exited with non-zero status code: 1
2017-03-30 19:16:34Z [overcloud.ControllerAllNodesValidationDeployment.0]: CREATE_FAILED  Error: resources[0]: Deployment to server failed: deploy_status_code : Deployment exited with non-zero status code: 1
2017-03-30 19:16:38Z [overcloud.ControllerAllNodesValidationDeployment.2]: SIGNAL_IN_PROGRESS  Signal: deployment 0c2d1545-1533-4434-b0ce-236914910ad3 failed (1)
2017-03-30 19:16:39Z [overcloud.ControllerAllNodesValidationDeployment.2]: CREATE_FAILED  Error: resources[2]: Deployment to server failed: deploy_status_code : Deployment exited with non-zero status code: 1
2017-03-30 19:16:39Z [overcloud.ControllerAllNodesValidationDeployment]: CREATE_FAILED  Resource CREATE failed: Error: resources[1]: Deployment to server failed: deploy_status_code : Deployment exited with non-zero status code: 1
2017-03-30 19:16:39Z [overcloud.ControllerAllNodesValidationDeployment]: CREATE_FAILED  Error: resources.ControllerAllNodesValidationDeployment.resources[1]: Deployment to server failed: deploy_status_code: Deployment exited with non-zero status code: 1
2017-03-30 19:16:39Z [overcloud.AllNodesDeploySteps]: CREATE_FAILED  CREATE aborted
2017-03-30 19:16:39Z [overcloud]: CREATE_FAILED  Resource CREATE failed: Error: resources.ControllerAllNodesValidationDeployment.resources[1]: Deployment to server failed: deploy_status_code: Deployment exited with non-zero status code: 1
2017-03-30 19:16:39Z [overcloud.AllNodesDeploySteps.ControllerPrePuppet]: CREATE_FAILED  CREATE aborted
2017-03-30 19:16:39Z [overcloud.AllNodesDeploySteps.ControllerArtifactsDeploy]: CREATE_FAILED  CREATE aborted
2017-03-30 19:16:39Z [overcloud.AllNodesDeploySteps.ComputeDeployment_Step1]: CREATE_FAILED  CREATE aborted
2017-03-30 19:16:40Z [overcloud.AllNodesDeploySteps]: CREATE_FAILED  Resource CREATE failed: Operation cancelled
2017-03-30 19 ...
(more)
edit retag flag offensive close merge delete

Comments

What reports

$ .  stackrc
$ neutron net-list
$ neutron subnet-list

when undercloud gets installed ?

dbaxps gravatar imagedbaxps ( 2017-03-31 02:58:13 -0600 )edit

In other words, what is Gateway router for the provisioning network (or Undercloud IP) ?
You may add "--libvirt-type qemu" to ovecloud-deploy.sh in regards of your last question.

dbaxps gravatar imagedbaxps ( 2017-03-31 03:13:44 -0600 )edit

Check https://access.redhat.com/documentati...
Section 4.2.1 .Isolating the Network ( second template mentioned )

dbaxps gravatar imagedbaxps ( 2017-03-31 04:16:15 -0600 )edit

Thank you. I have edited my question with the relevant information. For the section in the book, it seems that I already have all the same parameter as this template.

jfsaucier gravatar imagejfsaucier ( 2017-03-31 06:10:45 -0600 )edit

2 answers

Sort by ยป oldest newest most voted
0

answered 2017-03-31 13:58:51 -0600

jfsaucier gravatar image

My biggest problem was that on my undercloud system, my eth1 interface (192.168.200.1, external network) was not configured to accept VLAN traffic.

On a RHEL/CentOS system, this can be done by creating a ifcfg-eth1.100 (100 being the external network VLAN id) and putting your interface information in there instead of the normal ifcfg-eth1 file. Don't forget to add VLAN=yes in the fcfg-eth1.100 file!

When you restart the network, the 8021q module will be loaded and VLAN traffic will be accepted.

edit flag offensive delete link more

Comments

Inheritance MAC ADDRESS by br-ex from OVS port eth0 via OVS_EXTRA entry is not related with VLAN enabling of eth1.
IP from control plane obtained by Controller from neutron-dhcp agent running on undercloud gets transferred to br-ex due to syntax
of corresponding ifcfg-* files.

dbaxps gravatar imagedbaxps ( 2017-03-31 16:45:21 -0600 )edit

Originally for myself explained here :- https://www.youtube.com/watch?v=8zFQG...

dbaxps gravatar imagedbaxps ( 2017-03-31 16:55:50 -0600 )edit

I understand this part but even with my br-ex with the right mac address, it didn't work. The root of my problem was the VLAN was not accepted on my undercloud, so the ping got drop and failed.

jfsaucier gravatar imagejfsaucier ( 2017-03-31 17:03:06 -0600 )edit

Of-course, you are correct. But , I still guess that vlan enabling of outgoing external interface should be done by TripleO installer based on network-environment.yaml configuration. If doesn't happen something is wrong either with templates or with TripleO installer.

dbaxps gravatar imagedbaxps ( 2017-03-31 17:20:26 -0600 )edit

I agree that's something TripleO should take care of but I don't think the heat template modify anything on the undercloud itself. At least, I didn't see any mention of undercloud configuration in the template, only things related to the overcloud.

jfsaucier gravatar imagejfsaucier ( 2017-03-31 18:16:20 -0600 )edit
0

answered 2017-03-31 07:43:30 -0600

dbaxps gravatar image

updated 2017-03-31 08:44:33 -0600

Using as comment . Please check following configuration on on Controllers
First
On TripleO QS System I see :-

[root@undercloud bond-with-vlans]# pwd
/usr/share/openstack-tripleo-heat-templates/network/config/bond-with-vlans
[root@undercloud bond-with-vlans]# ls -l
total 68
-rw-r--r--. 1 root root 5813 Jan  3 10:49 ceph-storage.yaml
-rw-r--r--. 1 root root 6073 Jan  3 10:49 cinder-storage.yaml
-rw-r--r--. 1 root root 6387 Jan  3 10:49 compute-dpdk.yaml
-rw-r--r--. 1 root root 6060 Jan  3 10:49 compute.yaml
-rw-r--r--. 1 root root 6240 Jan  3 10:49 controller-no-external.yaml
-rw-r--r--. 1 root root 6933 Jan  3 10:49 controller-v6.yaml
-rw-r--r--. 1 root root 6676 Jan  3 10:49 controller.yaml
-rw-r--r--. 1 root root 2128 Oct  3 16:16 README.md
-rw-r--r--. 1 root root 6072 Jan  3 10:49 swift-storage.yaml

Please, go through README.md in this folder mentioned above

    [root@undercloud single-nic-vlans]# pwd
    /usr/share/openstack-tripleo-heat-templates/network/config/single-nic-vlans
    [root@undercloud single-nic-vlans]# ls -l
    total 60
    -rw-r--r--. 1 root root 4684 Jan  3 10:49 ceph-storage.yaml
    -rw-r--r--. 1 root root 5036 Jan  3 10:49 cinder-storage.yaml
    -rw-r--r--. 1 root root 5009 Jan  3 10:49 compute.yaml
    -rw-r--r--. 1 root root 5466 Jan  3 10:49 controller-no-external.yaml
    -rw-r--r--. 1 root root 5962 Jan  3 10:49 controller-v6.yaml
    -rw-r--r--. 1 root root 5781 Jan  3 10:49 controller.yaml
    -rw-r--r--. 1 root root 2131 Oct  3 16:16 README.md
    -rw-r--r--. 1 root root 5035 Jan  3 10:49 swift-storage.yaml

------------------------------------------------------
In network-environment.yaml I have
-----------------------------------------------------

    resource_registry:
      # Network Interface templates to use (these files must exist)
      OS::TripleO::BlockStorage::Net::SoftwareConfig:
        ../network/config/single-nic-vlans/cinder-storage.yaml
      OS::TripleO::Compute::Net::SoftwareConfig:
        ../network/config/single-nic-vlans/compute.yaml
      OS::TripleO::Controller::Net::SoftwareConfig:
        ../network/config/single-nic-vlans/controller.yaml
      OS::TripleO::ObjectStorage::Net::SoftwareConfig:
        ../network/config/single-nic-vlans/swift-storage.yaml
      OS::TripleO::CephStorage::Net::SoftwareConfig:
        ../network/config/single-nic-vlans/ceph-storage.yaml

------------------------------------------------------------
I guess on BM with bonding same entries should look like :-
------------------------------------------------------------

    resource_registry:
      # Network Interface templates to use (these files must exist)
      OS::TripleO::BlockStorage::Net::SoftwareConfig:
        ../network/config/bond-with-vlans/cinder-storage.yaml
      OS::TripleO::Compute::Net::SoftwareConfig:
        ../network/config/bond-with-vlans/compute.yaml
      OS::TripleO::Controller::Net::SoftwareConfig:
        ../network/config/bond-with-vlans/controller.yaml
      OS::TripleO::ObjectStorage::Net::SoftwareConfig:
        ../network/config/bond-with-vlans/swift-storage.yaml
      OS::TripleO::CephStorage::Net::SoftwareConfig:
        ../network/config/bond-with-vlans/ceph-storage.yaml

Second

    [root@overcloud-controller-0 network-scripts]# cat ifcfg-br-ex
    # This file is autogenerated by os-net-config
    DEVICE=br-ex
    ONBOOT=yes
    HOTPLUG=no
    NM_CONTROLLED=no
    DEVICETYPE=ovs
    TYPE=OVSBridge
    BOOTPROTO=static
    IPADDR=192.168.24.8
    NETMASK=255.255.255.0
    OVS_EXTRA="set bridge br-ex other-config:hwaddr=00:a0:3c:d3:31:a7 -- set bridge br-ex fail_mode=standalone"
    DNS1=192.168.23.1
    [root@overcloud-controller-0 network-scripts]# cat ifcfg-eth0
    # This file is autogenerated by os-net-config
    DEVICE=eth0
    ONBOOT=yes
    HOTPLUG=no
    NM_CONTROLLED=no
    PEERDNS=no
    DEVICETYPE=ovs
    TYPE=OVSPort
    OVS_BRIDGE=br-ex
    BOOTPROTO=none
    [root@overcloud-controller-0 network-scripts]# ifconfig
    br-ex: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
            inet 192.168.24.8  netmask 255.255.255.0  broadcast 192.168.24.255
            inet6 ...
(more)
edit flag offensive delete link more

Comments

I don't have the "other-config:hwaddr=xx:xx:xx:xx:xx:xx" option in my ifcfg-br-ex file for some reason...

Also, on the controller, my eth0 interface is used for the provisioning network. For the external, I have eth1 and eth2 as an ovs bond.

jfsaucier gravatar imagejfsaucier ( 2017-03-31 08:04:01 -0600 )edit

I have reviewed my templates and I will try a new deployment soon. I will update here as soon as my deployment finish.

jfsaucier gravatar imagejfsaucier ( 2017-03-31 12:24:25 -0600 )edit

Reviewing my template and validating with the output from your deployment gave me a succesful deployment on my end, thanks!

jfsaucier gravatar imagejfsaucier ( 2017-03-31 13:55:10 -0600 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

Stats

Asked: 2017-03-30 16:06:44 -0600

Seen: 316 times

Last updated: Mar 31 '17