newton - controller br-ex get random mac address

asked 2017-03-30 16:06:44 -0500

jfsaucier
1 ●1 ●1 ●2

updated 2017-03-31 06:09:35 -0500

Hi,

I have deployed my overcloud with tripleO using the bonds-with-vlans template. Here is my network-environment.yaml :

resource_registry:
  OS::TripleO::BlockStorage::Net::SoftwareConfig: /home/stack/templates/nics/cinder-storage.yaml
  OS::TripleO::Compute::Net::SoftwareConfig: /home/stack/templates/nics/compute.yaml
  OS::TripleO::Controller::Net::SoftwareConfig: /home/stack/templates/nics/controller.yaml
  OS::TripleO::ObjectStorage::Net::SoftwareConfig: /home/stack/templates/nics/swift-storage.yaml
  OS::TripleO::CephStorage::Net::SoftwareConfig: /home/stack/templates/nics/ceph-storage.yaml

parameter_defaults:
  NeutronExternalNetworkBridge: "''"

  InternalApiNetCidr: 172.18.0.0/24
  TenantNetCidr: 172.19.0.0/24
  StorageNetCidr: 172.20.0.0/24
  StorageMgmtNetCidr: 172.21.0.0/24
  ManagementNetCidr: 172.22.0.0/24
  ExternalNetCidr: 192.168.200.0/24

  InternalApiAllocationPools: [{'start': '172.18.0.10', 'end': '172.18.0.200'}]
  TenantAllocationPools: [{'start': '172.19.0.10', 'end': '172.19.0.200'}]
  StorageAllocationPools: [{'start': '172.20.0.10', 'end': '172.20.0.200'}]
  StorageMgmtAllocationPools: [{'start': '172.21.0.10', 'end': '172.21.0.200'}]
  ManagementAllocationPools: [{'start': '172.22.0.10', 'end': '172.22.0.200'}]
  ExternalAllocationPools: [{'start': '192.168.200.100', 'end': '192.168.200.200'}]

  ExternalInterfaceDefaultRoute: 192.168.200.1
  ControlPlaneDefaultRoute: 172.16.0.1
  EC2MetadataIp: 172.16.0.1
  DnsServers: ["10.100.0.254"]

  InternalApiNetworkVlanID: 201
  StorageNetworkVlanID: 202
  StorageMgmtNetworkVlanID: 203
  TenantNetworkVlanID: 204
  ManagementNetworkVlanID: 205
  ExternalNetworkVlanID: 100

  BondInterfaceOvsOptions:
    "bond_mode=active-backup lacp=off other_config:bond-miimon-interval=100"

And here is my deploy command :

openstack overcloud deploy --templates \
  -e /usr/share/openstack-tripleo-heat-templates/environments/network-isolation.yaml \
  -e /home/stack/templates/network-environment.yaml \
  --control-flavor control \
  --compute-flavor compute \
  --control-scale 3 \
  --compute-scale 3 \
  --ntp-server pool.ntp.org \
  --neutron-network-type vxlan \
  --neutron-tunnel-types vxlan

My deployment always fail with the following error :

2017-03-30 19:16:33Z [overcloud.ControllerAllNodesValidationDeployment.0]: SIGNAL_IN_PROGRESS  Signal: deployment 27e1be93-870b-4f95-94ce-b4d0c301fbdd failed (1)
2017-03-30 19:16:33Z [overcloud.ControllerAllNodesValidationDeployment.1]: SIGNAL_IN_PROGRESS  Signal: deployment 147a6d10-d11f-4c15-bf50-911c58933bf7 failed (1)
2017-03-30 19:16:33Z [overcloud.ControllerAllNodesValidationDeployment.1]: CREATE_FAILED  Error: resources[1]: Deployment to server failed: deploy_status_code : Deployment exited with non-zero status code: 1
2017-03-30 19:16:34Z [overcloud.ControllerAllNodesValidationDeployment.0]: CREATE_FAILED  Error: resources[0]: Deployment to server failed: deploy_status_code : Deployment exited with non-zero status code: 1
2017-03-30 19:16:38Z [overcloud.ControllerAllNodesValidationDeployment.2]: SIGNAL_IN_PROGRESS  Signal: deployment 0c2d1545-1533-4434-b0ce-236914910ad3 failed (1)
2017-03-30 19:16:39Z [overcloud.ControllerAllNodesValidationDeployment.2]: CREATE_FAILED  Error: resources[2]: Deployment to server failed: deploy_status_code : Deployment exited with non-zero status code: 1
2017-03-30 19:16:39Z [overcloud.ControllerAllNodesValidationDeployment]: CREATE_FAILED  Resource CREATE failed: Error: resources[1]: Deployment to server failed: deploy_status_code : Deployment exited with non-zero status code: 1
2017-03-30 19:16:39Z [overcloud.ControllerAllNodesValidationDeployment]: CREATE_FAILED  Error: resources.ControllerAllNodesValidationDeployment.resources[1]: Deployment to server failed: deploy_status_code: Deployment exited with non-zero status code: 1
2017-03-30 19:16:39Z [overcloud.AllNodesDeploySteps]: CREATE_FAILED  CREATE aborted
2017-03-30 19:16:39Z [overcloud]: CREATE_FAILED  Resource CREATE failed: Error: resources.ControllerAllNodesValidationDeployment.resources[1]: Deployment to server failed: deploy_status_code: Deployment exited with non-zero status code: 1
2017-03-30 19:16:39Z [overcloud.AllNodesDeploySteps.ControllerPrePuppet]: CREATE_FAILED  CREATE aborted
2017-03-30 19:16:39Z [overcloud.AllNodesDeploySteps.ControllerArtifactsDeploy]: CREATE_FAILED  CREATE aborted
2017-03-30 19:16:39Z [overcloud.AllNodesDeploySteps.ComputeDeployment_Step1]: CREATE_FAILED  CREATE aborted
2017-03-30 19:16:40Z [overcloud.AllNodesDeploySteps]: CREATE_FAILED  Resource CREATE failed: Operation cancelled
2017-03-30 19 ...

(more)

edit retag flag offensive close merge delete

Comments

What reports

$ .  stackrc
$ neutron net-list
$ neutron subnet-list

when undercloud gets installed ?

dbaxps ( 2017-03-31 02:58:13 -0500 )edit

In other words, what is Gateway router for the provisioning network (or Undercloud IP) ?
You may add "--libvirt-type qemu" to ovecloud-deploy.sh in regards of your last question.

dbaxps ( 2017-03-31 03:13:44 -0500 )edit

Check https://access.redhat.com/documentati...
Section 4.2.1 .Isolating the Network ( second template mentioned )

dbaxps ( 2017-03-31 04:16:15 -0500 )edit

Thank you. I have edited my question with the relevant information. For the section in the book, it seems that I already have all the same parameter as this template.

jfsaucier ( 2017-03-31 06:10:45 -0500 )edit

add a comment

2 answers

Sort by » oldest newest most voted

answered 2017-03-31 07:43:30 -0500

dbaxps

10788 ●57 ●112 ●224 http://bderzhavets.blo...

updated 2017-03-31 08:44:33 -0500

Using as comment . Please check following configuration on on Controllers
First
On TripleO QS System I see :-

[root@undercloud bond-with-vlans]# pwd
/usr/share/openstack-tripleo-heat-templates/network/config/bond-with-vlans
[root@undercloud bond-with-vlans]# ls -l
total 68
-rw-r--r--. 1 root root 5813 Jan  3 10:49 ceph-storage.yaml
-rw-r--r--. 1 root root 6073 Jan  3 10:49 cinder-storage.yaml
-rw-r--r--. 1 root root 6387 Jan  3 10:49 compute-dpdk.yaml
-rw-r--r--. 1 root root 6060 Jan  3 10:49 compute.yaml
-rw-r--r--. 1 root root 6240 Jan  3 10:49 controller-no-external.yaml
-rw-r--r--. 1 root root 6933 Jan  3 10:49 controller-v6.yaml
-rw-r--r--. 1 root root 6676 Jan  3 10:49 controller.yaml
-rw-r--r--. 1 root root 2128 Oct  3 16:16 README.md
-rw-r--r--. 1 root root 6072 Jan  3 10:49 swift-storage.yaml

Please, go through README.md in this folder mentioned above

    [root@undercloud single-nic-vlans]# pwd
    /usr/share/openstack-tripleo-heat-templates/network/config/single-nic-vlans
    [root@undercloud single-nic-vlans]# ls -l
    total 60
    -rw-r--r--. 1 root root 4684 Jan  3 10:49 ceph-storage.yaml
    -rw-r--r--. 1 root root 5036 Jan  3 10:49 cinder-storage.yaml
    -rw-r--r--. 1 root root 5009 Jan  3 10:49 compute.yaml
    -rw-r--r--. 1 root root 5466 Jan  3 10:49 controller-no-external.yaml
    -rw-r--r--. 1 root root 5962 Jan  3 10:49 controller-v6.yaml
    -rw-r--r--. 1 root root 5781 Jan  3 10:49 controller.yaml
    -rw-r--r--. 1 root root 2131 Oct  3 16:16 README.md
    -rw-r--r--. 1 root root 5035 Jan  3 10:49 swift-storage.yaml

------------------------------------------------------
In network-environment.yaml I have
-----------------------------------------------------

    resource_registry:
      # Network Interface templates to use (these files must exist)
      OS::TripleO::BlockStorage::Net::SoftwareConfig:
        ../network/config/single-nic-vlans/cinder-storage.yaml
      OS::TripleO::Compute::Net::SoftwareConfig:
        ../network/config/single-nic-vlans/compute.yaml
      OS::TripleO::Controller::Net::SoftwareConfig:
        ../network/config/single-nic-vlans/controller.yaml
      OS::TripleO::ObjectStorage::Net::SoftwareConfig:
        ../network/config/single-nic-vlans/swift-storage.yaml
      OS::TripleO::CephStorage::Net::SoftwareConfig:
        ../network/config/single-nic-vlans/ceph-storage.yaml

------------------------------------------------------------
I guess on BM with bonding same entries should look like :-
------------------------------------------------------------

    resource_registry:
      # Network Interface templates to use (these files must exist)
      OS::TripleO::BlockStorage::Net::SoftwareConfig:
        ../network/config/bond-with-vlans/cinder-storage.yaml
      OS::TripleO::Compute::Net::SoftwareConfig:
        ../network/config/bond-with-vlans/compute.yaml
      OS::TripleO::Controller::Net::SoftwareConfig:
        ../network/config/bond-with-vlans/controller.yaml
      OS::TripleO::ObjectStorage::Net::SoftwareConfig:
        ../network/config/bond-with-vlans/swift-storage.yaml
      OS::TripleO::CephStorage::Net::SoftwareConfig:
        ../network/config/bond-with-vlans/ceph-storage.yaml

Second

    [root@overcloud-controller-0 network-scripts]# cat ifcfg-br-ex
    # This file is autogenerated by os-net-config
    DEVICE=br-ex
    ONBOOT=yes
    HOTPLUG=no
    NM_CONTROLLED=no
    DEVICETYPE=ovs
    TYPE=OVSBridge
    BOOTPROTO=static
    IPADDR=192.168.24.8
    NETMASK=255.255.255.0
    OVS_EXTRA="set bridge br-ex other-config:hwaddr=00:a0:3c:d3:31:a7 -- set bridge br-ex fail_mode=standalone"
    DNS1=192.168.23.1
    [root@overcloud-controller-0 network-scripts]# cat ifcfg-eth0
    # This file is autogenerated by os-net-config
    DEVICE=eth0
    ONBOOT=yes
    HOTPLUG=no
    NM_CONTROLLED=no
    PEERDNS=no
    DEVICETYPE=ovs
    TYPE=OVSPort
    OVS_BRIDGE=br-ex
    BOOTPROTO=none
    [root@overcloud-controller-0 network-scripts]# ifconfig
    br-ex: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
            inet 192.168.24.8  netmask 255.255.255.0  broadcast 192.168.24.255
            inet6 ...

(more)

edit flag offensive delete link

Comments

I don't have the "other-config:hwaddr=xx:xx:xx:xx:xx:xx" option in my ifcfg-br-ex file for some reason...

Also, on the controller, my eth0 interface is used for the provisioning network. For the external, I have eth1 and eth2 as an ovs bond.

jfsaucier ( 2017-03-31 08:04:01 -0500 )edit

I have reviewed my templates and I will try a new deployment soon. I will update here as soon as my deployment finish.

jfsaucier ( 2017-03-31 12:24:25 -0500 )edit

Reviewing my template and validating with the output from your deployment gave me a succesful deployment on my end, thanks!

jfsaucier ( 2017-03-31 13:55:10 -0500 )edit

add a comment

answered 2017-03-31 13:58:51 -0500

jfsaucier
1 ●1 ●1 ●2

My biggest problem was that on my undercloud system, my eth1 interface (192.168.200.1, external network) was not configured to accept VLAN traffic.

On a RHEL/CentOS system, this can be done by creating a ifcfg-eth1.100 (100 being the external network VLAN id) and putting your interface information in there instead of the normal ifcfg-eth1 file. Don't forget to add VLAN=yes in the fcfg-eth1.100 file!

When you restart the network, the 8021q module will be loaded and VLAN traffic will be accepted.

edit flag offensive delete link

Comments

Inheritance MAC ADDRESS by br-ex from OVS port eth0 via OVS_EXTRA entry is not related with VLAN enabling of eth1.
IP from control plane obtained by Controller from neutron-dhcp agent running on undercloud gets transferred to br-ex due to syntax
of corresponding ifcfg-* files.

dbaxps ( 2017-03-31 16:45:21 -0500 )edit

Originally for myself explained here :- https://www.youtube.com/watch?v=8zFQG...

dbaxps ( 2017-03-31 16:55:50 -0500 )edit

I understand this part but even with my br-ex with the right mac address, it didn't work. The root of my problem was the VLAN was not accepted on my undercloud, so the ping got drop and failed.

jfsaucier ( 2017-03-31 17:03:06 -0500 )edit

Of-course, you are correct. But , I still guess that vlan enabling of outgoing external interface should be done by TripleO installer based on network-environment.yaml configuration. If doesn't happen something is wrong either with templates or with TripleO installer.

dbaxps ( 2017-03-31 17:20:26 -0500 )edit

I agree that's something TripleO should take care of but I don't think the heat template modify anything on the undercloud itself. At least, I didn't see any mention of undercloud configuration in the template, only things related to the overcloud.

jfsaucier ( 2017-03-31 18:16:20 -0500 )edit

add a comment

newton - controller br-ex get random mac address

Comments

2 answers

Comments

Comments

Your Answer

Get to know Ask OpenStack

Question Tools

Stats

Related questions

Feedback About This Page

OpenStack

Community

Documentation

Branding & Legal

newton - controller br-ex get random mac address edit

Comments

2 answers

Comments

Comments

Your Answer

Get to know Ask OpenStack

Question Tools

Stats

Related questions

Feedback About This Page

OpenStack

Community

Documentation

Branding & Legal

newton - controller br-ex get random mac address