Ask Your Question
0

RDO TripleO Mitaka HA Overcloud Failing

asked 2016-08-03 15:57:49 -0500

mgunjan gravatar image

updated 2016-08-08 11:00:29 -0500

rbowen gravatar image

Hi All,

I am currently working on Tripleo Mitaka Openstack deployment on baremetal servers: Undercloud – 1 baremetal server with 2 NIC (1 for provisioning and 2nd for external network connectivity) Controller – 3 baremetal server ( 7 NICs with each openstack VLANs on separate NIC) Compute – 1 baremetal server ( 7 NICs with each openstack VLANs on separate NIC)

I followed Graeme's instructions here : https://www.redhat.com/archives/rdo-list/2016-June/msg00049.html (https://www.redhat.com/archives/rdo-l...) to set up Undercloud . Undercloud deployment was successful and all the images required for overcloud deployment was properly built as per the instruction. I would like to mention that I used libvirt tools to modify the root password on overcloud-full.qcow2 and we also modified the grub file to include “net.ifnames=0 biosdevname=0” to restore old interface naming.

I was able to successfully introspect 2 serves to be used for controller and compute nodes. Also , we added the serial device discovered during introspection as root device: ironic node-update 604f7dfc-38af-4fe0-8986-4c8ac5f956e2 add properties/root_device='{"serial": "618e728372833010c79bead9066f0f9e"}' ironic node-update afcfbee3-3108-48da-a6da-aba8f422642c add properties/root_device='{"serial": "618e7283728347101f2107b511603adc"}'

Next, we added compute and control tag to respective introspected node with local boot option:

ironic node-update 604f7dfc-38af-4fe0-8986-4c8ac5f956e2 add properties/capabilities='profile:control,boot_option:local' ironic node-update afcfbee3-3108-48da-a6da-aba8f422642c add properties/capabilities='profile:compute,boot_option:local'

We used multiple NIC templates for control and compute node which has been attached along with network-environment.yaml file. Default network isolation template file has been used.

Deployment script looks like this : DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )" template_base_dir="$DIR" ntpserver=<sprint.ntp.server.ip> #Sprint LAB openstack overcloud deploy --templates \ -e /usr/share/openstack-tripleo-heat-templates/environments/network-isolation.yaml \ -e ${template_base_dir}/environments/network-environment.yaml \ --control-flavor control --compute-flavor compute \ --control-scale 1 --compute-scale 1 \ --ntp-server $ntpserver \ --neutron-network-type vxlan --neutron-tunnel-types vxlan --debug

Heat stack deployment goes on more really long time (more than 4 hours) and gets stuck at postdeployment configurations. Please find below the capture during install :

Every 2.0s: ironic node-list && nova list && heat stack-list && heat resource-list -n5 overcloud | grep -vi complete                           Wed Aug  3 17:33:37 2016

+--------------------------------------+------+--------------------------------------+-------------+--------------------+-------------+
| UUID                                 | Name | Instance UUID                        | Power State | Provisioning State | Maintenance |
+--------------------------------------+------+--------------------------------------+-------------+--------------------+-------------+
| 604f7dfc-38af-4fe0-8986-4c8ac5f956e2 | None | 9e7aae15-cabc-4489-a1b2-778915a78df2 | power on    | active             | False       |
| afcfbee3-3108-48da-a6da-aba8f422642c | None | c1ab52a9-461a-4a11-a13e-e57ff0a3ae2a | power on    | active             | False       |
+--------------------------------------+------+--------------------------------------+-------------+--------------------+-------------+
+--------------------------------------+-------------------------+--------+------------+-------------+------------------------+
| ID                                   | Name                    | Status | Task State | Power State | Networks               |
+--------------------------------------+-------------------------+--------+------------+-------------+------------------------+
| 9e7aae15-cabc-4489-a1b2-778915a78df2 | overcloud-controller-0  | ACTIVE | -          | Running     | ctlplane=192.168.149.9 |
| c1ab52a9-461a-4a11-a13e-e57ff0a3ae2a | overcloud-novacompute-0 | ACTIVE | -          | Running     | ctlplane=192.168.149.8 |
+--------------------------------------+-------------------------+--------+------------+-------------+------------------------+
+--------------------------------------+------------+---------------+---------------------+--------------+
| id                                   | stack_name | stack_status  | creation_time       | updated_time |
+--------------------------------------+------------+---------------+---------------------+--------------+
| 26ee0150-4cfa-4268-9107-8bfbf6712913 | overcloud  | CREATE_FAILED | 2016-08-03T08:11:34 | None         |
+--------------------------------------+------------+---------------+---------------------+--------------+
+---------------------------------------------+-----------------------------------------------+------------------------------------------------------------------------
---------+--------------------+---------------------+---------------------------------------------------------------------------------------------------------------+
| resource_name                               | physical_resource_id                          | resource_type
         | resource_status    | updated_time        | stack_name                                                                                                    |
+---------------------------------------------+-----------------------------------------------+------------------------------------------------------------------------
---------+--------------------+---------------------+---------------------------------------------------------------------------------------------------------------+
| ComputeNodesPostDeployment                  | 3797aec6-e543-4dda-9cd1-c7261e827a64          | OS::TripleO::ComputePostDeployment
         | CREATE_FAILED      | 2016-08-03T08:11:35 | overcloud                                                                                                     |
| ControllerNodesPostDeployment               | 6ad9f88c-5c55-4125-97f1-eb0e33329d16          | OS::TripleO::ControllerPostDeployment
         | CREATE_FAILED      | 2016-08-03T08:11:35 | overcloud                                                                                                     |
| ComputePuppetDeployment                     | 8b199f85-e4f9-48ad-9aee-b1cdf4900b9f          | OS::Heat::StructuredDeployments
         | CREATE_FAILED      | 2016-08-03T08:29:19 | overcloud-ComputeNodesPostDeployment-6vxfu2g2qucy                                                             |
| ControllerOvercloudServicesDeployment_Step4 | 15509f59-ff28-43af-95dd-6247a6a32c2d          | OS::Heat::StructuredDeployments
         | CREATE_FAILED      | 2016-08-03T08:29:20 | overcloud-ControllerNodesPostDeployment-35y7uafngfwj                                                          |
| 0                                           | 7cd0aa3d-742f-4e78-99ca-b2a575913f8e          | OS::Heat::StructuredDeployment
         | CREATE_IN_PROGRESS | 2016-08-03T08:30:04 | overcloud-ComputeNodesPostDeployment-6vxfu2g2qucy-ComputePuppetDeployment-cpahcct3tfw3                        |
| 0                                           | 5e9308f7-c3a9-4a94-a017-e1acb694c036          | OS::Heat::StructuredDeployment



[stack@mitaka-uc ~]$ openstack software deployment show 5e9308f7-c3a9-4a94-a017-e1acb694c036
+---------------+--------------------------------------+
| Field         | Value                                |
+---------------+--------------------------------------+
| id            | 5e9308f7-c3a9-4a94-a017-e1acb694c036 |
| server_id     | 9e7aae15-cabc-4489-a1b2-778915a78df2 |
| config_id     | 86d49e66-2f25-4cb1-b623-5ae87b01bb64 |
| creation_time | 2016-08-03T08:32:10                  |
| updated_time  |                                      |
| status        | IN_PROGRESS                          |
| status_reason | Deploy data available                |
| input_values  | {}                                   |
| action        | CREATE                               |
+---------------+--------------------------------------+

[stack@mitaka-uc ~]$ openstack software deployment show ...
(more)
edit retag flag offensive close merge delete

Comments

In case you need some attachments and/or links included please, submit to me via rdo mailing list.
I can update text above as you want.

dbaxps gravatar imagedbaxps ( 2016-08-03 23:59:04 -0500 )edit

Hi, the issue can be resolved. There was issue in the deployment yaml scripts. Once we rectified the yaml files, deployment went smoothly.

mgunjan gravatar imagemgunjan ( 2016-09-19 09:27:46 -0500 )edit

1 answer

Sort by » oldest newest most voted
0

answered 2016-11-19 13:20:04 -0500

kamlesh gravatar image

Most of the time,storage disk doesn't come live,so deployment gets stuck.u can login with root user and password ROOTPW ..Restart all overcloud node at same time..

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

2 followers

Stats

Asked: 2016-08-03 15:57:49 -0500

Seen: 485 times

Last updated: Aug 03 '16