Revision history [back]

click to hide/show revision 1
initial version

magum bay creation usin devstack remains in state"Create In Progress" and then times out

Deployed devstack in VM by following admin guide ie http://docs.openstack.org/developer/magnum/dev/dev-quickstart.html. Followed the steps in the doc as mentioned to create Kubernetes Bay,but noticed that bay creation never gets completed and then timesout eventually.

Dev Stack was deployed on VM with 6GB of ram and 50 GB of local space and provided 35GB of space in VM_Backing_File_Size in local.conf.

Nova list displays both instances up and running ie kube_master and kube_minion, but i dont see these istance in horizon.

Heat event-list says that kube_master and kube_minion are in "CREATE_IN_PROGRESS".

No other instances were running/created apart from the Kubernetes bay, so i can assume that space shouldn't be an issue to spwan kube_master's VM.

I dont see any errros in heat logs too.So, can somehelp me how to understand/debug this issue.

ubuntu@ubuntu:~/devstack$ nova list +--------------------------------------+-------------------------------------------------------+--------+------------+-------------+------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+-------------------------------------------------------+--------+------------+-------------+------------------------------+ | 7ad4fac5-5f6e-492a-a64f-09d88882552b | k8-dytp6xzlcn-0-vfvwzqnfnkfj-kube_master-7uwdq4ceoorp | ACTIVE | - | Running | private=10.0.0.6, 172.24.4.6 | | 942c5df8-7cdf-4ee7-b504-90a859699323 | k8-k22n7ajttu-0-k3iaewixvpmh-kube-minion-phhfvnomm7jz | ACTIVE | - | Running | private=10.0.0.5, 172.24.4.5 | +--------------------------------------+-------------------------------------------------------+--------+------------+-------------+------------------------------+

ubuntu@ubuntu:~/devstack$ heat event-list k8sbay-kwd55yquld5i

WARNING (shell) "heat event-list" is deprecated, please use "openstack stack event list" instead +----------------------+--------------------------------------+------------------------+--------------------+---------------------+ | resource_name | id | resource_status_reason | resource_status | event_time | +----------------------+--------------------------------------+------------------------+--------------------+---------------------+ | k8sbay-kwd55yquld5i | 51fdefd4-3175-4420-a0c9-8755ce481fcd | Stack CREATE started | CREATE_IN_PROGRESS | 2016-05-21T12:00:49 |

| secgroup_kube_minion | ff8bfcfa-5ea1-4c81-aab9-af9e3cac469c | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:49 |

| api_monitor | 1789aff3-e7b7-440c-b888-fa79d2826d7e | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:50 |

| fixed_network | ab504590-55ba-4f17-a88e-18a4afd60c3c | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:50 |

| secgroup_kube_master | b74b4b52-19bb-49ce-b1c9-effb55ccc7fc | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:50 |

| secgroup_base | c537e0ae-11c9-4cd6-af6c-537cbcebc61d | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:52 |

| etcd_monitor | 817c1aed-b164-4c9b-8537-2012d1e4621b | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:53 |

| extrouter | d851a06e-1732-41dd-b329-eb34bfd8c523 | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:53 |

| api_monitor | d7707033-99e3-4b4f-9830-2290715b600d | state changed | CREATE_COMPLETE | 2016-05-21T12:00:54 |

| secgroup_kube_master | 6d6aaea9-f440-446e-87c6-cca407a70340 | state changed | CREATE_COMPLETE | 2016-05-21T12:00:54 |

| etcd_monitor | e8f0f441-e34b-4ffc-ace0-7e5553089d36 | state changed | CREATE_COMPLETE | 2016-05-21T12:00:54 |

| secgroup_kube_minion | e26a56e7-8aa3-4215-8963-64a0c7a66fb6 | state changed | CREATE_COMPLETE | 2016-05-21T12:00:54 |

| fixed_network | 8eff6a62-31a1-4837-a586-455d2b3ce1b1 | state changed | CREATE_COMPLETE | 2016-05-21T12:00:54 |

| extrouter | d554c116-7754-44a9-b682-c9becee5e225 | state changed | CREATE_COMPLETE | 2016-05-21T12:00:54 |

| secgroup_base | 7acaf1bc-0fc5-4fe3-aa1b-10c53a3eedb3 | state changed | CREATE_COMPLETE | 2016-05-21T12:00:54 |

| fixed_subnet | 77640e29-a0e2-433c-9044-870f990a7f67 | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:54 |

| fixed_subnet | 033f6919-9466-4886-9eee-d76564522b87 | state changed | CREATE_COMPLETE | 2016-05-21T12:00:56 |

| api_pool | e67ba971-9088-4f1a-aa43-f48c323d2a8d | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:56 |

| etcd_pool | 9eb1db6f-0f43-4cd5-a7a6-0d4065e6326c | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:58 |

| extrouter_inside | 6f0b4c6b-ad18-4a3e-922f-3b52f80510cd | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:59 |

| extrouter_inside | 2bc0b21a-0bc6-421c-ac3b-a1c73715e6a4 | state changed | CREATE_COMPLETE | 2016-05-21T12:01:02 |

| api_pool | 6e9c137e-f248-4736-94e3-d63a11be3037 | state changed | CREATE_COMPLETE | 2016-05-21T12:01:02 |

| api_pool_floating | c4d97294-68cb-4b6f-b474-416fcb0fe995 | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:01:03 |

| api_pool_floating | 2905e5c9-255c-4dc2-a793-57aaad374442 | state changed | CREATE_COMPLETE | 2016-05-21T12:01:06 |

| etcd_pool | c4ac7b08-942b-45c0-8dc3-9dc90104d5e0 | state changed | CREATE_COMPLETE | 2016-05-21T12:01:06 |

| kube_masters | 8d265d7b-f218-4d80-ac34-e7b5acad5b72 | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:01:06 |

| kube_minions | 25ac5ae9-efc1-4ede-84c0-b4f934ed6e34 | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:01:08 |

magum bay creation usin devstack remains in state"Create In Progress" and then times out

Deployed devstack in VM by following admin guide ie http://docs.openstack.org/developer/magnum/dev/dev-quickstart.html. Followed the steps in the doc as mentioned to create Kubernetes Bay,but noticed that bay creation never gets completed and then timesout eventually.

Dev Stack was deployed on VM with 6GB of ram and 50 GB of local space and provided 35GB of space in VM_Backing_File_Size in local.conf.

Nova list displays both instances up and running ie kube_master and kube_minion, but i dont see these istance in horizon.

Heat event-list says that kube_master and kube_minion are in "CREATE_IN_PROGRESS".

No other instances were running/created apart from the Kubernetes bay, so i can assume that space shouldn't be an issue to spwan kube_master's VM.

I dont see any errros in heat logs too.So, can somehelp me how to understand/debug this issue.

ubuntu@ubuntu:~/devstack$ nova list
+--------------------------------------+-------------------------------------------------------+--------+------------+-------------+------------------------------+
| ID                                   | Name                                                  | Status | Task State | Power State | Networks                     |
+--------------------------------------+-------------------------------------------------------+--------+------------+-------------+------------------------------+
| 7ad4fac5-5f6e-492a-a64f-09d88882552b | k8-dytp6xzlcn-0-vfvwzqnfnkfj-kube_master-7uwdq4ceoorp | ACTIVE | -          | Running     | private=10.0.0.6, 172.24.4.6 |
| 942c5df8-7cdf-4ee7-b504-90a859699323 | k8-k22n7ajttu-0-k3iaewixvpmh-kube-minion-phhfvnomm7jz | ACTIVE | -          | Running     | private=10.0.0.5, 172.24.4.5 |
+--------------------------------------+-------------------------------------------------------+--------+------------+-------------+------------------------------+

+--------------------------------------+-------------------------------------------------------+--------+------------+-------------+------------------------------+ ubuntu@ubuntu:~/devstack$ heat event-list k8sbay-kwd55yquld5i

k8sbay-kwd55yquld5i WARNING (shell) "heat event-list" is deprecated, please use "openstack stack event list" instead +----------------------+--------------------------------------+------------------------+--------------------+---------------------+ | resource_name | id | resource_status_reason | resource_status | event_time | +----------------------+--------------------------------------+------------------------+--------------------+---------------------+ | k8sbay-kwd55yquld5i | 51fdefd4-3175-4420-a0c9-8755ce481fcd | Stack CREATE started | CREATE_IN_PROGRESS | 2016-05-21T12:00:49 |

| | secgroup_kube_minion | ff8bfcfa-5ea1-4c81-aab9-af9e3cac469c | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:49 |

| | api_monitor | 1789aff3-e7b7-440c-b888-fa79d2826d7e | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:50 |

| | fixed_network | ab504590-55ba-4f17-a88e-18a4afd60c3c | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:50 |

| | secgroup_kube_master | b74b4b52-19bb-49ce-b1c9-effb55ccc7fc | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:50 |

| | secgroup_base | c537e0ae-11c9-4cd6-af6c-537cbcebc61d | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:52 |

| | etcd_monitor | 817c1aed-b164-4c9b-8537-2012d1e4621b | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:53 |

| | extrouter | d851a06e-1732-41dd-b329-eb34bfd8c523 | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:53 |

| | api_monitor | d7707033-99e3-4b4f-9830-2290715b600d | state changed | CREATE_COMPLETE | 2016-05-21T12:00:54 |

| | secgroup_kube_master | 6d6aaea9-f440-446e-87c6-cca407a70340 | state changed | CREATE_COMPLETE | 2016-05-21T12:00:54 |

| | etcd_monitor | e8f0f441-e34b-4ffc-ace0-7e5553089d36 | state changed | CREATE_COMPLETE | 2016-05-21T12:00:54 |

| | secgroup_kube_minion | e26a56e7-8aa3-4215-8963-64a0c7a66fb6 | state changed | CREATE_COMPLETE | 2016-05-21T12:00:54 |

| | fixed_network | 8eff6a62-31a1-4837-a586-455d2b3ce1b1 | state changed | CREATE_COMPLETE | 2016-05-21T12:00:54 |

| | extrouter | d554c116-7754-44a9-b682-c9becee5e225 | state changed | CREATE_COMPLETE | 2016-05-21T12:00:54 |

| | secgroup_base | 7acaf1bc-0fc5-4fe3-aa1b-10c53a3eedb3 | state changed | CREATE_COMPLETE | 2016-05-21T12:00:54 |

| | fixed_subnet | 77640e29-a0e2-433c-9044-870f990a7f67 | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:54 |

| | fixed_subnet | 033f6919-9466-4886-9eee-d76564522b87 | state changed | CREATE_COMPLETE | 2016-05-21T12:00:56 |

| | api_pool | e67ba971-9088-4f1a-aa43-f48c323d2a8d | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:56 |

| | etcd_pool | 9eb1db6f-0f43-4cd5-a7a6-0d4065e6326c | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:58 |

| | extrouter_inside | 6f0b4c6b-ad18-4a3e-922f-3b52f80510cd | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:00:59 |

| | extrouter_inside | 2bc0b21a-0bc6-421c-ac3b-a1c73715e6a4 | state changed | CREATE_COMPLETE | 2016-05-21T12:01:02 |

| | api_pool | 6e9c137e-f248-4736-94e3-d63a11be3037 | state changed | CREATE_COMPLETE | 2016-05-21T12:01:02 |

| | api_pool_floating | c4d97294-68cb-4b6f-b474-416fcb0fe995 | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:01:03 |

| | api_pool_floating | 2905e5c9-255c-4dc2-a793-57aaad374442 | state changed | CREATE_COMPLETE | 2016-05-21T12:01:06 |

| | etcd_pool | c4ac7b08-942b-45c0-8dc3-9dc90104d5e0 | state changed | CREATE_COMPLETE | 2016-05-21T12:01:06 |

| | kube_masters | 8d265d7b-f218-4d80-ac34-e7b5acad5b72 | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:01:06 |

| | kube_minions | 25ac5ae9-efc1-4ede-84c0-b4f934ed6e34 | state changed | CREATE_IN_PROGRESS | 2016-05-21T12:01:08 |

|