Ask Your Question
0

Compute node access to keystone fails

asked 2014-07-04 14:03:53 -0500

andi gravatar image

updated 2014-07-07 18:22:10 -0500

I have used devstack to setup a "controller" node and second "compute" node, in addition to the compute service run on the controller node; i.e. when I run:

[vagrant@vagrant-fedora20 devstack]$ nova hypervisor-list
+----+--------------------------------+
| ID | Hypervisor hostname            |
+----+--------------------------------+
| 1  | vagrant-fedora20.vagrantup.com |
| 2  | compute                        |
+----+--------------------------------+

So things seem OK. Unfortunately, booting an instance fails:

[vagrant@vagrant-fedora20 devstack]$ nova boot myserver4 --image cirros-0.3.2-x86_64-uec --flavor m1.nano --nic port-id=33e459ec-e1b4-422d-89bf-08360921470d --availability-zone nova:compute
+--------------------------------------+----------------------------------------------------------------+
| Property                             | Value                                                          |
+--------------------------------------+----------------------------------------------------------------+
| OS-DCF:diskConfig                    | MANUAL                                                         |
| OS-EXT-AZ:availability_zone          | nova                                                           |
| OS-EXT-SRV-ATTR:host                 | -                                                              |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | -                                                              |
| OS-EXT-SRV-ATTR:instance_name        | instance-00000005                                              |
| OS-EXT-STS:power_state               | 0                                                              |
| OS-EXT-STS:task_state                | scheduling                                                     |
| OS-EXT-STS:vm_state                  | building                                                       |
| OS-SRV-USG:launched_at               | -                                                              |
| OS-SRV-USG:terminated_at             | -                                                              |
| accessIPv4                           |                                                                |
| accessIPv6                           |                                                                |
| adminPass                            | PH2FKckb3FGi                                                   |
| config_drive                         |                                                                |
| created                              | 2014-07-04T18:31:12Z                                           |
| flavor                               | m1.nano (42)                                                   |
| hostId                               |                                                                |
| id                                   | 72c7b049-f393-4686-9149-abdd3f666e9d                           |
| image                                | cirros-0.3.2-x86_64-uec (83cb0c8d-1945-4620-b75e-11aedb025d11) |
| key_name                             | -                                                              |
| metadata                             | {}                                                             |
| name                                 | myserver4                                                      |
| os-extended-volumes:volumes_attached | []                                                             |
| progress                             | 0                                                              |
| security_groups                      | default                                                        |
| status                               | BUILD                                                          |
| tenant_id                            | 9da3b5bead954650a5e7582699b58d24                               |
| updated                              | 2014-07-04T18:31:13Z                                           |
| user_id                              | 69d35d504d294b3a9542dbe6d1a902d8                               |
+--------------------------------------+----------------------------------------------------------------+
[vagrant@vagrant-fedora20 devstack]$ nova list
+--------------------------------------+-----------+--------+------------+-------------+------------------------------+
| ID                                   | Name      | Status | Task State | Power State | Networks                     |
+--------------------------------------+-----------+--------+------------+-------------+------------------------------+
| 0c5819ff-d345-4e2c-b287-63f8782545bc | myserver1 | ACTIVE | -          | Running     | private=10.0.0.2, 172.24.4.3 |
| 72c7b049-f393-4686-9149-abdd3f666e9d | myserver4 | BUILD  | -          | NOSTATE     |                              |
+--------------------------------------+-----------+--------+------------+-------------+------------------------------+

The new server never seems to get past the BUILD state. I have looked at the n-cpu screen output to see what happens in response to the nova boot command. It looks like the compute node can communicate with neutron server, since I see request-response interactions between compute and neutron like this:

2014-07-04 14:31:13.657 DEBUG neutronclient.client [-] 
REQ: curl -i http://192.168.40.4:9696/v2.0/networks.json?id=587159c1-37ed-4c41-a669-4087e2f854c0 -X GET -H "X-Auth-Token: PKIZ_eJy1WNt2osoWfa-vOO899mhATOLDfuAmQltlg8il3gQiUIKaGLl9_VmFSdpOdndMn7OTYYbhUqx
ac8255uKvv-BHNUyL_EfDS_7PXwhblsuyyP62p1ZeJ0RxEm0Pxza9phnhUVMco9U8ZaZmq0c9w5rJNE3_4pja8sFcWvEI6Y4xU9ZwcLIysuyre9_ZeSSRMhnhYlGot9bOrdeSf7LYPoNzh2RERBq4myh04LxSIMyUlmhCQzr4TJ12oe977O1bvJQbwhQJ91kx15SChnmzD
u0y6awbS7M6rBvC3FNGCP4Ivm6MFwy3C2a0QWEdLc0-UI1faDexOWU0yOvYdMvkfE6gwTiPd84QIbIqOCGRbh2qwjqYDKHGO_8Ya01mVf4pCuwjDYaLhWTnlzyadXAOfxG4OcKSJUaVn1N9KxI9ErFpiNRLxIVuSQuvLIiXbzFzhm3E1fSJLofIcmqKh7iwJ2izhCftIGk
7eogkX49CN4_NyY5HEoyOBYS7TczJId65_cuxKHCf1sHYX22bAvFQ1jNXSPR9Pe-NMS7klrDsRHQFPnuZ9IkwH0XdvC-3kUcKEthlFDhj4jkS8dQckWA1Il7WEbYdR2wlU90SrIJHZZdUKuu4GEJe0iA9xNL4e1ytinMexgIN7ROKgnYI5U8jQS-h_DKSqtzyvVushGssi
ehYJCwtse4I1PNzRE17S_RVj3vMUegjqIXzFlRApz1Eor_0zjWxT2dusyjuauxtuzkzpIUmCwjDnwXLRqR36pRZNcf2Wmg3vnBEsHIZV24TS-UpnZFNbJan9ZkHcThA7I4TczXkKJImT8nMF6AWeEVCkYklGvZXjeu0MgpeE0CYiwXPC3GCDYVTvt8OutzPeTtbCDOqr4U
ScSyvhHIMCEnz7pJsVoOI6TKsqwX2ckb6rUAqQ4qCqIl6v6LML6mOx0R3C6INNzYpkGsdkNcHoo-faE-GZAIz6UytediJOIFFxo9cG5A1fUr5ftJZ2Twz7URDdxSP7MdzIQH3gzMKceWL6cyuOQvnGqgVLIpeV-VKM32Cg9NtHJQn37fxGaFcSGfKzby7axeedcJeJM-Z0
8DnZqEnI0SKiYSLuzE1DahCH-g73S68lUDYqok8vyT9SsYsGi8CS1yYTveci-6MiHym86ryd1yNPGlcPtf_KTX9DgTk-FEk6CWUP4zkgJ7x7IFUFSi0jE23iCpHAD4AnI5IgRPwXY4AVMJwQ4uf4URXaoH0K1VCv9SCnTjAe6mJodQe4urprI2iMEg8ug_VckjSjtbxzH-
iYdS9xT8CYlFIKtD9HeHQNYx7T7gX_cAF4mEmzzAOkZTPDNxOTs-85-GXCY9oehWdf6x-2YWwGclRj2XsGR31IGe6IhA9G6OoAj1klkB1paEV4Gtaw42gPAWoE7u-kDQopA-Y9w_EYyiWxCYN3fIl5Iv-d4pHNOfHfyd16PrMYy79xduko89m_e3C6HLll4wTlgBxKKN6u
qVMhcZjgaxlMjWtFqSugH4BiSfwqzzXwZUZ5wkfHneRbHRltuGmH83kXPq4t3a8M80-NhG_Yyvi6ovZtvuMJ7jsI7-V9deFX1u80kOvYBGLRrQyWij5BkHXhQsNgfR2gSvCaOXm8D2_tsWji57YQcaHlv2Zjo3WgZhTafW2jHdgME8RHP-oY6MrBaTBugIUN_6VUv559dd
yDpyGmKsOOnO-8OyK6CSPvGyEzSm4eQeMltGBGIMqQz1_tpwXID6Y68cSrO5nBQRssEhNWieVmKdmWaO4eFPjVV7yYeJav4Q-lu-I5-eX9g_9ytpfK_XoGqh-Fwn6aMh47Qs9750WH7hKUKweIAYo8wotdPABps9wABIlUWjiyR_2BW4wlp8xGGdZQ5-oASmWWpF37Evic
RgZ3LSl4fvW_YdemWcc14kEfqAqGQ1x7Qz6KP8jvOh_YSJ_GHr3NKmt0-BnCGHM4Y2mpIEBXcFnhE-zYIl4c-FslIlkNcSDccf7HIQcQcQhxN2kB7mWwLbBcD3RB8Zp17V6dAFTGfXWW20cjv2f2jtXLucdH9A1Q_fvmIn-ALqfIvnU-H_h2ATKP17SokiaAq4YaAqGu5r
mg-EOrBYu6nmn-ghW9E-KOzi2K5mJLqn5CWaCKpM9DYmAkmp6fnfyxmCvTT9PtR_D1a9mK3SdL1r1xEv4cH7C_8rMRLznVlXIzRtHAmisYDIhBTiTKmKOCO5kTFmec4HFPTcYMNrinl7tSH4U1Gpoyui8r0-jcIAJBrZZwsizfNsbn8p7gCfm-Xiem9KQ8NdgN9wSDt8v0
ELRT3o3OQK27z3Ra05g_zpUrb4C7-CAp3IL4ILBx7cO5saSVE4bedsGV4787Bvr2PRfzeeFTuyhOoVwBIUUBeQxlCYjmMw7bl15mBcXbuLAfwKydWH3UlQX0xxEj3j4z9buIg_nKhsW1GwYBV3oC1MhWp7zsIZtvmydF1LzY__nfVsViIbpSNi0RFBgkDWnj6ppwdV4EWA
QYReOAYx9WqJhr6ysKBgpysqSek6_0N0Ce9mYmGB_9WwEhOsp1AFf5Hz9SorYFo6pFYLVYKBwoJj4kJHDQhF0Ju6HwZ3plFmlONmEQptlpootS904lqp4aoKnSav1io3UjPiqEnlK6XvYkRtdiXTfcSxd8f14R8pUNxZYaUxFXBlq00z9YAwtwGl1pmB-L1KVPVZ9_wTdS
cBu1kyzYQFdVyajdJScaJjncage6XLMYkngr4kbtYmm3xpZV_J9g3Tn8p2yoaqOYmSZocQPaix3p3k5HTnLR_eLfP_dWJb4e_N4f6O11rQ8LOu83D4hmFP0r1HTLdv08abxjj2bULu97dTDnT3v8q_Cpu8y8euYGbf7O2YbomR0WnjUxboP0i_1AzLuZs4yfOhu1ai8Hzt
C4Fni99Xmm9RWaqPSqnmayul40p3aXF2sswd1RrUmqy2HbnK5Gy3QJhPzBNdzg7pFxfJOvCPtd_mrOT-qD9SOV2TeqLK7cGxlciPvSZwa29J-DIp0fqs0fXqHbl3rsD-svte1GLsGu68n4Y10Wk_Fyuq-al-kvbvTZrpUH-83ynhDy8f8Rmk12oU3xtOXG9tGXzatq-GyP
D7su0Dd1mwaZ_buNDHH-Nt0eUtplDW2-GAp8i5_yP7-Gw3v9A2i_3i__18tv_MS" -H "Content-Type: application/json" -H "Accept: application/json" -H "User-Agent: python-neutronclient"
 from (pid=8886) http_log_req /opt/stack/python-neutronclient/neutronclient/common/utils.py:175

2014-07-04 14:31:13.720 DEBUG neutronclient.client [-] RESP:200 {'date': 'Fri, 04 Jul 2014 18:31:13 GMT', 'content-length': '373', 'content-type': 'application/json; charset=UTF-8', 'x-openstack-request
-id': 'req-651b6c79-35b7-4e76-b760-4835de3d115c'} {"networks": [{"status": "ACTIVE", "subnets": ["55d7dfb4-8236-49c2-bfe9-aa9607397cca"], "name": "private", "provider:physical_network": null, "admin_sta
te_up": true, "tenant_id": "44222309329c4bf0a62d498722036c14", "provider:network_type": "local", "router:external": false, "shared": false, "id": "587159c1-37ed-4c41-a669-4087e2f854c0", "provider:segmen
tation_id": null}]}
 from (pid=8886) http_log_resp /opt/stack/python-neutronclient/neutronclient/common/utils.py:184

The first error in the output seems to be with accessing keystone. I see this:

2014-07-04 14:31:13.783 DEBUG neutronclient.client [-] 
REQ: curl -i http://192.168.40.4:35357/v2.0/tokens -X POST -H "Content-Type: application/json" -H "Accept: application/json" -H "User-Agent: python-neutronclient" -d '{"auth": {"tenantName": "service", 
"passwordCredentials": {"username": "neutron", "password": "REDACTED"}}}'
 from (pid=8886) http_log_req /opt/stack/python-neutronclient/neutronclient/common/utils.py:175

2014-07-04 14:31:13.803 DEBUG nova.openstack.common.lockutils [req-bc0ce9ee-c4eb-4072-830c-c7061252427f admin admin] Released semaphore "compute_resources" from (pid=8886) lock /opt/stack/nova/nova/open
stack/common/lockutils.py:291

2014-07-04 14:31:13.804 DEBUG nova.openstack.common.lockutils [req-bc0ce9ee-c4eb-4072-830c-c7061252427f admin admin] Semaphore / lock released "update_usage" from (pid=8886) inner /opt/stack/nova/nova/o
penstack/common/lockutils.py:328

2014-07-04 14:31:13.840 DEBUG nova.block_device [req-bc0ce9ee-c4eb-4072-830c-c7061252427f admin admin ...
(more)
edit retag flag offensive close merge delete

1 answer

Sort by ยป oldest newest most voted
0

answered 2014-07-07 18:25:30 -0500

andi gravatar image

I was able to solve the problems in my setup. I added the detailed explanation to the question above. In summary, I had three problems: one was that admin_password was not correctly set in compute node, second is that the Python rootwrap modules were somehow wrong. I'm not sure how that happened - I installed devstack on a fresh box and I got the right version. Third, openvswitch service was somehow not started. Again, not sure why stack.sh failed to set this up in my machine, but usually this works (in my experience).

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2014-07-04 14:03:53 -0500

Seen: 195 times

Last updated: Jul 07 '14