Ask Your Question
0

ironic.drivers.modules.agent: node command status errored: Error downloading image

asked 2014-09-30 16:47:14 -0500

Alex Kravchenko gravatar image

Hello, I'm new in OpenStack and I'm trying to use DevStack+Ironic in attempt to deploy baremetal nodes via it.

I used this guide: http://docs.openstack.org/developer/ironic/dev/dev-quickstart.html#deploying-ironic-with-devstack (http://docs.openstack.org/developer/i...) and did step-by-step exactly that was said there and everythong went fine until this step:

I tried to swap an instance using this command:

nova boot --flavor baremetal --image $image --key-name default testing

ironic node-list
+--------------------------------------+--------------------------------------+-------------+--------------------+-------------+
| UUID                                 | Instance UUID                        | Power State | Provisioning State | Maintenance |
+--------------------------------------+--------------------------------------+-------------+--------------------+-------------+
| 31ed7500-73d4-41dc-b9f3-4f99051e715e | None                                 | power off   | None               | False       |
| f6191c41-f69e-4c4a-a3a2-e0d49fee1656 | 78f7ffe4-2c18-4555-a053-f009338c226e | power on    | wait call-back     | False       |
| 23c41d86-ed48-4990-a215-bd174d9f3144 | None                                 | power off   | None               | False       |
+--------------------------------------+--------------------------------------+-------------+--------------------+-------------+

After some time:

ironic node-list
+--------------------------------------+--------------------------------------+-------------+--------------------+-------------+
| UUID                                 | Instance UUID                        | Power State | Provisioning State | Maintenance |
+--------------------------------------+--------------------------------------+-------------+--------------------+-------------+
| 31ed7500-73d4-41dc-b9f3-4f99051e715e | None                                 | power off   | None               | False       |
| f6191c41-f69e-4c4a-a3a2-e0d49fee1656 | 78f7ffe4-2c18-4555-a053-f009338c226e | power on    | deploying          | False       |
| 23c41d86-ed48-4990-a215-bd174d9f3144 | None                                 | power off   | None               | False       |
+--------------------------------------+--------------------------------------+-------------+--------------------+-------------+

And then:

ironic node-list
+--------------------------------------+--------------------------------------+-------------+--------------------+-------------+
| UUID                                 | Instance UUID                        | Power State | Provisioning State | Maintenance |
+--------------------------------------+--------------------------------------+-------------+--------------------+-------------+
| 31ed7500-73d4-41dc-b9f3-4f99051e715e | None                                 | power off   | None               | False       |
| f6191c41-f69e-4c4a-a3a2-e0d49fee1656 | 78f7ffe4-2c18-4555-a053-f009338c226e | power on    | deploy failed      | False       |
| 23c41d86-ed48-4990-a215-bd174d9f3144 | None                                 | power off   | None               | False       |
+--------------------------------------+--------------------------------------+-------------+--------------------+-------------+

Flavor I was using:

nova flavor-show baremetal
+----------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Property                   | Value                                                                                                                                                               |
+----------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| OS-FLV-DISABLED:disabled   | False                                                                                                                                                               |
| OS-FLV-EXT-DATA:ephemeral  | 0                                                                                                                                                                   |
| disk                       | 10                                                                                                                                                                  |
| extra_specs                | {"cpu_arch": "x86_64", "baremetal:deploy_kernel_id": "1fa13e70-510b-4e65-97df-e6bc33831317", "baremetal:deploy_ramdisk_id": "59f7c329-c846-4bfd-ae20-fa3d46c303e6"} |
| id                         | 551                                                                                                                                                                 |
| name                       | baremetal                                                                                                                                                           |
| os-flavor-access:is_public | True                                                                                                                                                                |
| ram                        | 1024                                                                                                                                                                |
| rxtx_factor                | 1.0                                                                                                                                                                 |
| swap                       |                                                                                                                                                                     |
| vcpus                      | 1                                                                                                                                                                   |
+----------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+

Image I was trying to deploy:

glance image-show cirros-0.3.2-x86_64-disk
+------------------+--------------------------------------+
| Property         | Value                                |
+------------------+--------------------------------------+
| checksum         | 64d7c1cd2b6f60c92c14662941cb7913     |
| container_format | bare                                 |
| created_at       | 2014-09-30T17:42:33                  |
| deleted          | False                                |
| disk_format      | qcow2                                |
| id               | 93869972-ae09-4827-a14f-ab28d188a582 |
| is_public        | True                                 |
| min_disk         | 0                                    |
| min_ram          | 0                                    |
| name             | cirros-0.3.2-x86_64-disk             |
| owner            | 4cd3c963100e4161aa24573f6fc52422     |
| protected        | False                                |
| size             | 13167616                             |
| status           | active                               |
| updated_at       | 2014-09-30T17:42:34                  |
+------------------+--------------------------------------+

I managed to find some information from logs:

ir-cond.log
2014-10-01 00:39:28.293 29019 ERROR ironic.drivers.modules.agent [-] node 31ed7500-73d4-41dc-b9f3-4f99051e715e command status errored: {u'message': u'Error downloading image.', u'code': 500, u'type': u'ImageDownloadError', u'details': u'Could not download image with id 93869972-ae09-4827-a14f-ab28d188a582.'}

n-cond.log
2014-10-01 00:39:38.163 ERROR nova.scheduler.utils [req-f1d83bbb-e1a0-4e62-b2bb-13ded5b0392e demo demo] [instance: 78f7ffe4-2c18-4555-a053-f009338c226e] Error from last host: pax-pc01 (node 31ed7500-73d4-41dc-b9f3-4f99051e715e): [u'Traceback (most recent call last):\n', u'  File "/opt/stack/nova/nova/compute/manager.py", line 2014, in do_build_and_run_instance\n    filter_properties)\n', u'  File "/opt/stack/nova/nova/compute/manager.py", line 2149, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 78f7ffe4-2c18-4555-a053-f009338c226e was re-scheduled: Failed to provision instance 78f7ffe4-2c18-4555-a053-f009338c226e: None\n']

Then I tried to copy that image from glance manually and evrething seem to went fine:

stack@pax-pc01:~/devstack$ glance image-download cirros-0.3.2-x86_64-disk > 123

stack@pax-pc01:~/devstack$ ls 123

123

I can't manage to upload full ironic-conductor and nova-conductor logs because I haven't enough points to do it so If you need additional logs to investigate this issue please ask. Thanks for support.

edit retag flag offensive close merge delete

Comments

1

Is the glance service endpoint listening on an IP address that the bare metal machine can talk to?

mpetason gravatar imagempetason ( 2014-10-01 10:56:57 -0500 )edit

Devstack with "fake" baremetal nodes lives on one node (it was setup while devstack deploying). So I thisnk yes, glance service endpoint is listening on an IP address that the bare metal machine can talk to. Could you tell please me how I can check this out manually? Thanks.

Alex Kravchenko gravatar imageAlex Kravchenko ( 2014-10-01 17:10:47 -0500 )edit

2 answers

Sort by ยป oldest newest most voted
1

answered 2014-10-09 04:21:11 -0500

vigneshvar.a.s gravatar image

Hi i am vigneshvar.a.s

A little more investigation and debugging on the error, i found that it is not trying to download image from glance, instead with new implementation of swift temp url for downloading the images.

What it does is, a temporary url is created (with short life time) inorder to download image from glance (via swift). Most important is this url does not require any authentication. Problem here is for some reason, the swift temp url is not accessible. In keystone middleware log and swift log we can find authentication related errors.

I am trying to investigate further.

To confirm if you are facing similar issue, please check at the config file /etc/ironic/ironic.conf and search for "swift_temp_url_duration". If it is configured, then you hit the same issue as mine.

Hope this helps.

edit flag offensive delete link more
1

answered 2014-10-10 08:36:06 -0500

Alex Kravchenko gravatar image

I resolve this issue by using Devstack+Ironic from stable/icehouse branch instaead of master branch. There is no such issue there. So for me question is not actual anymore. Thanks

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2014-09-30 16:47:14 -0500

Seen: 456 times

Last updated: Oct 10 '14