instance cant boot without throwing any errors

asked 2016-12-19 16:01:01 -0600

paleksic
1 ●1 ●1 ●1

Setup : packstack allinone configuration . Fresh install as of today.
Images : Cirros
Hypervisor : kvm
Images : Cirros

Launching an instance in Compute node with cirros- Fail - Dashboard show the instance is active - instance not reachable.

the ramdisk and kernel file is not present at nova/instances/<id>

console log

Machine UUID 69d2575e-2ce0-4109-9cab-a082712f953c 
enter code here`gPXE (http://etherboot.org) - 00:03.0 C100 PCI2.10 PnP BBS PMM07E0@10 C100
 Press Ctrl-B to configure gPXE (PCI 00:03.0)...

Booting from Hard Disk...

I upload this "QCOW2" image to Glance by command

curl http://download.cirros-cloud.net/daily/20161201/cirros-d161201-x86_64-disk.img | glance image-create --name='cirros image' --visibility=public --container-format=bare --disk-format=qcow2

And I confirm by glance image-show

+------------------+--------------------------------------+
| Property         | Value                                |
+------------------+--------------------------------------+
| checksum         | ae303c6f064fdc912616f6dd0c044cef     |
| container_format | bare                                 |
| created_at       | 2016-12-19T21:00:39Z                 |
| disk_format      | qcow2                                |
| id               | bb5cb151-8689-4dc4-a4f2-c0310f0db97c |
| min_disk         | 0                                    |
| min_ram          | 0                                    |
| name             | cirros image                         |
| owner            | d8b81f2c3eda4f02a01dc4bcba746159     |
| protected        | False                                |
| size             | 12747776                             |
| status           | active                               |
| tags             | []                                   |
| updated_at       | 2016-12-19T21:01:23Z                 |
| virtual_size     | None                                 |
| visibility       | public                               |
+------------------+--------------------------------------+

Now, I began to create instance in compute node using dashboard. In nova list, it show:

+--------------------------------------+--------+--------+------------+-------------+--------------------------------+
| ID                                   | Name   | Status | Task State | Power State | Networks                       |
+--------------------------------------+--------+--------+------------+-------------+--------------------------------+
| 50be3ff0-4ddb-4d6c-8de6-badb6803efa2 | test32 | ACTIVE | -          | Running     | private_network=192.168.100.11 |
+--------------------------------------+--------+--------+------------+-------------+--------------------------------+

and nova show 50be3ff0-4ddb-4d6c-8de6-badb6803efa2

+--------------------------------------+---------------------------------------------------------------------------------+
| Property                             | Value                                                                           |
+--------------------------------------+---------------------------------------------------------------------------------+
| OS-DCF:diskConfig                    | AUTO                                                                            |
| OS-EXT-AZ:availability_zone          | nova                                                                            |
| OS-EXT-SRV-ATTR:host                 | server1.example.org                                                             |
| OS-EXT-SRV-ATTR:hostname             | test32                                                                          |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | server1.example.org                                                             |
| OS-EXT-SRV-ATTR:instance_name        | instance-00000001                                                               |
| OS-EXT-SRV-ATTR:kernel_id            |                                                                                 |
| OS-EXT-SRV-ATTR:launch_index         | 0                                                                               |
| OS-EXT-SRV-ATTR:ramdisk_id           |                                                                                 |
| OS-EXT-SRV-ATTR:reservation_id       | r-pk0rpipj                                                                      |
| OS-EXT-SRV-ATTR:root_device_name     | /dev/vda                                                                        |
| OS-EXT-SRV-ATTR:user_data            | -                                                                               |
| OS-EXT-STS:power_state               | 1                                                                               |
| OS-EXT-STS:task_state                | -                                                                               |
| OS-EXT-STS:vm_state                  | active                                                                          |
| OS-SRV-USG:launched_at               | 2016-12-19T21:08:45.000000                                                      |
| OS-SRV-USG:terminated_at             | -                                                                               |
| accessIPv4                           |                                                                                 |
| accessIPv6                           |                                                                                 |
| config_drive                         |                                                                                 |
| created                              | 2016-12-19T21:07:12Z                                                            |
| description                          | test32                                                                          |
| flavor                               | m1.tiny (1)                                                                     |
| hostId                               | efeb918ec3cfd920d4743140b66ce7810cd1db61f567c21e8551a0b7                        |
| host_status                          | UP                                                                              |
| id                                   | 50be3ff0-4ddb-4d6c-8de6-badb6803efa2                                            |
| image                                | Attempt to boot from volume - no image supplied                                 |
| key_name                             | -                                                                               |
| locked                               | False                                                                           |
| metadata                             | {}                                                                              |
| name                                 | test32                                                                          |
| os-extended-volumes:volumes_attached | [{"id": "abe6fd25-4bb1-4831-9435-e97772b8f5c4", "delete_on_termination": true}] |
| private_network network              | 192.168.100.11                                                                  |
| progress                             | 0                                                                               |
| security_groups                      | default                                                                         |
| status                               | ACTIVE                                                                          |
| tags                                 | []                                                                              |
| tenant_id                            | d8b81f2c3eda4f02a01dc4bcba746159                                                |
| updated                              | 2016-12-19T21:08:45Z                                                            |
| user_id                              | 93694f16d97d4646a4462484aac300a3                                                |
+--------------------------------------+---------------------------------------------------------------------------------+

compute log

2016-12-19 22:07:14.040 17593 INFO nova.compute.claims [req-ce4b8903-46e6-4e42-96c8-49d828793350 93694f16d97d4646a4462484aac300a3 d8b81f2c3eda4f02a01dc4bcba746159 - - -] [instance: 50be3ff0-4ddb-4d6c-8de6-badb6803efa2] Claim successful
2016-12-19 22:07:14.669 17593 WARNING nova.virt.libvirt.driver [req-ce4b8903-46e6-4e42-96c8-49d828793350 93694f16d97d4646a4462484aac300a3 d8b81f2c3eda4f02a01dc4bcba746159 - - -] [instance: 50be3ff0-4ddb-4d6c-8de6-badb6803efa2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
2016-12-19 22:07:18.439 17593 WARNING nova.virt.osinfo [req-ce4b8903-46e6-4e42-96c8-49d828793350 93694f16d97d4646a4462484aac300a3 d8b81f2c3eda4f02a01dc4bcba746159 - - -] Cannot find OS information - Reason: (No configuration information found for operating system Empty)
2016-12-19 22:07:20.169 17593 INFO nova.virt.block_device [req-ce4b8903-46e6-4e42-96c8-49d828793350 93694f16d97d4646a4462484aac300a3 d8b81f2c3eda4f02a01dc4bcba746159 - - -] [instance: 50be3ff0-4ddb-4d6c-8de6-badb6803efa2] Booting with blank volume at /dev/vda
2016-12-19 22:08:12.027 17593 INFO oslo.privsep.daemon [req-ce4b8903-46e6-4e42-96c8-49d828793350 93694f16d97d4646a4462484aac300a3 d8b81f2c3eda4f02a01dc4bcba746159 - - -] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/usr/share/nova/nova-dist.conf', '--config-file', '/etc/nova/nova.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpvZQgu7/privsep.sock']
2016-12-19 22:08:13.676 17593 INFO oslo.privsep.daemon [req-ce4b8903-46e6-4e42-96c8-49d828793350 93694f16d97d4646a4462484aac300a3 d8b81f2c3eda4f02a01dc4bcba746159 - - -] Spawned new privsep daemon via rootwrap
2016-12-19 22:08:13.679 17593 INFO oslo.privsep.daemon [-] privsep daemon starting
2016-12-19 22:08:13.679 17593 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
2016-12-19 22:08 ...

(more)

edit retag flag offensive close merge delete

Comments

On my Newton DevStack, by default Horizon copies the image to a volume when launching an instance. Your compute log indicates the same. This would explain why you have nothing in the instances directory.

Why does the launch fail? Something wrong with the image, I guess. Try launching it from CLI.

Bernd Bausch ( 2016-12-20 02:27:21 -0600 )edit

add a comment

4 answers

Sort by » oldest newest most voted

answered 2017-02-01 16:04:24 -0600

TimSerewicz
11 ●1 ●1 ●3

This could be an issue with Nova and the emulator you are using. I have found this in Newton when running in a virtualized environment. The new qemu-kvm-ev package seems to depend on svm or vmx flags under /proc/cpuinfo and will not boot the disk properly otherwise. This is what worked for me, at least with todays version of OpenStack:

Edit your /etc/nova/nova.conf file and verify/update these two parameters:

virt_type=qemu

cpu_mode=none

A reboot of the node is a way to make sure all services come up properly together. Launch another instance. It may be slow to come up but at least something will work.

edit flag offensive delete link

add a comment

answered 2016-12-20 03:32:22 -0600

paleksic
1 ●1 ●1 ●1

I tried launching from cli without any luck. It is strange. I'm learning openstack and keep installing every few days following the same procedure .Now is broken ? Did something change in few days , some update?

Downgraded to Mitaka and it works fine.

openstack server create --image 1d2e9b58-15e4-491e-b768-54200a816ff7 --flavor 1 --nic net-id=1d8ef739-5171-4f48-85f7-911f85d8c3a3 --wait CliTest

+--------------------------------------+----------------------------------------------------------+
| Field                                | Value                                                    |
+--------------------------------------+----------------------------------------------------------+
| OS-DCF:diskConfig                    | MANUAL                                                   |
| OS-EXT-AZ:availability_zone          | nova                                                     |
| OS-EXT-SRV-ATTR:host                 | server1.example.org                                      |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | server1.example.org                                      |
| OS-EXT-SRV-ATTR:instance_name        | instance-00000003                                        |
| OS-EXT-STS:power_state               | 1                                                        |
| OS-EXT-STS:task_state                | None                                                     |
| OS-EXT-STS:vm_state                  | active                                                   |
| OS-SRV-USG:launched_at               | 2016-12-20T09:06:04.000000                               |
| OS-SRV-USG:terminated_at             | None                                                     |
| accessIPv4                           |                                                          |
| accessIPv6                           |                                                          |
| addresses                            | private_network=192.168.100.5                            |
| adminPass                            | g44yFCyetJWQ                                             |
| config_drive                         |                                                          |
| created                              | 2016-12-20T09:05:48Z                                     |
| flavor                               | m1.tiny (1)                                              |
| hostId                               | d34746971eb80ba928e1e769ecf478b54ca05b14c240fdbd6088ab2b |
| id                                   | 43153896-e592-48f5-9bee-a9269d45409c                     |
| image                                | cirros image (1d2e9b58-15e4-491e-b768-54200a816ff7)      |
| key_name                             | None                                                     |
| name                                 | CliTest                                                  |
| os-extended-volumes:volumes_attached | []                                                       |
| progress                             | 0                                                        |
| project_id                           | f34df00f79f54fb8bcdd81a82a3a5946                         |
| properties                           |                                                          |
| security_groups                      | [{u'name': u'default'}]                                  |
| status                               | ACTIVE                                                   |
| updated                              | 2016-12-20T09:06:05Z                                     |
| user_id                              | 75493e99e9514176931c4ba584bc2182                         |
+--------------------------------------+----------------------------------------------------------+

console log

=== datasource: ec2 net ===
instance-id: i-00000003
name: N/A
availability-zone: nova
local-hostname: clitest.novalocal
launch-index: 0
=== cirros: current=d161201 uptime=11.30 ===
  ____               ____  ____
 / __/ __ ____ ____ / __ \/ __/
/ /__ / // __// __// /_/ /\ \
\___//_//_/  /_/   \____/___/
   http://cirros-cloud.net


login as 'cirros' user. default password: 'gocubsgo'. use 'sudo' for root.
clitest login: /dev/root resized successfully [took 0.72s]
[  462.436942] random: nonblocking pool is initialized

edit flag offensive delete link

Comments

I believe this may be the same related issue... https://ask.openstack.org/en/question/100756/instances-stuck-on-booting-from-hard-drive/ (https://ask.openstack.org/en/question...)

BigQEd ( 2017-01-03 08:18:10 -0600 )edit

I am having the same exact issue and I have done installation more then 10 times and same exact error everytime. Need to know how to resolve this issue.

mkhan ( 2017-01-17 10:22:15 -0600 )edit

add a comment

answered 2017-02-01 11:44:43 -0600

Jmartinez
1

I'm having exactly the same issue and no luck. Everything is working as expected, no errors on any log. Even I installed the same Newton version under Ubuntu and seems to work fine. Same version (Newton) same structure but instead of ubuntu, centos as hypervisor... no way to pass through the message booting from hard drive.

--- Logical volume ---
  LV Path                /dev/cinder-volumes/volume-bd9f6805-dca9-4431-ae94-2b790d26d1e2
  LV Name                volume-bd9f6805-dca9-4431-ae94-2b790d26d1e2
  VG Name                cinder-volumes
  LV UUID                kOIFzo-X21m-EUnf-hyXL-i3aM-uYmL-P0rKvc
  LV Write Access        read/write
  LV Creation host, time compute01, 2017-02-01 16:59:03 +0000
  LV Status              available
  # open                 1
  LV Size                10.00 GiB
  Current LE             2560
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     8192
  Block device           253:3

017-02-01 16:42:02.875 12702 INFO cinder.volume.targets.iscsi [req-d491123c-f86d-48cf-97fa-0d6529122b47 9aadfe73e495418ab21782bbf960d704 858dea97189f4b5591c1db54743699e5 - default default] S**kipping remove_export. No iscsi_target is presently exported for volume**: 69c33e50-c6cc-4859-ac4c-b5cf76c529c9
2017-02-01 16:42:03.008 12702 INFO cinder.brick.local_dev.lvm [req-d491123c-f86d-48cf-97fa-0d6529122b47 9aadfe73e495418ab21782bbf960d704 858dea97189f4b5591c1db54743699e5 - default default] **Logical Volume not found when querying LVM info**. (vg_name=cinder-volumes, lv_name=volume-69c33e50-c6cc-4859-ac4c-b5cf76c529c9
2017-02-01 16:42:03.448 12702 INFO cinder.volume.manager [req-d491123c-f86d-48cf-97fa-0d6529122b47 9aadfe73e495418ab21782bbf960d704 858dea97189f4b5591c1db54743699e5 - default default] Deleted volume successfully.
2017-02-01 16:58:52.297 12702 INFO cinder.volume.flows.manager.create_volume [req-11bc948b-dbdc-43f5-846d-30239af3b8ea 9aadfe73e495418ab21782bbf960d704 858dea97189f4b5591c1db54743699e5 - default default] **Volume bd9f6805-dca9-4431-ae94-2b790d26d1e2: being created as image with specification: {'status': u'creating', 'image_location': (None, None), 'volume_size': 10, 'volume_name': 'volume-bd9f6805-dca9-4431-ae94-2b790d26d1e2', 'image_id': 'b79b8deb-63f2-4759-ae82-4f9b73eeacbf', 'image_service': <cinder.image.glance.GlanceImageService object at 0x75e6a10>, 'image_meta': {'status': u'active', 'name': u'Centos7', 'deleted': False, 'container_format': u'bare', 'created_at': datetime.datetime(2017, 2, 1, 14, 55, 8, tzinfo=<iso8601.Utc>), 'disk_format': u'qcow2', 'updated_at': datetime.datetime(2017, 2, 1, 14, 55, 33, tzinfo=<iso8601.Utc>), 'id': u'b79b8deb-63f2-4759-ae82-4f9b73eeacbf', 'owner': u'858dea97189f4b5591c1db54743699e5', 'protected': False, 'min_ram': 0, 'checksum': u'9eca98f4b3ad7e6dd4390a9d181381c9', 'min_disk': 0, 'is_public': True, 'deleted_at': None, 'properties': {u'description': u'Centos 7'}, 'size': 1004994560}}**
2017-02-01 16:59:02.834 12702 INFO cinder.image.image_utils [req-11bc948b-dbdc-43f5-846d-30239af3b8ea 9aadfe73e495418ab21782bbf960d704 858dea97189f4b5591c1db54743699e5 - default default] Image download 958.00 MB at 90.94 MB/s
2017-02-01 17:00:37.432 12702 INFO cinder.image.image_utils [req-11bc948b-dbdc-43f5-846d-30239af3b8ea 9aadfe73e495418ab21782bbf960d704 858dea97189f4b5591c1db54743699e5 - default default] Converted 8192.00 MB image at 91.20 MB/s
2017-02-01 17:00:38.103 12702 INFO cinder.volume.flows.manager.create_volume [req-11bc948b-dbdc-43f5-846d-30239af3b8ea 9aadfe73e495418ab21782bbf960d704 858dea97189f4b5591c1db54743699e5 - default default] **Volume volume-bd9f6805-dca9-4431-ae94-2b790d26d1e2 (bd9f6805-dca9-4431-ae94-2b790d26d1e2): created successfully**
2017-02-01 17:00:38.109 12702 INFO cinder.volume.manager [req-11bc948b-dbdc-43f5-846d-30239af3b8ea 9aadfe73e495418ab21782bbf960d704 858dea97189f4b5591c1db54743699e5 - default default] **Created volume successfully.**
2017-02-01 17:00:40.023 12702 INFO cinder.volume.targets.lio [req-00cb0870-199b-4fa0-a5e8-158179dd9636 9aadfe73e495418ab21782bbf960d704 858dea97189f4b5591c1db54743699e5 - default default] **Creating iscsi_target for volume: volume-bd9f6805-dca9-4431-ae94-2b790d26d1e2**
2017-02-01 17:00:41.140 12702 INFO cinder.volume.manager [req-00cb0870-199b-4fa0-a5e8-158179dd9636 9aadfe73e495418ab21782bbf960d704 858dea97189f4b5591c1db54743699e5 - default default] **Initialize volume connection completed successfully.**
2017-02-01 17:00:41.909 12702 INFO cinder.volume.manager [req-db73c29e-8581-4f68-b3c2-c11be97e2204 9aadfe73e495418ab21782bbf960d704 858dea97189f4b5591c1db54743699e5 - default default] **Attach volume completed successfully.**



nova show d0029dda-1bc6-4beb-b09a-2786e9efa090
+--------------------------------------+----------------------------------------------------------------------------------+
| Property                             | Value                                                                            |
+--------------------------------------+----------------------------------------------------------------------------------+
| OS-DCF:diskConfig                    | AUTO                                                                             |
| OS-EXT-AZ:availability_zone          | nova                                                                             |
| OS-EXT-SRV-ATTR:host                 | compute01                                                       |
| OS-EXT-SRV-ATTR:hostname             | centos7                                                                          |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | compute01                                                        |
| OS-EXT-SRV-ATTR:instance_name        | instance-00000006                                                                |
| OS-EXT-SRV-ATTR:kernel_id            |                                                                                  |
| OS-EXT-SRV-ATTR:launch_index         | 0                                                                                |
| OS-EXT-SRV-ATTR:ramdisk_id           |                                                                                  |
| OS-EXT-SRV-ATTR:reservation_id       | r-062psrw6                                                                       |
| OS-EXT-SRV-ATTR:root_device_name     | /dev/vda                                                                         |
| OS-EXT-SRV-ATTR:user_data            | -                                                                                |
| OS-EXT-STS:power_state               | 1                                                                                |
| OS-EXT-STS:task_state                | -                                                                                |
| OS-EXT-STS:vm_state                  | active                                                                           |
| OS-SRV-USG:launched_at ...

(more)

edit flag offensive delete link

add a comment

answered 2017-05-01 11:37:45 -0600

BigQEd
11 ●2 ●2

updated 2017-05-01 11:39:32 -0600

A "work around" is to use virt_type=qemu and cpu_mode=none in nova.conf, however, if virt_type kvm is needed I'm not sure the current qemu-kvm version has a solution. There seems to be a resolution when libvirtd moves to 2.5.0 but that is not released yet.

See the following bugs:

https://bugzilla.redhat.com/show_bug.cgi?id=1404627 (https://bugzilla.redhat.com/show_bug....) https://bugs.launchpad.net/nova/+bug/1653430 (https://bugs.launchpad.net/nova/+bug/...)

edit flag offensive delete link

add a comment

instance cant boot without throwing any errors

Comments

4 answers

Comments

Your Answer

Get to know Ask OpenStack

Question Tools

Stats

Related questions

Feedback About This Page

OpenStack

Community

Documentation

Branding & Legal

instance cant boot without throwing any errors edit

Comments

4 answers

Comments

Your Answer

Get to know Ask OpenStack

Question Tools

Stats

Related questions

Feedback About This Page

OpenStack

Community

Documentation

Branding & Legal

instance cant boot without throwing any errors