Ask Your Question
2

Instance get stuck when booting grub

asked 2017-01-26 11:28:53 -0500

Jorge Florencio gravatar image

Hi folks, this is an OpenStack Mitaka running on CentOS 7.3 on top of VMWare ESXi 5.5 (nested virtualization).

I started a Cirros instance and the console get stuck booting grub:

Booting from Hard Disk...
GRUB

The nova-compute.log doesn't display any errors.

If I change the virt_type to qemu in /etc/nova/nova.conf the instance sucessfully boot, but I can't use hardware virtualization.

KVM module is loaded on compute nodes:

# lsmod |grep kvm
kvm_intel             170181  0
kvm                   554609  1 kvm_intel
irqbypass              13503  1 kvm
# ls -la /dev/kvm
crw-rw-rw- 1 root kvm 10, 232 Jan 26 17:28 /dev/kvm
#

Any suggestion would be appreciated.

Thanks! Jorge.

edit retag flag offensive close merge delete

6 answers

Sort by » oldest newest most voted
0

answered 2017-01-26 14:38:46 -0500

volenbovsky gravatar image

Hi,

your observations are pretty much describing the situation. Normally, you can't use KVM acceleration unless VM is running on bare metal (physical CPU with enabled virtualization)

Exposing KVM above something that is virtual machine itself - that's scenario of 'nested virtualization'.

Hopefully link https://forum.ivorde.com/kvm-nested-i... will be of help.

edit flag offensive delete link more

Comments

Nested virtualization was already enabled. I still can't boot instances.

Jorge Florencio gravatar imageJorge Florencio ( 2017-01-27 02:31:10 -0500 )edit

More needs investigated on this issue. I know many people having this issue. EXACT issue.

It started with CentOS 7.3 and Openstack Newton.

BigQEd gravatar imageBigQEd ( 2017-02-13 17:49:07 -0500 )edit
0

answered 2017-02-13 17:49:39 -0500

BigQEd gravatar image

More needs investigated on this issue. I know many people having this issue. EXACT issue.

It started with CentOS 7.3 and Openstack Newton.

edit flag offensive delete link more
0

answered 2017-06-19 06:17:52 -0500

qwest gravatar image

Facing exact same issue

CentOS 7 VM is hosted on ESXi v6.0

VM's vmx file has below lines appended in the end:

monitor.virtual_exec = “hardware”
hypervisor.cpuid.v0 = “FALSE”
vhv.enable = "TRUE"

# egrep -c '(vmx|svm)' /proc/cpuinfo 
16 (I've given 4 cores and 4 sockets to the VM)

# lsmod | grep kvm
kvm_intel              45674  0
kvm                   291811  1 kvm_intel

Ocata Packstack AIO has been installed and all openstack services are working properly

Windows instances were used from:

  • Cloudbase eval of windows 2012 r2
  • KVM based VM(win2k12r2) was created from another CentOS 6/7 VM
  • KVM based VM(win2k12r2) was created from another Ubuntu 16.04 VM
  • Baloon, viostor and NetKVM were the only drivers added during installation

in /etc/nova/nova.conf

if virt_type = qemu, windows instance boots up but goes into Blue screen

if virt_type=kvm, issue as mentioned by OP shows up and instance never boots

cpu_mode was kept as none in both the case

Tried setting up devstack on ubuntu 16.04 server and KVM was configured even in that

Ubuntu 16.04 Server VM on ESXi v6.0 with same contents in .vmx file of the VM as mentioned above.

#kvm-ok
INFO: /dev/kvm exists
KVM acceleration can be used

This time any or all the type of Windows VM images created/obtained through methods mentioned above comes up instantaneously

virt_type=kvm and cpu_mode=none in /etc/nova/nova.conf

Issue is being seen only in CentOS 7

edit flag offensive delete link more
0

answered 2018-01-22 16:55:19 -0500

I had the same issue. I was able to add the following property to the glance image properties

--property hw_disk_bus=ide

And that seemed to fix the problem and i was able to boot.

edit flag offensive delete link more
0

answered 2017-08-30 14:09:12 -0500

trakatelis gravatar image

If your compute host is centos/rhel 7.3 running as a VM on ESXi, there is a quick fix to have hardware assisted virtualization (virt_type = kvm) work.

In the [libvirt] section of /etc/nova/nova.conf set hw_machine_type as follows:

hw_machine_type = x86_64=pc-i440fx-rhel7.2.0

edit flag offensive delete link more
0

answered 2017-01-27 07:12:01 -0500

updated 2017-01-27 08:29:24 -0500

Hi there,

I've got the same issue. Installed Packstack in CentOS 7 as a VM on vmware. I have already added vhv.enable line to *.vmx file and changed virt_type = kvm in nova.conf. VNC console stop at "Booting from Hard Disk...GRUB" and Log console doesn't show anything.

When qemu was choosed as virt_type, the result was the same, but there was no information about SeaBIOS and GRUB (only Booting from hard disk information...).

Here is libvirt log of that instance:

2017-01-27 12:39:15.863+0000: starting up libvirt version: 2.0.0, package: 10.el7_3.4 (CentOS BuildSystem <http://bugs.centos.org>, 2017-01-17-23:37:48, c1bm.rdu2.centos.org), qemu version: 2.6.0 (qemu-kvm-ev-2.6.0-27.1.el7), hostname: packstack
LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin QEMU_AUDIO_DRV=none /usr/libexec/qemu-kvm -name guest=instance-00000001,debug-threads=on -S -object secret,id=masterKey0,format=raw,file=/var/lib/libvirt/qemu/domain-1-instance-00000001/master-key.aes -machine pc-i440fx-rhel7.3.0,accel=tcg,usb=off -cpu Broadwell,+vme,+ds,+ss,+vmx,+osxsave,+f16c,+rdrand,+hypervisor,+arat,+tsc_adjust,+xsaveopt,+pdpe1gb,+abm,+rtm,+hle -m 512 -realtime mlock=off -smp 1,sockets=1,cores=1,threads=1 -uuid 52cef116-5ad5-44f0-8923-3a77896f0861 -smbios 'type=1,manufacturer=RDO,product=OpenStack Compute,version=14.0.2-1.el7,serial=0f2c5c8a-4588-4f28-8290-d2a6707aa332,uuid=52cef116-5ad5-44f0-8923-3a77896f0861,family=Virtual Machine' -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/domain-1-instance-00000001/monitor.sock,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=utc -no-shutdown -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -drive file=/dev/disk/by-path/ip-10.123.200.1:3260-iscsi-iqn.2010-10.org.openstack:volume-6225acf9-2f51-4d31-aca7-59c61fb3084a-lun-0,format=raw,if=none,id=drive-virtio-disk0,serial=6225acf9-2f51-4d31-aca7-59c61fb3084a,cache=none,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x4,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -netdev tap,fd=29,id=hostnet0 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=fa:16:3e:5b:f9:07,bus=pci.0,addr=0x3 -add-fd set=1,fd=32 -chardev file,id=charserial0,path=/dev/fdset/1,append=on -device isa-serial,chardev=charserial0,id=serial0 -chardev pty,id=charserial1 -device isa-serial,chardev=charserial1,id=serial1 -device usb-tablet,id=input0,bus=usb.0,port=1 -vnc 0.0.0.0:0 -k en-us -device cirrus-vga,id=video0,bus=pci.0,addr=0x2 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5 -msg timestamp=on
char device redirected to /dev/pts/0 (label charserial1)
warning: TCG doesn't support requested feature: CPUID.01H:EDX.vme [bit 1]
warning: TCG doesn't support requested feature: CPUID.01H:EDX.ds [bit 21]
warning: TCG doesn't support requested feature: CPUID.01H:ECX.vmx [bit 5]
warning: TCG doesn't support requested feature: CPUID.01H:ECX.fma [bit 12]
warning: TCG doesn't support requested feature: CPUID.01H:ECX.pcid [bit 17]
warning: TCG doesn't support requested feature: CPUID.01H:ECX.x2apic [bit 21]
warning: TCG doesn't support requested feature: CPUID.01H:ECX.tsc-deadline [bit 24]
warning: TCG ...
(more)
edit flag offensive delete link more

Comments

Hi !

My enviroiment: Centos7.2 on VMware, OpenStack Mitaka

I fixed:

1.On Compute node, you can change in file /etc/nova/nova.conf on section [libvirt]

virt_type=qemu

cpu_mode=none

Plz, detail in sample: http://prnts cr.com/e8h4xe

2.Restart nova-compute server or reboot Compute

To Thanh Cong gravatar imageTo Thanh Cong ( 2017-02-13 23:02:50 -0500 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

4 followers

Stats

Asked: 2017-01-26 11:28:53 -0500

Seen: 6,546 times

Last updated: Aug 30 '17