pci passthrough grub intel_iommu=on causes no ip on guests

asked 2019-01-28 06:56:00 -0500

hudac gravatar image

updated 2019-01-28 17:30:32 -0500

Hi, My setup is: 1 controller node, 1 compute node. I've installed openstack rocky step-by-step from the openstack guide.

After setting the grub option in order to provide pci-passthrough nic:

GRUB_CMDLINE_LINUX_DEFAULT="intel_iommu=on"

Guests stopped receiving ip via dhcp server.

I see this error on the compute node, nova-compute.log:

Received unexpected event network-vif-plugged-681e4bee-6fe1-47f0-83a8-be928b21ee77 for instance with vm_state active and task_state None

This is what I see in the guest:

[  OK  ] Started ifup for ens3.
         Starting Raise network interfaces...
[FAILED] Failed to start Raise network interfaces.
See 'systemctl status networking.service' for details.
[  OK  ] Reached target Network.
         Starting Initial cloud-init job (metadata service crawler)...
[   40.160381] cloud-init[827]: Cloud-init v. 18.2 running 'init' at Mon, 28 Jan 2019 12:38:28 +0000. Up 39.55 seconds.
[   40.163789] cloud-init[827]: ci-info: +++++++++++++++++++++++++++++++++++++Net device info+++++++++++++++++++++++++++++++++++++
[   40.167100] cloud-init[827]: ci-info: +--------+-------+------------------------------+-----------+-------+-------------------+
[   40.170596] cloud-init[827]: ci-info: | Device |   Up  |           Address            |    Mask   | Scope |     Hw-Address    |
[   40.173904] cloud-init[827]: ci-info: +--------+-------+------------------------------+-----------+-------+-------------------+
[   40.177804] cloud-init[827]: ci-info: |  ens3  |  True |              .               |     .     |   .   | fa:16:3e:56:d8:b2 |
[   40.182129] cloud-init[827]: ci-info: |  ens3  |  True | fe80::f816:3eff:fe56:d8b2/64 |     .     |  link | fa:16:3e:56:d8:b2 |
[   40.185976] cloud-init[827]: ci-info: |  ens4  | False |              .               |     .     |   .   | fa:16:3e:e4:59:1d |
[   40.190119] cloud-init[827]: ci-info: |   lo   |  True |          127.0.0.1           | 255.0.0.0 |   .   |         .         |
[   40.193699] cloud-init[827]: ci-info: |   lo   |  True |           ::1/128            |     .     |  host |         .         |
[   40.197368] cloud-init[827]: ci-info: +--------+-------+------------------------------+-----------+-------+-------------------+
  • I set the timeout of networking.service to 30 seconds, so I won't have to wait 5 minutes.
  • Afterwards, there's no ip on ens3, and no connectivity.

More details:

On compute node, nova-compute.log

INFO nova.compute.manager [req-ff000448-ae13-4d5a-b51b-1747d811a83c - - - - -] [instance: ab350c3d-0156-4408-bed0-eadf708c281e] VM Resumed (Lifecycle Event)
INFO nova.virt.libvirt.driver [-] [instance: ab350c3d-0156-4408-bed0-eadf708c281e] Instance running successfully.
INFO nova.virt.libvirt.driver [req-98bab187-154e-44df-b433-356c815a3e5a 1584e0d5ecea4f98a010c9ba0209f5a0 abbe58c749a546589f5322d99e69eff9 - default default] [instance: ab350c3d-0156-4408-bed0-eadf708c281e] Instance soft rebooted successfully.
INFO nova.compute.manager [req-ff000448-ae13-4d5a-b51b-1747d811a83c - - - - -] [instance: ab350c3d-0156-4408-bed0-eadf708c281e] During sync_power_state the instance has a pending task (reboot_started). Skip.
INFO nova.compute.manager [req-ff000448-ae13-4d5a-b51b-1747d811a83c - - - - -] [instance: ab350c3d-0156-4408-bed0-eadf708c281e] VM Started (Lifecycle Event)
WARNING nova.compute.manager [req-1ec61c72-08e5-4081-867a-3bd28861fa68 c4c08da72442430a9ffb1508bfad551b 3bc27738ecf7487a9b7090ecac162d5e - default default] [instance: ab350c3d-0156-4408-bed0-eadf708c281e] Received unexpected event network-vif-plugged-326b4b3b-f66a-418b-8d6d-b32280079956 for instance with vm_state active and task_state None.
WARNING nova.compute.manager [req-167abffc-3d25-476b-a312-506c1db1df09 c4c08da72442430a9ffb1508bfad551b 3bc27738ecf7487a9b7090ecac162d5e - default default] [instance: ab350c3d-0156-4408-bed0-eadf708c281e] Received unexpected event network-vif-unplugged-681e4bee-6fe1-47f0-83a8-be928b21ee77 for instance with vm_state active and task_state None.
WARNING nova.compute.manager [req-2c2c2d1c-c34a-4bab-82fc-d82476c18fb8 c4c08da72442430a9ffb1508bfad551b 3bc27738ecf7487a9b7090ecac162d5e - default default] [instance: ab350c3d-0156-4408-bed0-eadf708c281e] Received unexpected event network-vif-plugged-681e4bee-6fe1-47f0-83a8-be928b21ee77 for instance with vm_state active and task_state None.
INFO nova.compute.resource_tracker [req-60faa024-6c3d-4706-aa05-985f5efb8e7d - - - - -] Final resource view: name=openstack phys_ram=32154MB used_ram=17408MB phys_disk=273GB used_disk=21GB total_vcpus=12 used_vcpus=5 pci_stats=[PciDevicePool(count=1,numa_node=None,product_id='1572',tags={dev_type='type-PF'},vendor_id='8086')

root@openstack:~# openstack server show vm1
+-------------------------------------+----------------------------------------------------------+
| Field                               | Value                                                    |
+-------------------------------------+----------------------------------------------------------+
| OS-DCF:diskConfig                   | AUTO                                                     |
| OS-EXT-AZ:availability_zone         | nova                                                     |
| OS-EXT-SRV-ATTR:host                | openstack                                                |
| OS-EXT-SRV-ATTR:hypervisor_hostname | openstack                                                |
| OS-EXT-SRV-ATTR:instance_name       | instance-00000002                                        |
| OS-EXT-STS:power_state              | Running                                                  |
| OS-EXT-STS:task_state               | None                                                     |
| OS-EXT-STS:vm_state                 | active                                                   |
| OS-SRV-USG:launched_at              | 2019-01-27T12:36:06.000000                               |
| OS-SRV-USG:terminated_at            | None                                                     |
| accessIPv4                          |                                                          |
| accessIPv6                          |                                                          |
| addresses                           | internal=172.16.1.108; datapath=172.16.2.107             |
| config_drive                        |                                                          |
| created                             | 2019-01-27T12:34:18Z                                     |
| flavor                              | vm_flavor (b6a83b01-7120-4047-9994-aa6f02c8d4bd ...
(more)
edit retag flag offensive close merge delete