Ask Your Question
0

spawning a VM with SRIOV interfaces is failing

asked 2016-12-21 21:48:00 -0500

chkrishn gravatar image

updated 2016-12-22 10:01:11 -0500

Hi,

I am running openstack mitaka. I am trying to spawn a VM with 2 interfaces. One interface is Virtio, second one is SRIOV (with binding direct). However VM fails with an error. I am spawning the VM in the following manner

nova boot --flavor vn.nclim8p --boot-volume e7ded76a-53d4-4573-90df-218c80ddbee7 --config-drive true \
 --nic port-id=15083f0d-e036-4daf-802d-27859b93595b \
 --nic port-id=257b5deb-1023-4528-af40-92fe2fd5a0e6 \
VM

I see the following error in nova-scheduler log

Compute fails NUMA topology requirements.

If I spawn a VM only with Virtio interfaces it is going through fine.

On Compute: nova.conf

pci_passthrough_whitelist = [ {"vendor_id":"15b3", "product_id":"1004"}, { "devname": "ens5f0", "physical_network": "physnet1"} ]

Here both Mellanox (15B3:1004) and Intel cards (ens5f0) are mentioned. SRIOV is working fine for Mellanox cards.

sriov_agent.ini

[securitygroup]
firewall_driver = neutron.agent.firewall.NoopFirewallDriver

[sriov_nic]
physical_device_mappings = physnet1:ens5f0
exclude_devices =

ip link  show ens5f0
3: ens5f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
    link/ether 14:02:ec:82:f9:f4 brd ff:ff:ff:ff:ff:ff
    vf 0 MAC 00:00:00:00:00:00, spoof checking on, link-state auto
    vf 1 MAC 1a:2a:7f:cc:a2:fe, spoof checking on, link-state auto
    vf 2 MAC 92:bc:69:ab:9f:80, spoof checking on, link-state auto
    vf 3 MAC e6:e9:d0:c2:2a:99, spoof checking on, link-state auto
    vf 4 MAC 62:b5:e2:35:fb:3c, spoof checking on, link-state auto
    vf 5 MAC 62:de:c3:c7:e0:5c, spoof checking on, link-state auto
    vf 6 MAC 6e:95:ab:45:71:0e, spoof checking on, link-state auto

On Controller: nova.conf

scheduler_default_filters = AvailabilityZoneFilter, RamFilter, DiskFilter, ComputeFilter, ComputeCapabilitiesFilter, ImagePropertiesFilter, ServerGroupAntiAffinityFilter, ServerGroupAffinityFilter, NUMATopologyFilter, PciPassthroughFilter, RetryFilter
scheduler_available_filters = nova.scheduler.filters.all_filters
scheduler_available_filters = nova.scheduler.filters.pci_passthrough_filter.PciPassthroughFilter

pci_alias={"name":"Mellanox_VF", "product_id":"1004", "vendor_id":"15b3", "device_type":"type-VF"}

ml2_conf.ini

[ml2]
type_drivers = flat,vlan
tenant_network_types =
mechanism_drivers = linuxbridge,sriovnicswitch
extension_drivers = port_security

[ml2_sriov]
supported_pci_vendor_devs = 8086:10ed
agent_required = False

[sriov_nic]
physical_device_mappings = physnet1:ens5f0

Can you please let me know if I am missing anything here?

Regards Krishna

edit retag flag offensive close merge delete

Comments

Can you add flavor vn.nclim8p and ports details?

Antonio G. gravatar imageAntonio G. ( 2016-12-22 10:05:17 -0500 )edit

Added flavor and port details

chkrishn gravatar imagechkrishn ( 2016-12-22 21:27:49 -0500 )edit

1 answer

Sort by ยป oldest newest most voted
0

answered 2016-12-22 21:23:17 -0500

chkrishn gravatar image

openstack flavor show vn.nclim8p

+----------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Field                      | Value                                                                                                                                                                                                                          |
+----------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| OS-FLV-DISABLED:disabled   | False                                                                                                                                                                                                                          |
| OS-FLV-EXT-DATA:ephemeral  | 0                                                                                                                                                                                                                              |
| disk                       | 0                                                                                                                                                                                                                              |
| id                         | af3a2a5a-44fa-48a9-970c-7764d1fb71c8                                                                                                                                                                                           |
| name                       | vn.nclim8p                                                                                                                                                                                                                     |
| os-flavor-access:is_public | True                                                                                                                                                                                                                           |
| properties                 | capabilities:cpu_info:arch='x86_64', capabilities:cpu_info:vendor='Intel', hw:cpu_policy='dedicated', hw:cpu_sockets='1', hw:cpu_threads='2', hw:mem_page_size='1GB', hw:numa_nodes='2', pci_passthrough:alias='Mellanox_VF:1' |
| ram                        | 16384                                                                                                                                                                                                                          |
| rxtx_factor                | 1.0                                                                                                                                                                                                                            |
| swap                       |                                                                                                                                                                                                                                |
| vcpus                      | 8                                                                                                                                                                                                                              |
+----------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

neutron port-show 257b5deb-1023-4528-af40-92fe2fd5a0e6

+-----------------------+--------------------------------------------------------------------------------------+
| Field                 | Value                                                                                |
+-----------------------+--------------------------------------------------------------------------------------+
| admin_state_up        | True                                                                                 |
| allowed_address_pairs |                                                                                      |
| binding:host_id       |                                                                                      |
| binding:profile       | {}                                                                                   |
| binding:vif_details   | {}                                                                                   |
| binding:vif_type      | unbound                                                                              |
| binding:vnic_type     | direct                                                                               |
| created_at            | 2016-12-20T16:59:57                                                                  |
| description           |                                                                                      |
| device_id             |                                                                                      |
| device_owner          |                                                                                      |
| extra_dhcp_opts       |                                                                                      |
| fixed_ips             | {"subnet_id": "db166731-818d-4bc5-9842-b319e646c4d0", "ip_address": "192.168.137.7"} |
| id                    | 257b5deb-1023-4528-af40-92fe2fd5a0e6                                                 |
| mac_address           | fa:16:3e:5e:9c:4e                                                                    |
| name                  | sriov-port2                                                                          |
| network_id            | 337d9249-f34a-42ea-9609-3e20aa5f614c                                                 |
| port_security_enabled | True                                                                                 |
| security_groups       | 97d44115-6337-4bba-ad27-b6ff74d86419                                                 |
| status                | DOWN                                                                                 |
| tenant_id             | e2ba5e79aa7f440faf89758a38623276                                                     |
| updated_at            | 2016-12-22T06:28:28                                                                  |
+-----------------------+--------------------------------------------------------------------------------------+

neutron port-show 15083f0d-e036-4daf-802d-27859b93595b

+-----------------------+---------------------------------------------------------------------------------------+
| Field                 | Value                                                                                 |
+-----------------------+---------------------------------------------------------------------------------------+
| admin_state_up        | True                                                                                  |
| allowed_address_pairs |                                                                                       |
| binding:host_id       |                                                                                       |
| binding:profile       | {}                                                                                    |
| binding:vif_details   | {}                                                                                    |
| binding:vif_type      | unbound                                                                               |
| binding:vnic_type     | normal                                                                                |
| created_at            | 2016-12-21T16:37:32                                                                   |
| description           |                                                                                       |
| device_id             |                                                                                       |
| device_owner          |                                                                                       |
| extra_dhcp_opts       |                                                                                       |
| fixed_ips             | {"subnet_id": "db166731-818d-4bc5-9842-b319e646c4d0", "ip_address": "192.168.38.166"} |
| id                    | 15083f0d-e036-4daf-802d-27859b93595b                                                  |
| mac_address           | fa:16:3e:83:b6:29                                                                     |
| name                  |                                                                                       |
| network_id            | 337d9249-f34a-42ea-9609-3e20aa5f614c                                                  |
| port_security_enabled | True                                                                                  |
| security_groups       | 97d44115-6337-4bba-ad27-b6ff74d86419                                                  |
| status                | DOWN                                                                                  |
| tenant_id             | e2ba5e79aa7f440faf89758a38623276                                                      |
| updated_at            | 2016-12-22T06:28:28                                                                   |
+-----------------------+---------------------------------------------------------------------------------------+
edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2016-12-21 21:48:00 -0500

Seen: 272 times

Last updated: Dec 22 '16