Ask Your Question
3

cinder emc vnx fc driver : create volume from image

asked 2015-02-12 05:03:25 -0600

hfamily15 gravatar image

hi, all

I'm testing Cinder (Juno version, 2014.2.1) with emc vnx fc driver. and I want to create volume from image.

I have 1 cinder-volume node (this is a VM). cinder-volume node is on Physical machine that have HBA card and can attach FC device.

In this environment, Is it possible to create volume from image? then, How can cinder-volume node recognize vHBA?

What should I do for this?

please somebody help me.

Thanks alot.

edit retag flag offensive close merge delete

Comments

Actually, EMC iscsi driver woks well to create volume from image. cinder-volume node can attach directly to Storage and copy image to lun. But with EMC FC driver, is it works same? how cinder-node can attach lun directly? use vHBA? Please help me. Thanks

hfamily15 gravatar imagehfamily15 ( 2015-02-12 05:06:25 -0600 )edit
add a comment

4 answers

Sort by » oldest newest most voted
3

answered 2015-02-15 21:06:38 -0600

jay-xu gravatar image

updated 2015-02-26 02:44:00 -0600

To access the storage in VNX, Nova compute nodes need to be registered with VNX first. In addition, in order to perform "Copy Image to Volume" and "Copy Volume to Image" operations, nodes running the cinder-volume service (Cinder nodes) must be registered with the VNX as well.

For the detail, you can refer to the session Preparation -> Register with VNX in README of EMC Cinder Direct Driver for OpenStack Juno release.

In general, currently there are only two ways to expose vHBA to guest:

  1. NPIV
    • Host creates vHBA
    • Use libvirt to expose vHBA as a scsi_host
  2. Single Root Input/Output Virtualization (SR-IOV)
    • Expose virtual functions of PCI-E devices to guest.

In the case you mentioned, NPIV is not the right solution because vHBAs (NPIV virtual adapters) are SCSI host adapters(and not PCI devices) which are not visible to the userspace and thus are not assignable to guests. This design is in the Linux kernel and cannot be worked around by any userspace component. As far as "How to use SR-IOV" , I noticed that there is a document from RedHat ( https://access.redhat.com/documentati... ). I hope that it would be helpful. Meanwhile, you need also ensure the FC HBA card (QLE2562) in your environment support the SR-IOV feature.

In addition, we do not have any reference that deploy cinder-volume on VM with FC Driver.

edit flag offensive delete link more

Comments

Hi Jay-xu Thank you very much. Your answers were very helpful and I should try to SR-IOV next time. I hope that it works well. if it does, I will let you know about the test result. Thank you.

hfamily15 gravatar imagehfamily15 ( 2015-02-26 03:56:27 -0600 )edit
add a comment
0

answered 2015-03-02 07:56:12 -0600

jeegn-chen gravatar image

According to the follow output (the devices that qemu-kvm can emulate), I don't think KVM can simulate FC HBA.

So using FC Driver within a KVM VM instance is probably infeasible for now.

stack@ubuntu-server7:/opt/stack/cinder$ qemu-system-x86_64 -device ?
Controller/Bridge/Hub devices:
name "i82801b11-bridge", bus PCI
name "ioh3420", bus PCI, desc "Intel IOH device id 3420 PCIE Root Port"
name "pci-bridge", bus PCI, desc "Standard PCI Bridge"
name "usb-host", bus usb-bus
name "usb-hub", bus usb-bus
name "x3130-upstream", bus PCI, desc "TI X3130 Upstream Port of PCI Express Switch"
name "xio3130-downstream", bus PCI, desc "TI X3130 Downstream Port of PCI Express Switch"

USB devices:
name "ich9-usb-ehci1", bus PCI
name "ich9-usb-ehci2", bus PCI
name "ich9-usb-uhci1", bus PCI
name "ich9-usb-uhci2", bus PCI
name "ich9-usb-uhci3", bus PCI
name "ich9-usb-uhci4", bus PCI
name "ich9-usb-uhci5", bus PCI
name "ich9-usb-uhci6", bus PCI
name "nec-usb-xhci", bus PCI
name "pci-ohci", bus PCI, desc "Apple USB Controller"
name "piix3-usb-uhci", bus PCI
name "piix4-usb-uhci", bus PCI
name "usb-ehci", bus PCI
name "vt82c686b-usb-uhci", bus PCI

Storage devices:
name "am53c974", bus PCI, desc "AMD Am53c974 PCscsi-PCI SCSI adapter"
name "dc390", bus PCI, desc "Tekram DC-390 SCSI adapter"
name "ich9-ahci", bus PCI, alias "ahci"
name "ide-cd", bus IDE, desc "virtual IDE CD-ROM"
name "ide-drive", bus IDE, desc "virtual IDE disk or CD-ROM (legacy)"
name "ide-hd", bus IDE, desc "virtual IDE disk"
name "isa-fdc", bus ISA
name "isa-ide", bus ISA
name "lsi53c810", bus PCI
name "lsi53c895a", bus PCI, alias "lsi"
name "megasas", bus PCI, desc "LSI MegaRAID SAS 1078"
name "nvme", bus PCI, desc "Non-Volatile Memory Express"
name "piix3-ide", bus PCI
name "piix3-ide-xen", bus PCI
name "piix4-ide", bus PCI
name "pvscsi", bus PCI
name "scsi-block", bus SCSI, desc "SCSI block device passthrough"
name "scsi-cd", bus SCSI, desc "virtual SCSI CD-ROM"
name "scsi-disk", bus SCSI, desc "virtual SCSI disk or CD-ROM (legacy)"
name "scsi-generic", bus SCSI, desc "pass through generic scsi device (/dev/sg*)"
name "scsi-hd", bus SCSI, desc "virtual SCSI disk"
name "usb-bot", bus usb-bus
name "usb-storage", bus usb-bus
name "usb-uas", bus usb-bus
name "vhost-scsi", bus virtio-bus
name "vhost-scsi-pci", bus PCI
name "virtio-9p-device", bus virtio-bus
name "virtio-9p-pci", bus PCI
name "virtio-blk-device", bus virtio-bus
name "virtio-blk-pci", bus PCI, alias "virtio-blk"
name "virtio-scsi-device", bus virtio-bus
name "virtio-scsi-pci", bus PCI

Network devices:
name "e1000", bus PCI, desc "Intel Gigabit Ethernet"
name "i82550", bus PCI, desc "Intel i82550 Ethernet"
name "i82551", bus PCI, desc "Intel i82551 Ethernet"
name "i82557a", bus PCI, desc "Intel i82557A Ethernet"
name "i82557b", bus PCI, desc "Intel i82557B Ethernet"
name "i82557c", bus PCI, desc "Intel i82557C Ethernet"
name "i82558a", bus PCI, desc "Intel i82558A Ethernet"
name "i82558b", bus PCI, desc "Intel i82558B Ethernet"
name "i82559a", bus PCI, desc "Intel i82559A Ethernet"
name "i82559b", bus PCI, desc "Intel i82559B Ethernet"
name "i82559c", bus PCI, desc "Intel i82559C Ethernet"
name "i82559er", bus PCI, desc "Intel i82559ER Ethernet"
name "i82562", bus PCI, desc "Intel i82562 Ethernet"
name "i82801", bus PCI, desc "Intel i82801 Ethernet"
name "ne2k_isa", bus ISA
name "ne2k_pci", bus PCI
name "pcnet", bus PCI
name "rtl8139", bus PCI
name "usb-bt-dongle", bus usb-bus
name ...
(more)
edit flag offensive delete link more
add a comment
0

answered 2015-04-01 17:46:59 -0600

walter-boring gravatar image

updated 2015-04-01 17:47:26 -0600

Unfortunately, there isn't really any support for having NPIV FC devices showing up in kvm guest's. The only way that I've been able to get an FC HBA to show up in a VM guest in kvm, is to do a pci passthrough for the entire HBA.

Livbirt is the problem here. It doesn't support sending an NPIV'd wwn into the guest. :(

edit flag offensive delete link more
add a comment
-1

answered 2015-02-25 07:38:54 -0600

hfamily15 gravatar image

updated 2015-02-25 07:40:36 -0600

Thank you for Answer my question.

I tried and success to create volume with image. But I success with cinder-volume service on Management Host not VM.

I think that deploy cinder-volume on Management Host is not efficient because Hostmachine has too much specs. So, I want to deploy cinder-volume service on VM.

Could you please let me know on following questions -

1) I tried your suggestion about deploying on VM with http://wiki.libvirt.org/page/NPIV_in_... (NPIV in libvirt).

but, there are some problem. first, there is nothing after execute the command "virsh nodedev-list --cap vports". Is there anything missing?

my test environment is below :

OS : ubuntu 14.04 Storage : EMC VNX5400

systool -c fc_host -v

Class = "fc_host"

Class Device = "host1" Class Device path = "/sys/devices/pci0000:40/0000:40:01.0/0000:41:00.0/host1/fc_host/host1" dev_loss_tmo = "45" fabric_name = "0xffffffffffffffff" issue_lip = <store method="" only=""> max_npiv_vports = "254" node_name = "0x20000024ff411282" npiv_vports_inuse = "0" port_id = "0x0000e8" port_name = "0x21000024ff411282" port_state = "Online" port_type = "LPort (private loop)" speed = "8 Gbit" supported_classes = "Class 3" supported_speeds = "1 Gbit, 2 Gbit, 4 Gbit, 8 Gbit" symbolic_name = "QLE2562 FW:v7.01.00 DVR:v8.06.00.08-k" system_hostname = "" tgtid_bind_type = "wwpn (World Wide Port Name)" uevent = vport_create = <store method="" only=""> vport_delete = <store method="" only="">

Device = "host1"
Device path = "/sys/devices/pci0000:40/0000:40:01.0/0000:41:00.0/host1"
  fw_dump             =
  nvram               = "ISP "
  optrom_ctl          = <store method only>
  optrom              =
  reset               = <store method only>
  sfp                 = ""
  uevent              = "DEVTYPE=scsi_host"
  vpd                 = "‚."

Class Device = "host2" Class Device path = "/sys/devices/pci0000:40/0000:40:01.0/0000:41:00.1/host2/fc_host/host2" dev_loss_tmo = "45" fabric_name = "0xffffffffffffffff" issue_lip = <store method="" only=""> max_npiv_vports = "254" node_name = "0x20000024ff411283" npiv_vports_inuse = "0" port_id = "0x0000e8" port_name = "0x21000024ff411283" port_state = "Online" port_type = "LPort (private loop)" speed = "8 Gbit" supported_classes = "Class 3" supported_speeds = "1 Gbit, 2 Gbit, 4 Gbit, 8 Gbit" symbolic_name = "QLE2562 FW:v7.01.00 DVR:v8.06.00.08-k" system_hostname = "" tgtid_bind_type = "wwpn (World Wide Port Name)" uevent = vport_create = <store method="" only=""> vport_delete = <store method="" only="">

Device = "host2"
Device path = "/sys/devices/pci0000:40/0000:40:01.0/0000:41:00.1/host2"
  fw_dump             =
  nvram               = "ISP "
  optrom_ctl          = <store method only>
  optrom              =
  reset               = <store method only>
  sfp                 = ""
  uevent              = "DEVTYPE=scsi_host"
  vpd                 = "‚."

2) Do you have any reference that deploy cinder-volume on VM with FC Driver?

Thank you in adnance.

edit flag offensive delete link more

Comments

this doesn't look like an answer. If you have to add more details, edit your original question. If the question was answered and you found other problem, ask a new question. Read https://ask.openstack.org/faq

smaffulli gravatar imagesmaffulli ( 2015-04-01 18:23:26 -0600 )edit
add a comment

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

subscribe to rss feed

Stats

Asked: 2015-02-12 05:03:25 -0600

Seen: 570 times

Last updated: Apr 01 '15