Kolla zun ceph storage

asked 2020-07-07 23:35:10 -0500

E3GH75 gravatar image

updated 2020-07-08 03:23:03 -0500

eblock gravatar image

Is there a way to configure zun to use ceph storage for containers instead of local disks? I don't see anything in the zun.conf to enable this nor does kolla-ansible say anything about copying ceph.conf and keys to the zun-compute or zun-api containers.

Nova, Cinder, and glance are working correctly with ceph. Running version Train on Centos 8 with Docker-ce 19.03.11

Error when creating Zun container with newly created cinder volume:

Unexpected error while running command. Command: rbd map volume-971719e3-85a9-4c80-9812-f3e61d7e8925 --pool volumes --id cinder --mon_host 172.30.0.11:6789 --mon_host 172.30.0.12:6789 --mon_host 172.30.0.13:6789 Exit code: 22 Stdout: 'In some cases useful info is found in syslog - try "dmesg | tail".\n' Stderr: "did not load config file, using default settings.\n2020-07-08 00:31:47.494 7fb221522080 -1 Errors while parsing config file!\n2020-07-08 00:31:47.494 7fb221522080 -1 parse_file: cannot open /etc/ceph/ceph.conf: (2) No such file or directory\n2020-07-08 00:31:47.494 7fb221522080 -1 parse_file: cannot open /root/.ceph/ceph.conf: (2) No such file or directory\n2020-07-08 00:31:47.494 7fb221522080 -1 parse_file: cannot open ceph.conf: (2) No such file or directory\n2020-07-08 00:31:47.494 7fb221522080 -1 Errors while parsing config file!\n2020-07-08 00:31:47.494 7fb221522080 -1 parse_file: cannot open /etc/ceph/ceph.conf: (2) No such file or directory\n2020-07-08 00:31:47.494 7fb221522080 -1 parse_file: cannot open /root/.ceph/ceph.conf: (2) No such file or directory\n2020-07-08 00:31:47.494 7fb221522080 -1 parse_file: cannot open ceph.conf: (2) No such file or directory\n2020-07-08 00:31:47.527 7fb221522080 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.cinder.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory\nrbd: sysfs write failed\n2020-07-08 00:31:47.535 7fb221522080 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.cinder.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory\n2020-07-08 00:31:47.535 7fb221522080 -1 AuthRegistry(0x5557852c0240) no keyring found at /etc/ceph/ceph.client.cinder.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,, disabling cephx\n2020-07-08 00:31:47.536 7fb221522080 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.cinder.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory\n2020-07-08 00:31:47.536 7fb221522080 -1 AuthRegistry(0x7ffe92593908) no keyring found at /etc/ceph/ceph.client.cinder.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,, disabling cephx\n2020-07-08 00:31:47.538 7fb221522080 -1 monclient: authenticate NOTE: no keyring found; disabled cephx authentication\nrbd: couldn't connect to the cluster!\nrbd: map failed: (22) Invalid argument\n"

Thanks!

edit retag flag offensive close merge delete

Comments

There is a patch for adding support for that: https://review.opendev.org/#/c/703274/ . The patch needs to go through the code review process to land.

To track the progress: https://bugs.launchpad.net/kolla-ansi...

hongbin034 gravatar imagehongbin034 ( 2020-07-08 10:08:34 -0500 )edit

one of the issues with this patch is you need to limit the functions of the image that gets created in ceph. Is there a way to use a storage plugin that supports userspace drivers?

E3GH75 gravatar imageE3GH75 ( 2020-07-09 13:47:11 -0500 )edit

@E3GH75,

Please feel free to put your remark on the patch or the bug report. I will check if someone in the domain to reply it or I will do an investigation then reply.

hongbin034 gravatar imagehongbin034 ( 2020-07-12 20:40:21 -0500 )edit