Ask Your Question

niv's profile - activity

2017-06-21 06:12:31 -0500 received badge  Famous Question (source)
2017-05-29 03:36:43 -0500 received badge  Notable Question (source)
2017-05-29 03:36:43 -0500 received badge  Popular Question (source)
2017-05-05 04:13:52 -0500 received badge  Famous Question (source)
2017-04-27 11:05:43 -0500 asked a question nova-conductor repeatedly causing deadlock on mysql

hi, i have mariadb with galera cluster (3 nodes) (mysql Ver 15.1) running on ubuntu 16.04. when trying to create a new instance, i get a error message on nova-conductor.log that there is a deadlock on mysql. the problem happens on nova.services table. about 120 processes trying to update the 'updated_at' column, causing deadlock the command 'SHOW OPEN TABLES WHERE In_use > 0', returns that nova.services is open around 125 times (it changes). the command 'SHOW processlist' returns a lot of processes from nova, trying to update the same table (services), all in QUERY state. when i turn down nova-conductor, the use counter goes back to 0, but when i turn it back on, it create deadlocks straight away! It happened more than once.

logs :

/var/log/nova/nova-scheduler.log - 2017-04-27 09:28:44 42798 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 9.06 sec ( this line appeared again and again)

/var/log/nova/nova-conductor.log - 2017-04-27 09:28:50 42542 ERROR oslo_db.api [-] DB exceeded retry limit. ... (stack trace) 2017-04-27 09:28:50 42542 ERROR oslo_db.api DBDeadlock: (pymysql.err.InternalError) (1205, u'Lock wait timeout exceeded, try restarting transaction') [SQL: u'UPDATE services SET updated_at=%(updated_at)s, report_count=%(report_count)s WHERE services.id = %(services_id)s'] [parameters: {'services_id':73, 'updated_at' : datetime.datetime(2017,4,27,13,27,59,586164), 'report_count': 22893}]

2017-04-27 09:28:50 42542 ERROR nova.servicegroups.drivers.db [-] Unexpected error while reporting service status ... (stack trace) 2017-04-27 09:28:50 42542 ERROR nova.servicegroups.drivers.db DBDeadlock: (pymysql.err.InternalError) (1205, u'Lock wait timeout exceeded, try restarting transaction') [SQL: u'UPDATE services SET updated_at=%(updated_at)s, report_count=%(report_count)s WHERE services.id = %(services_id)s'] [parameters: {'services_id':73, 'updated_at' : datetime.datetime(2017,4,27,13,27,59,586164), 'report_count': 22893}]

*NOTE: the same error repeats once every few seconds.

2017-04-05 03:58:26 -0500 received badge  Notable Question (source)
2017-02-23 10:37:47 -0500 received badge  Famous Question (source)
2017-02-13 17:11:57 -0500 received badge  Notable Question (source)
2017-02-01 06:49:54 -0500 received badge  Popular Question (source)
2017-01-24 15:38:26 -0500 received badge  Popular Question (source)
2017-01-24 09:58:22 -0500 asked a question magnum cluster create openstack newton and xenial

hey,

i follow this guide to install openstack magnum container projects:

http://docs.openstack.org/project-ins...

when i create cluster

 magnum cluster-create --name swarm-cluster \
                        --cluster-template swarm-cluster-template \
                        --master-count 1 \
                        --node-count 1

there are missing files in /usr/lib/python2.7/dist-packages/magnum/drivers i copied it manually from github magnum.

i got a new error:

EROOR: Failed to validate : resources.network : The Resource Type (Magnum::Optional::Neutron::Net) could not be found.

i am using: operating system: Ubuntu 16.04.01 xenial openstack: openstack newton

Does magnum support xenial and openstack newton? Thanks in advance

2017-01-15 03:54:51 -0500 answered a question Can't launch a swarm cluster using Magnum, any help ?

did u solve the issue? the same issue occurs to me

"error : failed to validate : resources.network : the resource type (Magnum::Optional::Neutron::Net) could not be found"

2017-01-15 01:53:29 -0500 answered a question Magnum kubecluster.yaml not found

did u solve the issue? the same issue occurs to me

2017-01-15 01:51:57 -0500 answered a question Magnum on Ubuntu 16.04 Newton is missing Kubernetes templates

did u solve the issue? the same issue occurs to me

if you install from source code this issue not occurs, or you can manually copy the missing files.

2016-07-06 20:05:52 -0500 received badge  Famous Question (source)
2016-06-07 03:47:55 -0500 received badge  Enthusiast
2016-05-26 03:13:14 -0500 answered a question Ceph-OpenStack integration "unable to update stats, RBDdriver -1.1.0 driver is uninitialized" error(Kilo Hammer)

it was network issue to ceph cluster

i wrote python script that test the connection to monitor servers

python: import rados

c=rados.Rados(conffile='/etc/ceph/ceph.conf') c.connect(); print c.version() print c.get_fsid()

link to detailed guide about rados library http://docs.ceph.com/docs/jewel/rados/api/python/ (http://docs.ceph.com/docs/jewel/rados...)

2016-05-26 03:05:06 -0500 received badge  Notable Question (source)
2016-05-24 12:16:52 -0500 received badge  Popular Question (source)
2016-05-24 12:16:52 -0500 received badge  Popular Question (source)
2016-05-24 07:35:34 -0500 commented answer Ceph-OpenStack integration "unable to update stats, RBDdriver -1.1.0 driver is uninitialized" error(Kilo Hammer)

Posted few mins ago

2016-05-24 07:34:55 -0500 commented answer Ceph-OpenStack integration "unable to update stats, RBDdriver -1.1.0 driver is uninitialized" error(Kilo Hammer)

Posted Ceph health and cinder-volume

2016-05-24 07:05:16 -0500 received badge  Editor (source)
2016-05-24 07:02:03 -0500 received badge  Supporter (source)
2016-05-24 07:00:11 -0500 answered a question Ceph-OpenStack integration "unable to update stats, RBDdriver -1.1.0 driver is uninitialized" error(Kilo Hammer)

my environment is in a closed network, its kinda hard to get stuff out. but when I try cinder-volume its just shows the log, what's in the log is just the sentence I wrote in the header.

RBDDriver -1.1.0 is uninitialized.

I've deployed my whole ceph env with ansible playbooks according to leseb's github as a standalone ceph I've manage to acomplish a fully functional ceph environment, tried it with different benchmarking tools such as COSbench, iometer, getput, DD, radosBench and few more and never encountered any errors or disfunctions cephwise.

my cinder.conf

[DEFAULT] rootwrap_config = /etc/cinder/rootwrap.conf api_paste_confg = /etc/cinder/api-paste.ini iscsi_helper = tgtadm volume_name_template = volume-%s volume_group = cinder-volumes verbose = True state_path = /var/lib/cinder lock_path = /var/lock/cinder volumes_dir = /var/lib/cinder/volumes

rpc_backend=rabbit auth_strategy=keystone my_ip={{ ip_manage }}

enabled_backends=ceph glance_host={{ controller_virtual_name }}

osapi_volume_listen_port=58776

[oslo_messaging_rabbit] rabbit_host={{ controller_virtual_name }} rabbit_userid=openstack rabbit_password={{ rabbit_mq_password }}

[oslo_concurrency] lock_path=/var/lock/cinder

[database] connection=mysql://{{mysql_cinder_user}}:{{ mysql_cinder_password }}@{{ controller_virtual_name }}/cinder

[keystone_authtoken] auth_uri=http://{{ controller_virtual_name }}:5000 auth_url=http://{{ controller_virtual_name }}:35357 auth_plugin=password project_domain_id=default user_domain_id=default project_name=service username=cinder user-name=cinder password=cinderpass

[ceph] volume_driver = cinder.volume.drivers.rbd.RBDDriver rbd_pool = volumes rbd_ceph_conf = /etc/ceph/ceph.conf rbd_flatten_volume_from_snapshot = false rbd_max_clone_depth = 5 rbd_store_chunk_size = 4 rados_connect_timeout = -1 glance_api_version = 2 rbd_user = cinder rbd_secret_uuid = XXXXXXXXXXXXXXXXX

2016-05-24 01:53:00 -0500 answered a question Ceph-OpenStack integration "unable to update stats, RBDdriver -1.1.0 driver is uninitialized" error(Kilo Hammer)

My system: ubuntu 14.04.02 ceph hammer - (cephx) Openstack Kilo

REFERENCE to the guide I used: http://docs.ceph.com/docs/master/rbd/rbd-openstack/ (http://docs.ceph.com/docs/master/rbd/...)

cinder.conf [DEFAULT] ... enabled_backends = ceph ... [ceph] volume_driver = cinder.volume.drivers.rbd.RBDDriver rbd_pool = volumes rbd_ceph_conf = /etc/ceph/ceph.conf rbd_flatten_volume_from_snapshot = false rbd_max_clone_depth = 5 rbd_store_chunk_size = 4 rados_connect_timeout = -1 glance_api_version = 2

2016-05-24 01:47:57 -0500 asked a question Ceph-OpenStack integration "unable to update stats, RBDdriver -1.1.0 driver is uninitialized" error(Kilo Hammer)

Is somebody familar with this error? i've tried to search for a fix but sadly failed to find one out there.

My system: ubuntu 14.04.02 ceph hammer - (cephx) Openstack Kilo

REFERENCE to the guide I used: http://docs.ceph.com/docs/master/rbd/rbd-openstack/ (http://docs.ceph.com/docs/master/rbd/...) (http://docs.ceph.com/docs/master/rbd/...)

my environment is in a closed network, its kinda hard to get stuff out. but when I try cinder-volume its just shows the log, what's in the log is just the sentence I wrote in the header.

RBDDriver -1.1.0 is uninitialized.

I've deployed my whole ceph env with ansible playbooks according to leseb's github as a standalone ceph I've manage to acomplish a fully functional ceph environment, tried it with different benchmarking tools such as COSbench, iometer, getput, DD, radosBench and few more and never encountered any errors or disfunctions cephwise.

my cinder.conf

[DEFAULT] rootwrap_config = /etc/cinder/rootwrap.conf api_paste_confg = /etc/cinder/api-paste.ini iscsi_helper = tgtadm volume_name_template = volume-%s volume_group = cinder-volumes verbose = True state_path = /var/lib/cinder lock_path = /var/lock/cinder volumes_dir = /var/lib/cinder/volumes

rpc_backend=rabbit auth_strategy=keystone my_ip={{ ip_manage }}

enabled_backends=ceph glance_host={{ controller_virtual_name }}

osapi_volume_listen_port=58776

[oslo_messaging_rabbit] rabbit_host={{ controller_virtual_name }} rabbit_userid=openstack rabbit_password={{ rabbit_mq_password }}

[oslo_concurrency] lock_path=/var/lock/cinder

[database] connection=mysql://{{mysql_cinder_user}}:{{ mysql_cinder_password }}@{{ controller_virtual_name }}/cinder

[keystone_authtoken]

auth_uri=http://{{ controller_virtual_name }}:5000

auth_url=http://{{ controller_virtual_name }}:35357

auth_plugin=password

project_domain_id=default

user_domain_id=default

project_name=service

username=cinder

user-name=cinder

password=cinderpass

[ceph]

volume_driver = cinder.volume.drivers.rbd.RBDDriver

rbd_pool = volumes

rbd_ceph_conf = /etc/ceph/ceph.conf

rbd_flatten_volume_from_snapshot = false

rbd_max_clone_depth = 5

rbd_store_chunk_size = 4

rados_connect_timeout = -1

glance_api_version = 2

rbd_user = cinder

rbd_secret_uuid = XXXXXXXXXXXXXXXXX


HEALTH_WARN pool .rgw.buckets has too few pgs; noout,noscrub,nodeep-scrub flag(s) set.

cinder-volume

DeprecationWarning: The oslo namespace package is deprecated. please use oslo_config instead

cinder.volume.manager Determined volume DB was empty at startup

cinder.openstack.common.service Starting 1 workers

cinder.openstack.common.service Started child 99999

cinder.service Starting cinder-volume node (version 2015.1.1)

cinder.volume.manger Starting volume driver RBDDriver (-1.1.0)

cinder.volume.drivers.rbd Error connecting to ceph cluster.

cinder.volume.manger Error encountered during initialization of driver: RBDDriver

cinder.volume.manager Bad or unexpected response from storage volume backend API: Error connecting to ceph cluster

oslo_messaging._drivers.impl_rabbit Connected to AMQP server on controller:5672

cinder.volume.manager Updating volume status

cinder.volume.manager self.driver.initialized

cinder.volume.manager Unable to update stats, RBDDriver -1.1.0 driver is uninitialized

2015-11-30 11:49:58 -0500 asked a question openstack ansible deployment without containers

Hi ,

I need your help , I am searching for a github that deploys openstack using ansible . all the things I've found so far use containers , I dont want to use container. I would appreciate if someone could refer me the appropriate github.

os : Ubuntu 14.04

Thanks in advance

2015-11-30 11:49:58 -0500 asked a question openstack ansible deployment

Hi ,

I need your help , I am searching for a github that deploys openstack using ansible . all the things I've found so far use containers , I dont want to use container. I would appreciate if someone could refer me the appropriate github.

os : Ubuntu 14.04

Thanks in advance