Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Trove Status become BUILD after a short-alived ACTIVE

I try to install openstack liberty with trove by using devstack,but the trove instance cannot keep ACTIVE.

I use percona.qcow2 whick downloaded from tarballs.openstack.org as trove guest image. Trove status will become BUILD after a short -alived ACTIVE when I start a trove instance.

here is the tr-tmgr.log 2015-12-14 11:40:11.405 DEBUG trove.taskmanager.models [-] Entering guest_prepare from (pid=13615) _guest_prepare /opt/stack/trove/trove/taskmanager/models.py:875 2015-12-14 11:40:11.405 DEBUG trove.guestagent.api [-] Sending the call to prepare the Guest. from (pid=13615) prepare /opt/stack/trove/trove/guestagent/api.py:232 2015-12-14 11:40:11.406 DEBUG oslo_messaging._drivers.amqp [-] Pool creating new connection from (pid=13615) create /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:103 2015-12-14 11:40:11.408 INFO oslo.messaging._drivers.impl_rabbit [-] Connecting to AMQP server on localhost:5672 2015-12-14 11:40:11.418 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on 127.0.0.1:5672 2015-12-14 11:40:11.430 DEBUG trove.guestagent.api [-] Casting prepare from (pid=13615) _cast /opt/stack/trove/trove/guestagent/api.py:76 2015-12-14 11:40:11.432 INFO trove.instance.models [-] Resetting task status to NONE on instance 390cc439-3dca-434b-97cc-73449c13bc1d. 2015-12-14 11:40:11.437 DEBUG trove.db.models [-] Saving DBInstance: {u'cluster_id': None, u'shard_id': None, u'deleted_at': None, u'id': u'390cc439-3dca-434b-97cc-73449c13bc1d', u'datastore_version_id': u'9050e168-8cb1-4915-b6c2-b5b0052e3ecf', 'errors': {}, u'hostname': None, u'server_status': None, u'task_description': 'No tasks for the instance.', u'volume_size': 1, u'type': None, u'updated': datetime.datetime(2015, 12, 14, 3, 40, 11, 437703), '_sa_instance_state': <sqlalchemy.orm.state.instancestate object="" at="" 0x7f3e23801ed0="">, u'deleted': 0, u'configuration_id': None, u'volume_id': u'1dadb1bd-7ebd-41e2-a83f-4d7aa3966bd0', u'slave_of_id': None, u'task_start_time': None, u'name': u'db_instance', u'task_id': 1, u'created': datetime.datetime(2015, 12, 14, 3, 40, 7), u'tenant_id': u'7c1bb175219740ff9e04852b53b9aed2', u'compute_instance_id': u'0981142e-9794-49db-80e9-6bd43f3e1da8', u'flavor_id': u'4'} from (pid=13615) save /opt/stack/trove/trove/db/models.py:62 2015-12-14 11:40:11.444 DEBUG trove.taskmanager.models [-] trove dns support = False from (pid=13615) _create_dns_entry /opt/stack/trove/trove/taskmanager/models.py:889 2015-12-14 11:40:11.444 DEBUG trove.taskmanager.models [-] <greenlet.greenlet object="" at="" 0x7f3e23bbad70="">: DNS not enabled for instance: 390cc439-3dca-434b-97cc-73449c13bc1d from (pid=13615) _create_dns_entry /opt/stack/trove/trove/taskmanager/models.py:930 2015-12-14 11:41:52.451 INFO trove.taskmanager.models [-] Created instance 390cc439-3dca-434b-97cc-73449c13bc1d successfully. 2015-12-14 11:41:52.546 DEBUG trove.taskmanager.models [-] Sending event: trove.instance.create, {'state_description': 'BUILD', 'availability_zone': u'nova', 'instance_type_id': u'4', 'instance_size': 8192, 'nova_volume_id': u'1dadb1bd-7ebd-41e2-a83f-4d7aa3966bd0', 'instance_name': u'db_instance', 'user_id': u'a4fb54cf2de3444daca0be8497c945a1', 'name': u'db_instance', 'volume_size': 1, 'tenant_id': u'7c1bb175219740ff9e04852b53b9aed2', 'region': 'LOCAL_DEV', 'launched_at': '2015-12-14T03:40:07Z', 'instance_id': u'390cc439-3dca-434b-97cc-73449c13bc1d', 'instance_type': u'm1.large', 'state': 'BUILD', 'nova_instance_id': u'0981142e-9794-49db-80e9-6bd43f3e1da8', 'service_id': 'fd1723f5-68d2-409c-994f-a4a197892a17', 'created_at': '2015-12-14T03:40:07Z'} from (pid=13615) send_usage_event /opt/stack/trove/trove/taskmanager/models.py:142

here is trove-guest.log 2015-12-14 03:40:49.830 DEBUG oslo_service.service [-] cassandra.restore_namespace = None from (pid=1320) log_opt_values /usr/local/lib/python2.7/dist-packages/oslo_config/cfg.py:2268 2015-12-14 03:40:49.830 DEBUG oslo_service.service [-] cassandra.root_controller = trove.extensions.common.service.DefaultRootController from (pid=1320) log_opt_values /usr/local/lib/python2.7/dist-packages/oslo_config/cfg.py:2268 2015-12-14 03:40:49.830 DEBUG oslo_service.service [-] cassandra.tcp_ports = ['7000', '7001', '9042', '9160'] from (pid=1320) log_opt_values /usr/local/lib/python2.7/dist-packages/oslo_config/cfg.py:2268 2015-12-14 03:40:49.830 DEBUG oslo_service.service [-] cassandra.udp_ports = [] from (pid=1320) log_opt_values /usr/local/lib/python2.7/dist-packages/oslo_config/cfg.py:2268 2015-12-14 03:40:49.831 DEBUG oslo_service.service [-] cassandra.volume_support = True from (pid=1320) log_opt_values /usr/local/lib/python2.7/dist-packages/oslo_config/cfg.py:2268 2015-12-14 03:40:49.831 DEBUG oslo_service.service [-] ************************** from (pid=1320) log_opt_values /usr/local/lib/python2.7/dist-packages/oslo_config/cfg.py:2270 2015-12-14 03:40:49.831 DEBUG trove.common.rpc.service [-] Creating RPC server for service guestagent from (pid=1320) start /home/ubuntu/trove/trove/common/rpc/service.py:54 2015-12-14 03:40:49.845 DEBUG oslo_messaging._drivers.amqp [-] Pool creating new connection from (pid=1320) create /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:103 2015-12-14 03:40:49.850 INFO oslo.messaging._drivers.impl_rabbit [-] Connecting to AMQP server on 10.0.0.1:5672 2015-12-14 03:40:49.862 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on 10.0.0.1:5672 2015-12-14 03:41:49.876 DEBUG oslo_service.periodic_task [-] Running periodic task Manager.update_status from (pid=1320) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213 2015-12-14 03:41:49.876 DEBUG trove.guestagent.datastore.service [-] Determining status of DB server. from (pid=1320) update /home/ubuntu/trove/trove/guestagent/datastore/service.py:137 2015-12-14 03:41:49.877 DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): sudo /usr/bin/mysqladmin ping from (pid=1320) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:250 2015-12-14 03:41:49.893 DEBUG oslo_concurrency.processutils [-] CMD "sudo /usr/bin/mysqladmin ping" returned: 0 in 0.016s from (pid=1320) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:280 2015-12-14 03:41:49.894 INFO trove.guestagent.datastore.mysql.service_base [-] MySQL Service Status is RUNNING. 2015-12-14 03:41:49.895 DEBUG trove.guestagent.datastore.service [-] Casting set_status message to conductor (status is 'running'). from (pid=1320) set_status /home/ubuntu/trove/trove/guestagent/datastore/service.py:120 2015-12-14 03:41:49.896 DEBUG trove.conductor.api [-] Making async call to cast heartbeat for instance: 390cc439-3dca-434b-97cc-73449c13bc1d from (pid=1320) heartbeat /home/ubuntu/trove/trove/conductor/api.py:48 2015-12-14 03:41:49.897 DEBUG oslo_messaging._drivers.amqp [-] Pool creating new connection from (pid=1320) create /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:103 2015-12-14 03:41:49.899 INFO oslo.messaging._drivers.impl_rabbit [-] Connecting to AMQP server on 10.0.0.1:5672 2015-12-14 03:41:49.917 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on 10.0.0.1:5672 2015-12-14 03:41:49.917 DEBUG oslo_messaging._drivers.amqpdriver [-] CAST unique_id: b3b017a2662d42b99584896c21472238 exchange 'trove' topic 'trove-conductor' from (pid=1320) _send /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:448 2015-12-14 03:41:49.920 DEBUG trove.guestagent.datastore.service [-] Successfully cast set_status. from (pid=1320) set_status /home/ubuntu/trove/trove/guestagent/datastore/service.py:129 2015-12-14 03:42:34.496 DEBUG oslo_messaging._drivers.amqpdriver [-] received message msg_id: 9732401b9847402ba46d8e763b63e87a reply to reply_3cc17cdab0114036a8fedae0e911e6ea from (pid=1320) __call__ /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:193 2015-12-14 03:42:34.502 DEBUG oslo_messaging._drivers.amqpdriver [-] sending reply msg_id: 9732401b9847402ba46d8e763b63e87a reply queue: reply_3cc17cdab0114036a8fedae0e911e6ea from (pid=1320) _send_reply /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:79 ^[OB2015-12-14 03:43:11.692 DEBUG oslo_messaging._drivers.amqpdriver [-] received message unique_id: ad260f4f6d4643b18677c5aa1bba295c from (pid=1320) __call__ /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:195 2015-12-14 03:43:11.694 DEBUG oslo_messaging._drivers.amqpdriver [-] received message msg_id: 855f5d5dd4da4c9d9e7739871d0f5374 reply to reply_3cc17cdab0114036a8fedae0e911e6ea from (pid=1320) __call__ /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:193 2015-12-14 03:43:11.696 DEBUG oslo_messaging._drivers.amqpdriver [-] received message msg_id: 7700cb89c094435e96faa818ceba14e2 reply to reply_352734bf14054d7383138cd101851d5d from (pid=1320) __call__ /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:193 2015-12-14 03:43:11.698 DEBUG trove.guestagent.datastore.service [-] Casting set_status message to conductor (status is 'building'). from (pid=1320) set_status /home/ubuntu/trove/trove/guestagent/datastore/service.py:120 2015-12-14 03:43:11.699 DEBUG trove.conductor.api [-] Making async call to cast heartbeat for instance: 390cc439-3dca-434b-97cc-73449c13bc1d from (pid=1320) heartbeat /home/ubuntu/trove/trove/conductor/api.py:48 2015-12-14 03:43:11.700 DEBUG oslo_messaging._drivers.amqpdriver [-] CAST unique_id: 5560730881fd49bab481c5c7a0ded4d8 exchange 'trove' topic 'trove-conductor' from (pid=1320) _send /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:448 2015-12-14 03:43:11.702 DEBUG oslo_messaging._drivers.amqp [-] Pool creating new connection from (pid=1320) create /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:103 2015-12-14 03:43:11.704 INFO oslo.messaging._drivers.impl_rabbit [-] Connecting to AMQP server on 10.0.0.1:5672 2015-12-14 03:43:11.717 DEBUG oslo_messaging._drivers.amqp [-] Pool creating new connection from (pid=1320) create /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:103 2015-12-14 03:43:11.718 INFO oslo.messaging._drivers.impl_rabbit [-] Connecting to AMQP server on 10.0.0.1:5672 2015-12-14 03:43:11.727 DEBUG trove.guestagent.datastore.service [-] Successfully cast set_status. from (pid=1320) set_status /home/ubuntu/trove/trove/guestagent/datastore/service.py:129 2015-12-14 03:43:11.727 INFO trove.guestagent.datastore.mysql.service_base [-] Preparing Guest as MySQL Server. 2015-12-14 03:43:11.810 DEBUG trove.guestagent.datastore.mysql.service_base [-] Installing MySQL server. from (pid=1320) install_if_needed /home/ubuntu/trove/trove/guestagent/datastore/mysql/service_base.py:650 2015-12-14 03:43:11.810 DEBUG trove.guestagent.datastore.mysql.service_base [-] Clearing old MySQL config. from (pid=1320) _clear_mysql_config /home/ubuntu/trove/trove/guestagent/datastore/mysql/service_base.py:704 2015-12-14 03:43:11.811 DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): sudo mv /etc/my.cnf /etc/my.cnf_20ded018-9eaf-494a-b247-d193addcc61b from (pid=1320) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:250 2015-12-14 03:43:11.819 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on 10.0.0.1:5672 2015-12-14 03:43:11.820 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on 10.0.0.1:5672 2015-12-14 03:43:11.821 DEBUG oslo_concurrency.processutils [-] CMD "sudo mv /etc/my.cnf /etc/my.cnf_20ded018-9eaf-494a-b247-d193addcc61b" returned: 1 in 0.010s from (pid=1320) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:280 2015-12-14 03:43:11.821 DEBUG oslo_concurrency.processutils [-] u'sudo mv /etc/my.cnf /etc/my.cnf_20ded018-9eaf-494a-b247-d193addcc61b' failed. Not Retrying. from (pid=1320) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:328 2015-12-14 03:43:11.822 DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): sudo mv /etc/mysql/conf.d /etc/mysql/conf.d_20ded018-9eaf-494a-b247-d193addcc61b from (pid=1320) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:250 2015-12-14 03:43:11.828 DEBUG oslo_messaging._drivers.amqpdriver [-] sending reply msg_id: 7700cb89c094435e96faa818ceba14e2 reply queue: reply_352734bf14054d7383138cd101851d5d from (pid=1320) _send_reply /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:79 2015-12-14 03:43:11.831 DEBUG oslo_messaging._drivers.amqpdriver [-] sending reply msg_id: 855f5d5dd4da4c9d9e7739871d0f5374 reply queue: reply_3cc17cdab0114036a8fedae0e911e6ea from (pid=1320) _send_reply /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:79 2015-12-14 03:43:11.832 DEBUG oslo_concurrency.processutils [-] CMD "sudo mv /etc/mysql/conf.d /etc/mysql/conf.d_20ded018-9eaf-494a-b247-d193addcc61b" returned: 0 in 0.010s from (pid=1320) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:280 2015-12-14 03:43:11.832 DEBUG trove.guestagent.datastore.mysql.service_base [-] /etc/mysql/conf.d saved to /etc/mysql/conf.d_20ded018-9eaf-494a-b247-d193addcc61b. from (pid=1320) _clear_mysql_config /home/ubuntu/trove/trove/guestagent/datastore/mysql/service_base.py:712 2015-12-14 03:43:11.833 DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): sudo mv /etc/mysql/my.cnf /etc/mysql/my.cnf_20ded018-9eaf-494a-b247-d193addcc61b from (pid=1320) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:250 2015-12-14 03:43:11.843 DEBUG oslo_concurrency.processutils [-] CMD "sudo mv /etc/mysql/my.cnf /etc/mysql/my.cnf_20ded018-9eaf-494a-b247-d193addcc61b" returned: 0 in 0.010s from (pid=1320) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:280 2015-12-14 03:43:11.844 DEBUG trove.guestagent.datastore.mysql.service_base [-] /etc/mysql/my.cnf saved to /etc/mysql/my.cnf_20ded018-9eaf-494a-b247-d193addcc61b. from (pid=1320) _clear_mysql_config /home/ubuntu/trove/trove/guestagent/datastore/mysql/service_base.py:712 2015-12-14 03:43:11.845 DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): sudo apt-get update from (pid=1320) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:250 2015-12-14 03:43:19.876 DEBUG oslo_service.periodic_task [-] Running periodic task Manager.update_status from (pid=1320) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213 2015-12-14 03:43:19.877 INFO trove.guestagent.datastore.service [-] DB server is not installed or is in restart mode, so for now we'll skip determining the status of DB on this instance. 2015-12-14 03:44:19.876 DEBUG oslo_service.periodic_task [-] Running periodic task Manager.update_status from (pid=1320) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213 2015-12-14 03:44:19.877 INFO trove.guestagent.datastore.service [-] DB server is not installed or is in restart mode, so for now we'll skip determining the status of DB on this instance. 2015-12-14 03:45:19.877 DEBUG oslo_service.periodic_task [-] Running periodic task Manager.update_status from (pid=1320) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213 2015-12-14 03:45:19.877 INFO trove.guestagent.datastore.service [-] DB server is not installed or is in restart mode, so for now we'll skip determining the status of DB on this instance. 2015-12-14 03:46:19.877 DEBUG oslo_service.periodic_task [-] Running periodic task Manager.update_status from (pid=1320) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213

According the log,it seems like the trove instance will be active when DB server installed and restarted. I saw MySQL Service Status is running,So I assume that the DB server installed successfully,but stuck at restart.

What could be the issue here?