Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Controller Node

    root@perfcontroller:~# nova-status upgrade check

+-------------------------------------------------------------------+ | Upgrade Check Results | +-------------------------------------------------------------------+ | Check: Cells v2 | | Result: Success | | Details: None | +-------------------------------------------------------------------+ | Check: Placement API | | Result: Success | | Details: None | +-------------------------------------------------------------------+ | Check: Resource Providers | | Result: Warning | | Details: There are no compute resource providers in the Placement | | service but there are 2 compute nodes in the deployment. | | This means no compute nodes are reporting into the | | Placement service and need to be upgraded and/or fixed. | | See | | http://docs.openstack.org/developer/nova/placement.html | | for more details. | +-------------------------------------------------------------------+

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

      Compute Node nova-compute.log

17-04-26 13:11:06.795 17293 INFO nova.servicegroup.drivers.db [-] Recovered from being unable to report status. 2017-04-26 13:11:06.796 17293 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 128.03 sec 2017-04-26 13:11:06.799 17293 INFO oslo.messaging._drivers.impl_rabbit [-] [9665c296-5693-4532-8d54-faa55db265a8] Reconnected to AMQP server on perfcontroller:5672 via [amqp] client with port 35770. 2017-04-26 13:11:06.906 17293 INFO nova.compute.manager [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Bandwidth usage not supported by hypervisor. 2017-04-26 13:11:11.389 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] The placement API endpoint not found. Placement is optional in Newton, but required in Ocata. Please enable the placement service before upgrading. 2017-04-26 13:11:11.390 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Unable to refresh my resource provider record 2017-04-26 13:11:11.443 17293 INFO nova.compute.resource_tracker [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Final resource view: name=perfcompute2 phys_ram=128826MB used_ram=512MB phys_disk=789GB used_disk=0GB total_vcpus=32 used_vcpus=0 pci_stats=[] 2017-04-26 13:12:06.997 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Unable to refresh my resource provider record 2017-04-26 13:12:07.077 17293 INFO nova.compute.resource_tracker [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Final resource view: name=perfcompute2 phys_ram=128826MB used_ram=512MB phys_disk=789GB used_disk=0GB total_vcpus=32 used_vcpus=0 pci_stats=[] 2017-04-26 13:13:05.354 17293 INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : 89b267fb704849c99a74570d0ecb2366 2017-04-26 13:13:05.385 17293 INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : b99ef61861694e3c9d9dfe9962962a33 2017-04-26 13:13:09.029 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Unable to refresh my resource provider record 2017-04-26 13:13:09.106 17293 INFO nova.compute.resource_tracker [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Final resource view: name=perfcompute2 phys_ram=128826MB used_ram=512MB phys_disk=789GB used_disk=0GB total_vcpus=32 used_vcpus=0 pci_stats=[]

nov.conf from compute node [placement] os_region_name = RegionOne project_domain_name = Default project_name = service user_domain_name = Default auth_url = http://perfcontroller:35357/v3 auth_type = password username = placement password = Welcome123

These are the errors i see in controller node but not sure if they are relevant for this issue

root@perfcontroller:~# tail -f /var/log//.log | grep -i error ==> /var/log/apache2/error.log <== ==> /var/log/apache2/nova_placement_error.log <== ==> /var/log/mysql/error.log <== 2017-04-25 17:32:21.588 25491 DEBUG oslo_db.sqlalchemy.engines [req-2b1466c5-999a-4816-a6cb-cef1904d173b - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 Context: shutdown_error 2017-04-25 17:33:06.587 25527 DEBUG oslo_db.sqlalchemy.engines [req-9cd4df40-8802-4819-97e2-859c644f783a - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:14.894 25828 DEBUG oslo_db.sqlalchemy.engines [req-9aa3e1bc-8be2-4922-9559-65ff8369b342 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:14.894 25829 DEBUG oslo_db.sqlalchemy.engines [req-e49ca89d-5acd-434e-beed-3c5adc053246 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:16.047 25836 DEBUG oslo_db.sqlalchemy.engines [req-e85259d8-f669-41ce-8471-83cd459bcaaf - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:16.050 25837 DEBUG oslo_db.sqlalchemy.engines [req-bdf42b02-4fc9-4ae8-b504-5cfdc143fcbe - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:16.059 25815 DEBUG oslo_service.service [req-1b72b89d-608f-4232-8afc-7447149bf6eb - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:16.072 25815 DEBUG oslo_service.service [req-1b72b89d-608f-4232-8afc-7447149bf6eb - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:16.248 25815 DEBUG oslo_service.service [req-1b72b89d-608f-4232-8afc-7447149bf6eb - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 2017-04-25 17:33:24.604 25859 DEBUG oslo_db.sqlalchemy.engines [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:24.904 25859 DEBUG oslo_db.sqlalchemy.engines [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:24.948 25859 DEBUG oslo_service.service [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:24.959 25859 DEBUG oslo_service.service [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:25.109 25859 DEBUG oslo_service.service [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 2017-04-25 17:33:40.753 25928 DEBUG oslo_service.service [req-234db78c-fc49-4685-a72b-217c0fc95d3f - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:40.761 25928 DEBUG oslo_service.service [req-234db78c-fc49-4685-a72b-217c0fc95d3f - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:40.882 25928 DEBUG oslo_service.service [req-234db78c-fc49-4685-a72b-217c0fc95d3f - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 2017-04-25 17:33:40.908 25928 DEBUG oslo_db.sqlalchemy.engines [req-29bd813d-ec32-4f13-b6a3-d30aa7fb6e85 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 ==> /var/log/apache2/error.log <== 2017-04-25 17:33:44.611 25960 DEBUG oslo_service.service [req-a0d459b2-ad6c-4774-8e52-3dad26ad4f5d - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:44.617 26000 DEBUG oslo_db.sqlalchemy.engines [req-40866294-b477-47e9-b4cd-324702af42ab - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:44.617 25999 DEBUG oslo_db.sqlalchemy.engines [req-cd93e109-0c9f-4339-8a36-ec20bb965686 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:44.620 25960 DEBUG oslo_service.service [req-a0d459b2-ad6c-4774-8e52-3dad26ad4f5d - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:44.737 25960 DEBUG oslo_service.service [req-a0d459b2-ad6c-4774-8e52-3dad26ad4f5d - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 ==> /var/log/apache2/error.log <==

i followed Ocata installation guide for ubuntu for a multi node environment-1 controller node and 2 compute nodes.Initially placement api check was failure but on changing placment endpoints to use http://controller:8778 instead of htttp://controller/placement i see that placement api check on controller node is now succesful.But check for resource providers is failing and i see "placement api not found error" on compute nodes.I have [placement] section on compute node but not sure why is this happening

Controller Node

    root@perfcontroller:~# nova-status upgrade check

+-------------------------------------------------------------------+ | Upgrade Check Results | +-------------------------------------------------------------------+ | Check: Cells v2 | | Result: Success | | Details: None | +-------------------------------------------------------------------+ | Check: Placement API | | Result: Success | | Details: None | +-------------------------------------------------------------------+ | Check: Resource Providers | | Result: Warning | | Details: There are no compute resource providers in the Placement | | service but there are 2 compute nodes in the deployment. | | This means no compute nodes are reporting into the | | Placement service and need to be upgraded and/or fixed. | | See | | http://docs.openstack.org/developer/nova/placement.html | | for more details. | +-------------------------------------------------------------------+

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

      Compute Node nova-compute.log

17-04-26 13:11:06.795 17293 INFO nova.servicegroup.drivers.db [-] Recovered from being unable to report status. 2017-04-26 13:11:06.796 17293 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 128.03 sec 2017-04-26 13:11:06.799 17293 INFO oslo.messaging._drivers.impl_rabbit [-] [9665c296-5693-4532-8d54-faa55db265a8] Reconnected to AMQP server on perfcontroller:5672 via [amqp] client with port 35770. 2017-04-26 13:11:06.906 17293 INFO nova.compute.manager [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Bandwidth usage not supported by hypervisor. 2017-04-26 13:11:11.389 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] The placement API endpoint not found. Placement is optional in Newton, but required in Ocata. Please enable the placement service before upgrading. 2017-04-26 13:11:11.390 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Unable to refresh my resource provider record 2017-04-26 13:11:11.443 17293 INFO nova.compute.resource_tracker [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Final resource view: name=perfcompute2 phys_ram=128826MB used_ram=512MB phys_disk=789GB used_disk=0GB total_vcpus=32 used_vcpus=0 pci_stats=[] 2017-04-26 13:12:06.997 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Unable to refresh my resource provider record 2017-04-26 13:12:07.077 17293 INFO nova.compute.resource_tracker [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Final resource view: name=perfcompute2 phys_ram=128826MB used_ram=512MB phys_disk=789GB used_disk=0GB total_vcpus=32 used_vcpus=0 pci_stats=[] 2017-04-26 13:13:05.354 17293 INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : 89b267fb704849c99a74570d0ecb2366 2017-04-26 13:13:05.385 17293 INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : b99ef61861694e3c9d9dfe9962962a33 2017-04-26 13:13:09.029 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Unable to refresh my resource provider record 2017-04-26 13:13:09.106 17293 INFO nova.compute.resource_tracker [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Final resource view: name=perfcompute2 phys_ram=128826MB used_ram=512MB phys_disk=789GB used_disk=0GB total_vcpus=32 used_vcpus=0 pci_stats=[]

nov.conf from compute node [placement] os_region_name = RegionOne project_domain_name = Default project_name = service user_domain_name = Default auth_url = http://perfcontroller:35357/v3 auth_type = password username = placement password = Welcome123

These are the errors i see in controller node but not sure if they are relevant for this issue

root@perfcontroller:~# tail -f /var/log//.log | grep -i error ==> /var/log/apache2/error.log <== ==> /var/log/apache2/nova_placement_error.log <== ==> /var/log/mysql/error.log <== 2017-04-25 17:32:21.588 25491 DEBUG oslo_db.sqlalchemy.engines [req-2b1466c5-999a-4816-a6cb-cef1904d173b - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 Context: shutdown_error 2017-04-25 17:33:06.587 25527 DEBUG oslo_db.sqlalchemy.engines [req-9cd4df40-8802-4819-97e2-859c644f783a - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:14.894 25828 DEBUG oslo_db.sqlalchemy.engines [req-9aa3e1bc-8be2-4922-9559-65ff8369b342 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:14.894 25829 DEBUG oslo_db.sqlalchemy.engines [req-e49ca89d-5acd-434e-beed-3c5adc053246 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:16.047 25836 DEBUG oslo_db.sqlalchemy.engines [req-e85259d8-f669-41ce-8471-83cd459bcaaf - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:16.050 25837 DEBUG oslo_db.sqlalchemy.engines [req-bdf42b02-4fc9-4ae8-b504-5cfdc143fcbe - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:16.059 25815 DEBUG oslo_service.service [req-1b72b89d-608f-4232-8afc-7447149bf6eb - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:16.072 25815 DEBUG oslo_service.service [req-1b72b89d-608f-4232-8afc-7447149bf6eb - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:16.248 25815 DEBUG oslo_service.service [req-1b72b89d-608f-4232-8afc-7447149bf6eb - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 2017-04-25 17:33:24.604 25859 DEBUG oslo_db.sqlalchemy.engines [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:24.904 25859 DEBUG oslo_db.sqlalchemy.engines [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:24.948 25859 DEBUG oslo_service.service [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:24.959 25859 DEBUG oslo_service.service [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:25.109 25859 DEBUG oslo_service.service [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 2017-04-25 17:33:40.753 25928 DEBUG oslo_service.service [req-234db78c-fc49-4685-a72b-217c0fc95d3f - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:40.761 25928 DEBUG oslo_service.service [req-234db78c-fc49-4685-a72b-217c0fc95d3f - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:40.882 25928 DEBUG oslo_service.service [req-234db78c-fc49-4685-a72b-217c0fc95d3f - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 2017-04-25 17:33:40.908 25928 DEBUG oslo_db.sqlalchemy.engines [req-29bd813d-ec32-4f13-b6a3-d30aa7fb6e85 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 ==> /var/log/apache2/error.log <== 2017-04-25 17:33:44.611 25960 DEBUG oslo_service.service [req-a0d459b2-ad6c-4774-8e52-3dad26ad4f5d - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:44.617 26000 DEBUG oslo_db.sqlalchemy.engines [req-40866294-b477-47e9-b4cd-324702af42ab - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:44.617 25999 DEBUG oslo_db.sqlalchemy.engines [req-cd93e109-0c9f-4339-8a36-ec20bb965686 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:44.620 25960 DEBUG oslo_service.service [req-a0d459b2-ad6c-4774-8e52-3dad26ad4f5d - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:44.737 25960 DEBUG oslo_service.service [req-a0d459b2-ad6c-4774-8e52-3dad26ad4f5d - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 ==> /var/log/apache2/error.log <==

i followed Ocata installation guide for ubuntu for a multi node environment-1 controller node and 2 compute nodes.Initially placement api check was failure but on changing placment endpoints to use http://controller:8778 instead of htttp://controller/placement i see that placement api check on controller node is now succesful.But check for resource providers is failing and i see "placement api not found error" on compute nodes.I have [placement] section on compute node but not sure why is this happening

Controller Node

    root@perfcontroller:~# nova-status upgrade check

+-------------------------------------------------------------------+ | Upgrade Check Results | +-------------------------------------------------------------------+ | Check: Cells v2 | | Result: Success | | Details: None | +-------------------------------------------------------------------+ | Check: Placement API | | Result: Success | | Details: None | +-------------------------------------------------------------------+ | Check: Resource Providers | | Result: Warning | | Details: There are no compute resource providers in the Placement | | service but there are 2 compute nodes in the deployment. | | This means no compute nodes are reporting into the | | Placement service and need to be upgraded and/or fixed. | | See | | http://docs.openstack.org/developer/nova/placement.html | | for more details. | +-------------------------------------------------------------------+

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

      Compute Node nova-compute.log

17-04-26 13:11:06.795 17293 INFO nova.servicegroup.drivers.db [-] Recovered from being unable to report status. 2017-04-26 13:11:06.796 17293 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 128.03 sec 2017-04-26 13:11:06.799 17293 INFO oslo.messaging._drivers.impl_rabbit [-] [9665c296-5693-4532-8d54-faa55db265a8] Reconnected to AMQP server on perfcontroller:5672 via [amqp] client with port 35770. 2017-04-26 13:11:06.906 17293 INFO nova.compute.manager [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Bandwidth usage not supported by hypervisor. 2017-04-26 13:11:11.389 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] The placement API endpoint not found. Placement is optional in Newton, but required in Ocata. Please enable the placement service before upgrading. 2017-04-26 13:11:11.390 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Unable to refresh my resource provider record 2017-04-26 13:11:11.443 17293 INFO nova.compute.resource_tracker [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Final resource view: name=perfcompute2 phys_ram=128826MB used_ram=512MB phys_disk=789GB used_disk=0GB total_vcpus=32 used_vcpus=0 pci_stats=[] 2017-04-26 13:12:06.997 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Unable to refresh my resource provider record 2017-04-26 13:12:07.077 17293 INFO nova.compute.resource_tracker [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Final resource view: name=perfcompute2 phys_ram=128826MB used_ram=512MB phys_disk=789GB used_disk=0GB total_vcpus=32 used_vcpus=0 pci_stats=[] 2017-04-26 13:13:05.354 17293 INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : 89b267fb704849c99a74570d0ecb2366 2017-04-26 13:13:05.385 17293 INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : b99ef61861694e3c9d9dfe9962962a33 2017-04-26 13:13:09.029 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Unable to refresh my resource provider record 2017-04-26 13:13:09.106 17293 INFO nova.compute.resource_tracker [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Final resource view: name=perfcompute2 phys_ram=128826MB used_ram=512MB phys_disk=789GB used_disk=0GB total_vcpus=32 used_vcpus=0 pci_stats=[]

nov.conf from compute node [placement] os_region_name = RegionOne project_domain_name = Default project_name = service user_domain_name = Default auth_url = http://perfcontroller:35357/v3 auth_type = password username = placement password = Welcome123

These are the errors i see in controller node but not sure if they are relevant for this issue

root@perfcontroller:~# tail -f /var/log//.log | grep -i error ==> /var/log/apache2/error.log <== ==> /var/log/apache2/nova_placement_error.log <== ==> /var/log/mysql/error.log <== 2017-04-25 17:32:21.588 25491 DEBUG oslo_db.sqlalchemy.engines [req-2b1466c5-999a-4816-a6cb-cef1904d173b - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 Context: shutdown_error 2017-04-25 17:33:06.587 25527 DEBUG oslo_db.sqlalchemy.engines [req-9cd4df40-8802-4819-97e2-859c644f783a - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:14.894 25828 DEBUG oslo_db.sqlalchemy.engines [req-9aa3e1bc-8be2-4922-9559-65ff8369b342 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:14.894 25829 DEBUG oslo_db.sqlalchemy.engines [req-e49ca89d-5acd-434e-beed-3c5adc053246 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:16.047 25836 DEBUG oslo_db.sqlalchemy.engines [req-e85259d8-f669-41ce-8471-83cd459bcaaf - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:16.050 25837 DEBUG oslo_db.sqlalchemy.engines [req-bdf42b02-4fc9-4ae8-b504-5cfdc143fcbe - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:16.059 25815 DEBUG oslo_service.service [req-1b72b89d-608f-4232-8afc-7447149bf6eb - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:16.072 25815 DEBUG oslo_service.service [req-1b72b89d-608f-4232-8afc-7447149bf6eb - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:16.248 25815 DEBUG oslo_service.service [req-1b72b89d-608f-4232-8afc-7447149bf6eb - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 2017-04-25 17:33:24.604 25859 DEBUG oslo_db.sqlalchemy.engines [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:24.904 25859 DEBUG oslo_db.sqlalchemy.engines [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:24.948 25859 DEBUG oslo_service.service [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:24.959 25859 DEBUG oslo_service.service [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:25.109 25859 DEBUG oslo_service.service [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 2017-04-25 17:33:40.753 25928 DEBUG oslo_service.service [req-234db78c-fc49-4685-a72b-217c0fc95d3f - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:40.761 25928 DEBUG oslo_service.service [req-234db78c-fc49-4685-a72b-217c0fc95d3f - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:40.882 25928 DEBUG oslo_service.service [req-234db78c-fc49-4685-a72b-217c0fc95d3f - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 2017-04-25 17:33:40.908 25928 DEBUG oslo_db.sqlalchemy.engines [req-29bd813d-ec32-4f13-b6a3-d30aa7fb6e85 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 ==> /var/log/apache2/error.log <== 2017-04-25 17:33:44.611 25960 DEBUG oslo_service.service [req-a0d459b2-ad6c-4774-8e52-3dad26ad4f5d - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:44.617 26000 DEBUG oslo_db.sqlalchemy.engines [req-40866294-b477-47e9-b4cd-324702af42ab - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:44.617 25999 DEBUG oslo_db.sqlalchemy.engines [req-cd93e109-0c9f-4339-8a36-ec20bb965686 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:44.620 25960 DEBUG oslo_service.service [req-a0d459b2-ad6c-4774-8e52-3dad26ad4f5d - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:44.737 25960 DEBUG oslo_service.service [req-a0d459b2-ad6c-4774-8e52-3dad26ad4f5d - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 ==> /var/log/apache2/error.log <==

i followed Ocata installation guide for ubuntu for a multi node environment-1 controller node and 2 compute nodes.Initially placement api check was failure but on changing placment endpoints to use http://controller:8778 instead of htttp://controller/placement i see that placement api check on controller node is now succesful.But check for resource providers is failing and i see "placement api not found error" on compute nodes.I have [placement] section on compute node but not sure why is this happening

Controller Node

    root@perfcontroller:~# nova-status upgrade check

+-------------------------------------------------------------------+ | Upgrade Check Results | +-------------------------------------------------------------------+ | Check: Cells v2 | | Result: Success | | Details: None | +-------------------------------------------------------------------+ | Check: Placement API | | Result: Success | | Details: None | +-------------------------------------------------------------------+ | Check: Resource Providers | | Result: Warning | | Details: There are no compute resource providers in the Placement | | service but there are 2 compute nodes in the deployment. | | This means no compute nodes are reporting into the | | Placement service and need to be upgraded and/or fixed. | | See | | http://docs.openstack.org/developer/nova/placement.html | | for more details. | +-------------------------------------------------------------------+

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

 

Compute Node nova-compute.log

nova-compute.log

17-04-26 13:11:06.795 17293 INFO nova.servicegroup.drivers.db [-] Recovered from being unable to report status. 2017-04-26 13:11:06.796 17293 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 128.03 sec 2017-04-26 13:11:06.799 17293 INFO oslo.messaging._drivers.impl_rabbit [-] [9665c296-5693-4532-8d54-faa55db265a8] Reconnected to AMQP server on perfcontroller:5672 via [amqp] client with port 35770. 2017-04-26 13:11:06.906 17293 INFO nova.compute.manager [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Bandwidth usage not supported by hypervisor. 2017-04-26 13:11:11.389 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] The placement API endpoint not found. Placement is optional in Newton, but required in Ocata. Please enable the placement service before upgrading. 2017-04-26 13:11:11.390 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Unable to refresh my resource provider record 2017-04-26 13:11:11.443 17293 INFO nova.compute.resource_tracker [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Final resource view: name=perfcompute2 phys_ram=128826MB used_ram=512MB phys_disk=789GB used_disk=0GB total_vcpus=32 used_vcpus=0 pci_stats=[] 2017-04-26 13:12:06.997 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Unable to refresh my resource provider record 2017-04-26 13:12:07.077 17293 INFO nova.compute.resource_tracker [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Final resource view: name=perfcompute2 phys_ram=128826MB used_ram=512MB phys_disk=789GB used_disk=0GB total_vcpus=32 used_vcpus=0 pci_stats=[] 2017-04-26 13:13:05.354 17293 INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : 89b267fb704849c99a74570d0ecb2366 2017-04-26 13:13:05.385 17293 INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : b99ef61861694e3c9d9dfe9962962a33 2017-04-26 13:13:09.029 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Unable to refresh my resource provider record 2017-04-26 13:13:09.106 17293 INFO nova.compute.resource_tracker [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Final resource view: name=perfcompute2 phys_ram=128826MB used_ram=512MB phys_disk=789GB used_disk=0GB total_vcpus=32 used_vcpus=0 pci_stats=[]

nov.conf from compute node [placement] os_region_name = RegionOne project_domain_name = Default project_name = service user_domain_name = Default auth_url = http://perfcontroller:35357/v3 auth_type = password username = placement password = Welcome123

These are the errors i see in controller node but not sure if they are relevant for this issue

root@perfcontroller:~# tail -f /var/log//.log | grep -i error ==> /var/log/apache2/error.log <== ==> /var/log/apache2/nova_placement_error.log <== ==> /var/log/mysql/error.log <== 2017-04-25 17:32:21.588 25491 DEBUG oslo_db.sqlalchemy.engines [req-2b1466c5-999a-4816-a6cb-cef1904d173b - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 Context: shutdown_error 2017-04-25 17:33:06.587 25527 DEBUG oslo_db.sqlalchemy.engines [req-9cd4df40-8802-4819-97e2-859c644f783a - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:14.894 25828 DEBUG oslo_db.sqlalchemy.engines [req-9aa3e1bc-8be2-4922-9559-65ff8369b342 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:14.894 25829 DEBUG oslo_db.sqlalchemy.engines [req-e49ca89d-5acd-434e-beed-3c5adc053246 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:16.047 25836 DEBUG oslo_db.sqlalchemy.engines [req-e85259d8-f669-41ce-8471-83cd459bcaaf - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:16.050 25837 DEBUG oslo_db.sqlalchemy.engines [req-bdf42b02-4fc9-4ae8-b504-5cfdc143fcbe - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:16.059 25815 DEBUG oslo_service.service [req-1b72b89d-608f-4232-8afc-7447149bf6eb - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:16.072 25815 DEBUG oslo_service.service [req-1b72b89d-608f-4232-8afc-7447149bf6eb - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:16.248 25815 DEBUG oslo_service.service [req-1b72b89d-608f-4232-8afc-7447149bf6eb - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 2017-04-25 17:33:24.604 25859 DEBUG oslo_db.sqlalchemy.engines [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:24.904 25859 DEBUG oslo_db.sqlalchemy.engines [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:24.948 25859 DEBUG oslo_service.service [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:24.959 25859 DEBUG oslo_service.service [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:25.109 25859 DEBUG oslo_service.service [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 2017-04-25 17:33:40.753 25928 DEBUG oslo_service.service [req-234db78c-fc49-4685-a72b-217c0fc95d3f - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:40.761 25928 DEBUG oslo_service.service [req-234db78c-fc49-4685-a72b-217c0fc95d3f - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:40.882 25928 DEBUG oslo_service.service [req-234db78c-fc49-4685-a72b-217c0fc95d3f - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 2017-04-25 17:33:40.908 25928 DEBUG oslo_db.sqlalchemy.engines [req-29bd813d-ec32-4f13-b6a3-d30aa7fb6e85 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 ==> /var/log/apache2/error.log <== 2017-04-25 17:33:44.611 25960 DEBUG oslo_service.service [req-a0d459b2-ad6c-4774-8e52-3dad26ad4f5d - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:44.617 26000 DEBUG oslo_db.sqlalchemy.engines [req-40866294-b477-47e9-b4cd-324702af42ab - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:44.617 25999 DEBUG oslo_db.sqlalchemy.engines [req-cd93e109-0c9f-4339-8a36-ec20bb965686 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:44.620 25960 DEBUG oslo_service.service [req-a0d459b2-ad6c-4774-8e52-3dad26ad4f5d - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:44.737 25960 DEBUG oslo_service.service [req-a0d459b2-ad6c-4774-8e52-3dad26ad4f5d - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 ==> /var/log/apache2/error.log <==

i followed Ocata installation guide for ubuntu for a multi node environment-1 controller node and 2 compute nodes.Initially placement api check was failure but on changing placment endpoints to use http://controller:8778 instead of htttp://controller/placement i see that placement api check on controller node is now succesful.But check for resource providers is failing and i see "placement api not found error" on compute nodes.I have [placement] section on compute node but not sure why is this happening

Controller Node

    root@perfcontroller:~# nova-status upgrade check

+-------------------------------------------------------------------+ | Upgrade Check Results | +-------------------------------------------------------------------+ | Check: Cells v2 | | Result: Success | | Details: None | +-------------------------------------------------------------------+ | Check: Placement API | | Result: Success | | Details: None | +-------------------------------------------------------------------+ | Check: Resource Providers | | Result: Warning | | Details: There are no compute resource providers in the Placement | | service but there are 2 compute nodes in the deployment. | | This means no compute nodes are reporting into the | | Placement service and need to be upgraded and/or fixed. | | See | | http://docs.openstack.org/developer/nova/placement.html | | for more details. | +-------------------------------------------------------------------+

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Compute Node nova-compute.log

17-04-26 13:11:06.795 17293 INFO nova.servicegroup.drivers.db [-] Recovered from being unable to report status. 2017-04-26 13:11:06.796 17293 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 128.03 sec 2017-04-26 13:11:06.799 17293 INFO oslo.messaging._drivers.impl_rabbit [-] [9665c296-5693-4532-8d54-faa55db265a8] Reconnected to AMQP server on perfcontroller:5672 via [amqp] client with port 35770. 2017-04-26 13:11:06.906 17293 INFO nova.compute.manager [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Bandwidth usage not supported by hypervisor. 2017-04-26 13:11:11.389 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] The placement API endpoint not found. Placement is optional in Newton, but required in Ocata. Please enable the placement service before upgrading. 2017-04-26 13:11:11.390 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Unable to refresh my resource provider record 2017-04-26 13:11:11.443 17293 INFO nova.compute.resource_tracker [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Final resource view: name=perfcompute2 phys_ram=128826MB used_ram=512MB phys_disk=789GB used_disk=0GB total_vcpus=32 used_vcpus=0 pci_stats=[] 2017-04-26 13:12:06.997 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Unable to refresh my resource provider record 2017-04-26 13:12:07.077 17293 INFO nova.compute.resource_tracker [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Final resource view: name=perfcompute2 phys_ram=128826MB used_ram=512MB phys_disk=789GB used_disk=0GB total_vcpus=32 used_vcpus=0 pci_stats=[] 2017-04-26 13:13:05.354 17293 INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : 89b267fb704849c99a74570d0ecb2366 2017-04-26 13:13:05.385 17293 INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : b99ef61861694e3c9d9dfe9962962a33 2017-04-26 13:13:09.029 17293 WARNING nova.scheduler.client.report [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Unable to refresh my resource provider record 2017-04-26 13:13:09.106 17293 INFO nova.compute.resource_tracker [req-7e8b5070-f389-4637-b906-305e5a6cb8d0 - - - - -] Final resource view: name=perfcompute2 phys_ram=128826MB used_ram=512MB phys_disk=789GB used_disk=0GB total_vcpus=32 used_vcpus=0 pci_stats=[]

nov.conf from compute node node

[placement]
 os_region_name = RegionOne
 project_domain_name = Default
 project_name = service
 user_domain_name = Default
 auth_url = http://perfcontroller:35357/v3
 auth_type = password
 username = placement
  password = Welcome123

Welcome123

These are the errors i see in controller node but not sure if they are relevant for this issue

root@perfcontroller:~# tail -f /var/log//.log | grep -i error ==> /var/log/apache2/error.log <== ==> /var/log/apache2/nova_placement_error.log <== ==> /var/log/mysql/error.log <== 2017-04-25 17:32:21.588 25491 DEBUG oslo_db.sqlalchemy.engines [req-2b1466c5-999a-4816-a6cb-cef1904d173b - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 Context: shutdown_error 2017-04-25 17:33:06.587 25527 DEBUG oslo_db.sqlalchemy.engines [req-9cd4df40-8802-4819-97e2-859c644f783a - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:14.894 25828 DEBUG oslo_db.sqlalchemy.engines [req-9aa3e1bc-8be2-4922-9559-65ff8369b342 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:14.894 25829 DEBUG oslo_db.sqlalchemy.engines [req-e49ca89d-5acd-434e-beed-3c5adc053246 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:16.047 25836 DEBUG oslo_db.sqlalchemy.engines [req-e85259d8-f669-41ce-8471-83cd459bcaaf - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:16.050 25837 DEBUG oslo_db.sqlalchemy.engines [req-bdf42b02-4fc9-4ae8-b504-5cfdc143fcbe - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:16.059 25815 DEBUG oslo_service.service [req-1b72b89d-608f-4232-8afc-7447149bf6eb - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:16.072 25815 DEBUG oslo_service.service [req-1b72b89d-608f-4232-8afc-7447149bf6eb - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:16.248 25815 DEBUG oslo_service.service [req-1b72b89d-608f-4232-8afc-7447149bf6eb - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 2017-04-25 17:33:24.604 25859 DEBUG oslo_db.sqlalchemy.engines [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:24.904 25859 DEBUG oslo_db.sqlalchemy.engines [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:24.948 25859 DEBUG oslo_service.service [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:24.959 25859 DEBUG oslo_service.service [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:25.109 25859 DEBUG oslo_service.service [req-09cc2062-8228-4f8e-8966-6485618b4c0d - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 2017-04-25 17:33:40.753 25928 DEBUG oslo_service.service [req-234db78c-fc49-4685-a72b-217c0fc95d3f - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:40.761 25928 DEBUG oslo_service.service [req-234db78c-fc49-4685-a72b-217c0fc95d3f - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:40.882 25928 DEBUG oslo_service.service [req-234db78c-fc49-4685-a72b-217c0fc95d3f - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 2017-04-25 17:33:40.908 25928 DEBUG oslo_db.sqlalchemy.engines [req-29bd813d-ec32-4f13-b6a3-d30aa7fb6e85 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 ==> /var/log/apache2/error.log <== 2017-04-25 17:33:44.611 25960 DEBUG oslo_service.service [req-a0d459b2-ad6c-4774-8e52-3dad26ad4f5d - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:44.617 26000 DEBUG oslo_db.sqlalchemy.engines [req-40866294-b477-47e9-b4cd-324702af42ab - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:44.617 25999 DEBUG oslo_db.sqlalchemy.engines [req-cd93e109-0c9f-4339-8a36-ec20bb965686 - - - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py:261 2017-04-25 17:33:44.620 25960 DEBUG oslo_service.service [req-a0d459b2-ad6c-4774-8e52-3dad26ad4f5d - - - - -] publish_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2736 2017-04-25 17:33:44.737 25960 DEBUG oslo_service.service [req-a0d459b2-ad6c-4774-8e52-3dad26ad4f5d - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values /usr/lib/python2.7/dist-packages/oslo_config/cfg.py:2744 ==> /var/log/apache2/error.log <==