Revision history [back]

click to hide/show revision 1
initial version

Openstack Fresh Install Train - Neutron

I was following the deployment guide for Train installation - I was able to install Keystone, Glance, Placement, Nova, Heat and Horizon, but when following the guide to install Neutron at the point of populating the database Mysql lost connection.

su -s /bin/sh -c "neutron-db-manage --config-file /etc/neutron/neutron.conf \
  --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head" neutron

oslo_db.exception.DBError: (pymysql.err.InternalError) (1832, "Cannot change column 'network_id': used in a foreign key constraint 'subnets_ibfk_1'") [SQL: 'ALTER TABLE subnets MODIFY network_id VARCHAR(36) NOT NULL'] (Background on this error at: http://sqlalche.me/e/2j85)

I found this article https://ask.openstack.org/en/question/126230/failed-to-populate-neutron-database-train/

So I upgraded from mariadb 10.1 to mariadb 10.4 and did the upgrade of the databases and got everything to work, then tried again to do the neutron population

su -s /bin/sh -c "neutron-db-manage --config-file /etc/neutron/neutron.conf \
  --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head" neutron

I got another error within mysql

jul 1 01:18:17 openstack-controller1 mysqld[19040]: This could be because you hit a bug. It is also possible that this binary Jul 1 01:18:17 openstack-controller1 mysqld[19040]: or one of the libraries it was linked against is corrupt, improperly built, Jul 1 01:18:17 openstack-controller1 mysqld[19040]: or misconfigured. This error can also be caused by malfunctioning hardware. Jul 1 01:18:17 openstack-controller1 mysqld[19040]: To report this bug, see https://mariadb.com/kb/en/reporting-bugs Jul 1 01:18:17 openstack-controller1 mysqld[19040]: We will try our best to scrape up some info that will hopefully help Jul 1 01:18:17 openstack-controller1 mysqld[19040]: diagnose the problem, but since we have already crashed, Jul 1 01:18:17 openstack-controller1 mysqld[19040]: something is definitely wrong and this may fail. Jul 1 01:18:17 openstack-controller1 mysqld[19040]: Server version: 10.4.13-MariaDB-1:10.4.13+maria~bionic-log Jul 1 01:18:17 openstack-controller1 mysqld[19040]: key_buffer_size=134217728 Jul 1 01:18:17 openstack-controller1 mysqld[19040]: read_buffer_size=1073741824 Jul 1 01:18:17 openstack-controller1 mysqld[19040]: max_used_connections=187 Jul 1 01:18:17 openstack-controller1 mysqld[19040]: max_threads=35002 Jul 1 01:18:17 openstack-controller1 mysqld[19040]: thread_count=196 Jul 1 01:18:17 openstack-controller1 mysqld[19040]: It is possible that mysqld could use up to Jul 1 01:18:17 openstack-controller1 mysqld[19040]: key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 36846621323 K bytes of memory Jul 1 01:18:17 openstack-controller1 mysqld[19040]: Hope that’s ok; if not, decrease some variables in the equation. Jul 1 01:18:17 openstack-controller1 mysqld[19040]: Thread pointer: 0x7f00a4000c08 Jul 1 01:18:17 openstack-controller1 mysqld[19040]: Attempting backtrace. You can use the following information to find out Jul 1 01:18:17 openstack-controller1 mysqld[19040]: where mysqld died. If you see no messages after this, something went Jul 1 01:18:17 openstack-controller1 mysqld[19040]: terribly wrong... Jul 1 01:18:17 openstack-controller1 mysqld[19040]: stack_bottom = 0x7f0218ba4dd8 thread_stack 0x49000 Jul 1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x56073f8c0e8e] Jul 1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(handle_fatal_signal+0x515)[0x56073f33c915] Jul 1 01:18:18 openstack-controller1 mysqld[19040]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12890)[0x7f053a6f9890] Jul 1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(_ZN12Item_func_in7cleanupEv+0x73)[0x56073f4632a3] Jul 1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(_ZN11Query_arena10free_itemsEv+0x2d)[0x56073f0e2c2d] Jul 1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(_ZN3THD19cleanup_after_queryEv+0x11b)[0x56073f0e4b4b] Jul 1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_statebb+0x25b)[0x56073f13502b] Jul 1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(+0x66882a)[0x56073f13582a] Jul 1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcjbb+0x2220)[0x56073f138250] Jul 1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(_Z10do_commandP3THD+0x104)[0x56073f138bb4] Jul 1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(_Z24do_handle_one_connectionP7CONNECT+0x25e)[0x56073f21523e] Jul 1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(handle_one_connection+0x3d)[0x56073f2152fd] Jul 1 01:18:18 openstack-controller1 mysqld[19040]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db)[0x7f053a6ee6db] Jul 1 01:18:18 openstack-controller1 mysqld[19040]: /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7f053911088f] Jul 1 01:18:18 openstack-controller1 mysqld[19040]: Trying to get some variables. Jul 1 01:18:18 openstack-controller1 mysqld[19040]: Some pointers may be invalid and cause the dump to abort. Jul 1 01:18:18 openstack-controller1 mysqld[19040]: Query (0x7f00a40100a0): CREATE INDEX ix_networks_tenant_id ON networks (tenant_id) Jul 1 01:18:18 openstack-controller1 mysqld[19040]: Connection ID (thread ID): 575 Jul 1 01:18:18 openstack-controller1 mysqld[19040]: Status: NOT_KILLED

Any idea why this could be happening?

Openstack Fresh Install Train - Neutron

I was following the deployment guide for Train installation - I was able to install Keystone, Glance, Placement, Nova, Heat and Horizon, but when following the guide to install Neutron at the point of populating the database Mysql lost connection.

su -s /bin/sh -c "neutron-db-manage --config-file /etc/neutron/neutron.conf \
  --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head" neutron

oslo_db.exception.DBError: (pymysql.err.InternalError) (1832, "Cannot change column 'network_id': used in a foreign key constraint 'subnets_ibfk_1'") [SQL: 'ALTER TABLE subnets MODIFY network_id VARCHAR(36) NOT NULL'] (Background on this error at: http://sqlalche.me/e/2j85)

I found this article https://ask.openstack.org/en/question/126230/failed-to-populate-neutron-database-train/

So I upgraded from mariadb 10.1 to mariadb 10.4 and did the upgrade of the databases and got everything to work, then tried again to do the neutron population

su -s /bin/sh -c "neutron-db-manage --config-file /etc/neutron/neutron.conf \
  --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head" neutron

I got another error within mysql

jul  1 01:18:17 openstack-controller1 mysqld[19040]: This could be because you hit a bug. It is also possible that this binary
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: or one of the libraries it was linked against is corrupt, improperly built,
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: or misconfigured. This error can also be caused by malfunctioning hardware.
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: To report this bug, see https://mariadb.com/kb/en/reporting-bugs
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: We will try our best to scrape up some info that will hopefully help
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: diagnose the problem, but since we have already crashed,
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: something is definitely wrong and this may fail.
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: Server version: 10.4.13-MariaDB-1:10.4.13+maria~bionic-log
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: key_buffer_size=134217728
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: read_buffer_size=1073741824
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: max_used_connections=187
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: max_threads=35002
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: thread_count=196
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: It is possible that mysqld could use up to
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 36846621323 K  bytes of memory
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: Hope that’s ok; if not, decrease some variables in the equation.
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: Thread pointer: 0x7f00a4000c08
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: Attempting backtrace. You can use the following information to find out
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: where mysqld died. If you see no messages after this, something went
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: terribly wrong...
Jul  1 01:18:17 openstack-controller1 mysqld[19040]: stack_bottom = 0x7f0218ba4dd8 thread_stack 0x49000
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x56073f8c0e8e]
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(handle_fatal_signal+0x515)[0x56073f33c915]
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12890)[0x7f053a6f9890]
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(_ZN12Item_func_in7cleanupEv+0x73)[0x56073f4632a3]
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(_ZN11Query_arena10free_itemsEv+0x2d)[0x56073f0e2c2d]
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(_ZN3THD19cleanup_after_queryEv+0x11b)[0x56073f0e4b4b]
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_statebb+0x25b)[0x56073f13502b]
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(+0x66882a)[0x56073f13582a]
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcjbb+0x2220)[0x56073f138250]
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(_Z10do_commandP3THD+0x104)[0x56073f138bb4]
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(_Z24do_handle_one_connectionP7CONNECT+0x25e)[0x56073f21523e]
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: /usr/sbin/mysqld(handle_one_connection+0x3d)[0x56073f2152fd]
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db)[0x7f053a6ee6db]
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7f053911088f]
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: Trying to get some variables.
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: Some pointers may be invalid and cause the dump to abort.
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: Query (0x7f00a40100a0): CREATE INDEX ix_networks_tenant_id ON networks (tenant_id)
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: Connection ID (thread ID): 575
Jul  1 01:18:18 openstack-controller1 mysqld[19040]: Status: NOT_KILLED

NOT_KILLED

Any idea why this could be happening?