Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Can not associate the floating ip to instance

When I associate a floating ip to the instance, create success, but can not attach it to the instance.

enter image description here

The error information:

Error: External network 8603929d-6d3b-44dd-af59-d9a4f77d4048 is not reachable from subnet 4c76341d-c7b4-49a4-add9-465eb1696344. Therefore, cannot associate Port 14b82c66-209a-4c64-9791-49042a3667e3 with a Floating IP. Neutron server returns request_ids: ['req-ae0d016c-97a9-408d-9a40-2bf741463034']

Error: Unable to associate IP address 45.117.40.62.

And in the Project->COMPUTE->Instance all are down.

enter image description here


EDIT-1

All the neutron service status are active(running):

systemctl status  neutron-server.service neutron-l3-agent.servic neutron-server.service neutron-linuxbridge-agent.service neutron-dhcp-agent.service neutron-metadata-agent.service

# all the service information are running.

Can not associate the floating ip to instance

When I associate a floating ip to the instance, create success, but can not attach it to the instance.

enter image description here

The error information:

Error: External network 8603929d-6d3b-44dd-af59-d9a4f77d4048 is not reachable from subnet 4c76341d-c7b4-49a4-add9-465eb1696344. Therefore, cannot associate Port 14b82c66-209a-4c64-9791-49042a3667e3 with a Floating IP. Neutron server returns request_ids: ['req-ae0d016c-97a9-408d-9a40-2bf741463034']

Error: Unable to associate IP address 45.117.40.62.

And in the Project->COMPUTE->Instance all are down.

enter image description here


EDIT-1

All the neutron service status are active(running):

systemctl status  neutron-server.service neutron-l3-agent.servic neutron-server.service neutron-linuxbridge-agent.service neutron-dhcp-agent.service neutron-metadata-agent.service

# all the service information are running.

EDIT-2

This is the network topology:

image description

Can not associate the floating ip to instance

When I associate a floating ip to the instance, create success, but can not attach it to the instance.

enter image description here

The error information:

Error: External network 8603929d-6d3b-44dd-af59-d9a4f77d4048 is not reachable from subnet 4c76341d-c7b4-49a4-add9-465eb1696344. Therefore, cannot associate Port 14b82c66-209a-4c64-9791-49042a3667e3 with a Floating IP. Neutron server returns request_ids: ['req-ae0d016c-97a9-408d-9a40-2bf741463034']

Error: Unable to associate IP address 45.117.40.62.

And in the Project->COMPUTE->Instance all are down.

enter image description here


EDIT-1

All the neutron service status are active(running):

systemctl status  neutron-server.service neutron-l3-agent.servic neutron-server.service neutron-linuxbridge-agent.service neutron-dhcp-agent.service neutron-metadata-agent.service

# all the service information are running.

EDIT-2

This is the network topology:

image description


EDIT-3

I only find crm status the vim_public_monitor is not running. I don't know if this affect it:

[root@ha-node1 ~]# crm status Last updated: Mon Aug 7 13:58:05 2017 Last change: Sun Aug 6 18:33:12 2017 by root via cibadmin on ha-node1 Stack: corosync Current DC: ha-node1 (version 1.1.13-10.el7-44eb2dd) - partition with quorum 3 nodes and 2 resources configured

Online: [ ha-node1 ha-node2 ha-node3 ]

Full list of resources:

vip_public (ocf::heartbeat:IPaddr2): Started ha-node1 vip_management (ocf::heartbeat:IPaddr2): Started ha-node2

Failed Actions: * vip_public_monitor_30000 on ha-node1 'not running' (7): call=12, status=complete, exitreason='none', last-rc-change='Mon Aug 7 10:02:46 2017', queued=0ms, exec=0ms

Can not associate the floating ip to instance

When I associate a floating ip to the instance, create success, but can not attach it to the instance.

enter image description here

The error information:

Error: External network 8603929d-6d3b-44dd-af59-d9a4f77d4048 is not reachable from subnet 4c76341d-c7b4-49a4-add9-465eb1696344. Therefore, cannot associate Port 14b82c66-209a-4c64-9791-49042a3667e3 with a Floating IP. Neutron server returns request_ids: ['req-ae0d016c-97a9-408d-9a40-2bf741463034']

Error: Unable to associate IP address 45.117.40.62.

And in the Project->COMPUTE->Instance all are down.

enter image description here


EDIT-1

All the neutron service status are active(running):

systemctl status  neutron-server.service neutron-l3-agent.servic neutron-server.service neutron-linuxbridge-agent.service neutron-dhcp-agent.service neutron-metadata-agent.service

# all the service information are running.

EDIT-2

This is the network topology:

image description


EDIT-3

I only find crm status the vim_public_monitor is not running. I don't know if this affect it:

[root@ha-node1 ~]# crm status 
Last updated: Mon Aug  7 13:58:05 2017      Last change: Sun Aug  6 18:33:12 2017 by root via cibadmin on ha-node1
Stack: corosync
Current DC: ha-node1 (version 1.1.13-10.el7-44eb2dd) - partition with quorum
3 nodes and 2 resources configured

configured Online: [ ha-node1 ha-node2 ha-node3 ]

] Full list of resources:

resources: vip_public (ocf::heartbeat:IPaddr2): Started ha-node1 vip_management (ocf::heartbeat:IPaddr2): Started ha-node2

ha-node2 Failed Actions: * vip_public_monitor_30000 on ha-node1 'not running' (7): call=12, status=complete, exitreason='none', last-rc-change='Mon Aug 7 10:02:46 2017', queued=0ms, exec=0ms

exec=0ms

Can not associate the floating ip to instance

When I associate a floating ip to the instance, create success, but can not attach it to the instance.

enter image description here

The error information:

Error: External network 8603929d-6d3b-44dd-af59-d9a4f77d4048 is not reachable from subnet 4c76341d-c7b4-49a4-add9-465eb1696344. Therefore, cannot associate Port 14b82c66-209a-4c64-9791-49042a3667e3 with a Floating IP. Neutron server returns request_ids: ['req-ae0d016c-97a9-408d-9a40-2bf741463034']

Error: Unable to associate IP address 45.117.40.62.

And in the Project->COMPUTE->Instance all are down.

enter image description here


EDIT-1

All the neutron service status are active(running):

systemctl status  neutron-server.service neutron-l3-agent.servic neutron-server.service neutron-linuxbridge-agent.service neutron-dhcp-agent.service neutron-metadata-agent.service

# all the service information are running.

EDIT-2

This is the network topology:

image description

The interfaces all are active:

image description


EDIT-3

I only find crm status the vim_public_monitor is not running. I don't know if this affect it:

[root@ha-node1 ~]# crm status 
Last updated: Mon Aug  7 13:58:05 2017      Last change: Sun Aug  6 18:33:12 2017 by root via cibadmin on ha-node1
Stack: corosync
Current DC: ha-node1 (version 1.1.13-10.el7-44eb2dd) - partition with quorum
3 nodes and 2 resources configured

Online: [ ha-node1 ha-node2 ha-node3 ]

Full list of resources:

 vip_public (ocf::heartbeat:IPaddr2):   Started ha-node1
 vip_management (ocf::heartbeat:IPaddr2):   Started ha-node2

Failed Actions:
* vip_public_monitor_30000 on ha-node1 'not running' (7): call=12, status=complete, exitreason='none',
    last-rc-change='Mon Aug  7 10:02:46 2017', queued=0ms, exec=0ms

Can not associate the floating ip to instance

When I associate a floating ip to the instance, create success, but can not attach it to the instance.

enter image description here

The error information:

Error: External network 8603929d-6d3b-44dd-af59-d9a4f77d4048 is not reachable from subnet 4c76341d-c7b4-49a4-add9-465eb1696344. Therefore, cannot associate Port 14b82c66-209a-4c64-9791-49042a3667e3 with a Floating IP. Neutron server returns request_ids: ['req-ae0d016c-97a9-408d-9a40-2bf741463034']

Error: Unable to associate IP address 45.117.40.62.

And in the Project->COMPUTE->Instance all are down.

enter image description here


EDIT-1

All the neutron service status are active(running):

systemctl status  neutron-server.service neutron-l3-agent.servic neutron-server.service neutron-linuxbridge-agent.service neutron-dhcp-agent.service neutron-metadata-agent.service

# all the service information are running.

EDIT-2

This is the network topology:

image description

The interfaces all are active:

image description


EDIT-3

I only find crm status the vim_public_monitor is not running. I don't know if this affect it:

[root@ha-node1 ~]# crm status 
Last updated: Mon Aug  7 13:58:05 2017      Last change: Sun Aug  6 18:33:12 2017 by root via cibadmin on ha-node1
Stack: corosync
Current DC: ha-node1 (version 1.1.13-10.el7-44eb2dd) - partition with quorum
3 nodes and 2 resources configured

Online: [ ha-node1 ha-node2 ha-node3 ]

Full list of resources:

 vip_public (ocf::heartbeat:IPaddr2):   Started ha-node1
 vip_management (ocf::heartbeat:IPaddr2):   Started ha-node2

Failed Actions:
* vip_public_monitor_30000 on ha-node1 'not running' (7): call=12, status=complete, exitreason='none',
    last-rc-change='Mon Aug  7 10:02:46 2017', queued=0ms, exec=0ms

EDIT-4

I find in the router's interfaces, the ha-node1, and ha-node3 interface are Build Status, not Active. I am not sure if is because of this issue.

image description

Can not associate the floating ip to instance

When I associate a floating ip to the instance, create success, but can not attach it to the instance.

enter image description here

The error information:

Error: External network 8603929d-6d3b-44dd-af59-d9a4f77d4048 is not reachable from subnet 4c76341d-c7b4-49a4-add9-465eb1696344. Therefore, cannot associate Port 14b82c66-209a-4c64-9791-49042a3667e3 with a Floating IP. Neutron server returns request_ids: ['req-ae0d016c-97a9-408d-9a40-2bf741463034']

Error: Unable to associate IP address 45.117.40.62.

And in the Project->COMPUTE->Instance all are down.

enter image description here


EDIT-1

All the neutron service status are active(running):

systemctl status  neutron-server.service neutron-l3-agent.servic neutron-server.service neutron-linuxbridge-agent.service neutron-dhcp-agent.service neutron-metadata-agent.service

# all the service information are running.

EDIT-2

This is the network topology:

image description

The interfaces all are active:

image description


EDIT-3

I only find crm status the vim_public_monitor is not running. I don't know if this affect it:

[root@ha-node1 ~]# crm status 
Last updated: Mon Aug  7 13:58:05 2017      Last change: Sun Aug  6 18:33:12 2017 by root via cibadmin on ha-node1
Stack: corosync
Current DC: ha-node1 (version 1.1.13-10.el7-44eb2dd) - partition with quorum
3 nodes and 2 resources configured

Online: [ ha-node1 ha-node2 ha-node3 ]

Full list of resources:

 vip_public (ocf::heartbeat:IPaddr2):   Started ha-node1
 vip_management (ocf::heartbeat:IPaddr2):   Started ha-node2

Failed Actions:
* vip_public_monitor_30000 on ha-node1 'not running' (7): call=12, status=complete, exitreason='none',
    last-rc-change='Mon Aug  7 10:02:46 2017', queued=0ms, exec=0ms

EDIT-4

I find in the router's interfaces, the ha-node1, and ha-node3 interface are Build Status, not Active. I am not sure if is because of this issue.issue.if is the interface is down the VM can not connect to the public network.(but my vm1 and vm3 all are in the ha-node2).

image description

Can not associate the floating ip to instance

When I associate a floating ip to the instance, create success, but can not attach it to the instance.

enter image description here

The error information:

Error: External network 8603929d-6d3b-44dd-af59-d9a4f77d4048 is not reachable from subnet 4c76341d-c7b4-49a4-add9-465eb1696344. Therefore, cannot associate Port 14b82c66-209a-4c64-9791-49042a3667e3 with a Floating IP. Neutron server returns request_ids: ['req-ae0d016c-97a9-408d-9a40-2bf741463034']

Error: Unable to associate IP address 45.117.40.62.

And in the Project->COMPUTE->Instance all are down.

enter image description here


EDIT-1

All the neutron service status are active(running):

systemctl status  neutron-server.service neutron-l3-agent.servic neutron-server.service neutron-linuxbridge-agent.service neutron-dhcp-agent.service neutron-metadata-agent.service

# all the service information are running.

EDIT-2

This is the network topology:

image description

The interfaces all are active:

image description


EDIT-3

I only find crm status the vim_public_monitor is not running. I don't know if this affect it:

[root@ha-node1 ~]# crm status 
Last updated: Mon Aug  7 13:58:05 2017      Last change: Sun Aug  6 18:33:12 2017 by root via cibadmin on ha-node1
Stack: corosync
Current DC: ha-node1 (version 1.1.13-10.el7-44eb2dd) - partition with quorum
3 nodes and 2 resources configured

Online: [ ha-node1 ha-node2 ha-node3 ]

Full list of resources:

 vip_public (ocf::heartbeat:IPaddr2):   Started ha-node1
 vip_management (ocf::heartbeat:IPaddr2):   Started ha-node2

Failed Actions:
* vip_public_monitor_30000 on ha-node1 'not running' (7): call=12, status=complete, exitreason='none',
    last-rc-change='Mon Aug  7 10:02:46 2017', queued=0ms, exec=0ms

EDIT-4

I find in the router's interfaces, the ha-node1, and ha-node3 interface are Build Status, not Active. I am not sure if is because of this issue.if is the interface is down the VM can not connect to the public network.(but my vm1 and vm3 all are in the ha-node2).

image description


EDIT-5

I cat the neutron-server.log use the command in ha-node1 :cat server.log | grep ERROR

get the below log info:

2017-08-07 13:02:09.564 49128 ERROR oslo_db.sqlalchemy.exc_filters 
2017-08-07 13:02:09.581 49128 ERROR oslo_messaging.rpc.server [req-7fc47486-406d-4b63-b68c-b46fc15f0914 - - - - -] Exception during message handling
2017-08-07 13:02:09.581 49128 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2017-08-07 13:02:09.581 49128 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/
...
2017-08-07 13:02:10.208 49131 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
...
2017-08-07 13:02:10.208 49131 ERROR oslo_db.sqlalchemy.exc_filters     err.raise_mysql_exception(self._data)
2017-08-07 13:02:10.208 49131 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/site-packages/pymysql/err.py", line 107, in raise_mysql_exception
2017-08-07 13:02:10.208 49131 ERROR oslo_db.sqlalchemy.exc_filters     raise errorclass(errno, errval)
2017-08-07 13:02:10.208 49131 ERROR oslo_db.sqlalchemy.exc_filters InternalError: (1047, u'WSREP has not yet prepared node for application use')
2017-08-07 13:02:10.208 49131 ERROR oslo_db.sqlalchemy.exc_filters 
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server [req-fd5daf2a-f9d7-48d0-a730-9361e82fd306 - - - - -] Exception during message handling
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 133, in _process_incoming
...
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     ret = list(self)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2736, in __iter__
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     return self._execute_and_instances(context)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2749, in _execute_and_instances
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     close_with_result=True)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2740, in _connection_from_session
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     **kw)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 905, in connection
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     execution_options=execution_options)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 910, in _connection_for_bind
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     engine, execution_options)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 334, in _connection_for_bind
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     conn = bind.contextual_connect()
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2041, in contextual_connect
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     **kwargs)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 92, in __init__
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     self.dispatch.engine_connect(self, self.__branch)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     fn(*args, **kw)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py", line 72, in _connect_ping_listener
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     connection.scalar(select([1]))
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 844, in scalar
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     return self.execute(object, *multiparams, **params).scalar()
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 914, in execute
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     return meth(self, multiparams, params)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     return connection._execute_clauseelement(self, multiparams, params)
...
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     self._read_ok_packet()
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 752, in _read_ok_packet
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     pkt = self._read_packet()
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 991, in _read_packet
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     packet.check_error()
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 393, in check_error
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     err.raise_mysql_exception(self._data)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/pymysql/err.py", line 107, in raise_mysql_exception
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     raise errorclass(errno, errval)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server InternalError: (pymysql.err.InternalError) (1047, u'WSREP has not yet prepared node for application use')
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server 
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool [req-bfa59b1c-28f9-4009-8189-cdcbb4799216 - - - - -] Exception during reset or similar
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool Traceback (most recent call last):
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 636, in _finalize_fairy
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     fairy._reset(pool)
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 776, in _reset
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     pool._dialect.do_rollback(self)
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib64/python2.7/site-packages/sqlalchemy/dialects/mysql/base.py", line 2526, in do_rollback
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     dbapi_connection.rollback()
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 778, in rollback
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     self._read_ok_packet()
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 752, in _read_ok_packet
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     pkt = self._read_packet()
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 971, in _read_packet
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     packet_header = self._read_bytes(4)
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1008, in _read_bytes
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     2013, "Lost connection to MySQL server during query")
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool OperationalError: (2013, 'Lost connection to MySQL server during query')
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool

Can not associate the floating ip to instance

When I associate a floating ip to the instance, create success, but can not attach it to the instance.

enter image description here

The error information:

Error: External network 8603929d-6d3b-44dd-af59-d9a4f77d4048 is not reachable from subnet 4c76341d-c7b4-49a4-add9-465eb1696344. Therefore, cannot associate Port 14b82c66-209a-4c64-9791-49042a3667e3 with a Floating IP. Neutron server returns request_ids: ['req-ae0d016c-97a9-408d-9a40-2bf741463034']

Error: Unable to associate IP address 45.117.40.62.

And in the Project->COMPUTE->Instance all are down.

enter image description here


EDIT-1

All the neutron service status are active(running):

systemctl status  neutron-server.service neutron-l3-agent.servic neutron-server.service neutron-linuxbridge-agent.service neutron-dhcp-agent.service neutron-metadata-agent.service

# all the service information are running.

EDIT-2

This is the network topology:

image description

The interfaces all are active:

image description


EDIT-3

I only find crm status the vim_public_monitor is not running. I don't know if this affect it:

[root@ha-node1 ~]# crm status 
Last updated: Mon Aug  7 13:58:05 2017      Last change: Sun Aug  6 18:33:12 2017 by root via cibadmin on ha-node1
Stack: corosync
Current DC: ha-node1 (version 1.1.13-10.el7-44eb2dd) - partition with quorum
3 nodes and 2 resources configured

Online: [ ha-node1 ha-node2 ha-node3 ]

Full list of resources:

 vip_public (ocf::heartbeat:IPaddr2):   Started ha-node1
 vip_management (ocf::heartbeat:IPaddr2):   Started ha-node2

Failed Actions:
* vip_public_monitor_30000 on ha-node1 'not running' (7): call=12, status=complete, exitreason='none',
    last-rc-change='Mon Aug  7 10:02:46 2017', queued=0ms, exec=0ms

EDIT-4

I find in the router's interfaces, the ha-node1, and ha-node3 interface are Build Status, not Active. I am not sure if is because of this issue.if is the interface is down the VM can not connect to the public network.(but my vm1 and vm3 all are in the ha-node2).

image description


EDIT-5

I cat the neutron-server.log use the command in ha-node1 or ha-node2, or ha-node3 :cat server.log | grep ERROR

get the below log info:

2017-08-07 13:02:09.564 49128 ERROR oslo_db.sqlalchemy.exc_filters 
2017-08-07 13:02:09.581 49128 ERROR oslo_messaging.rpc.server [req-7fc47486-406d-4b63-b68c-b46fc15f0914 - - - - -] Exception during message handling
2017-08-07 13:02:09.581 49128 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2017-08-07 13:02:09.581 49128 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/
...
2017-08-07 13:02:10.208 49131 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
...
2017-08-07 13:02:10.208 49131 ERROR oslo_db.sqlalchemy.exc_filters     err.raise_mysql_exception(self._data)
2017-08-07 13:02:10.208 49131 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/site-packages/pymysql/err.py", line 107, in raise_mysql_exception
2017-08-07 13:02:10.208 49131 ERROR oslo_db.sqlalchemy.exc_filters     raise errorclass(errno, errval)
2017-08-07 13:02:10.208 49131 ERROR oslo_db.sqlalchemy.exc_filters InternalError: (1047, u'WSREP has not yet prepared node for application use')
2017-08-07 13:02:10.208 49131 ERROR oslo_db.sqlalchemy.exc_filters 
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server [req-fd5daf2a-f9d7-48d0-a730-9361e82fd306 - - - - -] Exception during message handling
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 133, in _process_incoming
...
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     ret = list(self)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2736, in __iter__
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     return self._execute_and_instances(context)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2749, in _execute_and_instances
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     close_with_result=True)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2740, in _connection_from_session
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     **kw)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 905, in connection
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     execution_options=execution_options)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 910, in _connection_for_bind
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     engine, execution_options)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 334, in _connection_for_bind
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     conn = bind.contextual_connect()
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2041, in contextual_connect
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     **kwargs)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 92, in __init__
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     self.dispatch.engine_connect(self, self.__branch)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     fn(*args, **kw)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py", line 72, in _connect_ping_listener
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     connection.scalar(select([1]))
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 844, in scalar
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     return self.execute(object, *multiparams, **params).scalar()
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 914, in execute
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     return meth(self, multiparams, params)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     return connection._execute_clauseelement(self, multiparams, params)
...
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     self._read_ok_packet()
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 752, in _read_ok_packet
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     pkt = self._read_packet()
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 991, in _read_packet
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     packet.check_error()
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 393, in check_error
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     err.raise_mysql_exception(self._data)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/pymysql/err.py", line 107, in raise_mysql_exception
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     raise errorclass(errno, errval)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server InternalError: (pymysql.err.InternalError) (1047, u'WSREP has not yet prepared node for application use')
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server 
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool [req-bfa59b1c-28f9-4009-8189-cdcbb4799216 - - - - -] Exception during reset or similar
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool Traceback (most recent call last):
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 636, in _finalize_fairy
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     fairy._reset(pool)
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 776, in _reset
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     pool._dialect.do_rollback(self)
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib64/python2.7/site-packages/sqlalchemy/dialects/mysql/base.py", line 2526, in do_rollback
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     dbapi_connection.rollback()
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 778, in rollback
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     self._read_ok_packet()
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 752, in _read_ok_packet
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     pkt = self._read_packet()
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 971, in _read_packet
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     packet_header = self._read_bytes(4)
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1008, in _read_bytes
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     2013, "Lost connection to MySQL server during query")
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool OperationalError: (2013, 'Lost connection to MySQL server during query')
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool

Can not associate the floating ip to instance

When I associate a floating ip to the instance, create success, but can not attach it to the instance.

enter image description here

The error information:

Error: External network 8603929d-6d3b-44dd-af59-d9a4f77d4048 is not reachable from subnet 4c76341d-c7b4-49a4-add9-465eb1696344. Therefore, cannot associate Port 14b82c66-209a-4c64-9791-49042a3667e3 with a Floating IP. Neutron server returns request_ids: ['req-ae0d016c-97a9-408d-9a40-2bf741463034']

Error: Unable to associate IP address 45.117.40.62.

And in the Project->COMPUTE->Instance all are down.

enter image description here


EDIT-1

All the neutron service status are active(running):

systemctl status  neutron-server.service neutron-l3-agent.servic neutron-server.service neutron-linuxbridge-agent.service neutron-dhcp-agent.service neutron-metadata-agent.service

# all the service information are running.

EDIT-2

This is the network topology:

image description

The interfaces all are active:

image description


EDIT-3

I only find crm status the vim_public_monitor is not running. I don't know if this affect it:

[root@ha-node1 ~]# crm status 
Last updated: Mon Aug  7 13:58:05 2017      Last change: Sun Aug  6 18:33:12 2017 by root via cibadmin on ha-node1
Stack: corosync
Current DC: ha-node1 (version 1.1.13-10.el7-44eb2dd) - partition with quorum
3 nodes and 2 resources configured

Online: [ ha-node1 ha-node2 ha-node3 ]

Full list of resources:

 vip_public (ocf::heartbeat:IPaddr2):   Started ha-node1
 vip_management (ocf::heartbeat:IPaddr2):   Started ha-node2

Failed Actions:
* vip_public_monitor_30000 on ha-node1 'not running' (7): call=12, status=complete, exitreason='none',
    last-rc-change='Mon Aug  7 10:02:46 2017', queued=0ms, exec=0ms

EDIT-4

I find in the router's interfaces, the ha-node1, and ha-node3 interface are Build Status, not Active. I am not sure if is because of this issue.if is the interface is down the VM can not connect to the public network.(but my vm1 and vm3 all are in the ha-node2).

image description


EDIT-5

I cat the neutron-server.log use the command in ha-node1 or ha-node2, or ha-node3 :cat server.log | grep ERROR

get the below log info:

2017-08-07 13:02:09.564 49128 ERROR oslo_db.sqlalchemy.exc_filters 
2017-08-07 13:02:09.581 49128 ERROR oslo_messaging.rpc.server [req-7fc47486-406d-4b63-b68c-b46fc15f0914 - - - - -] Exception during message handling
2017-08-07 13:02:09.581 49128 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2017-08-07 13:02:09.581 49128 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/
...
2017-08-07 13:02:10.208 49131 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
...
2017-08-07 13:02:10.208 49131 ERROR oslo_db.sqlalchemy.exc_filters     err.raise_mysql_exception(self._data)
2017-08-07 13:02:10.208 49131 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/site-packages/pymysql/err.py", line 107, in raise_mysql_exception
2017-08-07 13:02:10.208 49131 ERROR oslo_db.sqlalchemy.exc_filters     raise errorclass(errno, errval)
2017-08-07 13:02:10.208 49131 ERROR oslo_db.sqlalchemy.exc_filters InternalError: (1047, u'WSREP has not yet prepared node for application use')
2017-08-07 13:02:10.208 49131 ERROR oslo_db.sqlalchemy.exc_filters 
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server [req-fd5daf2a-f9d7-48d0-a730-9361e82fd306 - - - - -] Exception during message handling
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 133, in _process_incoming
...
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     ret = list(self)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2736, in __iter__
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     return self._execute_and_instances(context)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2749, in _execute_and_instances
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     close_with_result=True)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2740, in _connection_from_session
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     **kw)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 905, in connection
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     execution_options=execution_options)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 910, in _connection_for_bind
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     engine, execution_options)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 334, in _connection_for_bind
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     conn = bind.contextual_connect()
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2041, in contextual_connect
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     **kwargs)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 92, in __init__
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     self.dispatch.engine_connect(self, self.__branch)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     fn(*args, **kw)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py", line 72, in _connect_ping_listener
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     connection.scalar(select([1]))
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 844, in scalar
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     return self.execute(object, *multiparams, **params).scalar()
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 914, in execute
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     return meth(self, multiparams, params)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     return connection._execute_clauseelement(self, multiparams, params)
...
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     self._read_ok_packet()
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 752, in _read_ok_packet
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     pkt = self._read_packet()
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 991, in _read_packet
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     packet.check_error()
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 393, in check_error
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     err.raise_mysql_exception(self._data)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/pymysql/err.py", line 107, in raise_mysql_exception
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server     raise errorclass(errno, errval)
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server InternalError: (pymysql.err.InternalError) (1047, u'WSREP has not yet prepared node for application use')
2017-08-07 13:02:10.211 49131 ERROR oslo_messaging.rpc.server 
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool [req-bfa59b1c-28f9-4009-8189-cdcbb4799216 - - - - -] Exception during reset or similar
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool Traceback (most recent call last):
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 636, in _finalize_fairy
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     fairy._reset(pool)
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 776, in _reset
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     pool._dialect.do_rollback(self)
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib64/python2.7/site-packages/sqlalchemy/dialects/mysql/base.py", line 2526, in do_rollback
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     dbapi_connection.rollback()
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 778, in rollback
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     self._read_ok_packet()
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 752, in _read_ok_packet
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     pkt = self._read_packet()
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 971, in _read_packet
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     packet_header = self._read_bytes(4)
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1008, in _read_bytes
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool     2013, "Lost connection to MySQL server during query")
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool OperationalError: (2013, 'Lost connection to MySQL server during query')
2017-08-07 13:04:18.038 49128 ERROR sqlalchemy.pool.QueuePool

EDIT-6

I check the l3-agent.log see the below error:

[root@ha-node1 neutron]# vim l3-agent.log 

2017-08-07 13:02:09.865 48963 ERROR neutron.agent.l3.agent     return method(context, 'report_state', **kwargs)
2017-08-07 13:02:09.865 48963 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 169, in call
2017-08-07 13:02:09.865 48963 ERROR neutron.agent.l3.agent     retry=self.retry)
2017-08-07 13:02:09.865 48963 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 97, in _send
2017-08-07 13:02:09.865 48963 ERROR neutron.agent.l3.agent     timeout=timeout, retry=retry)
2017-08-07 13:02:09.865 48963 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 464, in send
2017-08-07 13:02:09.865 48963 ERROR neutron.agent.l3.agent     retry=retry)
2017-08-07 13:02:09.865 48963 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 455, in _send
2017-08-07 13:02:09.865 48963 ERROR neutron.agent.l3.agent     raise result
2017-08-07 13:02:09.865 48963 ERROR neutron.agent.l3.agent RemoteError: Remote error: InternalError (pymysql.err.InternalError) (1047, u'WSREP has not yet prepared node for application use')
@