Host not accepting instances
I have a multi host setup that is working with 5 hosts and 1 controller. The 6th host is listed as available, but no instances get created there, nor can I create any instances on that host manually. I am relatively new to OpenStack administration, so if anyone could kindly point me in the right direction to troubleshoot, that would be great.
After a manual attempt from CLI, I have this:
Error: Failed to perform requested operation on instance "host_test", the instance has an error status: Please try again later [Error: Binding failed for port f7070118-ce82-497c-ba1a-a9bac1d8d212, please check neutron logs for more information.]
In /var/log/neutron/openvswitch-agent.log on OpenStack host:
Port f7070118-ce82-497c-ba1a-a9bac1d8d212 not present in bridge br-int
So it seems to have something to do with that, but I am not certain how to proceed.
I would look for other messages that contain this port's ID.
I would also try to (temporally) disable all healthy hosts, manually create a port, then launch an instance on this port and see if anything changes.
Nuclear option: Save time, stop troubleshooting, reinstall the host.
If I run at ovs-vsctl show on a healthy host I get info missing from the misbehaving host: Port "int-br-em2" Interface "int-br-em2" type: patch options: {peer="phy-br-em2"}
...and also this: Bridge "br-em2" Port "br-em2" Interface "br-em2" type: internal Port "phy-br-em2" Interface "phy-br-em2" type: patch options: {peer="int-br-em2"}
Is that additional configuration populated from the config / controller, or manually added?
It also appears that neutron.service is failing to start: CRITICAL neutron [req-52a80795-ad04-46dd-8230-f67519c54541 - - - - -] Unhandled error: CantStartEngineError: No sql_connection parameter is established