kolla-ansible deploy fails on DB create/connect (which works manually from within containers)
Still centos7, updated, with ansible 2.5, updated pip, and kolla-ansible from PIP. I get the same error almost every time, regardless of the number of controller nodes I deploy to(1 or 2) Last attempt had 2 nodes of each function. All nodes are always created using qcow-backing images from the same centos-base.
During deploy, the /neutron/tasks/bootstrap.yml, when trying to create the neutron database, it fails with:
"unable to find /var/lib/ansible/.my.cnf. Exception message: (2003, 'Can\\'t connect to MySQL server on \\'172.16.101.111\\' (110 \"Connection timed out\")')"}
Where ever I look, there is no ".my.cnf" on any host (ctrl, neutron, etc) so should that's ONE problem I dont know how to solve, if it even should be available after the failed playbook.
The weirder problem is that I have NO problems connecting to .111 (the VIP address) if I manually enter "mysql -u haproxy -h <VIP> in either the maradb container, or kolla-toolbox container on either of the control nodes.
So HOW THE HECK can I troubleshoot this? HELP :'(
connection to the database cluster is also made through the VIP
So how do I figure out why it fails? Looking at both haproxy containers on my two neutron nodes, I can see established both local and vip address available, LISTENing sockets on VIP, and ESTABLISHED connections from node to both ctrl:er nodes, to maria db.