I have setup a HA Openstack with Kilo. I have deployed MariaDB-Galera cluster on 2 nodes with master-master setup using link: http://behindtheracks.com/2014/04/mysql-high-availability-with-galera-and-haproxy/ (http://behindtheracks.com/2014/04/mys...)

Everything works fine when both the nodes up, but when I switch off any of the cluster node then DB stops responding and I get the exception in logs: 'wsrep has may not yet prepared node'.

My cluster.cnf file: Node1:

[mysqld] query_cache_size=0 binlog_format=ROW default-storage-engine=innodb innodb_autoinc_lock_mode=2 query_cache_type=0 bind-address=0.0.0.0

Galera Provider Configuration

wsrep_provider=/usr/lib/galera/libgalera_smm.so

wsrep_provider_options="gcache.size=32G"

Galera Cluster Configuration

wsrep_cluster_name="test_cluster" wsrep_cluster_address="gcomm://192.168.10.53,192.168.10.54"

Galera Synchronization Congifuration

wsrep_sst_method=rsync

wsrep_sst_method=xtrabackup

wsrep_sst_auth=user:pass

Galera Node Configuration

wsrep_node_address="192.168.10.53" wsrep_node_name="hacontroller1" wsrep_debug=ON

And Node 2 [mysqld] query_cache_size=0 binlog_format=ROW default-storage-engine=innodb innodb_autoinc_lock_mode=2 query_cache_type=0 bind-address=0.0.0.0

Galera Provider Configuration

wsrep_provider=/usr/lib/galera/libgalera_smm.so

wsrep_provider_options="gcache.size=32G"

Galera Cluster Configuration

wsrep_cluster_name="test_cluster" wsrep_cluster_address="gcomm://192.168.10.53,192.168.10.54"

Galera Synchronization Congifuration

wsrep_sst_method=rsync

wsrep_sst_method=xtrabackup

wsrep_sst_auth=user:pass

Galera Node Configuration

wsrep_node_address="192.168.10.54" wsrep_node_name="hacontroller2" wsrep_debug=ON

Could anyone let me know what am I doing wrong here?