Recovering from full cluster shutdown

Posted on Tue 04 December 2012 in hints-and-kinks • 1 min read

If at any time all of the nodes in your cluster have been taken down, it is necessary to re-initialize the Galera replication state. In effect, this is identical to bootstrapping the cluster.

Start by manually bringing up the cluster IP on one of your nodes:

ip address add dev eth1 label eth1:galera

Re-initialize the Galera cluster:

mysqld --wsrep_cluster_address=gcomm:// &

Note the empty gcomm:// address.

Finally, clear your resource state with crm resource cleanup cl_mysql. Pacemaker will leave the running IP address and MySQL instance untouched, and bring up the additional MySQL instances.

This article originally appeared on the website (now defunct).