<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
span.E-mailStijl17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1113595124;
mso-list-type:hybrid;
mso-list-template-ids:898416248 68354063 68354073 68354075 68354063 68354073 68354075 68354063 68354073 68354075;}
@list l0:level1
{mso-level-start-at:4;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l1
{mso-list-id:1319963090;
mso-list-type:hybrid;
mso-list-template-ids:-1664691686 68354065 68354073 68354075 68354063 68354073 68354075 68354063 68354073 68354075;}
@list l1:level1
{mso-level-text:"%1\)";
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l1:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l1:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l1:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l1:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l1:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l1:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l1:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l1:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="NL" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">Package: galera-3<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">Version: 25.3.19-2<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">Severity: minor<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">Tags: sid<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">The default configuration of Galera-3 systemd scripts for the mariaDB server in debian Sid is incorrect. The secondary (tertiary, etc.) nodes do not connect to the primary node.
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">The problem may also be with one of the ‘systemd’ or ‘mariadb’ packages, and the script may be provided upstream. This information is unknown to me.
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">Reproducing the issue:
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">1) Create 3 connected VMs or connect 3 physical machines on a LAN with a default debian install.
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2) Install the galera-3, mariadb-client, mariadb-server, and rsync packages.
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">3) Configure /etc/mysql/conf.d/galera.cnf with the recommended settings. In my case, each of 3 servers had a configuration file like this (the two bottom lines are changed on a server-to-server
basis): <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">[mysqld]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">#mysql settings<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">binlog_format=ROW<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">default-storage-engine=innodb<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">innodb_autoinc_lock_mode=2<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">innodb_doublewrite=1<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">query_cache_size=0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">query_cache_type=0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">bind-address=0.0.0.0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">#galera settings<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">wsrep_on=ON<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">wsrep_provider=/usr/lib/galera/libgalera_smm.so<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">wsrep_cluster_name="osdb_cluster"<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">wsrep_cluster_address=gcomm://10.0.40.111,10.0.40.112,10.0.40.113<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">wsrep_sst_method=rsync<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">wsrep_node_address="10.0.40.111"<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">wsrep_node_name="galera01"<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">4) Bootstrap the cluster by using the recommended script on the primary node, by calling
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"> $ galera_new_cluster<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">5) Using the recommended way, check whether the cluster is started:
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">MariaDB [(none)]> SHOW STATUS LIKE 'wsrep_cluster_size';<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">+--------------------+-------+<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">| Variable_name | Value |<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">+--------------------+-------+<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">| wsrep_cluster_size | 1 |<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">+--------------------+-------+<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">1 row in set (0.01 sec)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"> <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">6) Now, on the second node, try the recommended way of starting this node (as described on galera's home page):
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"> $ systemctl start mysql<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">Here's where the bug happens. This operation fails with the mysql server not starting on the second node, while we're expecting a two-node cluster. Below is the output passed to the file
'/var/log/mysql/error.log'. <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: Read nil XID from storage engines, skipping position init<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so'<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: wsrep_load(): Galera 3.19(rb98f92f) by Codership Oy <info@codership.com> loaded successfully.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: CRC-32C: using hardware acceleration.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootsrap: 1<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.0.40.113; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict
= 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout
= PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.recover = no; gcache.size = 128M;
gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no;
gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; pc.ig<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: GCache history reset: old(00000000-0000-0000-0000-000000000000:0) -> new(00000000-0000-0000-0000-000000000000:-1)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: wsrep_sst_grab()<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: Start replication<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: protonet asio version 0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: Using CRC-32C for message checksums.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: backend: asio<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: gcomm thread scheduling priority set to other:0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: restore pc from disk failed<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: GMCast version 0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: (f877f818, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: (f877f818, 'tcp://0.0.0.0:4567') multicast: , ttl: 1<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: EVS version 0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: gcomm: connecting to group 'osdb_cluster', peer '10.0.40.111:,10.0.40.112:,10.0.40.113:'<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: (f877f818, 'tcp://0.0.0.0:4567') connection established to f877f818 tcp://10.0.40.113:4567<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Warning] WSREP: (f877f818, 'tcp://0.0.0.0:4567') address 'tcp://10.0.40.113:4567' points to own listening address, blacklisting<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: (f877f818, 'tcp://0.0.0.0:4567') connection established to f5e5497f tcp://10.0.40.112:4567<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: (f877f818, 'tcp://0.0.0.0:4567') connection established to 71b33d37 tcp://10.0.40.111:4567<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: (f877f818, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: declaring 71b33d37 at tcp://10.0.40.111:4567 stable<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: declaring f5e5497f at tcp://10.0.40.112:4567 stable<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:13 139930521723456 [Note] WSREP: view(view_id(NON_PRIM,71b33d37,360) memb {<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"> 71b33d37,0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"> f5e5497f,0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"> f877f818,0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">} joined {<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">} left {<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">} partitioned {<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"> 1d6324f7,0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"> 1e18a4f1,0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"> 2416f453,0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"> 3355448a,0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"> 5fc6bb86,0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"> 62a46c5c,0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"> b1235628,0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">})<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:16 139930521723456 [Note] WSREP: (f877f818, 'tcp://0.0.0.0:4567') connection to peer f877f818 with addr tcp://10.0.40.113:4567 timed out, no messages seen in PT3S<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:16 139930521723456 [Note] WSREP: (f877f818, 'tcp://0.0.0.0:4567') turning message relay requesting off<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:39 139930521723456 [Note] WSREP: (f877f818, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.0.40.112:4567<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:40 139930521723456 [Note] WSREP: (f877f818, 'tcp://0.0.0.0:4567') reconnecting to f5e5497f (tcp://10.0.40.112:4567), attempt 0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:43 139930521723456 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"> at gcomm/src/pc.cpp:connect():158<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:43 139930521723456 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:43 139930521723456 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1380: Failed to open channel 'osdb_cluster' at 'gcomm://10.0.40.111,10.0.40.112,10.0.40.113': -110 (Connection
timed out)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:43 139930521723456 [ERROR] WSREP: gcs connect failed: Connection timed out<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">2017-11-06 17:10:43 139930521723456 [ERROR] WSREP: wsrep::connect(gcomm://10.0.40.111,10.0.40.112,10.0.40.113) failed: 7<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">2017-11-06 17:10:43 139930521723456 [ERROR] Aborting<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">As one can see; the node will not connect to the base node. Normally, this issue would be caused by a network problem. I checked using 'nmap', and the ports galera wants to use by default
are not in use by another service or blocked by a firewall. This is a simple test setup without any firewall or password settings.
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">WORKAROUND: <o:p>
</o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">I believe the problem is caused by an error in the systemctl script for starting mysql. I found a workaround for the problem like so:
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">7) On the second node, manually start mysqld with<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">$ mysqld --wsrep-new-cluster<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">8) Connect with a second terminal and manually kill the mysqld process. (E.g. kill -9 12741, where 12741 is whatever PID got assigned to mysql)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">9) Now start mysql via the recommended way on node 2:
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">$ systemctl start mysql
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">10) Back on node 1; we can run the query to check that the new node was added to the cluster;
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">MariaDB [(none)]> SHOW STATUS LIKE 'wsrep_cluster_size';<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">+--------------------+-------+<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">| Variable_name | Value |<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">+--------------------+-------+<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">| wsrep_cluster_size | 2 |<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">+--------------------+-------+<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">1 row in set (0.01 sec)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">This time, there is no error, and the second cluster node starts up correctly (this process can be repeated for the 3rd, 4th, etc. nodes).
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">CONFIGURATION:
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">Apart from the configuration files mentioned above, no configuration files have been modified (e.g. the config files are the unmodified defaults shipped with mariadb, which sets up a basic
database server with no password protection). <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">$ uname -a <o:p>
</o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas">Linux st01 4.9.0-4-amd64 #1 SMP Debian 4.9.51-1 (2017-09-28) x86_64 GNU/Linux<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">$ cat /etc/issue<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Debian GNU/Linux 9 \n \l<o:p></o:p></span></p>
</div>
</body>
</html>