[00:07:21] PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 1 backends are down. mw1 [00:08:41] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [00:09:20] PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 1 backends are down. mw2 [00:11:05] RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy [00:12:00] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy [00:12:25] RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy [06:28:21] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 2893 MB (12% inode=94%); [09:35:43] PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 1 backends are down. mw3 [09:35:44] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 1 datacenter is down: 2604:180:0:33b::2/cpweb [09:36:20] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 1 backends are down. mw3 [09:38:19] RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy [09:38:19] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [09:39:00] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy [10:25:09] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JessS [10:25:10] [02miraheze/services] 07MirahezeSSLBot 03901df28 - BOT: Updating services config for wikis [11:52:47] hi. [12:05:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JesZ2 [12:05:13] [02miraheze/services] 07MirahezeSSLBot 035f708ee - BOT: Updating services config for wikis [12:08:13] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2651 MB (10% inode=94%); [12:08:58] hispano76_: hi [12:18:44] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 3.88, 3.68, 2.86 [12:22:12] PROBLEM - glusterfs2 Current Load on glusterfs2 is CRITICAL: CRITICAL - load average: 7.22, 4.74, 3.40 [12:27:53] RECOVERY - glusterfs2 Current Load on glusterfs2 is OK: OK - load average: 1.89, 3.02, 3.11 [12:37:45] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 2.94, 3.55, 3.39 [12:40:40] RECOVERY - glusterfs2 Current Load on glusterfs2 is OK: OK - load average: 3.06, 3.23, 3.29 [12:41:26] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_33 [+0/-0/±1] 13https://git.io/JesnL [12:41:28] [02miraheze/mediawiki] 07paladox 039a40728 - Update DiscordNotifications [12:42:09] paladox: thx [12:45:01] !log runninc lc on mw* [12:45:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [12:48:10] PROBLEM - glusterfs2 Current Load on glusterfs2 is CRITICAL: CRITICAL - load average: 6.06, 5.10, 4.18 [12:56:51] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 1.51, 3.62, 3.92 [12:59:41] PROBLEM - glusterfs2 Current Load on glusterfs2 is CRITICAL: CRITICAL - load average: 4.21, 3.62, 3.85 [13:15:00] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 2.45, 3.51, 3.90 [13:20:58] PROBLEM - glusterfs2 Current Load on glusterfs2 is CRITICAL: CRITICAL - load average: 4.37, 3.56, 3.75 [13:21:35] revi: when you get a moment https://meta.miraheze.org/wiki/Special:RequestWikiQueue/9323 [13:21:36] [ Wiki requests queue - Miraheze Meta ] - meta.miraheze.org [13:58:03] PROBLEM - glusterfs1 Current Load on glusterfs1 is CRITICAL: CRITICAL - load average: 4.96, 4.19, 3.54 [13:59:48] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JescU [13:59:49] [02miraheze/mw-config] 07paladox 0308d86c8 - Make test1 always use the new mount [14:16:04] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 1 backends are down. mw2 [14:18:54] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy [14:20:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JescR [14:20:13] [02miraheze/services] 07MirahezeSSLBot 039014dab - BOT: Updating services config for wikis [14:20:48] PROBLEM - glusterfs1 Current Load on glusterfs1 is WARNING: WARNING - load average: 3.48, 3.53, 3.95 [14:24:18] PROBLEM - glusterfs1 Current Load on glusterfs1 is CRITICAL: CRITICAL - load average: 3.54, 4.05, 4.12 [14:27:31] PROBLEM - glusterfs1 Current Load on glusterfs1 is WARNING: WARNING - load average: 2.34, 3.26, 3.80 [14:30:34] PROBLEM - glusterfs1 Current Load on glusterfs1 is CRITICAL: CRITICAL - load average: 5.99, 3.93, 3.91 [14:40:17] PROBLEM - glusterfs1 Current Load on glusterfs1 is WARNING: WARNING - load average: 2.79, 3.48, 3.89 [14:43:25] PROBLEM - glusterfs1 Current Load on glusterfs1 is CRITICAL: CRITICAL - load average: 4.37, 3.95, 3.99 [14:43:57] paladox: what's gluster fouhn? [14:44:04] s/fouhn/doing [14:44:04] RhinosF1 meant to say: paladox: what's gluster doing? [14:44:15] i'm rsyncing per -staff [14:44:26] Ok [14:46:31] PROBLEM - glusterfs1 Current Load on glusterfs1 is WARNING: WARNING - load average: 1.18, 2.90, 3.59 [14:49:16] RECOVERY - glusterfs1 Current Load on glusterfs1 is OK: OK - load average: 1.52, 2.25, 3.22 [14:49:55] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 1.18, 2.31, 3.58 [14:53:15] PROBLEM - glusterfs2 Current Load on glusterfs2 is CRITICAL: CRITICAL - load average: 4.33, 3.28, 3.72 [14:56:06] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 2.82, 3.46, 3.75 [14:59:06] Thanks revi [14:59:09] (Farmer log); 23:58 Revi talk contribs block created the wiki "salvationwikiwiki" ‎(Requested) [14:59:34] Thanks for that revi [14:59:48] :-) [15:01:43] RECOVERY - glusterfs2 Current Load on glusterfs2 is OK: OK - load average: 1.77, 2.22, 3.09 [15:08:56] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 2.75, 3.33, 3.50 [15:14:59] PROBLEM - glusterfs2 Current Load on glusterfs2 is CRITICAL: CRITICAL - load average: 4.15, 4.01, 3.72 [15:15:16] PROBLEM - glusterfs1 Current Load on glusterfs1 is WARNING: WARNING - load average: 3.53, 3.78, 3.31 [15:18:03] PROBLEM - glusterfs1 Current Load on glusterfs1 is CRITICAL: CRITICAL - load average: 4.06, 3.98, 3.46 [15:27:27] PROBLEM - glusterfs1 Current Load on glusterfs1 is WARNING: WARNING - load average: 2.33, 3.76, 3.75 [15:33:23] PROBLEM - glusterfs1 Current Load on glusterfs1 is CRITICAL: CRITICAL - load average: 5.44, 3.86, 3.70 [15:36:32] PROBLEM - glusterfs1 Current Load on glusterfs1 is WARNING: WARNING - load average: 2.41, 3.57, 3.65 [15:36:32] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 2.67, 3.49, 4.00 [15:39:47] PROBLEM - glusterfs2 Current Load on glusterfs2 is CRITICAL: CRITICAL - load average: 4.63, 3.92, 4.05 [15:42:58] PROBLEM - glusterfs1 Current Load on glusterfs1 is CRITICAL: CRITICAL - load average: 5.91, 4.14, 3.80 [15:46:22] PROBLEM - glusterfs1 Current Load on glusterfs1 is WARNING: WARNING - load average: 3.01, 3.51, 3.62 [15:52:19] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 3.75, 3.62, 3.95 [15:55:39] PROBLEM - glusterfs2 Current Load on glusterfs2 is CRITICAL: CRITICAL - load average: 4.92, 4.71, 4.36 [15:58:59] RECOVERY - glusterfs1 Current Load on glusterfs1 is OK: OK - load average: 1.18, 2.52, 3.13 [15:59:03] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 1.40, 3.35, 3.90 [16:03:15] PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 1 backends are down. mw1 [16:05:29] RECOVERY - glusterfs2 Current Load on glusterfs2 is OK: OK - load average: 1.50, 2.26, 3.23 [16:06:31] RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy [16:12:31] PROBLEM - glusterfs2 Current Load on glusterfs2 is CRITICAL: CRITICAL - load average: 4.83, 3.64, 3.46 [16:15:36] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 3.70, 3.59, 3.47 [16:18:49] PROBLEM - glusterfs2 Current Load on glusterfs2 is CRITICAL: CRITICAL - load average: 4.89, 4.27, 3.76 [16:28:07] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 2.44, 3.93, 3.93 [16:31:02] PROBLEM - glusterfs2 Current Load on glusterfs2 is CRITICAL: CRITICAL - load average: 5.57, 4.42, 4.10 [16:35:14] PROBLEM - glusterfs1 Current Load on glusterfs1 is CRITICAL: CRITICAL - load average: 4.30, 4.60, 3.83 [16:35:50] paladox: ^ meta a tad slow as well [16:38:45] PROBLEM - glusterfs1 Current Load on glusterfs1 is WARNING: WARNING - load average: 2.56, 3.52, 3.56 [16:42:04] PROBLEM - glusterfs1 Current Load on glusterfs1 is CRITICAL: CRITICAL - load average: 4.48, 3.94, 3.71 [16:42:28] I’m currently mobile, should recover [16:45:05] PROBLEM - glusterfs1 Current Load on glusterfs1 is WARNING: WARNING - load average: 2.60, 3.50, 3.59 [16:47:55] RECOVERY - glusterfs1 Current Load on glusterfs1 is OK: OK - load average: 2.50, 3.00, 3.37 [16:55:40] PROBLEM - glusterfs1 Current Load on glusterfs1 is CRITICAL: CRITICAL - load average: 3.73, 4.30, 3.86 [16:58:35] PROBLEM - glusterfs1 Current Load on glusterfs1 is WARNING: WARNING - load average: 2.75, 3.46, 3.60 [16:59:18] paladox: seems to [16:59:29] Do quickly but u said say something [16:59:33] Last night [17:03:51] Yup [17:04:49] RECOVERY - glusterfs1 Current Load on glusterfs1 is OK: OK - load average: 2.07, 2.92, 3.36 [17:05:46] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 1.70, 2.91, 3.85 [17:11:36] PROBLEM - glusterfs2 Current Load on glusterfs2 is CRITICAL: CRITICAL - load average: 4.90, 3.31, 3.65 [17:14:36] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 3.06, 3.40, 3.64 [17:17:24] PROBLEM - glusterfs2 Current Load on glusterfs2 is CRITICAL: CRITICAL - load average: 4.64, 3.54, 3.63 [17:20:16] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 3.08, 3.15, 3.45 [17:21:16] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.84, 1.62, 1.27 [17:23:27] PROBLEM - glusterfs2 Current Load on glusterfs2 is CRITICAL: CRITICAL - load average: 5.76, 4.82, 4.10 [17:24:28] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 1.38, 1.54, 1.30 [17:38:23] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 2.47, 3.43, 3.86 [17:44:42] PROBLEM - glusterfs2 Current Load on glusterfs2 is CRITICAL: CRITICAL - load average: 4.83, 4.52, 4.16 [17:50:20] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 3.02, 3.56, 3.86 [17:53:32] PROBLEM - glusterfs2 Current Load on glusterfs2 is CRITICAL: CRITICAL - load average: 5.99, 4.96, 4.36 [18:04:15] PROBLEM - glusterfs1 Current Load on glusterfs1 is CRITICAL: CRITICAL - load average: 4.51, 3.91, 3.42 [18:07:28] PROBLEM - glusterfs1 Current Load on glusterfs1 is WARNING: WARNING - load average: 2.52, 3.59, 3.42 [18:10:31] RECOVERY - glusterfs1 Current Load on glusterfs1 is OK: OK - load average: 2.41, 2.84, 3.14 [18:14:57] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 2.98, 3.25, 3.91 [18:18:08] PROBLEM - glusterfs2 Current Load on glusterfs2 is CRITICAL: CRITICAL - load average: 3.81, 3.97, 4.11 [18:27:09] PROBLEM - glusterfs1 Current Load on glusterfs1 is WARNING: WARNING - load average: 3.32, 3.47, 3.30 [18:31:32] PROBLEM - glusterfs1 Current Load on glusterfs1 is CRITICAL: CRITICAL - load average: 7.05, 6.06, 4.48 [18:33:32] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [18:44:34] PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 2 backends are down. mw2 mw3 [18:44:37] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [18:46:39] PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 2 backends are down. mw2 mw3 [18:47:17] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [18:48:09] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [18:48:09] RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy [18:48:39] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [18:49:37] RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy [18:50:14] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy [19:24:10] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 1 backends are down. mw1 [19:27:28] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy [19:48:42] PROBLEM - glusterfs1 Current Load on glusterfs1 is WARNING: WARNING - load average: 1.46, 2.81, 3.74 [19:54:37] RECOVERY - glusterfs1 Current Load on glusterfs1 is OK: OK - load average: 2.35, 2.66, 3.38 [19:57:26] PROBLEM - glusterfs2 Current Load on glusterfs2 is WARNING: WARNING - load average: 0.80, 2.10, 3.72 [20:00:29] RECOVERY - glusterfs2 Current Load on glusterfs2 is OK: OK - load average: 1.36, 1.58, 3.21 [20:11:19] paladox: meta 503 [20:15:27] ^ back [20:16:33] PROBLEM - wc.miraheze.org on sslhost is WARNING: WARNING - Certificate '*.miraheze.org' expires in 30 day(s) (Wed 23 Oct 2019 08:12:13 PM GMT +0000). [20:17:00] PROBLEM - tallguysfree.miraheze.org - GlobalSign on sslhost is WARNING: WARNING - Certificate '*.miraheze.org' expires in 30 day(s) (Wed 23 Oct 2019 08:12:13 PM GMT +0000). [20:17:04] PROBLEM - hellointernet.miraheze.org - GlobalSign on sslhost is WARNING: WARNING - Certificate '*.miraheze.org' expires in 30 day(s) (Wed 23 Oct 2019 08:12:13 PM GMT +0000). [20:17:09] PROBLEM - unmade.miraheze.org - GlobalSign on sslhost is WARNING: WARNING - Certificate '*.miraheze.org' expires in 30 day(s) (Wed 23 Oct 2019 08:12:13 PM GMT +0000). [20:17:10] PROBLEM - piwik.miraheze.org - GlobalSign on sslhost is WARNING: WARNING - Certificate '*.miraheze.org' expires in 30 day(s) (Wed 23 Oct 2019 08:12:13 PM GMT +0000). [20:17:11] PROBLEM - cnt.miraheze.org - GlobalSign on sslhost is WARNING: WARNING - Certificate '*.miraheze.org' expires in 30 day(s) (Wed 23 Oct 2019 08:12:13 PM GMT +0000). [20:17:16] PROBLEM - commonswiki.miraheze.org - GlobalSign on sslhost is WARNING: WARNING - Certificate '*.miraheze.org' expires in 30 day(s) (Wed 23 Oct 2019 08:12:13 PM GMT +0000). [20:17:25] SPF|Cloud: ^ [20:17:26] PROBLEM - sims.miraheze.org - GlobalSign on sslhost is WARNING: WARNING - Certificate '*.miraheze.org' expires in 30 day(s) (Wed 23 Oct 2019 08:12:13 PM GMT +0000). [20:17:48] PROBLEM - intp.miraheze.org - GlobalSign on sslhost is WARNING: WARNING - Certificate '*.miraheze.org' expires in 30 day(s) (Wed 23 Oct 2019 08:12:13 PM GMT +0000). [20:18:19] ^ known [20:18:46] PROBLEM - marthaspeaks.miraheze.org - GlobalSign on sslhost is WARNING: WARNING - Certificate '*.miraheze.org' expires in 30 day(s) (Wed 23 Oct 2019 08:12:13 PM GMT +0000). [20:18:48] PROBLEM - studynotekr.miraheze.org - GlobalSign on sslhost is WARNING: WARNING - Certificate '*.miraheze.org' expires in 30 day(s) (Wed 23 Oct 2019 08:12:13 PM GMT +0000). [20:25:33] hmm [20:25:33] ok [20:29:49] RhinosF1: I cannot do anything, it's on GlobalSign to help me [20:30:04] SPF|Cloud: k [20:30:37] Though if shit hits the fan we can issue a LetsEncrypt certificate [20:30:43] ^ [20:38:07] SPF|Cloud: you may want to clarify that cause shit hitting the fan could mean a 503 :P [21:00:13] [02puppet] 07paladox created branch 03paladox-patch-4 - 13https://git.io/vbiAS [21:00:15] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+1/-0/±0] 13https://git.io/JesBy [21:00:16] [02miraheze/puppet] 07paladox 036d22c56 - gluster: Upgrade to gluster 6 [21:00:18] [02puppet] 07paladox opened pull request 03#1090: gluster: Upgrade to gluster 6 - 13https://git.io/JesBS [21:02:09] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JesB7 [21:02:10] [02miraheze/puppet] 07paladox 03b351e00 - Update init.pp [21:02:12] [02puppet] 07paladox synchronize pull request 03#1090: gluster: Upgrade to gluster 6 - 13https://git.io/JesBS [21:02:37] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JesB5 [21:02:38] [02miraheze/puppet] 07paladox 0360b4bcc - Update mount.pp [21:02:40] [02puppet] 07paladox synchronize pull request 03#1090: gluster: Upgrade to gluster 6 - 13https://git.io/JesBS [21:02:50] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JesBF [21:02:51] [02miraheze/puppet] 07paladox 03d9b615b - Update apt.pp [21:02:53] [02puppet] 07paladox synchronize pull request 03#1090: gluster: Upgrade to gluster 6 - 13https://git.io/JesBS [21:03:38] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JesBN [21:03:39] [02miraheze/puppet] 07paladox 03a121357 - Update apt.pp [21:03:41] [02puppet] 07paladox synchronize pull request 03#1090: gluster: Upgrade to gluster 6 - 13https://git.io/JesBS [21:05:18] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JesBh [21:05:20] [02miraheze/puppet] 07paladox 035c79fd0 - Update apt.pp [21:05:21] [02puppet] 07paladox synchronize pull request 03#1090: gluster: Upgrade to gluster 6 - 13https://git.io/JesBS [21:05:34] paladox: hey, do you want puppet? [21:05:35] xD [21:05:44] lol [21:05:51] * paladox sends Zppix to the circus :P [21:06:05] paladox: why you sending me to the circus [21:06:15] So you can be a puppet :) [21:07:07] [02puppet] 07paladox closed pull request 03#1090: gluster: Upgrade to gluster 6 - 13https://git.io/JesBS [21:07:08] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+1/-0/±2] 13https://git.io/JesRe [21:07:10] [02miraheze/puppet] 07paladox 032794387 - gluster: Upgrade to gluster 6 (#1090) * gluster: Upgrade to gluster 6 * Update init.pp * Update mount.pp * Update apt.pp * Update apt.pp * Update apt.pp [21:07:52] hello. Does anybody have experience with $wgForeignFileRepos ? How many items can it contain practically? [21:08:36] paladox: ^ ? [21:08:56] qq[IrcCity] hi, what do you mean exactly by that? [21:09:04] [02puppet] 07paladox deleted branch 03paladox-patch-4 - 13https://git.io/vbiAS [21:09:05] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-4 [21:09:23] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JesRv [21:09:25] [02miraheze/puppet] 07paladox 034bb83b6 - Fix syntax [21:09:39] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JesRf [21:09:41] [02miraheze/puppet] 07paladox 03df0e9fe - Update mount.pp [21:10:47] paladox: may some foreign wiki rely on commons.miraheze in supplement to commons.wikimedia and local storage? [21:10:59] yes [21:11:06] you can have as many as you want i think [21:11:22] that's how it's currently setup iirc [21:12:27] It is in-house setup, but there could be objections if somebody third-party would use Miraheze bandwidth. [21:14:19] moreover, even tries to reach a file (which does not exist on specific repo) generate some load. [21:15:01] oh, ok [21:17:48] !log depool mw1 and repool (disabling mediawiki-static-new mount to prevent wikis going down) [21:17:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [21:18:38] !log depool mw2 and repool (disabling mediawiki-static-new mount to prevent wikis going down) [21:18:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [21:19:03] qq[IrcCity]: if you supply a user agent to each request containing your website or email address we can contact you in the case of issues [21:19:30] !log depool mw3 and repool (disabling mediawiki-static-new mount to prevent wikis going down) [21:19:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [21:19:35] Which may be helpful to prevent us from blocking your IPs :) [21:23:56] PROBLEM - mw2 Puppet on mw2 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 11 minutes ago with 0 failures [21:24:21] PROBLEM - mw1 Puppet on mw1 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 11 minutes ago with 0 failures [21:25:28] PROBLEM - mw3 Puppet on mw3 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 3 minutes ago with 0 failures [21:27:50] !log upgrade glusterfs on glusterfs[12] to 6.5 [21:27:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [21:32:44] PROBLEM - glusterfs1 GlusterFS port 49152 on glusterfs1 is CRITICAL: connect to address 81.4.100.90 and port 49152: Connection refused [21:42:45] RECOVERY - glusterfs1 GlusterFS port 49152 on glusterfs1 is OK: TCP OK - 0.001 second response time on 81.4.100.90 port 49152 [21:43:10] !log depool and repool mw[123] (upgrading gluster client to 6.5) [21:43:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [21:46:12] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:48:49] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [21:49:42] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:07:15] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JesRx [22:07:16] [02miraheze/mw-config] 07paladox 0327fae19 - Revert "Revert "Move sidemwiki to new mount"" This reverts commit 85dbff70a0aca76966bb69ab434daa18e783c3c4. Change-Id: Ic9d59fcc9f7555c38a41ef4b1439d973971a9d3c [22:07:47] first one to 10 reverts in one commit msg win paladox [22:08:21] lol [22:09:51] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 22 seconds ago with 0 failures [22:47:32] [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbvb3 [22:47:33] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/Jes0g [22:47:35] [02miraheze/mw-config] 07paladox 039f85cde - Move browndustwiki to new mount [22:47:36] [02mw-config] 07paladox opened pull request 03#2768: Move browndustwiki to new mount - 13https://git.io/Jes02 [22:51:47] [02mw-config] 07paladox closed pull request 03#2768: Move browndustwiki to new mount - 13https://git.io/Jes02 [22:51:48] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jes0o [22:51:50] [02miraheze/mw-config] 07paladox 0312defd5 - Move browndustwiki to new mount (#2768) [22:51:51] [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbvb3 [22:51:53] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1 [22:59:41] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 6 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki config] [23:15:08] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures