[00:02:45] RECOVERY - cp8 Disk Space on cp8 is OK: DISK OK - free space: / 3902 MB (20% inode=93%); [00:19:14] PROBLEM - cp7 Varnish Backends on cp7 is CRITICAL: 3 backends are down. mw5 mw6 mw7 [00:22:32] RECOVERY - cp7 Varnish Backends on cp7 is OK: All 12 backends are healthy [00:28:53] PROBLEM - ping4 on ns1 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 240.86 ms [00:32:24] PROBLEM - ping4 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 140.11 ms [00:35:48] PROBLEM - ping4 on ns1 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 207.57 ms [00:39:11] PROBLEM - ping4 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 134.71 ms [00:56:07] RECOVERY - ping4 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 99.00 ms [01:04:21] PROBLEM - ping4 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 151.89 ms [01:14:25] PROBLEM - ping4 on ns1 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 251.32 ms [01:17:50] PROBLEM - ping4 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 143.55 ms [01:24:33] RECOVERY - ping4 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 95.12 ms [01:32:43] PROBLEM - ping4 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 175.14 ms [01:39:28] RECOVERY - ping4 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 94.65 ms [06:20:13] PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 6 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[nagios-plugins] [06:21:37] PROBLEM - puppet2 Disk Space on puppet2 is WARNING: DISK WARNING - free space: / 1443 MB (10% inode=87%); [06:25:41] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 2826 MB (11% inode=94%); [06:26:47] RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 3 minutes ago with 0 failures [08:16:40] PROBLEM - puppet2 Disk Space on puppet2 is CRITICAL: DISK CRITICAL - free space: / 770 MB (5% inode=87%); [08:29:30] RECOVERY - puppet2 Disk Space on puppet2 is OK: DISK OK - free space: / 2370 MB (17% inode=87%); [11:20:58] PROBLEM - puppet2 Disk Space on puppet2 is WARNING: DISK WARNING - free space: / 1451 MB (10% inode=87%); [13:17:16] PROBLEM - puppet2 Disk Space on puppet2 is CRITICAL: DISK CRITICAL - free space: / 773 MB (5% inode=87%); [13:20:29] RECOVERY - puppet2 Disk Space on puppet2 is OK: DISK OK - free space: / 7460 MB (55% inode=87%); [13:20:43] !log root@puppet2:/opt/puppetlabs/server/data/puppetserver/reports# rm -rf * [13:20:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [14:05:51] just waiting for the day someone logs ‘root@hostname: /# rm -rf *’, followed by an ‘oh shit’ [14:06:52] lol [15:15:40] Wait so does !log run the command? [15:16:01] no [15:16:03] Or does it just add it to the page? [15:16:11] just adds it to the page [15:17:44] For some reason that reminds me of https://xkcd.com/327/ [15:17:44] https://xkcd.com/327 | Exploits of a Mom | Alt-text: Her daughter is named Help I'm trapped in a driver's license factory. [15:17:46] https://xkcd.com/327 | Exploits of a Mom | Alt-text: Her daughter is named Help I'm trapped in a driver's license factory. [15:18:38] heh [16:52:33] Hello Gustavfn! If you have any questions, feel free to ask and someone should answer soon. [16:52:39] Hi! [16:56:04] Hi [16:56:40] Do you have a wiki with miraheze? [16:57:55] I have to go. Bye. [16:57:57] I have a few [16:58:05] Oh. Cool! I'll be back [18:03:39] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvieF [18:03:40] [02miraheze/puppet] 07paladox 03a814e47 - mediawiki: Switch to gluster1 [18:14:56] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://git.io/JvivL [18:14:58] [02miraheze/puppet] 07paladox 0393a7304 - varnish: Depool lizardfs6 and replace with mw4 [18:14:59] [02puppet] 07paladox created branch 03paladox-patch-5 - 13https://git.io/vbiAS [18:15:01] [02puppet] 07paladox opened pull request 03#1288: varnish: Depool lizardfs6 and replace with mw4 - 13https://git.io/Jvivm [18:15:27] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://git.io/JvivY [18:15:28] [02miraheze/puppet] 07paladox 03e3ea4c3 - Update stunnel.conf [18:15:28] paladox: update checksheet on merge pls [18:15:30] [02puppet] 07paladox synchronize pull request 03#1288: varnish: Depool lizardfs6 and replace with mw4 - 13https://git.io/Jvivm [18:15:42] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://git.io/Jviv3 [18:15:43] [02miraheze/puppet] 07paladox 03bef31ec - Update varnish.pp [18:15:45] [02puppet] 07paladox synchronize pull request 03#1288: varnish: Depool lizardfs6 and replace with mw4 - 13https://git.io/Jvivm [18:16:01] [02puppet] 07paladox closed pull request 03#1288: varnish: Depool lizardfs6 and replace with mw4 - 13https://git.io/Jvivm [18:16:03] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/JvivG [18:16:04] [02miraheze/puppet] 07paladox 03bcd96ef - varnish: Depool lizardfs6 and replace with mw4 (#1288) * varnish: Depool lizardfs6 and replace with mw4 * Update stunnel.conf * Update varnish.pp [18:16:06] [02puppet] 07paladox deleted branch 03paladox-patch-5 - 13https://git.io/vbiAS [18:16:07] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-5 [18:22:05] [18:23:57] PROBLEM - cp8 Stunnel Http for mw4 on cp8 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [18:25:36] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 128.199.139.216/cpweb [18:27:39] PROBLEM - cp3 Stunnel Http for mw4 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [18:29:15] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/Jviv6 [18:29:17] [02miraheze/puppet] 07paladox 0363dc02e - Revert "varnish: Depool lizardfs6 and replace with mw4 (#1288)" This reverts commit bcd96ef98856583fb4e4eee70139dea4af1796ae. [18:29:19] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [18:31:25] RECOVERY - cp3 Stunnel Http for mw4 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15316 bytes in 0.869 second response time [18:31:34] RECOVERY - cp8 Stunnel Http for mw4 on cp8 is OK: HTTP OK: HTTP/1.1 200 OK - 15316 bytes in 0.322 second response time [18:59:38] .at 21:00 update markblockedusers.js (test/meta?wiki) [18:59:38] RhinosF1: Okay, I will set the reminder for: 2020-03-13 - 20:59:59UTC [19:00:08] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvifT [19:00:10] [02miraheze/services] 07MirahezeSSLBot 0308fd219 - BOT: Updating services config for wikis [19:35:07] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JviJU [19:35:09] [02miraheze/services] 07MirahezeSSLBot 033917277 - BOT: Updating services config for wikis [20:18:44] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2649 MB (10% inode=94%); [20:57:00] RhinosF1: can i recommend the bot flag next time [20:58:51] Zppix: yes [20:59:59] RhinosF1: update markblockedusers.js (test/meta?wiki) [21:02:58] !log rename godaigowiki to brambowiki [21:03:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [21:03:27] PROBLEM - cp8 Disk Space on cp8 is WARNING: DISK WARNING - free space: / 2106 MB (10% inode=93%);