[00:38:57] <icinga-miraheze>	 RECOVERY - ping4 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 250.17 ms
[01:24:42] <Not-ca25>	 [02miraheze/WikiDiscover] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JmwNC
[01:24:44] <Not-ca25>	 [02miraheze/WikiDiscover] 07paladox 03f4ac3a8 - Fix WikiDiscovery api
[01:24:45] <Not-ca25>	 [02WikiDiscover] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vhUAp
[01:24:47] <Not-ca25>	 [02WikiDiscover] 07paladox opened pull request 03#39: Fix WikiDiscovery api - 13https://git.io/JmwNl
[01:25:48] <miraheze-github>	 miraheze/WikiDiscover - paladox the build passed.
[01:33:44] <Not-ca25>	 [02miraheze/WikiDiscover] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JmwxV
[01:33:45] <Not-ca25>	 [02miraheze/WikiDiscover] 07paladox 03b62adf6 - Update ApiWikiDiscover.php
[01:33:47] <Not-ca25>	 [02WikiDiscover] 07paladox synchronize pull request 03#39: Fix WikiDiscovery api - 13https://git.io/JmwNl
[01:34:52] <miraheze-github>	 miraheze/WikiDiscover - paladox the build passed.
[01:55:38] <Not-ca25>	 [02miraheze/WikiDiscover] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JmrJF
[01:55:39] <Not-ca25>	 [02miraheze/WikiDiscover] 07paladox 034fcf5f7 - Update ApiWikiDiscover.php
[01:55:41] <Not-ca25>	 [02WikiDiscover] 07paladox synchronize pull request 03#39: Fix WikiDiscovery api - 13https://git.io/JmwNl
[01:55:55] <Not-ca25>	 [02WikiDiscover] 07paladox closed pull request 03#39: Fix WikiDiscovery api - 13https://git.io/JmwNl
[01:55:57] <Not-ca25>	 [02miraheze/WikiDiscover] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JmrUe
[01:55:58] <Not-ca25>	 [02miraheze/WikiDiscover] 07paladox 03d69574d - Fix WikiDiscovery api (#39)
[01:56:00] <Not-ca25>	 [02WikiDiscover] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vhUAp
[01:56:01] <Not-ca25>	 [02miraheze/WikiDiscover] 07paladox deleted branch 03paladox-patch-1
[01:56:43] <miraheze-github>	 miraheze/WikiDiscover - paladox the build passed.
[01:56:52] <Not-ca25>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JmrU8
[01:56:54] <Not-ca25>	 [02miraheze/mediawiki] 07paladox 037d2546a - Update WikiDiscover
[01:56:57] <miraheze-github>	 miraheze/WikiDiscover - paladox the build passed.
[02:09:51] <icinga-miraheze>	 PROBLEM - cp12 Current Load on cp12 is CRITICAL: CRITICAL - load average: 1.85, 2.01, 1.46
[02:11:51] <icinga-miraheze>	 RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.94, 1.59, 1.37
[02:39:10] <icinga-miraheze>	 RECOVERY - mail2 IMAP on mail2 is OK: IMAP OK - 0.008 second response time on 51.195.236.253 port 143 [* OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS LOGINDISABLED] Dovecot (Debian) ready.]
[02:54:50] <icinga-miraheze>	 PROBLEM - mail2 IMAP on mail2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[03:54:18] <icinga-miraheze>	 RECOVERY - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 0s
[04:02:41] <icinga-miraheze>	 RECOVERY - mail2 IMAP on mail2 is OK: IMAP OK - 0.012 second response time on 51.195.236.253 port 143 [* OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS LOGINDISABLED] Dovecot (Debian) ready.]
[04:22:59] <icinga-miraheze>	 PROBLEM - mail2 IMAP on mail2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[05:08:26] <icinga-miraheze>	 RECOVERY - mail2 IMAP on mail2 is OK: IMAP OK - 0.009 second response time on 51.195.236.253 port 143 [* OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS LOGINDISABLED] Dovecot (Debian) ready.]
[05:22:46] <icinga-miraheze>	 PROBLEM - mail2 IMAP on mail2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[05:24:41] <icinga-miraheze>	 RECOVERY - mail2 IMAP on mail2 is OK: IMAP OK - 0.009 second response time on 51.195.236.253 port 143 [* OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS LOGINDISABLED] Dovecot (Debian) ready.]
[05:28:52] <icinga-miraheze>	 PROBLEM - mail2 IMAP on mail2 is CRITICAL: No data received from host
[06:09:39] <Not-ca25>	 [02mediawiki] 07Reception123 opened pull request 03#1338: Switch MsCatSelect to REL1_35 (T6997) - 13https://git.io/JmoK2
[06:10:40] <Not-ca25>	 [02mediawiki] 07Reception123 closed pull request 03#1338: Switch MsCatSelect to REL1_35 (T6997) - 13https://git.io/JmoK2
[06:10:41] <Not-ca25>	 [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_35 [+0/-0/±2] 13https://git.io/JmoKx
[06:10:43] <Not-ca25>	 [02miraheze/mediawiki] 07Reception123 03cd8d289 - Switch MsCatSelect to REL1_35 (T6997) (#1338)
[06:22:09] <icinga-miraheze>	 PROBLEM - test3 MediaWiki Rendering on test3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 MediaWiki configuration Error - 1297 bytes in 0.009 second response time
[06:26:10] <icinga-miraheze>	 RECOVERY - test3 MediaWiki Rendering on test3 is OK: HTTP OK: HTTP/1.1 200 OK - 1260 bytes in 0.345 second response time
[06:27:36] <icinga-miraheze>	 RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures
[06:30:09] <icinga-miraheze>	 PROBLEM - test3 MediaWiki Rendering on test3 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 2502 bytes in 0.010 second response time
[06:36:09] <icinga-miraheze>	 PROBLEM - test3 MediaWiki Rendering on test3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 MediaWiki configuration Error - 1297 bytes in 0.022 second response time
[06:36:24] <icinga-miraheze>	 PROBLEM - cp10 Stunnel Http for test3 on cp10 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 338 bytes in 0.003 second response time
[06:36:53] <icinga-miraheze>	 PROBLEM - cp12 Stunnel Http for test3 on cp12 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 338 bytes in 0.233 second response time
[06:37:56] <icinga-miraheze>	 PROBLEM - cp11 Stunnel Http for test3 on cp11 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 338 bytes in 0.007 second response time
[06:37:59] <icinga-miraheze>	 PROBLEM - cp3 Stunnel Http for test3 on cp3 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 338 bytes in 0.788 second response time
[06:40:10] <icinga-miraheze>	 RECOVERY - test3 MediaWiki Rendering on test3 is OK: HTTP OK: HTTP/1.1 200 OK - 1260 bytes in 0.274 second response time
[06:41:57] <icinga-miraheze>	 RECOVERY - cp11 Stunnel Http for test3 on cp11 is OK: HTTP OK: HTTP/1.1 200 OK - 15195 bytes in 0.082 second response time
[06:41:58] <icinga-miraheze>	 RECOVERY - cp3 Stunnel Http for test3 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15195 bytes in 0.997 second response time
[06:43:37] <icinga-miraheze>	 PROBLEM - test3 Puppet on test3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[ExtensionMessageFiles]
[06:44:09] <icinga-miraheze>	 PROBLEM - test3 MediaWiki Rendering on test3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 MediaWiki configuration Error - 1297 bytes in 0.013 second response time
[06:45:58] <icinga-miraheze>	 PROBLEM - cp3 Stunnel Http for test3 on cp3 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 338 bytes in 0.768 second response time
[06:45:58] <icinga-miraheze>	 PROBLEM - cp11 Stunnel Http for test3 on cp11 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 338 bytes in 0.003 second response time
[06:48:10] <icinga-miraheze>	 RECOVERY - test3 MediaWiki Rendering on test3 is OK: HTTP OK: HTTP/1.1 200 OK - 1260 bytes in 0.199 second response time
[06:49:56] <icinga-miraheze>	 RECOVERY - cp11 Stunnel Http for test3 on cp11 is OK: HTTP OK: HTTP/1.1 200 OK - 15195 bytes in 0.011 second response time
[06:49:58] <icinga-miraheze>	 RECOVERY - cp3 Stunnel Http for test3 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15195 bytes in 1.038 second response time
[06:50:24] <icinga-miraheze>	 RECOVERY - cp10 Stunnel Http for test3 on cp10 is OK: HTTP OK: HTTP/1.1 200 OK - 15195 bytes in 0.004 second response time
[06:50:55] <icinga-miraheze>	 RECOVERY - cp12 Stunnel Http for test3 on cp12 is OK: HTTP OK: HTTP/1.1 200 OK - 15195 bytes in 0.318 second response time
[06:52:09] <icinga-miraheze>	 PROBLEM - test3 MediaWiki Rendering on test3 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 2502 bytes in 0.010 second response time
[06:57:36] <icinga-miraheze>	 RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[07:36:15] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is CRITICAL: CRITICAL - load average: 6.15, 5.26, 2.33
[07:38:15] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is WARNING: WARNING - load average: 1.75, 3.91, 2.19
[07:40:15] <icinga-miraheze>	 RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 0.49, 2.70, 1.95
[08:10:18] <icinga-miraheze>	 PROBLEM - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is WARNING: MariaDB replication - both - WARNING - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 174s
[08:12:18] <icinga-miraheze>	 RECOVERY - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 3s
[09:16:18] <icinga-miraheze>	 PROBLEM - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 219s
[10:44:18] <icinga-miraheze>	 RECOVERY - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 0s
[11:10:18] <icinga-miraheze>	 PROBLEM - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is WARNING: MariaDB replication - both - WARNING - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 106s
[11:12:18] <icinga-miraheze>	 RECOVERY - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 0s
[11:51:36] <icinga-miraheze>	 RECOVERY - mail2 IMAP on mail2 is OK: IMAP OK - 0.005 second response time on 51.195.236.253 port 143 [* OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS LOGINDISABLED] Dovecot (Debian) ready.]
[12:37:45] <MH-Discord>	 <R4356th> I got an error 502 after waiting for four minutes to save an edit.
[12:39:08] <MH-Discord>	 <R4356th> Worked again after retrying just now.
[12:44:16] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is WARNING: WARNING - load average: 3.54, 3.12, 1.68
[12:46:16] <icinga-miraheze>	 RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 1.09, 2.26, 1.53
[12:58:18] <icinga-miraheze>	 PROBLEM - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 225s
[13:00:18] <icinga-miraheze>	 PROBLEM - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is WARNING: MariaDB replication - both - WARNING - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 174s
[13:02:18] <icinga-miraheze>	 PROBLEM - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 244s
[13:04:18] <icinga-miraheze>	 RECOVERY - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 65s
[13:08:19] <icinga-miraheze>	 PROBLEM - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 216s
[14:12:18] <icinga-miraheze>	 RECOVERY - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 0s
[14:29:52] <Not-ca25>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JmPv5
[14:29:53] <Not-ca25>	 [02miraheze/puppet] 07paladox 036d3ea72 - mediawiki: Generate vmtouch file dynamically
[14:29:55] <Not-ca25>	 [02puppet] 07paladox created branch 03paladox-patch-3 - 13https://git.io/vbiAS
[14:29:57] <Not-ca25>	 [02puppet] 07paladox opened pull request 03#1719: mediawiki: Generate vmtouch file dynamically - 13https://git.io/JmPvb
[14:40:03] <Not-ca25>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+1/-0/±0] 13https://git.io/JmPk2
[14:40:05] <Not-ca25>	 [02miraheze/puppet] 07paladox 03848efb6 - Create generateVmtouch.py
[14:40:06] <Not-ca25>	 [02puppet] 07paladox synchronize pull request 03#1719: mediawiki: Generate vmtouch file dynamically - 13https://git.io/JmPvb
[14:40:17] <Not-ca25>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-1/±0] 13https://git.io/JmPki
[14:40:18] <Not-ca25>	 [02miraheze/puppet] 07paladox 03da37c7a - Delete vmtouch-mediawiki-files.list
[14:40:20] <Not-ca25>	 [02puppet] 07paladox synchronize pull request 03#1719: mediawiki: Generate vmtouch file dynamically - 13https://git.io/JmPvb
[14:41:12] <Not-ca25>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JmPIL
[14:41:13] <Not-ca25>	 [02miraheze/puppet] 07paladox 037863ce7 - Update init.pp
[14:41:15] <Not-ca25>	 [02puppet] 07paladox synchronize pull request 03#1719: mediawiki: Generate vmtouch file dynamically - 13https://git.io/JmPvb
[14:41:41] <Not-ca25>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JmPIB
[14:41:42] <Not-ca25>	 [02miraheze/puppet] 07paladox 03da8649a - Update vmtouch.systemd.erb
[14:41:44] <Not-ca25>	 [02puppet] 07paladox synchronize pull request 03#1719: mediawiki: Generate vmtouch file dynamically - 13https://git.io/JmPvb
[14:44:38] <Not-ca25>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JmPLA
[14:44:39] <Not-ca25>	 [02miraheze/puppet] 07paladox 03c089dcf - Update generateVmtouch.py
[14:44:41] <Not-ca25>	 [02puppet] 07paladox synchronize pull request 03#1719: mediawiki: Generate vmtouch file dynamically - 13https://git.io/JmPvb
[14:46:18] <icinga-miraheze>	 PROBLEM - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is WARNING: MariaDB replication - both - WARNING - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 142s
[14:50:09] <icinga-miraheze>	 PROBLEM - test3 MediaWiki Rendering on test3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 771 bytes in 0.180 second response time
[14:52:13] <icinga-miraheze>	 RECOVERY - test3 MediaWiki Rendering on test3 is OK: HTTP OK: HTTP/1.1 200 OK - 20745 bytes in 1.007 second response time
[14:54:18] <icinga-miraheze>	 RECOVERY - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 36s
[14:58:37] <Not-ca25>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JmPsp
[14:58:38] <Not-ca25>	 [02miraheze/puppet] 07paladox 03e80f91e - Update init.pp
[14:58:40] <Not-ca25>	 [02puppet] 07paladox synchronize pull request 03#1719: mediawiki: Generate vmtouch file dynamically - 13https://git.io/JmPvb
[14:59:06] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.69, 6.82, 5.52
[15:01:07] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.64, 6.50, 5.57
[15:03:11] <icinga-miraheze>	 PROBLEM - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 207s
[15:07:58] <Not-ca25>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JmPC1
[15:07:59] <Not-ca25>	 [02miraheze/puppet] 07paladox 033ba8339 - Update generateVmtouch.py
[15:08:01] <Not-ca25>	 [02puppet] 07paladox synchronize pull request 03#1719: mediawiki: Generate vmtouch file dynamically - 13https://git.io/JmPvb
[15:10:34] <Not-ca25>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JmPlG
[15:10:34] <Not-ca25>	 [02miraheze/puppet] 07paladox 033b03a5d - Update init.pp
[15:10:36] <Not-ca25>	 [02puppet] 07paladox synchronize pull request 03#1719: mediawiki: Generate vmtouch file dynamically - 13https://git.io/JmPvb
[15:11:30] <icinga-miraheze>	 PROBLEM - mw9 Puppet on mw9 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 7 minutes ago with 0 failures
[15:11:39] <icinga-miraheze>	 PROBLEM - mw10 Puppet on mw10 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 8 minutes ago with 0 failures
[15:11:54] <icinga-miraheze>	 PROBLEM - mw11 Puppet on mw11 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 7 minutes ago with 0 failures
[15:12:40] <icinga-miraheze>	 PROBLEM - mw8 Puppet on mw8 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 9 minutes ago with 0 failures
[15:12:46] <icinga-miraheze>	 PROBLEM - jobrunner4 Puppet on jobrunner4 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 9 minutes ago with 0 failures
[15:12:55] <icinga-miraheze>	 PROBLEM - jobrunner3 Puppet on jobrunner3 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 9 minutes ago with 0 failures
[15:24:14] <Not-ca25>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JmPE2
[15:24:15] <Not-ca25>	 [02miraheze/puppet] 07paladox 034f25781 - Update vmtouch.systemd.erb
[15:24:17] <Not-ca25>	 [02puppet] 07paladox synchronize pull request 03#1719: mediawiki: Generate vmtouch file dynamically - 13https://git.io/JmPvb
[15:26:45] <Not-ca25>	 [02puppet] 07paladox closed pull request 03#1719: mediawiki: Generate vmtouch file dynamically - 13https://git.io/JmPvb
[15:26:46] <Not-ca25>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+1/-1/±2] 13https://git.io/JmPu6
[15:26:48] <Not-ca25>	 [02miraheze/puppet] 07paladox 033a53fb0 - mediawiki: Generate vmtouch file dynamically (#1719)
[15:26:49] <Not-ca25>	 [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-3
[15:26:51] <Not-ca25>	 [02puppet] 07paladox deleted branch 03paladox-patch-3 - 13https://git.io/vbiAS
[15:27:30] <icinga-miraheze>	 RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[15:27:40] <icinga-miraheze>	 RECOVERY - mw10 Puppet on mw10 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[15:27:54] <icinga-miraheze>	 RECOVERY - mw11 Puppet on mw11 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[15:28:41] <icinga-miraheze>	 RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 16 seconds ago with 0 failures
[15:28:46] <icinga-miraheze>	 RECOVERY - jobrunner4 Puppet on jobrunner4 is OK: OK: Puppet is currently enabled, last run 30 seconds ago with 0 failures
[15:28:55] <icinga-miraheze>	 RECOVERY - jobrunner3 Puppet on jobrunner3 is OK: OK: Puppet is currently enabled, last run 37 seconds ago with 0 failures
[15:40:12] <Not-ca25>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JmPrD
[15:40:13] <Not-ca25>	 [02miraheze/services] 07MirahezeSSLBot 03bc49e73 - BOT: Updating services config for wikis
[16:40:15] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is CRITICAL: CRITICAL - load average: 4.30, 3.63, 2.18
[16:41:45] <SPF|Cloud>	 Reception123: https://phabricator.miraheze.org/T4005 can you remove me as the assignee and instead ask your team to work on this?
[16:41:46] <MirahezeBot>	 [ ⚓ T4005 Execute external commands on MediaWiki servers inside sandboxes ] - phabricator.miraheze.org
[16:42:55] <Reception123>	 SPF|Cloud: sure
[16:43:38] <Reception123>	 RhinosF1: ^ would you perhaps be interested in this?
[16:46:15] <icinga-miraheze>	 RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 1.44, 3.33, 2.58
[17:07:25] <Not-ca25>	 [02mediawiki] 07Reception123 opened pull request 03#1339: Switch Editcount to REL1_35 (T6997) - 13https://git.io/JmXOK
[17:09:26] <Not-ca25>	 [02mediawiki] 07Reception123 closed pull request 03#1339: Switch Editcount to REL1_35 (T6997) - 13https://git.io/JmXOK
[17:09:27] <Not-ca25>	 [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_35 [+0/-0/±2] 13https://git.io/JmX3Y
[17:09:29] <Not-ca25>	 [02miraheze/mediawiki] 07Reception123 036a6a77f - Switch Editcount to REL1_35 (T6997) (#1339)
[17:09:47] <Not-ca25>	 [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JmX38
[17:09:49] <Not-ca25>	 [02miraheze/mediawiki] 07Reception123 03d518b24 - ignore dirty for editcount
[17:23:53] <RhinosF1>	 Reception123: i don't mind looking but I won't commit to it
[17:24:00] <RhinosF1>	 I've never used firejail
[17:24:14] <Reception123>	 ok, let me know if you find anything 
[17:40:43] <icinga-miraheze>	 PROBLEM - mw8 Puppet on mw8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[18:04:48] <icinga-miraheze>	 RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures
[18:31:05] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.00, 7.10, 5.55
[18:33:05] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.50, 7.50, 5.92
[18:34:05] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.11, 6.38, 5.23
[18:34:52] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.49, 7.43, 5.61
[18:35:05] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.21, 7.74, 6.19
[18:36:28] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.82, 6.65, 5.33
[18:36:51] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.67, 6.85, 5.62
[18:37:05] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.05, 7.48, 6.29
[18:38:05] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.92, 6.28, 5.48
[18:38:27] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.08, 6.05, 5.26
[18:38:51] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.25, 5.87, 5.41
[18:43:06] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.95, 6.30, 6.20
[19:42:15] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is WARNING: WARNING - load average: 2.98, 3.96, 2.33
[19:44:15] <icinga-miraheze>	 RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 0.82, 2.76, 2.08
[19:59:22] <Not-ca25>	 [02mw-config] 07dmehus commented on pull request 03#3789: Add new "Song Contest" category for CreateWiki - 13https://git.io/Jm1Lg
[20:08:09] <Not-ca25>	 [02mw-config] 07Reception123 commented on pull request 03#3761: Better canned responses - 13https://git.io/Jm1q7
[20:21:48] <Not-ca25>	 [02mw-config] 07dmehus commented on pull request 03#3761: Better canned responses - 13https://git.io/Jm13u
[20:23:25] <Not-ca25>	 [02mw-config] 07dmehus edited a comment on pull request 03#3761: Better canned responses - 13https://git.io/Jm13u
[20:24:45] <Not-ca25>	 [02mw-config] 07dmehus edited a comment on pull request 03#3761: Better canned responses - 13https://git.io/Jm13u
[20:25:57] <Not-ca25>	 [02mw-config] 07dmehus edited a comment on pull request 03#3761: Better canned responses - 13https://git.io/Jm13u
[20:27:07] <Not-ca25>	 [02mw-config] 07R4356th commented on pull request 03#3761: Better canned responses - 13https://git.io/Jm1sx
[20:33:16] <Not-ca25>	 [02mw-config] 07dmehus commented on pull request 03#3761: Better canned responses - 13https://git.io/Jm1Z6
[20:38:23] <SPF|Cloud>	 https://phabricator.miraheze.org/T7003 yet another Cargo bug!
[20:38:24] <MirahezeBot>	 [ ⚓ T7003 Cargo: Error: unclosed string literal. ] - phabricator.miraheze.org
[20:41:30] <MH-Discord>	 <Kozd> the old one from Lake, i just want to point out that Cargo works completely fine on our wiki.
[20:41:51] <MH-Discord>	 <Lake> by the way, I tried to recreate this specific table, delete it, etc. But for some reason it just don't want to be displayed
[20:42:01] <MH-Discord>	 <Lake> but the query works normally somehow
[20:42:50] <SPF|Cloud>	 I've commented on the task
[20:43:06] <MH-Discord>	 <Lake> I tried to see what if it was something on the template itself, but I couldn't find any typo or something
[20:43:30] <SPF|Cloud>	 The issue is that the Moves table has a column called `King's_Rock`
[20:43:51] <MH-Discord>	 <Lake> oh, it's the apostrophe... hmmm weird
[20:43:54] <SPF|Cloud>	 correct
[20:43:58] <MH-Discord>	 <Kozd> told you, sorry.
[20:43:59] <MH-Discord>	 <Lake> because the other tables work normally with accents
[20:44:08] <MH-Discord>	 <Lake> so I assumed it worked with that too
[20:44:09] <SPF|Cloud>	 because there's only one apostrophe, the string is 'unclosed'
[20:44:40] <MH-Discord>	 <Lake> kozd: lol, no problem, it happens :P
[20:45:44] <MH-Discord>	 <Lake> this is only for the parameters on the table, right? I think it doesn't affect the values
[20:45:56] <SPF|Cloud>	 it's only the column
[20:46:13] <SPF|Cloud>	 renaming the column to Kings_Rock or similar will fix the issue
[20:48:18] <SPF|Cloud>	 and https://mariadb.com/kb/en/identifier-names/#quoted says that the single quote (should have called them 'quotes' instead of 'apostrophes', I guess) is a valid character in a column name
[20:48:18] <MirahezeBot>	 [ Identifier Names - MariaDB Knowledge Base ] - mariadb.com
[20:49:17] <SPF|Cloud>	 the extension is at fault here ;)
[20:49:20] <MH-Discord>	 <Kozd> backtick != single quote
[20:49:51] <SPF|Cloud>	 the column name has a single quote, not a backtick
[20:50:22] <MH-Discord>	 <Lake> (i usually just call it apostrophe because it's the only word for it in portuguese, heh, so I remember mostly that)
[20:51:06] <MH-Discord>	 <Lake> but anyway, Cargo works well for me :) The only real "issue" I'm having with it is customization
[20:51:08] <SPF|Cloud>	 but backticks are mandatory in the SQL query, to ensure the single quote becomes part of the column name (identifier), otherwise mariadb interprets the single quote as part of the SQL statement, in which case a similar error (unclosed string literal) will be generated
[20:51:24] <SPF|Cloud>	  select `King's_Rock` from cargo__Moves; works, select King's_Rock from cargo__Moves; generates an error here
[20:53:40] <MH-Discord>	 <Lake> I just use the ' because of my keyboard :p I do have the backtick key, but it's supposed to be used only in the letter a (à)
[20:56:35] <MH-Discord>	 <Lake> by the way, does SMW have problems handling non-ASCII characters?
[20:57:04] <MH-Discord>	 <Kozd> yeah, when you use forward ticks or backticks for the characters like that, they merge into one character itself, the problem here is because how the sql expression is formed it uses ' or doesn't uses them at all, so ' is interpreted wrongly.
[20:58:05] <SPF|Cloud>	 mediawiki quotes identifiers with backticks, as a result quite a lot of characters are allowed SQL-wise
[20:59:38] <MH-Discord>	 <Kozd> https://cdn.discordapp.com/attachments/808001911868489748/822575062720446536/unknown.png
[21:00:04] <MH-Discord>	 <Kozd> yeah, basically instead of deleting the quote, it throws error
[21:00:24] <MH-Discord>	 <Kozd> very strange handling by the extension
[21:00:52] <SPF|Cloud>	 added a few more comments to the task
[21:01:02] <SPF|Cloud>	 Rhinos is right that this should be an upstream task
[21:02:01] <SPF|Cloud>	 indeed, fortunately debugging is fun at times :)
[21:02:04] <MH-Discord>	 <Kozd> i mean the intention is completely different, it removes the text within quotes and quotes itself. but since there is only 1 quote it throws error.
[21:02:30] <MH-Discord>	 <Kozd> the question is why you do that instead of removing the quote or just supporting it, haha.
[21:03:33] <SPF|Cloud>	 don't know, we are able to provide the maintainers with the root cause of this issue, that's what matters
[21:05:00] <SPF|Cloud>	 now it is the maintainer's turn (unless someone from us decides to submit a patch, but that's completely optional) to come with a fix
[21:06:37] <SPF|Cloud>	 protecting miraheze from security incidents has a higher priority on my list of tasks
[21:07:23] <SPF|Cloud>	 (correction: against) anyways, afk
[21:08:18] <icinga-miraheze>	 RECOVERY - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 99s
[21:33:42] <MH-Discord>	 <Lake> by the way, SPF. I removed the quote from my column. But if you need again I can recreate the table (there's only 2 rows for now)
[22:40:18] <icinga-miraheze>	 PROBLEM - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 225s
[22:42:18] <icinga-miraheze>	 RECOVERY - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 0s
[23:53:25] <Universal_Omega>	 paladox: around?
[23:53:30] <paladox>	 yup
[23:55:07] <Universal_Omega>	 paladox: https://phabricator.miraheze.org/T7003#138414 Phabricator spam, mind disabling the user maybe?
[23:55:08] <MirahezeBot>	 [ ⚓ T7003 Cargo: Error: unclosed string literal. ] - phabricator.miraheze.org
[23:55:39] <paladox>	 sure
[23:55:41] <paladox>	 done
[23:55:46] <Universal_Omega>	 Thanks!
[23:55:56] <paladox>	 !log disable user 2247 on phabricator
[23:55:59] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log