[00:29:11] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is WARNING: WARNING - load average: 2.97, 3.47, 1.99
[00:29:14] <Not-71a9>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtQHc
[00:29:16] <Not-71a9>	 [02miraheze/puppet] 07paladox 0334f0911 - syslog: Add timestamp to output
[00:29:17] <Not-71a9>	 [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbiAS
[00:29:26] <Not-71a9>	 [02puppet] 07paladox opened pull request 03#1661: syslog: Add timestamp to output - 13https://git.io/JtQHW
[00:30:31] <Not-71a9>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtQHu
[00:30:32] <Not-71a9>	 [02miraheze/puppet] 07paladox 03c2cf290 - Update syslog.pp
[00:30:34] <Not-71a9>	 [02puppet] 07paladox synchronize pull request 03#1661: syslog: Add timestamp to output - 13https://git.io/JtQHW
[00:30:47] <Not-71a9>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtQHz
[00:30:48] <Not-71a9>	 [02miraheze/puppet] 07paladox 0391c81f8 - Update syslog.pp
[00:30:50] <Not-71a9>	 [02puppet] 07paladox synchronize pull request 03#1661: syslog: Add timestamp to output - 13https://git.io/JtQHW
[00:31:11] <icinga-miraheze>	 RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 0.45, 2.35, 1.76
[00:44:12] <Universal_Omega>	 !log sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=terribletvshowswiki --r "[[phab:T6888|Requested]]" /home/universalomega/threads.txt
[00:44:15] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:53:55] <Universal_Omega>	 !log universalomega@jobrunner4:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=terribletvshowswiki --r "[[phab:T6888|Requested]]" /home/universalomega/comments.txt
[00:53:58] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:54:08] <Universal_Omega>	 !log universalomega@jobrunner4:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=terribletvshowswiki --r "[[phab:T6888|Requested]]" /home/universalomega/blogs.txt
[00:54:11] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:54:15] <Universal_Omega>	 !log universalomega@jobrunner4:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=terribletvshowswiki --r "[[phab:T6888|Requested]]" /home/universalomega/blogcomments.txt
[00:54:18] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[02:15:40] <icinga-miraheze>	 RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[02:26:15] <paladox>	 !log restart dovecot on mail2
[02:26:19] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[02:26:42] <icinga-miraheze>	 RECOVERY - mail2 IMAP on mail2 is OK: IMAP OK - 0.006 second response time on 51.195.236.253 port 143 [* OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS LOGINDISABLED] Dovecot (Debian) ready.]
[03:06:43] <dmehus>	 Universal_Omega, there's > 175 jobs outstanding on `metawiki`
[03:07:14] <dmehus>	 or, failing Omega, paladox
[10:33:18] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is WARNING: WARNING - load average: 1.51, 3.91, 2.57
[10:35:17] <icinga-miraheze>	 RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 0.40, 2.69, 2.28
[13:59:54] <RhinosF1>	 SPF|Cloud: around?
[14:35:14] <JohnLewis>	 RhinosF1: anything particular?
[14:39:47] <Not-71a9>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt7KW
[14:39:49] <Not-71a9>	 [02miraheze/puppet] 07paladox 03d885fb7 - matomo: Upgrade to 4.2.0
[14:41:26] <RhinosF1>	 JohnLewis: want his opinion on something
[14:41:42] <JohnLewis>	 Okay
[14:42:33] <RhinosF1>	 JohnLewis: something you can look at is the trolls claiming to be Amanda. I think reception just locked another account and MrJaroslavik did one earlier
[14:42:45] <RhinosF1>	 Reception123 was saying their not confident it's actually Amanda
[14:43:22] <JohnLewis>	 Behavioural wise, it's completely out of key
[14:43:40] <MH-Discord>	 <MrJaroslavik> I locked about 5 users, but some was accidentally marked as bot :(
[14:47:19] <RhinosF1>	 JohnLewis: I mean from what I know it seems it but I think when void checked one last night they were VPNs
[14:47:30] <RhinosF1>	 So technically a pain to tell if it is
[14:48:32] <JohnLewis>	 Considering we're going back almost 4 years, CU would not be of much value in terms of technical evidence anyway
[14:48:48] <RhinosF1>	 True
[14:49:01] <RhinosF1>	 But over 90 days
[14:49:11] <JohnLewis>	 4 years is enough for some people to just move cities, countries etc.
[14:49:17] <RhinosF1>	 Unless it was always a common range it's not gonna do much
[14:49:25] <RhinosF1>	 And yeah you can move in that time
[14:51:59] <Reception123>	 yeah, and either way it would appear the one from yesterday was a proxy/VPN
[15:30:41] <icinga-miraheze>	 PROBLEM - reviwiki.info - PositiveSSLDV on sslhost is WARNING: WARNING - Certificate 'reviwiki.info' expires in 30 day(s) (Fri 26 Mar 2021 15:22:32 GMT +0000).
[15:35:33] <RhinosF1>	 That should be LE now
[15:38:12] <Not-71a9>	 [02ssl] 07RhinosF1 opened pull request 03#390: Update redirects.yaml - 13https://git.io/Jt71W
[15:38:23] <RhinosF1>	 paladox: ^
[15:39:30] <Not-71a9>	 [02ssl] 07paladox closed pull request 03#390: Update redirects.yaml - 13https://git.io/Jt71W
[15:39:31] <Not-71a9>	 [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt71z
[15:39:33] <Not-71a9>	 [02miraheze/ssl] 07RhinosF1 03a2f885b - Update redirects.yaml (#390)
[15:40:08] <RhinosF1>	 paladox: I assume ssl bot will auto get on with renewing that when it's time
[15:40:27] <paladox>	 well we renew at 15 days
[15:41:00] <RhinosF1>	 Yeah
[15:41:17] <RhinosF1>	 But no action needed by us now it has the right type
[15:51:20] <Not-71a9>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/Jt7M0
[15:51:22] <Not-71a9>	 [02miraheze/puppet] 07paladox 03ad7698f - dovecot: Expose stats
[15:51:23] <Not-71a9>	 [02puppet] 07paladox created branch 03paladox-patch-3 - 13https://git.io/vbiAS
[15:51:25] <Not-71a9>	 [02puppet] 07paladox opened pull request 03#1662: dovecot: Expose stats - 13https://git.io/Jt7Mu
[16:02:09] <Not-71a9>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/Jt7D0
[16:02:11] <Not-71a9>	 [02miraheze/puppet] 07paladox 0355f7828 - Update dovecot.conf
[16:02:12] <Not-71a9>	 [02puppet] 07paladox synchronize pull request 03#1662: dovecot: Expose stats - 13https://git.io/Jt7Mu
[16:21:00] <icinga-miraheze>	 PROBLEM - mail2 Puppet on mail2 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 22 minutes ago with 0 failures
[16:22:59] <icinga-miraheze>	 RECOVERY - mail2 Puppet on mail2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[17:15:12] <Not-71a9>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt75Z
[17:15:14] <Not-71a9>	 [02miraheze/services] 07MirahezeSSLBot 039fb10fb - BOT: Updating services config for wikis
[18:58:52] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is WARNING: WARNING - load average: 3.44, 2.26, 1.62
[19:00:51] <icinga-miraheze>	 RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 0.78, 1.68, 1.48
[19:05:31] <Reception123>	 !log reception@jobrunner3:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki peacewiki /home/reception/delbackups4/peacewiki.xml
[19:05:34] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:20:52] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is CRITICAL: CRITICAL - load average: 12.99, 6.38, 3.21
[21:24:51] <icinga-miraheze>	 RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 0.71, 3.21, 2.62
[21:30:51] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is CRITICAL: CRITICAL - load average: 5.36, 5.97, 3.89
[21:34:51] <icinga-miraheze>	 RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 0.47, 2.94, 3.11
[22:21:22] <icinga-miraheze>	 PROBLEM - test3 MediaWiki Rendering on test3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 324 bytes in 0.064 second response time
[22:21:59] <RhinosF1>	 paladox: ^
[22:22:03] <RhinosF1>	 Why's it unhappy
[22:22:06] <paladox>	 yes, i'm aware
[22:22:08] <paladox>	 its me
[22:22:12] <RhinosF1>	 Ok
[22:25:22] <icinga-miraheze>	 RECOVERY - test3 MediaWiki Rendering on test3 is OK: HTTP OK: HTTP/1.1 200 OK - 20729 bytes in 0.352 second response time
[23:15:07] <SPF|Cloud>	 hi :)
[23:16:19] <SPF|Cloud>	 (looking at the current time, it's better to go to bed...)
[23:38:24] <Not-71a9>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt53w
[23:38:26] <Not-71a9>	 [02miraheze/mw-config] 07Universal-Omega 03beccc9a - Remove config for deleted wiki
[23:39:27] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[23:40:01] <Not-71a9>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt53K
[23:40:02] <Not-71a9>	 [02miraheze/mw-config] 07Universal-Omega 03b6bd205 - Fix defaults
[23:41:02] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[23:43:59] <Not-71a9>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt53M
[23:44:00] <Not-71a9>	 [02miraheze/mw-config] 07Universal-Omega 03998da75 - Remove wiki config
[23:44:57] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[23:46:26] <paladox>	 SPF|Cloud hi