[01:36:12] <icinga-miraheze>	 PROBLEM - sahitya.shaunak.in - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'sahitya.shaunak.in' expires in 15 day(s) (Wed 12 Feb 2020 01:33:18 AM GMT +0000).
[01:36:19] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jvmko
[01:36:20] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot 03cdbe6d3 - Bot: Update SSL cert for sahitya.shaunak.in
[01:42:10] <icinga-miraheze>	 RECOVERY - sahitya.shaunak.in - LetsEncrypt on sslhost is OK: OK - Certificate 'sahitya.shaunak.in' will expire on Sun 12 Apr 2020 01:46:33 AM GMT +0000.
[06:26:47] <icinga-miraheze>	 RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 3131 MB (12% inode=94%);
[08:15:38] <icinga-miraheze>	 PROBLEM - bacula1 Bacula Private Git on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[08:17:02] <icinga-miraheze>	 PROBLEM - bacula1 Bacula Databases db4 on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[08:18:00] <icinga-miraheze>	 PROBLEM - bacula1 Bacula Databases db5 on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[08:19:34] <icinga-miraheze>	 PROBLEM - bacula1 Bacula Phabricator Static on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[08:20:46] <icinga-miraheze>	 PROBLEM - bacula1 SSH on bacula1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[08:22:00] <icinga-miraheze>	 PROBLEM - bacula1 Current Load on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[08:23:15] <icinga-miraheze>	 PROBLEM - bacula1 Bacula Phabricator Static on bacula1 is WARNING: WARNING: Full, 81154 files, 2.852GB, 2020-01-11 21:17:00 (2.2 weeks ago)
[08:23:38] <icinga-miraheze>	 PROBLEM - bacula1 Bacula Private Git on bacula1 is WARNING: WARNING: Full, 4396 files, 9.233MB, 2020-01-11 17:17:00 (2.2 weeks ago)
[08:23:41] <icinga-miraheze>	 RECOVERY - bacula1 SSH on bacula1 is OK: SSH OK - OpenSSH_7.9p1 Debian-10+deb10u1 (protocol 2.0)
[08:23:46] <icinga-miraheze>	 PROBLEM - bacula1 Bacula Databases db4 on bacula1 is WARNING: WARNING: Full, 1007552 files, 44.08GB, 2020-01-11 20:01:00 (2.2 weeks ago)
[08:24:00] <icinga-miraheze>	 RECOVERY - bacula1 Current Load on bacula1 is OK: OK - load average: 0.23, 0.10, 0.06
[08:25:26] <icinga-miraheze>	 PROBLEM - bacula1 Bacula Databases db5 on bacula1 is WARNING: WARNING: Full, 2212 files, 61.69GB, 2020-01-11 21:09:00 (2.2 weeks ago)
[13:43:38] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2639 MB (10% inode=94%);
[15:20:08] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvmrJ
[15:20:10] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot 0345f633e - BOT: Updating services config for wikis
[15:26:55] <Reception123>	 !log reception@mw1:/srv/mediawiki/w/extensions/CentralAuth/maintenance$ sudo -u www-data php fixStuckGlobalRename.php --wiki=receptionflamewarswiki ZapperGlaze49 "TheChisatoFan" --logwiki=metawiki
[15:27:00] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[15:31:52] <RhinosF1>	 Hey Reception123
[15:32:05] <Reception123>	 hi
[15:32:22] <RhinosF1>	 Reception123: have you looked at github sponsors?
[15:32:59] <Reception123>	 unfortunately still haven't got enough time to take care of that today since it requires asking Owen for data, etc. I just came around to see if there were any urgent issues and have a few mins  but not enough time for that for now 
[15:33:10] <Reception123>	 I'll get to it by Thursday for sure though 
[15:33:14] <Reception123>	 hopefully earlier
[15:34:39] <RhinosF1>	 Reception123: kk
[16:05:16] <JohnLewis>	 I'll get the details off Owen I guess
[16:06:17] <RhinosF1>	 JohnLewis: It should only be bank details rest I think is on gov.uk
[16:08:03] <RhinosF1>	 JohnLewis: I put the funding.yaml file on phab linked as an example ready
[16:11:03] <JohnLewis>	 Okay
[17:05:12] <JohnLewis>	 RhinosF1: I can't find a way to do anything with Sponsors besides set up a custom link to paypal.me, which I can anyone can do who has commit access/PR access to repos?
[17:16:55] <icinga-miraheze>	 PROBLEM - wiki.svenskabriardklubben.se - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[17:18:21] <icinga-miraheze>	 PROBLEM - bacula1 Bacula Private Git on bacula1 is CRITICAL: CRITICAL: Full, 4396 files, 9.233MB, 2020-01-11 17:17:00 (2.3 weeks ago)
[17:28:15] <paladox>	 !log root@mw1:/srv/mediawiki/w/extensions/CentralAuth/maintenance# sudo -u www-data php migrateAccount.php --wiki=wikifinanzawiki --userlist=./userlist --homewiki=wikifinanzawiki --attachmissing --auto
[17:28:23] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[17:29:25] <icinga-miraheze>	 RECOVERY - wiki.svenskabriardklubben.se - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.svenskabriardklubben.se' will expire on Thu 09 Apr 2020 11:23:46 AM GMT +0000.
[17:42:13] <icinga-miraheze>	 PROBLEM - wiki.svenskabriardklubben.se - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[17:48:22] <icinga-miraheze>	 RECOVERY - wiki.svenskabriardklubben.se - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.svenskabriardklubben.se' will expire on Thu 09 Apr 2020 11:23:46 AM GMT +0000.
[17:50:02] <RhinosF1>	 paladox: Parked ^
[17:50:22] <paladox>	 ok
[17:50:58] <Not-5a0a>	 [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JvmPc
[17:50:59] <Not-5a0a>	 [02miraheze/ssl] 07paladox 03fcdebac - Remove wiki.svenskabriardklubben.se Domain not pointing at us.
[17:51:01] <Not-5a0a>	 [02ssl] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vxP9L
[17:51:03] <Not-5a0a>	 [02ssl] 07paladox opened pull request 03#262: Remove wiki.svenskabriardklubben.se - 13https://git.io/JvmPC
[17:51:34] <Not-5a0a>	 [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-1/±0] 13https://git.io/JvmPl
[17:51:35] <Not-5a0a>	 [02miraheze/ssl] 07paladox 03dca01eb - Delete wiki.svenskabriardklubben.se.crt
[17:51:37] <Not-5a0a>	 [02ssl] 07paladox synchronize pull request 03#262: Remove wiki.svenskabriardklubben.se - 13https://git.io/JvmPC
[17:52:06] <Not-5a0a>	 [02ssl] 07paladox closed pull request 03#262: Remove wiki.svenskabriardklubben.se - 13https://git.io/JvmPC
[17:52:07] <Not-5a0a>	 [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-1/±1] 13https://git.io/JvmP8
[17:52:09] <Not-5a0a>	 [02miraheze/ssl] 07paladox 03c258162 - Remove wiki.svenskabriardklubben.se (#262) * Remove wiki.svenskabriardklubben.se Domain not pointing at us. * Delete wiki.svenskabriardklubben.se.crt
[17:52:49] <Not-5a0a>	 [02miraheze/ssl] 07paladox deleted branch 03paladox-patch-1
[17:52:50] <Not-5a0a>	 [02ssl] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vxP9L
[17:54:50] <icinga-miraheze>	 PROBLEM - wiki.svenskabriardklubben.se - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[17:55:04] <RhinosF1>	 paladox: puppet? ^
[17:55:41] <paladox>	 puppet has not ran yet
[17:55:57] <paladox>	 well actually, i'm wrong it has, but i did the change just as puppet was running
[17:55:57] <RhinosF1>	 paladox: kk
[17:56:01] <RhinosF1>	 Ah
[18:47:15] * hispano76 greetings
[19:51:19] <paladox>	 !log root@mw1:/srv/mediawiki/w/maintenance# sudo -u www-data php nukeNS.php --wiki=thefinalrumblewiki --all --ns=3000 --delete
[19:51:29] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[19:55:13] <paladox>	 !log root@mw1:/srv/mediawiki/w/maintenance# sudo -u www-data php deleteBatch.php --wiki=thefinalrumblewiki list (Deleting User_blog:%)
[19:55:21] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[19:57:47] <paladox>	 !log root@mw1:/srv/mediawiki/w/maintenance# sudo -u www-data php deleteBatch.php --wiki=thefinalrumblewiki list2 (Deleting User_blog_comment:%)
[19:57:55] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[20:02:01] <paladox>	 !log root@mw1:/srv/mediawiki/w/maintenance# sudo -u www-data php deleteBatch.php --wiki=thefinalrumblewiki list (Deleting Message_Wall:%)
[20:02:11] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[22:24:20] <icinga-miraheze>	 PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 2 datacenters are down: 107.191.126.23/cpweb, 128.199.139.216/cpweb
[22:26:17] <icinga-miraheze>	 RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online
[22:28:29] <Zppix>	 !log zppix@mw1:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --report=1 --no-local-users --username-prefix "백괴게임" --wiki ungamewiki /home/zppix/uncyclogame-full-2019-05-15.xml (T5148)
[22:28:47] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[22:29:34] <Zppix>	 .t utc
[22:29:35] <ZppixBot>	 2020-01-27 - 22:29:34UTC
[22:50:42] <paladox>	 !log sudo /sbin/sysctl -w vm.drop_caches=3 on lizardfs6 and db4 temporarily
[22:50:56] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[22:58:11] <paladox>	 !log sync; echo 1 > /proc/sys/vm/drop_caches (lizardfs6 & db4)
[22:59:11] <icinga-miraheze>	 PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 5 datacenters are down: 107.191.126.23/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb
[22:59:25] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 4 datacenters are down: 2604:180:0:33b::2/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb
[22:59:47] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[23:01:08] <icinga-miraheze>	 RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online
[23:07:23] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[23:11:35] <icinga-miraheze>	 PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 3 datacenters are down: 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2a00:d880:5:8ea::ebc7/cpweb
[23:11:37] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 2400:6180:0:d0::403:f001/cpweb, 2a00:d880:5:8ea::ebc7/cpweb
[23:15:48] <icinga-miraheze>	 RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online
[23:15:49] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online