[00:03:22] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 2.02, 1.66, 1.05
[00:04:54] <icinga-miraheze>	 PROBLEM - public.revi.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'public.revi.wiki' expires in 15 day(s) (Sun 09 Feb 2020 12:01:42 AM GMT +0000).
[00:05:09] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvtVL
[00:05:11] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot 03340e0fb - Bot: Update SSL cert for public.revi.wiki
[00:05:23] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 1.12, 1.22, 1.01
[00:07:27] <icinga-miraheze>	 PROBLEM - udc-japan.xyz - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'udc-japan.xyz' expires in 15 day(s) (Sun 09 Feb 2020 12:03:48 AM GMT +0000).
[00:07:39] <icinga-miraheze>	 PROBLEM - zw.fontainebleau-avon.fr - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'zw.fontainebleau-avon.fr' expires in 15 day(s) (Sun 09 Feb 2020 12:04:25 AM GMT +0000).
[00:07:41] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvtVt
[00:07:42] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot 0359b59d1 - Bot: Update SSL cert for udc-japan.xyz
[00:07:54] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvtVq
[00:07:56] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot 03cd96dcb - Bot: Update SSL cert for zw.fontainebleau-avon.fr
[00:11:37] <icinga-miraheze>	 RECOVERY - zw.fontainebleau-avon.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'zw.fontainebleau-avon.fr' will expire on Wed 22 Apr 2020 11:07:48 PM GMT +0000.
[00:12:50] <icinga-miraheze>	 RECOVERY - public.revi.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'public.revi.wiki' will expire on Wed 22 Apr 2020 11:05:01 PM GMT +0000.
[00:13:27] <icinga-miraheze>	 RECOVERY - udc-japan.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'udc-japan.xyz' will expire on Wed 22 Apr 2020 11:07:34 PM GMT +0000.
[01:23:34] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 1.12, 3.06, 2.00
[01:25:28] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.31, 1.62, 1.65
[05:10:07] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvtiB
[05:10:09] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot 0374fd00d - BOT: Updating services config for wikis
[06:27:02] <icinga-miraheze>	 PROBLEM - www.mashedpotaytoes.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.mashedpotaytoes.com' expires in 15 day(s) (Sun 09 Feb 2020 06:24:39 AM GMT +0000).
[06:27:20] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvtPw
[06:27:22] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot 03241b737 - Bot: Update SSL cert for www.mashedpotaytoes.com
[06:27:44] <icinga-miraheze>	 RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 3076 MB (12% inode=94%);
[06:33:00] <icinga-miraheze>	 RECOVERY - www.mashedpotaytoes.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.mashedpotaytoes.com' will expire on Thu 23 Apr 2020 05:27:13 AM GMT +0000.
[10:25:56] <ZppixBot>	 Hello Halian! If you have any questions, feel free to ask and someone should answer soon.
[13:14:48] <Not-5a0a>	 [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/Jvt7Z
[13:14:49] <Not-5a0a>	 [02miraheze/ManageWiki] 07paladox 031804dac - modifyGroupPermission: Add --all flag
[13:14:51] <Not-5a0a>	 [02ManageWiki] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vpSns
[13:14:52] <Not-5a0a>	 [02ManageWiki] 07paladox opened pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt7n
[13:15:20] <Not-5a0a>	 [02ManageWiki] 07paladox synchronize pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt7n
[13:15:21] <Not-5a0a>	 [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/Jvt7c
[13:15:23] <Not-5a0a>	 [02miraheze/ManageWiki] 07paladox 03a09569b - Update modifyGroupPermission.php
[13:16:21] <Not-5a0a>	 [02ManageWiki] 07paladox synchronize pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt7n
[13:16:22] <Not-5a0a>	 [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/Jvt7l
[13:16:24] <Not-5a0a>	 [02miraheze/ManageWiki] 07paladox 03a6c9686 - Update modifyGroupPermission.php
[13:17:21] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] commented on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt74
[13:17:29] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] deleted a comment on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt74
[13:17:31] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] commented on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt7B
[13:19:22] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] deleted a comment on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt7B
[13:19:23] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] commented on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt72
[13:19:38] <travis-ci>	 miraheze/ManageWiki/paladox-patch-1/a6c9686 - paladox The build passed. https://travis-ci.org/miraheze/ManageWiki/builds/641346989
[13:20:16] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] deleted a comment on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt72
[13:20:18] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] commented on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt7a
[13:34:17] <Not-5a0a>	 [02ManageWiki] 07paladox synchronize pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt7n
[13:34:19] <Not-5a0a>	 [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/Jvt7b
[13:34:20] <Not-5a0a>	 [02miraheze/ManageWiki] 07paladox 037a5c3fa - Update modifyGroupPermission.php
[13:36:13] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] deleted a comment on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt7a
[13:36:15] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] commented on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt7N
[13:36:22] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] deleted a comment on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt7N
[13:36:23] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] commented on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt7A
[13:37:04] <Not-5a0a>	 [02ManageWiki] 07paladox synchronize pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt7n
[13:37:05] <Not-5a0a>	 [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/Jvt7p
[13:37:07] <Not-5a0a>	 [02miraheze/ManageWiki] 07paladox 03c135112 - Update modifyGroupPermission.php
[13:38:08] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] deleted a comment on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt7A
[13:38:10] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] commented on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt5f
[13:38:30] <paladox>	 !log remove oathauth-disable-for-user from all groups.
[13:38:35] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[13:39:06] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] deleted a comment on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt5f
[13:39:08] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] commented on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt5I
[13:39:59] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] deleted a comment on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt5I
[13:40:01] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] commented on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt5q
[13:40:53] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] deleted a comment on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt5q
[13:40:54] <Not-5a0a>	 [02ManageWiki] 07sonarcloud[bot] commented on pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt5m
[13:45:43] <Not-5a0a>	 [02ManageWiki] 07paladox closed pull request 03#131: modifyGroupPermission: Add --all flag - 13https://git.io/Jvt7n
[13:45:45] <Not-5a0a>	 [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jvt53
[13:45:46] <Not-5a0a>	 [02miraheze/ManageWiki] 07paladox 0387b2176 - modifyGroupPermission: Add --all flag (#131) * modifyGroupPermission: Add --all flag * Update modifyGroupPermission.php * Update modifyGroupPermission.php * Update modifyGroupPermission.php * Update modifyGroupPermission.php
[13:45:48] <Not-5a0a>	 [02ManageWiki] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vpSns
[13:45:49] <Not-5a0a>	 [02miraheze/ManageWiki] 07paladox deleted branch 03paladox-patch-1
[13:52:35] <Not-5a0a>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±2] 13https://git.io/Jvt55
[13:52:36] <Not-5a0a>	 [02miraheze/mediawiki] 07paladox 03083151f - Update ManageWiki
[13:59:02] <paladox>	 !log MariaDB [mhglobal]> update mw_permissions set perm_addgroupstoself = '[]' where perm_addgroupstoself = 'null';
[13:59:08] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[14:01:04] <paladox>	 !log MariaDB [mhglobal]> update mw_permissions set perm_addgroups = '[]' where perm_addgroups = 'null';
[14:01:10] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[14:01:13] <paladox>	 !log MariaDB [mhglobal]> update mw_permissions set perm_removegroups = '[]' where perm_removegroups = 'null';
[14:01:20] <paladox>	 !log MariaDB [mhglobal]> update mw_permissions set perm_removegroupsfromself = '[]' where perm_removegroupsfromself = 'null';
[14:01:24] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[14:01:32] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[14:02:05] <paladox>	 !log rm -rf /srv/mediawiki/w/cache/managewiki/** on mw* and lizardfs6
[14:02:11] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[14:02:37] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2639 MB (10% inode=94%);
[14:04:30] <paladox>	 !log MariaDB [mhglobal]> update mw_permissions set perm_addgroupstoself = '[]' where perm_addgroupstoself = 'null';
[14:04:36] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[14:10:32] <paladox>	 !log fake log
[14:10:43] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[14:12:03] <paladox>	 !log MariaDB [mhglobal]> update mw_permissions set perm_removegroupsfromself = '[]' where perm_removegroupsfromself = 'null';
[14:12:11] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[14:13:21] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 2.57, 2.12, 1.31
[14:15:18] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.72, 1.33, 1.17
[14:35:51] <paladox>	 MariaDB [shiropediawiki]> delete from nl_newsletters where nl_id = 3; - T4985
[14:36:22] <paladox>	 MariaDB [shiropediawiki]> delete from nl_newsletters where nl_id = 4; - T4985
[14:43:55] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 4.08, 4.15, 2.27
[14:47:45] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.43, 1.27, 1.58
[15:44:03] <hispano76>	 hello
[15:45:18] <hispano76>	 Who's there?
[15:47:36] <hispano76>	 https://commons.miraheze.org/wiki/User:Hispano76/Proposal I would like to comment on these policies, unfortunately they are in Spanish 
[15:47:39] <ZppixBot>	 [ User:Hispano76/Proposal - Miraheze Commons ] - commons.miraheze.org
[16:50:53] <Reception123>	 hi hispano76 
[16:50:55] <Reception123>	 I can take a look later
[16:53:06] <hispano76>	 Ok
[17:33:18] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 1.11, 1.92, 1.37
[17:33:56] <Not-5a0a>	 [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jvtp0
[17:33:58] <Not-5a0a>	 [02miraheze/ssl] 07paladox 03135a042 - Update www.baharna.org.crt
[17:35:19] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 3.18, 1.75, 1.37
[17:37:18] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.67, 1.05, 1.17
[21:15:05] <icinga-miraheze>	 PROBLEM - misc4 Puppet on misc4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/logrotate.d/nginx]
[21:16:08] <icinga-miraheze>	 PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/usr/local/bin/gen_fingerprints]
[21:16:20] <icinga-miraheze>	 PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[glusterfs.pem]
[21:16:41] <icinga-miraheze>	 PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[glusterfs.pem]
[21:21:17] <icinga-miraheze>	 RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 0 seconds ago with 0 failures
[21:22:08] <icinga-miraheze>	 RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 36 seconds ago with 0 failures
[21:22:18] <icinga-miraheze>	 RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 33 seconds ago with 0 failures
[21:22:51] <icinga-miraheze>	 RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures
[23:23:44] <hispano76>	 miraheze no working
[23:27:53] <paladox>	 !log restart php7.3-fpm on mw1
[23:28:01] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[23:28:16] <paladox>	 !log restart php7.3-fpm on mw2
[23:28:26] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[23:28:34] <MH-Discord>	 <CariTheKitty> Seems Miraheze is down?
[23:28:52] <paladox>	 !log restart php7.3-fpm on mw3 and lizardfs6
[23:29:05] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[23:29:24] <paladox>	 hispano76 and @ CariTheKitty should be resolved, apologies. (just restarted php-fpm to see if that will fix it)
[23:30:21] <Voidwalker>	 hey paladox, what's up with the GDNSD Datacenters on ns1 and misc1?
[23:31:27] <paladox>	 Voidwalker that's only lfs6, but should not be an issue as we doin't want to keep lfs6 permantly as a mw server, so i haven't fixed that.
[23:32:07] <paladox>	 oh
[23:32:17] <paladox>	 Voidwalker that's cp2
[23:32:27] <paladox>	 cp2 is suspended till 26th due to bandwidth
[23:32:56] <Voidwalker>	 ah, ok
[23:33:15] <JohnLewis>	 lsf6 on gdnsd?
[23:33:28] <paladox>	 nope, i confused the things :)
[23:33:33] <JohnLewis>	 Ah okay
[23:33:49] <Voidwalker>	 well, anyway, there's also four critical certs that should be looked at too IMO
[23:42:43] <hispano76>	 thanks paladox