[05:14:34] <icinga-miraheze>	 PROBLEM - wiki.antlersg2.info - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.antlersg2.info' expires in 15 day(s) (Fri 16 Aug 2019 05:12:28 AM GMT +0000).
[05:14:48] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjS7E
[05:14:49] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot 038b0ebc6 - Bot: Update SSL cert for wiki.antlersg2.info
[05:23:37] <ZppixBot>	 Hello Faun! If you have any questions feel free to ask and someone should answer soon.
[05:24:13] <Faun>	 Hi all, I just added MSCalendar extension. I created it on https://nwmarches.miraheze.org/wiki/NWMarches_Gaming_Calendar, it doesn't seem to be working
[05:24:13] <ZppixBot>	 [ NWMarches Gaming Calendar, - Northwest Marches ] - nwmarches.miraheze.org
[05:24:34] <icinga-miraheze>	 RECOVERY - wiki.antlersg2.info - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.antlersg2.info' will expire on Tue 29 Oct 2019 04:14:40 AM GMT +0000.
[05:25:18] <Faun>	 all I see after putting the calendar tags on the page is ❮❯❮❯
[05:26:08] <Faun>	 is there someone who could help me please?
[05:34:43] <Faun>	 I'll try back later. I'll also refresh and see if it starts working. 
[05:35:40] <Faun>	 That worked, just needed to clear my cache.
[06:25:20] <icinga-miraheze>	 RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 2728 MB (11% inode=94%);
[06:49:48] <RhinosF1>	 morning Reception123: I see your busy cleaning phab up and yes the CW 504s seem to be
[07:01:58] <Reception123>	 RhinosF1: good morning :)
[07:02:05] <Reception123>	 yeah, it really needed a cleanup
[07:02:34] <Reception123>	 though most need paladox so we'll have to wait for him to take action
[07:03:14] <RhinosF1>	 Reception123: did u see someone ask how long db5 will take after you said there will be a delay
[07:04:00] <Reception123>	 RhinosF1: that quick? No, I'll look but I would not be sure as most likely paladox would also be taking care of that install
[07:04:18] <RhinosF1>	 Reception123: yep that quick
[07:06:10] <Reception123>	 replied
[07:06:32] <Reception123>	 We really need to get better at answering Phabricator requests, many have gone unanswered 
[07:07:16] <RhinosF1>	 Reception123: yeah, I try to keep an eye on things now and just poke you if they don't get done but I only really look at new tasks
[07:27:41] <Reception123>	 yeah :)
[07:28:12] <RhinosF1>	 Reception123: gets them done pretty quick that way
[08:26:41] <icinga-miraheze>	 PROBLEM - misc2 Puppet on misc2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[php7.3-apcu]
[08:34:49] <icinga-miraheze>	 PROBLEM - misc3 Puppet on misc3 is CRITICAL: CRITICAL: Puppet has 9 failures. Last run 2 minutes ago with 9 failures. Failed resources (up to 3 shown)
[08:35:44] <icinga-miraheze>	 PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 249 failures. Last run 2 minutes ago with 249 failures. Failed resources (up to 3 shown)
[08:36:15] <icinga-miraheze>	 PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Puppet has 261 failures. Last run 3 minutes ago with 261 failures. Failed resources (up to 3 shown)
[08:36:41] <icinga-miraheze>	 PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Puppet has 25 failures. Last run 3 minutes ago with 25 failures. Failed resources (up to 3 shown)
[08:36:45] <icinga-miraheze>	 PROBLEM - cp3 Puppet on cp3 is CRITICAL: CRITICAL: Puppet has 214 failures. Last run 2 minutes ago with 214 failures. Failed resources (up to 3 shown): File[www.openonderwijs.org],File[www.openonderwijs.org_private],File[wiki.meeusen.net],File[wiki.meeusen.net_private]
[08:36:54] <icinga-miraheze>	 PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 241 failures. Last run 3 minutes ago with 241 failures. Failed resources (up to 3 shown)
[08:36:55] <icinga-miraheze>	 PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 291 failures. Last run 3 minutes ago with 291 failures. Failed resources (up to 3 shown)
[08:36:57] <icinga-miraheze>	 PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 213 failures. Last run 3 minutes ago with 213 failures. Failed resources (up to 3 shown)
[08:37:24] <icinga-miraheze>	 PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 303 failures. Last run 4 minutes ago with 303 failures. Failed resources (up to 3 shown): File[disabled.life],File[disabled.life_private],File[wiki.teessidehackspace.org.uk],File[wiki.teessidehackspace.org.uk_private]
[08:39:44] <icinga-miraheze>	 RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[08:40:54] <icinga-miraheze>	 RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[08:44:14] <icinga-miraheze>	 RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 20 seconds ago with 0 failures
[08:44:40] <icinga-miraheze>	 RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[08:44:41] <icinga-miraheze>	 RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[08:44:48] <icinga-miraheze>	 RECOVERY - misc3 Puppet on misc3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[08:44:59] <icinga-miraheze>	 RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 32 seconds ago with 0 failures
[08:45:06] <icinga-miraheze>	 RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 55 seconds ago with 0 failures
[08:45:24] <icinga-miraheze>	 RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 35 seconds ago with 0 failures
[08:46:43] <icinga-miraheze>	 RECOVERY - cp3 Puppet on cp3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[08:52:46] <Not-9fc7>	 [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjSFC
[08:52:48] <Not-9fc7>	 [02miraheze/puppet] 07Reception123 0358231e7 - disable slowvote on Phabricator unused at the time, can be re-enabled if there's a need in the future
[08:53:23] <Not-9fc7>	 [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjSFW
[08:53:25] <Not-9fc7>	 [02miraheze/puppet] 07Reception123 03593f049 - small 'v' for vote
[09:09:11] <Not-9fc7>	 [02mw-config] 07RhinosF1 opened pull request 03#2709: add editrepo protection for rf1botwiki - 13https://git.io/fjSFN
[09:10:04] <RhinosF1>	 ^ don't merge - need to sort indents out
[09:10:22] <Reception123>	 ok
[09:11:25] <Not-9fc7>	 [02mw-config] 07RhinosF1 synchronize pull request 03#2709: add editrepo protection for rf1botwiki - 13https://git.io/fjSFN
[09:11:33] <RhinosF1>	 Reception123: merge pls
[09:12:51] <RhinosF1>	 Reception123: hang on - noticed a mistake
[09:13:52] <Reception123>	 k
[09:16:16] <Not-9fc7>	 [02mw-config] 07RhinosF1 synchronize pull request 03#2709: add editrepo protection for rf1botwiki - 13https://git.io/fjSFN
[09:16:37] <RhinosF1>	 Reception123: think that's right now
[09:17:32] <RhinosF1>	 hey JohnLewis 
[09:17:56] <JohnLewis>	 Hey
[09:20:32] <Reception123>	 hi
[09:21:17] <Not-9fc7>	 [02mw-config] 07Reception123 closed pull request 03#2709: add editrepo protection for rf1botwiki - 13https://git.io/fjSFN
[09:21:19] <Not-9fc7>	 [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjSbq
[09:21:20] <Not-9fc7>	 [02miraheze/mw-config] 07RhinosF1 03a08b537 - add editrepo protection for rf1botwiki (#2709) * add editrepo protection for rf1botwiki * fix indent * Update LocalSettings.php spelling
[09:21:45] <RhinosF1>	 thanks Reception123 
[09:22:06] <Reception123>	 No problem
[09:26:56] <icinga-miraheze>	 PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki config]
[09:33:23] <Not-9fc7>	 [02mw-config] 07RhinosF1 opened pull request 03#2710: allow crat to add/remove repo_maintainer on rf1botwiki - 13https://git.io/fjSb4
[09:33:53] <RhinosF1>	 Reception123, JohnLewis: ^
[09:37:38] <Reception123>	 RhinosF1: this can't be done with ManageWiki right?
[09:37:45] <RhinosF1>	 Reception123: yep
[09:47:17] <Not-9fc7>	 [02mw-config] 07Reception123 closed pull request 03#2710: allow crat to add/remove repo_maintainer on rf1botwiki - 13https://git.io/fjSb4
[09:47:19] <Not-9fc7>	 [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjSby
[09:47:20] <Not-9fc7>	 [02miraheze/mw-config] 07RhinosF1 03710b368 - allow crat to add/remove repo_maintainer on rf1botwiki (#2710)
[09:51:18] <RhinosF1>	 Reception123: [91cad89cdb2570d52e7de5d0] 2019-07-31 09:51:08: Fatal exception of type "JobQueueError"
[09:51:41] <RhinosF1>	 trying to mark page for translation
[09:51:52] <Reception123>	 urgh not the jobqueue again..
[09:51:57] <Reception123>	 always some issue with that
[09:52:08] <RhinosF1>	 Reception123: unforunately
[09:53:27] * RhinosF1 runs off and leaves Reception123 and JohnLewis to fix it for about 10-15mins
[09:54:50] <Reception123>	 Don't think there's such a quick fix 
[09:55:01] <Reception123>	 Plus jobqueue is paladox's thing 
[10:03:26] <RhinosF1>	 Reception123: what's the log saying?
[10:12:30] <JohnLewis>	 Reception123: Redis not jobqueue :P
[10:13:13] <RhinosF1>	 also, I still can't add Repo_Mainainer to myself on rf1botwiki
[10:13:32] <RhinosF1>	 (or anyone)
[10:15:06] <JohnLewis>	 RhinosF1: because you're not a member of "Bureaucrats"
[10:15:43] <RhinosF1>	 JohnLewis: you mean I can't spell - What should it be?
[10:15:50] <JohnLewis>	 bureacurat :)
[10:16:00] <RhinosF1>	 JohnLewis: i'll push now
[10:16:01] <JohnLewis>	 https://quirc.miraheze.org/w/index.php?title=Special:ListUsers&group=Bureaucrats is what you've done
[10:16:03] <ZppixBot>	 [ User list - QuIRC ] - quirc.miraheze.org
[10:16:13] <JohnLewis>	 https://quirc.miraheze.org/w/index.php?title=Special:ListUsers&group=bureaucrat is correct :P
[10:16:13] <ZppixBot>	 [ User list - QuIRC ] - quirc.miraheze.org
[10:16:31] <RhinosF1>	 JohnLewis: wrong wiki - rf1bot.miraheze.org
[10:17:04] <JohnLewis>	 RhinosF1: so you've also done it on the wrong wiki in config :D
[10:17:05] <RhinosF1>	 JohnLewis: I put the wrong wiki as well :)
[10:19:02] <Not-9fc7>	 [02mw-config] 07RhinosF1 opened pull request 03#2711: Bug Fixes - 13https://git.io/fjSNM
[10:19:14] <RhinosF1>	 JohnLewis: ^
[10:19:48] <Not-9fc7>	 [02mw-config] 07JohnFLewis closed pull request 03#2711: Bug Fixes - 13https://git.io/fjSNM
[10:19:49] <Not-9fc7>	 [02miraheze/mw-config] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjSNS
[10:19:51] <Not-9fc7>	 [02miraheze/mw-config] 07RhinosF1 03edb7705 - Bug Fixes (#2711) Apply to correct wiki and change to correct name for crats
[10:28:16] <RhinosF1>	 JohnLewis: yey, I can finally assign the right
[10:28:48] <JohnLewis>	 good good
[10:32:45] <Reception123>	 can't find anything in redis/log that helps
[10:32:58] <Reception123>	 and the PR thing was my fault, should've noticed that it was a wrong plural
[10:33:37] <JohnLewis>	 Reception123: exception log, likely "can't insert" or "can't connect" which means Redis OOM'd likely is my guess
[10:35:07] <RhinosF1>	 Reception123, JohnLewis: I manged to reset translation by removing it and reapplying it and it worked. Don't know if marking that version for translation works now
[10:35:38] <RhinosF1>	 Yes it works now
[10:36:57] <Reception123>	 https://www.irccloud.com/pastebin/TkhLCBf5/
[10:36:58] <ZppixBot>	 [ Snippet | IRCCloud ] - www.irccloud.com
[10:37:05] <Reception123>	 the usual
[10:56:09] <Not-9fc7>	 [02mw-config] 07Reception123 commented on pull request 03#2683: Include "--logs --uploads" in the DataDump dumps - 13https://git.io/fjSAn
[11:03:52] <paladox>	 Reception123: cat syslog | grep OOM
[11:23:00] <Reception123>	 paladox: nothing on misc2 for that
[11:25:28] <paladox>	 https://grafana.miraheze.org/d/h8GaZJZWz/prometheus-redis?orgId=1&refresh=30s
[11:25:29] <ZppixBot>	 [ Grafana ] - grafana.miraheze.org
[11:34:54] <Reception123>	 !log re-enable puppet on misc4
[11:34:58] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[11:36:27] <icinga-miraheze>	 RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 47 seconds ago with 0 failures
[11:36:58] <Reception123>	 !log removed /etc/aliases on misc4 (refresh, puppet error)
[11:37:03] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[11:45:15] <Reception123>	 !log purge binary logs before '2019-07-31 11:00:00';
[11:45:19] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[13:28:59] <RhinosF1>	 If anyone is good at the translate extension then your help is wanted on rf1botwiki - or can translate things
[14:30:28] * RhinosF1 is listening to an old podcast by JohnLewis on between the brackets
[15:21:38] <RhinosF1>	 paladox: check staff@ pls - see https://phabricator.miraheze.org/T4585#87125
[15:21:39] <ZppixBot>	 [ ⚓ T4585 reset my 2-step verification ] - phabricator.miraheze.org
[15:21:43] <paladox>	 ok
[15:21:53] <paladox>	 the comment was removed.
[15:22:09] <RhinosF1>	 paladox: the whole ticket
[15:24:09] <paladox>	 ok
[15:25:07] <RhinosF1>	 paladox: thx
[15:26:07] <RhinosF1>	 paladox: user has fixed it
[15:26:40] <paladox>	 ok
[15:26:52] <paladox>	 so nothing for me to do i guess
[15:27:02] <RhinosF1>	 paladox: I don't think so
[15:29:24] <paladox>	 ok
[15:38:02] <Reception123>	 ok, so the 2FA isn't necessary anymore
[15:38:12] <Reception123>	 *2FA reset
[15:38:36] <RhinosF1>	 Reception123: no, they fixed it -- despite me saying try fixing it before emailing
[15:39:03] <Reception123>	 ok, it's fine
[15:40:55] <RhinosF1>	 if anyone wants to endlessly tag things for translation properly then help is wanted on my wiki
[16:05:09] <Not-9fc7>	 [02mw-config] 07Reception123 created branch 03Reception123-patch-1 - 13https://git.io/vbvb3
[16:05:10] <Not-9fc7>	 [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://git.io/fj9JT
[16:05:12] <Not-9fc7>	 [02miraheze/mw-config] 07Reception123 03eabcabc - [DO NOT MERGE] temporarily allow user to dump images DO NOT MERGE without @JohnFLewis 's approval. Due to liability reasons I think this would be the only way to do it?
[16:05:14] <Not-9fc7>	 [02mw-config] 07Reception123 opened pull request 03#2712: [DO NOT MERGE] temporarily allow user to dump images - 13https://git.io/fj9Jk
[16:05:39] <Not-9fc7>	 [02mw-config] 07Reception123 edited pull request 03#2712: [DO NOT MERGE] temporarily allow user to dump images - 13https://git.io/fj9Jk
[16:07:20] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2648 MB (10% inode=94%);
[18:57:57] <RhinosF1>	 SPF|Cloud, Reception123: see https://meta.miraheze.org/wiki/Special:Contributions/System_Operator pls thinking he’s rules Meta — Time for a NOT HERE I think
[18:57:58] <ZppixBot>	 [ User contributions for System Operator - Miraheze Meta ] - meta.miraheze.org
[18:58:13] <SPF|Cloud>	 already left a message on their talk page
[18:58:25] <SPF|Cloud>	 but yes, it's time to stop this
[18:58:51] <RhinosF1>	 SPF|Cloud: Have u seen what he posted on receptions talk
[19:01:22] <SPF|Cloud>	 RhinosF1: yes, I did
[19:10:13] <Not-9fc7>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9kJ
[19:10:14] <Not-9fc7>	 [02miraheze/services] 07MirahezeSSLBot 037da3682 - BOT: Updating services config for wikis
[19:35:07] <icinga-miraheze>	 PROBLEM - antiguabarbudacalypso.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'antiguabarbudacalypso.com' expires in 15 day(s) (Fri 16 Aug 2019 07:31:46 PM GMT +0000).
[19:35:22] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9kB
[19:35:24] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot 0366551e3 - Bot: Update SSL cert for antiguabarbudacalypso.com
[19:36:24] <icinga-miraheze>	 PROBLEM - permanentfuturelab.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'permanentfuturelab.wiki' expires in 15 day(s) (Fri 16 Aug 2019 07:34:22 PM GMT +0000).
[19:36:37] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9kR
[19:36:39] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot 036f0295c - Bot: Update SSL cert for permanentfuturelab.wiki
[19:37:51] <icinga-miraheze>	 PROBLEM - www.permanentfuturelab.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'permanentfuturelab.wiki' expires in 15 day(s) (Fri 16 Aug 2019 07:34:22 PM GMT +0000).
[19:40:09] <icinga-miraheze>	 PROBLEM - spiral.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'spiral.wiki' expires in 15 day(s) (Fri 16 Aug 2019 07:36:45 PM GMT +0000).
[19:40:25] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9kz
[19:40:26] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot 038abd639 - Bot: Update SSL cert for spiral.wiki
[19:43:03] <icinga-miraheze>	 RECOVERY - antiguabarbudacalypso.com - LetsEncrypt on sslhost is OK: OK - Certificate 'antiguabarbudacalypso.com' will expire on Tue 29 Oct 2019 06:35:16 PM GMT +0000.
[19:43:52] <icinga-miraheze>	 RECOVERY - www.permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Tue 29 Oct 2019 06:36:30 PM GMT +0000.
[19:44:24] <icinga-miraheze>	 RECOVERY - permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Tue 29 Oct 2019 06:36:30 PM GMT +0000.
[19:45:15] <Not-9fc7>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9kK
[19:45:16] <Not-9fc7>	 [02miraheze/services] 07MirahezeSSLBot 039a02bb6 - BOT: Updating services config for wikis
[19:45:26] <icinga-miraheze>	 PROBLEM - publictestwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'publictestwiki.com' expires in 15 day(s) (Fri 16 Aug 2019 07:43:09 PM GMT +0000).
[19:45:34] <icinga-miraheze>	 PROBLEM - es.publictestwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'publictestwiki.com' expires in 15 day(s) (Fri 16 Aug 2019 07:43:09 PM GMT +0000).
[19:45:39] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9k6
[19:45:41] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot 0386481eb - Bot: Update SSL cert for publictestwiki.com
[19:50:15] <icinga-miraheze>	 PROBLEM - wiki.valentinaproject.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.valentinaproject.org' expires in 15 day(s) (Fri 16 Aug 2019 07:47:05 PM GMT +0000).
[19:50:29] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9k1
[19:50:30] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot 037c21687 - Bot: Update SSL cert for wiki.valentinaproject.org
[19:53:26] <icinga-miraheze>	 RECOVERY - publictestwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'publictestwiki.com' will expire on Tue 29 Oct 2019 06:45:33 PM GMT +0000.
[19:53:34] <icinga-miraheze>	 RECOVERY - es.publictestwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'publictestwiki.com' will expire on Tue 29 Oct 2019 06:45:33 PM GMT +0000.
[19:54:11] <icinga-miraheze>	 RECOVERY - spiral.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'spiral.wiki' will expire on Tue 29 Oct 2019 06:40:18 PM GMT +0000.
[19:55:19] <paladox>	 bah
[19:55:27] <paladox>	 ohh wrong date
[19:59:03] <Reception123>	 hm?
[20:00:01] <paladox>	 I was thinking it was a brexit date
[20:00:51] <Reception123>	 paladox: lol, when those certs expire the UK will still be in the EU no worries :P
[20:00:59] <paladox>	 heh
[20:03:43] <RhinosF1>	 SPF|Cloud: u allowed to say who SO was a sock of
[20:03:47] <RhinosF1>	 ??
[20:04:15] <icinga-miraheze>	 RECOVERY - wiki.valentinaproject.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.valentinaproject.org' will expire on Tue 29 Oct 2019 06:50:22 PM GMT +0000.
[20:06:08] <icinga-miraheze>	 PROBLEM - wiki.dwplive.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.dwplive.com' expires in 15 day(s) (Fri 16 Aug 2019 08:03:22 PM GMT +0000).
[20:06:25] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9IJ
[20:06:26] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot 03d001fbb - Bot: Update SSL cert for wiki.dwplive.com
[20:07:13] <icinga-miraheze>	 PROBLEM - wiki.grottocenter.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.grottocenter.org' expires in 15 day(s) (Fri 16 Aug 2019 08:04:42 PM GMT +0000).
[20:07:27] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9Ik
[20:07:28] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot 032cf3d32 - Bot: Update SSL cert for wiki.grottocenter.org
[20:10:01] <icinga-miraheze>	 PROBLEM - wiki.make717.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.make717.org' expires in 15 day(s) (Fri 16 Aug 2019 08:07:16 PM GMT +0000).
[20:10:23] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9Iq
[20:10:24] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot 037a141a4 - Bot: Update SSL cert for wiki.make717.org
[20:12:27] <icinga-miraheze>	 PROBLEM - thelonsdalebattalion.co.uk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'thelonsdalebattalion.co.uk' expires in 15 day(s) (Fri 16 Aug 2019 08:08:32 PM GMT +0000).
[20:12:41] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9IO
[20:12:42] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot 035bbb30f - Bot: Update SSL cert for thelonsdalebattalion.co.uk
[20:13:13] <icinga-miraheze>	 RECOVERY - wiki.grottocenter.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.grottocenter.org' will expire on Tue 29 Oct 2019 07:07:20 PM GMT +0000.
[20:14:08] <icinga-miraheze>	 RECOVERY - wiki.dwplive.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.dwplive.com' will expire on Tue 29 Oct 2019 07:06:18 PM GMT +0000.
[20:19:19] <icinga-miraheze>	 PROBLEM - wisdomwiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wisdomwiki.org' expires in 15 day(s) (Fri 16 Aug 2019 08:15:50 PM GMT +0000).
[20:19:34] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9IZ
[20:19:36] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot 03b360822 - Bot: Update SSL cert for wisdomwiki.org
[20:24:01] <icinga-miraheze>	 RECOVERY - wiki.make717.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.make717.org' will expire on Tue 29 Oct 2019 07:10:15 PM GMT +0000.
[20:24:27] <icinga-miraheze>	 RECOVERY - thelonsdalebattalion.co.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'thelonsdalebattalion.co.uk' will expire on Tue 29 Oct 2019 07:12:34 PM GMT +0000.
[20:33:20] <icinga-miraheze>	 RECOVERY - wisdomwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wisdomwiki.org' will expire on Tue 29 Oct 2019 07:19:27 PM GMT +0000.
[21:04:20] <icinga-miraheze>	 PROBLEM - db5 SSH on db5 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[21:04:40] <icinga-miraheze>	 PROBLEM - db5 Puppet on db5 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[21:04:41] <icinga-miraheze>	 PROBLEM - db5 Disk Space on db5 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[21:04:45] <icinga-miraheze>	 PROBLEM - db5 Current Load on db5 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[21:05:53] <icinga-miraheze>	 PROBLEM - Host db5 is DOWN: PING CRITICAL - Packet loss = 100%
[21:06:14] <RhinosF1>	 paladox: is that u? ^
[21:06:19] <paladox>	 yup
[21:42:18] <icinga-miraheze>	 PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'm.miraheze.org' expires in 15 day(s) (Fri 16 Aug 2019 09:39:26 PM GMT +0000).
[21:52:40] <icinga-miraheze>	 PROBLEM - www.zenbuddhism.info - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.zenbuddhism.info' expires in 15 day(s) (Fri 16 Aug 2019 09:50:31 PM GMT +0000).
[21:52:53] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9L5
[21:52:54] <Not-9fc7>	 [02miraheze/ssl] 07MirahezeSSLBot 03a4fe396 - Bot: Update SSL cert for www.zenbuddhism.info
[22:04:40] <icinga-miraheze>	 RECOVERY - www.zenbuddhism.info - LetsEncrypt on sslhost is OK: OK - Certificate 'www.zenbuddhism.info' will expire on Tue 29 Oct 2019 08:52:46 PM GMT +0000.
[22:27:12] <Not-9fc7>	 [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9tV
[22:27:13] <Not-9fc7>	 [02miraheze/dns] 07paladox 0382631d1 - Update db5 ip
[22:31:16] <icinga-miraheze>	 RECOVERY - Host db5 is UP: PING OK - Packet loss = 0%, RTA = 0.44 ms
[22:31:21] <icinga-miraheze>	 PROBLEM - db5 MySQL on db5 is CRITICAL: Lost connection to MySQL server at 'reading initial communication packet', system error: 2 "No such file or directory"
[23:04:02] <Not-9fc7>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9qT
[23:04:03] <Not-9fc7>	 [02miraheze/puppet] 07paladox 03604b8fa - mariadb: Enable ssl for the icinga monitoring
[23:10:53] <paladox>	 !log CREATE TABLE /*_*/test (`test` VARCHAR(64) NOT NULL); - db5
[23:10:58] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master