[00:02:41] <icinga-miraheze>	 PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:02:45] <icinga-miraheze>	 PROBLEM - db4 Puppet on db4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:02:51] <icinga-miraheze>	 PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:02:55] <icinga-miraheze>	 PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:03:03] <icinga-miraheze>	 PROBLEM - misc4 Puppet on misc4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:03:11] <icinga-miraheze>	 PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:03:13] <icinga-miraheze>	 PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:03:17] <icinga-miraheze>	 PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:03:25] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:03:59] <icinga-miraheze>	 PROBLEM - lizardfs2 Puppet on lizardfs2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:04:45] <icinga-miraheze>	 PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:11:13] <icinga-miraheze>	 RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 7 seconds ago with 0 failures  
[00:11:25] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 20 seconds ago with 0 failures  
[00:11:57] <icinga-miraheze>	 RECOVERY - lizardfs2 Puppet on lizardfs2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[00:12:39] <icinga-miraheze>	 RECOVERY - misc3 Puppet on misc3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[00:12:41] <icinga-miraheze>	 RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[00:12:45] <icinga-miraheze>	 RECOVERY - db4 Puppet on db4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[00:12:49] <icinga-miraheze>	 RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[00:12:53] <icinga-miraheze>	 RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[00:13:03] <icinga-miraheze>	 RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[00:13:09] <icinga-miraheze>	 RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[00:13:17] <icinga-miraheze>	 RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 59 seconds ago with 0 failures  
[00:14:43] <icinga-miraheze>	 RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[01:00:20] <Not-a634>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA6Tj
[01:00:21] <Not-a634>	 [02miraheze/services] 07MirahezeSSLBot 032b2102d - BOT: Updating services config for wikis
[01:06:55] <icinga-miraheze>	 RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs  
[01:46:55] <icinga-miraheze>	 PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 372  
[01:48:53] <icinga-miraheze>	 RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs  
[02:46:13] <icinga-miraheze>	 PROBLEM - bacula1 Disk Space on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.  
[02:48:09] <icinga-miraheze>	 PROBLEM - bacula1 Disk Space on bacula1 is WARNING: DISK WARNING - free space: / 90690 MB (19% inode=99%);  
[04:48:55] <icinga-miraheze>	 PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 383  
[04:56:55] <icinga-miraheze>	 RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs  
[06:55:11] <Not-a634>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA6nr
[06:55:13] <Not-a634>	 [02miraheze/services] 07MirahezeSSLBot 03fd2d59a - BOT: Updating services config for wikis
[08:58:56] <icinga-miraheze>	 PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 6514  
[09:03:13] <Not-a634>	 [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA60w
[09:03:14] <Not-a634>	 [02miraheze/CreateWiki] 07translatewiki 03227d2be - Localisation updates from https://translatewiki.net.
[09:03:16] <Not-a634>	 [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±14] 13https://git.io/fA60r
[09:03:17] <Not-a634>	 [02miraheze/ManageWiki] 07translatewiki 032da89f4 - Localisation updates from https://translatewiki.net.
[12:19:22] <Not-a634>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA69Z
[12:19:23] <Not-a634>	 [02miraheze/puppet] 07paladox 03e74b2f9 - Disable memcached on mw* Not needed yet.
[12:21:24] <Not-a634>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA69B
[12:21:25] <Not-a634>	 [02miraheze/mw-config] 07paladox 03faed722 - Disable memcached in Redis.php
[12:32:55] <icinga-miraheze>	 PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki config]  
[12:38:54] <icinga-miraheze>	 RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[12:40:25] <paladox>	 Im going to re clone mw on mw3 as it seems the directory is all messed up.
[12:41:04] <paladox>	 !log depool mw3
[12:41:09] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[12:44:20] <icinga-miraheze>	 PROBLEM - cp5 Varnish Backends on cp5 is CRITICAL: 1 backends are down.  mw3  
[12:44:30] <icinga-miraheze>	 PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 1 backends are down.  mw3  
[12:44:50] <icinga-miraheze>	 PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 1 backends are down.  mw3  
[12:48:54] <icinga-miraheze>	 PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_clone_MediaWiki core]  
[12:57:36] <Not-a634>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fA67H
[12:57:37] <Not-a634>	 [02miraheze/mediawiki] 07paladox 0331ba898 - Update PdfBook
[12:59:13] <icinga-miraheze>	 PROBLEM - mw3 JobQueue on mw3 is UNKNOWN: NRPE: Unable to read output  
[13:00:21] <icinga-miraheze>	 RECOVERY - cp5 Varnish Backends on cp5 is OK: All 5 backends are healthy  
[13:00:29] <icinga-miraheze>	 RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy  
[13:00:49] <icinga-miraheze>	 RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy  
[13:05:09] <icinga-miraheze>	 PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - check plugin (check_jobqueue) or PHP errors  
[13:06:53] <icinga-miraheze>	 RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 41 seconds ago with 0 failures  
[13:20:04] <paladox>	 !log repool mw3
[13:20:17] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[13:28:33] <icinga-miraheze>	 PROBLEM - mw3 JobQueue on mw3 is UNKNOWN: NRPE: Unable to read output  
[13:29:07] <MacFan4000>	 hm
[13:30:55] <icinga-miraheze>	 PROBLEM - mw3 Puppet on mw3 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 10 minutes ago with 0 failures  
[13:38:53] <Not-a634>	 [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA6bd
[13:38:55] <Not-a634>	 [02miraheze/puppet] 07JohnFLewis 03b920c8a - run check as www-data
[13:39:46] <paladox>	 oh
[13:40:54] <icinga-miraheze>	 RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures  
[13:42:26] <icinga-miraheze>	 PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 28196  
[13:42:31] <paladox>	 ah
[13:42:34] <paladox>	 i know the second fix
[13:43:04] <Not-a634>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA6N3
[13:43:05] <Not-a634>	 [02miraheze/puppet] 07paladox 0362a2d17 - Fix sudo rules
[13:44:24] <icinga-miraheze>	 PROBLEM - karagash.info - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'karagash.info' expires in 15 day(s) (Sat 29 Sep 2018 01:42:17 PM GMT +0000).  
[13:44:33] <Not-a634>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA6N4
[13:44:35] <Not-a634>	 [02miraheze/ssl] 07MirahezeSSLBot 033e9167f - Bot: Update SSL cert for karagash.info
[13:45:22] <JohnLewis>	 That’s... not s fic
[13:45:39] <JohnLewis>	 itd an improvement. Not a fix
[13:48:54] <paladox>	 ok
[13:52:00] <icinga-miraheze>	 PROBLEM - saveta.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'saveta.org' expires in 15 day(s) (Sat 29 Sep 2018 01:49:47 PM GMT +0000).  
[13:52:15] <Not-a634>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA6As
[13:52:16] <Not-a634>	 [02miraheze/ssl] 07MirahezeSSLBot 03ec6461d - Bot: Update SSL cert for saveta.org
[13:52:22] <icinga-miraheze>	 RECOVERY - karagash.info - LetsEncrypt on sslhost is OK: OK - Certificate 'karagash.info' will expire on Wed 12 Dec 2018 12:44:28 PM GMT +0000.  
[13:56:45] <icinga-miraheze>	 PROBLEM - www.saveta.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.saveta.org' expires in 15 day(s) (Sat 29 Sep 2018 01:52:48 PM GMT +0000).  
[13:56:55] <Not-a634>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA6AP
[13:56:56] <Not-a634>	 [02miraheze/ssl] 07MirahezeSSLBot 034709d76 - Bot: Update SSL cert for www.saveta.org
[14:02:01] <icinga-miraheze>	 RECOVERY - saveta.org - LetsEncrypt on sslhost is OK: OK - Certificate 'saveta.org' will expire on Wed 12 Dec 2018 12:52:09 PM GMT +0000.  
[14:02:09] <icinga-miraheze>	 PROBLEM - www.lab612.at - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.lab612.at' expires in 15 day(s) (Sat 29 Sep 2018 01:58:11 PM GMT +0000).  
[14:02:22] <Not-a634>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA6xY
[14:02:23] <Not-a634>	 [02miraheze/ssl] 07MirahezeSSLBot 03716219e - Bot: Update SSL cert for www.lab612.at
[14:02:43] <icinga-miraheze>	 RECOVERY - www.saveta.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.saveta.org' will expire on Wed 12 Dec 2018 12:56:49 PM GMT +0000.  
[14:12:09] <icinga-miraheze>	 RECOVERY - www.lab612.at - LetsEncrypt on sslhost is OK: OK - Certificate 'www.lab612.at' will expire on Wed 12 Dec 2018 01:02:17 PM GMT +0000.  
[14:22:56] <Not-a634>	 [02puppet] 07MacFan4000 opened pull request 03#830: disable GUP jobs - 13https://git.io/fA6h5
[14:44:23] <Not-a634>	 [02puppet] 07JohnFLewis commented on pull request 03#827: Retry ssl-acme up to 5 times - 13https://git.io/fAiv7
[14:46:46] <paladox>	 JohnLewis thanks for reviewing! I will see if there's a better way at doing it before merging.
[14:47:00] <paladox>	 I think i found a better way a few days to a week ago but then closed the tab.
[14:47:12] <paladox>	 so lost what i was trying to achive and then forgot about it.
[14:49:41] <JohnLewis>	 Okay :P
[14:55:23] <paladox>	 !log sudo -u www-data php /srv/mediawiki/w/maint*/rebuildLocalisationCache.php --wiki test1wiki on mw*
[14:55:27] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[14:56:28] <Not-a634>	 [02puppet] 07MacFan4000 closed pull request 03#830: disable GUP jobs - 13https://git.io/fA6h5
[15:24:44] <Not-a634>	 [02puppet] 07paladox deleted branch 03paladox-patch-4 - 13https://git.io/vbiAS
[15:24:45] <Not-a634>	 [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-5
[15:24:47] <Not-a634>	 [02puppet] 07paladox deleted branch 03paladox-patch-5 - 13https://git.io/vbiAS
[15:24:49] <Not-a634>	 [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbiAS
[15:24:50] <Not-a634>	 [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-4
[15:24:52] <Not-a634>	 [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-2
[15:24:53] <Not-a634>	 [02puppet] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbiAS
[15:24:54] <Not-a634>	 [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1
[15:27:06] <Wiki-1776>	 Hello
[15:27:30] <paladox>	 hi
[16:10:05] <MacFan4000>	 paladox: the matomo branch can be deleted as the PR was closed and it was changing matomo subdomain which is already done
[16:10:28] <Not-a634>	 [02puppet] 07paladox deleted branch 03matomo - 13https://git.io/vbiAS
[16:10:30] <Not-a634>	 [02miraheze/puppet] 07paladox deleted branch 03matomo
[16:10:30] <paladox>	 ok
[16:23:36] <Wiki-1776>	 and preview of image? bug? https://prnt.sc/ku1c2u
[16:23:36] <ZppixBot>	 Title: [ Screenshot by Lightshot ] - prnt.sc
[16:29:43] <paladox>	 !log sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=terribletvshowswiki --report=1 terribletvandwebshows_pages_full.xml on mw1 in a screen
[16:29:48] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[17:03:00] <Wiki-1776>	 bug for preview of image? https://prnt.sc/ku1c2u
[17:03:00] <ZppixBot>	 Title: [ Screenshot by Lightshot ] - prnt.sc
[17:55:52] <Reception123>	 !log reception@mw2:/srv/mediawiki/w/maintenance$ sudo -u www-data php importImages.php --wiki nonciclopediawiki --search-recursively /home/reception/NonciclopediaDump_2018-08-18/images
[17:55:56] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[18:00:53] <Reception123>	 !log reception@mw2:~/NonciclopediaDump_2018-08-18$ sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=nonciclopediawiki /home/reception/NonciclopediaDump_2018-08-18/nonciclopediawikiacom-20180818-history.xml
[18:00:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[19:03:17] <Wiki-1776>	 Hola
[19:25:46] <Not-a634>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+1/-0/±1] 13https://git.io/fAiaA
[19:25:48] <Not-a634>	 [02miraheze/mediawiki] 07paladox 039a7f3d5 - Add ApprovedRevs mw extension per T3473
[19:26:30] <Not-a634>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fAiap
[19:26:32] <Not-a634>	 [02miraheze/mediawiki] 07paladox 03c5ffc53 - Update .gitmodules
[19:28:01] <Not-a634>	 [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbvb3
[19:28:02] <Not-a634>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fAiVO
[19:28:04] <Not-a634>	 [02miraheze/mw-config] 07paladox 037e58d67 - Add ApprovedRevs to ManageWiki fixes T3473
[19:28:05] <Not-a634>	 [02mw-config] 07paladox opened pull request 03#2455: Add ApprovedRevs to ManageWiki fixes T3473 - 13https://git.io/fAiVs
[19:28:36] <Not-a634>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fAiVC
[19:28:37] <Not-a634>	 [02miraheze/mw-config] 07paladox 03f67bf5e - Update LocalExtensions.php
[19:28:39] <Not-a634>	 [02mw-config] 07paladox synchronize pull request 03#2455: Add ApprovedRevs to ManageWiki fixes T3473 - 13https://git.io/fAiVs
[19:29:00] <Not-a634>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fAiVW
[19:29:01] <Not-a634>	 [02miraheze/mw-config] 07paladox 037bfc6ce - Update LocalSettings.php
[19:29:03] <Not-a634>	 [02mw-config] 07paladox synchronize pull request 03#2455: Add ApprovedRevs to ManageWiki fixes T3473 - 13https://git.io/fAiVs
[19:29:19] <travis-ci>	 miraheze/mw-config/paladox-patch-1/f67bf5e - paladox The build was canceled. https://travis-ci.org/miraheze/mw-config/builds/428316593
[19:29:22] <Not-a634>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fAiV0
[19:29:24] <Not-a634>	 [02miraheze/mw-config] 07paladox 0398b33d1 - Update extension-list
[19:29:25] <Not-a634>	 [02mw-config] 07paladox synchronize pull request 03#2455: Add ApprovedRevs to ManageWiki fixes T3473 - 13https://git.io/fAiVs
[19:30:42] <travis-ci>	 miraheze/mw-config/paladox-patch-1/98b33d1 - paladox The build passed. https://travis-ci.org/miraheze/mw-config/builds/428316936
[19:31:02] <Not-a634>	 [02mw-config] 07paladox closed pull request 03#2455: Add ApprovedRevs to ManageWiki fixes T3473 - 13https://git.io/fAiVs
[19:31:03] <Not-a634>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/fAiVo
[19:31:05] <Not-a634>	 [02miraheze/mw-config] 07paladox 03f03e2b7 - Add ApprovedRevs to ManageWiki fixes T3473 (#2455) * Add ApprovedRevs to ManageWiki fixes T3473 * Update LocalExtensions.php * Update LocalSettings.php * Update extension-list
[19:31:06] <Not-a634>	 [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbvb3
[19:31:08] <Not-a634>	 [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1
[19:32:39] <paladox>	 meh comes with
[19:32:45] <paladox>	 sql
[19:33:38] <Not-a634>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAiVS
[19:33:40] <Not-a634>	 [02miraheze/mw-config] 07paladox 03f81e78f - Add ApprovedRevs.sql to wgCreateWikiSQLfiles
[19:34:48] <paladox>	 !log /usr/local/bin/foreachwikiindblist /srv/mediawiki/dblist/all.dblist /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/w/extensions/ApprovedRevs/sql/ApprovedRevs.sql on mw1 in a screen
[19:34:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[19:36:51] <icinga-miraheze>	 PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]  
[19:37:16] <Not-a634>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAiw3
[19:37:18] <Not-a634>	 [02miraheze/mw-config] 07paladox 0372b4226 - Fix link
[19:38:45] <Not-a634>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAiwc
[19:38:46] <Not-a634>	 [02miraheze/mw-config] 07paladox 0340286f7 - fix
[19:39:23] <paladox>	 !log sudo -u www-data php /srv/mediawiki/w/maint*/rebuildLocalisationCache.php --wiki test1wiki on mw* and test1
[19:39:27] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[19:42:51] <icinga-miraheze>	 RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[19:48:40] <arvindvenk>	 Newbie here: is this a good place to ask for help?
[19:48:55] <paladox>	 hi yes.
[19:49:47] <arvindvenk>	 thanks. I was wondering if it's possible to setup a wiki such that users can authenticate with their google / microsoft accounts
[19:50:26] <arvindvenk>	 I know there is a GoogleLogin extension for MediaWiki, but I can't tell if I can install that or something like it
[19:50:49] <paladox>	 arvindvenk hi, unfourntly nope. We use CentralAuth and have a main login wiki ie login.miraheze.org
[19:51:24] <arvindvenk>	 so users would have to create their own accounts, then?
[19:52:09] <paladox>	 yep
[19:52:23] <arvindvenk>	 ok, thanks!
[20:01:17] <Not-a634>	 [02miraheze/CreateWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAioa
[20:01:18] <Not-a634>	 [02miraheze/CreateWiki] 07JohnFLewis 039ed6440 - fix listDatabases.php
[20:21:39] <Not-a634>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+1/-0/±1] 13https://git.io/fAi6L
[20:21:40] <Not-a634>	 [02miraheze/mediawiki] 07paladox 034789212 - Add Purge mw extension per T3495
[20:22:34] <Not-a634>	 [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbvb3
[20:22:35] <Not-a634>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fAi63
[20:22:37] <Not-a634>	 [02miraheze/mw-config] 07paladox 03420c807 - Add Purge to ManageWiki fixes T3495
[20:22:38] <Not-a634>	 [02mw-config] 07paladox opened pull request 03#2456: Add Purge to ManageWiki fixes T3495 - 13https://git.io/fAi6s
[20:23:02] <Not-a634>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fAi6C
[20:23:04] <Not-a634>	 [02miraheze/mw-config] 07paladox 039d56009 - Update LocalSettings.php
[20:23:05] <Not-a634>	 [02mw-config] 07paladox synchronize pull request 03#2456: Add Purge to ManageWiki fixes T3495 - 13https://git.io/fAi6s
[20:23:25] <Not-a634>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fAi6l
[20:23:26] <Not-a634>	 [02miraheze/mw-config] 07paladox 031a5a5e8 - Update LocalExtensions.php
[20:23:28] <Not-a634>	 [02mw-config] 07paladox synchronize pull request 03#2456: Add Purge to ManageWiki fixes T3495 - 13https://git.io/fAi6s
[20:23:44] <Not-a634>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fAi68
[20:23:46] <Not-a634>	 [02miraheze/mw-config] 07paladox 03934e8cf - Update extension-list
[20:23:47] <Not-a634>	 [02mw-config] 07paladox synchronize pull request 03#2456: Add Purge to ManageWiki fixes T3495 - 13https://git.io/fAi6s
[20:25:43] <Not-a634>	 [02mw-config] 07paladox closed pull request 03#2456: Add Purge to ManageWiki fixes T3495 - 13https://git.io/fAi6s
[20:25:44] <Not-a634>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/fAi6i
[20:25:46] <Not-a634>	 [02miraheze/mw-config] 07paladox 03ddad689 - Add Purge to ManageWiki fixes T3495 (#2456) * Add Purge to ManageWiki fixes T3495 * Update LocalSettings.php * Update LocalExtensions.php * Update extension-list
[20:25:47] <Not-a634>	 [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbvb3
[20:25:49] <Not-a634>	 [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1
[20:28:52] <Not-a634>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAi6N
[20:28:54] <Not-a634>	 [02miraheze/mw-config] 07paladox 03fa81a2a - Fix loading purge extension
[20:29:23] <paladox>	 !log sudo -u www-data php /srv/mediawiki/w/maint*/rebuildLocalisationCache.php --wiki test1wiki on mw* and test1
[20:29:28] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[20:50:10] <Not-a634>	 [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fAiP6
[20:50:11] <Not-a634>	 [02miraheze/mediawiki] 07MacFan4000 034d34795 - Update GUP
[20:59:58] <icinga-miraheze>	 PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]  
[21:00:22] <paladox>	 MacFan4000 that has a syntax error
[21:01:58] <icinga-miraheze>	 RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 36 seconds ago with 0 failures  
[21:01:58] <MacFan4000>	 !log running jobs everywhere
[21:02:03] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[21:02:40] <Not-a634>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fAi1e
[21:02:42] <Not-a634>	 [02miraheze/mediawiki] 07paladox 03d6d4f14 - Revert "Update GUP" This reverts commit 4d34795246192de38d75e775d5126cf9138e7004.
[21:02:54] <MacFan4000>	 link me to the syntax error
[21:03:01] <MacFan4000>	 please
[21:03:05] <MacFan4000>	 paladox:
[21:03:07] <paladox>	 i did
[21:03:12] <paladox>	 i wrote on your comment
[21:03:17] <paladox>	 https://github.com/macfanforks/mediawiki-extensions-GlobalUserPage/commit/d7e951561dbe8a89e5f544ff4ff0a04c2aa75e26
[21:03:18] <ZppixBot>	 Title: [ Update CacheInvalidator.php · macfanforks/mediawiki-extensions-GlobalUserPage@d7e9515 · GitHub ] - github.com
[21:07:48] <MacFan4000>	 paladox: https://github.com/macfanforks/mediawiki-extensions-GlobalUserPage/commit/2e09cc100e506a97b6f9f82ff8e042c077e348df
[21:07:49] <ZppixBot>	 Title: [ fix · macfanforks/mediawiki-extensions-GlobalUserPage@2e09cc1 · GitHub ] - github.com
[21:08:50] <MacFan4000>	 how does that look?
[21:09:46] <paladox>	 MacFan4000 GUPUseCache is disabled by default
[21:10:33] <paladox>	 it's still failed on REL1_31 https://github.com/macfanforks/mediawiki-extensions-GlobalUserPage/commit/d7e951561dbe8a89e5f544ff4ff0a04c2aa75e26
[21:10:34] <ZppixBot>	 Title: [ Update CacheInvalidator.php · macfanforks/mediawiki-extensions-GlobalUserPage@d7e9515 · GitHub ] - github.com
[21:10:41] <MacFan4000>	 yes and below is an if that says what to do if its disabled or set to false
[21:10:44] <paladox>	 also didn't john say no?
[21:10:51] <MacFan4000>	 no to what?
[21:11:02] <paladox>	 to disabling jobs in the jobqueue for gup?
[21:11:07] <MacFan4000>	 he never said to to not doing jobs at all
[21:11:12] <MacFan4000>	 he said go ahead I think
[21:11:41] <MacFan4000>	 there is literally no need for 26k jobs that only purge varnish
[21:20:56] <JohnLewis>	 I thought most of the jobs were htmlCacheUpdate
[21:21:40] <MacFan4000>	 well GUP still creates a lot of Jobs as well, and its been a longer term issue
[21:22:13] <JohnLewis>	 I know but these jobs are rare and aren’t exactly causing this issue
[21:22:33] <JohnLewis>	 keep in the jobs ARENT necessary but they SHOULD be ran
[21:23:03] <MacFan4000>	 GUP jobs art needed and don't need to be run
[21:23:13] <MacFan4000>	 arent
[21:23:50] <JohnLewis>	 But they should be
[21:23:56] <MacFan4000>	 no
[21:24:09] <JohnLewis>	 because caching differences. Also this won’t solve the issue 
[21:24:31] <JohnLewis>	 and I’d rather move GUP centrally off meta elsewhere 
[21:24:43] <MacFan4000>	 doesn't varnish already get purged plenty
[21:24:52] <JohnLewis>	 Clearing cache shouldn’t be done? Yes it should 
[21:25:00] <paladox>	 ^^
[21:25:10] <JohnLewis>	 Uh yes. By actions 
[21:25:15] <JohnLewis>	 by THESE actions 
[21:25:32] <MacFan4000>	 oh
[21:25:48] <JohnLewis>	 We should be upping cache retention to reduce mw load
[21:26:07] <paladox>	 JohnLewis lets do that now :)
[21:26:55] <paladox>	 JohnLewis is this https://github.com/miraheze/puppet/blob/master/modules/varnish/templates/default.vcl#L262 what we raise?
[21:26:56] <ZppixBot>	 Title: [ puppet/default.vcl at master · miraheze/puppet · GitHub ] - github.com
[21:28:46] <JohnLewis>	 Uh... ni
[21:29:01] <MacFan4000>	 ?
[21:29:12] <JohnLewis>	 for a first the line immediately below it says “say we can’t cache this”
[21:29:37] <paladox>	 oh
[21:29:44] <paladox>	 JohnLewis i let you do it so i learn then :)
[21:31:37] <JohnLewis>	 I have no idea rn and have no intention of doing so rn
[21:32:24] <paladox>	 ok
[22:05:30] <icinga-miraheze>	 PROBLEM - takethatwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds