[00:03:11] PROBLEM - misc3 Puppet on misc3 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:15] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:27] PROBLEM - misc4 Puppet on misc4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:41] PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:42] [02mw-config] 07Amanda-Catherine opened pull request 03#2457: Add ApprovedRevs and Purge to MWP on weatherwiki - 13https://git.io/fAX6S [00:04:03] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:04:15] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:04:33] PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:04:42] [02mw-config] 07paladox closed pull request 03#2457: Add ApprovedRevs and Purge to MWP on weatherwiki - 13https://git.io/fAX6S [00:04:44] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAX65 [00:04:45] [02miraheze/mw-config] 07Amanda-Catherine 036b2d040 - Add ApprovedRevs and Purge to MWP on weatherwiki (#2457) These are both extensions that I’m interested in using, and by default it seems that nobody has the necessary rights to use the extensions. [00:05:10] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAX6b [00:05:11] [02miraheze/mw-config] 07paladox 03c7ece33 - Fix syntax [00:09:31] paladox: you shouldn't have merged that [00:09:39] JohnLewis oh? [00:09:46] 1) if that actually accurate then way. Those exts are awful [00:09:47] ok, i can revert JohnLewis if you want? [00:10:05] and 2) add them to the $wmgUse's because otherwise the exts are useless being in ManageWiki [00:10:35] [02miraheze/mw-config] 07paladox pushed 032 commits to 03master [+0/-0/±2] 13https://git.io/fAXiY [00:10:37] [02miraheze/mw-config] 07paladox 031b5f9e2 - Revert "Fix syntax" This reverts commit c7ece3337efd2ca72ecfc4ee0d2e603b880710d5. [00:10:38] JohnLewis ^^ [00:10:38] [02miraheze/mw-config] 07paladox 030bbf718 - Revert "Add ApprovedRevs and Purge to MWP on weatherwiki (#2457)" This reverts commit 6b2d0400a53c54e9ab45802655524b1d7402b2eb. [00:11:09] RECOVERY - misc3 Puppet on misc3 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [00:11:15] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 17 seconds ago with 0 failures [00:11:41] RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 39 seconds ago with 0 failures [00:11:45] okay now do 1 or 2 as appropriate [00:12:00] JohnLewis ? [00:12:15] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 57 seconds ago with 0 failures [00:12:22] 1) if that is the case, those exts are awful and just wow [00:12:29] JohnLewis i guess add them to wgManageWikiPermissionsAdditionalRights ? [00:12:35] 2) if so, add them to the $wmgUse's otherwise the exts are useless [00:12:39] no [00:12:40] ok [00:13:27] RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:13:34] JohnLewis im not sure which wmgUse your talking about? [00:14:13] JohnLewis i guess $wmgUseApprovedRevs [00:14:17] and $wmgUsePurge? [00:14:33] RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:14:41] yes [00:15:18] ok [00:15:58] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAXig [00:16:00] [02miraheze/mw-config] 07paladox 038dc263e - Add ApprovedRevs and Purge to MWP if ext is enabled Follows up to https://github.com/miraheze/mw-config/commit/6b2d0400a53c54e9ab45802655524b1d7402b2eb [00:16:01] JohnLewis ^^ [00:16:01] Title: [ Add ApprovedRevs and Purge to MWP on weatherwiki (#2457) · miraheze/mw-config@6b2d040 · GitHub ] - github.com [00:16:03] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 12 seconds ago with 0 failures [00:16:21] yeah [00:16:30] of course that should also be fixed upstream :) [00:16:53] ok heh [00:21:52] [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAXiX [00:21:54] [02miraheze/CreateWiki] 07paladox 03d8d76f6 - Update renameWiki.php [00:22:26] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fAXiM [00:22:28] [02miraheze/mediawiki] 07paladox 03f1fbf23 - Update CW [00:28:36] [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAXix [00:28:37] [02miraheze/CreateWiki] 07paladox 03594fd9c - Fix getArg part 1 [00:28:40] JohnLewis ^^ [00:28:59] awesome [00:29:08] [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAXip [00:29:08] #needstoreaddocsbetter [00:29:10] [02miraheze/CreateWiki] 07paladox 034648308 - Fix getArg part 2 [00:29:18] JohnLewis you use twitter? [00:29:25] I used to :P [00:29:46] lol [00:29:52] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fAXih [00:29:53] [02miraheze/mediawiki] 07paladox 03a7daed0 - Update CW [00:29:58] i had a account on there once but deleted it [00:33:15] [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAXPI [00:33:16] [02miraheze/ManageWiki] 07paladox 03fe13b1b - Fix syntax [00:34:53] [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAXP3 [00:34:55] [02miraheze/CreateWiki] 07paladox 036aa91cf - Remove unused var [00:35:29] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±2] 13https://git.io/fAXPs [00:35:31] [02miraheze/mediawiki] 07paladox 039d2b023 - Update CW and MW [00:40:10] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAXPW [00:40:11] [02miraheze/mw-config] 07paladox 03ac342b4 - Set wgCreateWikiNotificationEmail to staff@miraheze.org [00:41:53] I wouldn't have put the @ in the commit message ;0 [00:41:55] *;) [00:42:03] *crap* [00:44:08] miraheze/ManageWiki/master/fe13b1b - paladox The build has errored. https://travis-ci.org/miraheze/ManageWiki/builds/428856704 [01:02:04] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAXXe [01:02:06] [02miraheze/mw-config] 07paladox 034d0c2a5 - Add WikiForum to MWP if ext is enabled [01:04:32] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 14 seconds ago with 0 failures [02:30:15] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAXMV [02:30:16] [02miraheze/services] 07MirahezeSSLBot 03ccfa7a9 - BOT: Updating services config for wikis [05:41:34] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [06:50:13] PROBLEM - db4 Disk Space on db4 is WARNING: DISK WARNING - free space: / 76924 MB (20% inode=94%); [08:41:34] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 449 [08:45:34] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [12:19:35] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 3153 [13:27:33] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [13:47:35] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 3161 [13:51:00] Morning [13:52:58] hi [13:53:31] paladox: did the spambots come back (seeing how the channel is muted again)? [13:53:36] yep [13:53:47] they have been hitting all the channels again. [13:54:26] This is the first time I’ve seen them hit #wikimedia-cloud though [13:55:01] Before I think they had banned $~a [13:55:41] *sigh* [13:56:14] AmandaCatherine John created this blog post https://phabricator.miraheze.org/phame/post/view/2/managewikipermissions_the_good_the_bad_the_ugly/ if your interested. [13:56:16] Title: [ ✩ ManageWikiPermissions: The Good, The Bad, The Ugly ] - phabricator.miraheze.org [13:56:18] oh wait [13:56:24] let me get you the better url [13:56:32] https://blog.miraheze.org/post/2/managewikipermissions_the_good_the_bad_the_ugly/ [13:56:33] Title: [ ✩ ManageWikiPermissions: The Good, The Bad, The Ugly ] - blog.miraheze.org [13:57:34] I saw it already [13:57:45] Didn’t really read it in detail though [14:00:58] ok [14:14:19] https://mobile.twitter.com/miraheze/status/1040966976989028354 [14:14:20] Title: [ Twitter ] - mobile.twitter.com [14:14:30] Just tweeted about the post [14:14:45] ok thanks. [14:26:41] PROBLEM - astrapedia.ru - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'astrapedia.ru' expires in 15 day(s) (Mon 01 Oct 2018 02:23:12 PM GMT +0000). [14:26:52] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA1vM [14:26:53] [02miraheze/ssl] 07MirahezeSSLBot 03d8269a0 - Bot: Update SSL cert for astrapedia.ru [14:32:39] RECOVERY - astrapedia.ru - LetsEncrypt on sslhost is OK: OK - Certificate 'astrapedia.ru' will expire on Fri 14 Dec 2018 01:26:46 PM GMT +0000. [14:43:35] paladox: ^ where's the bot [14:43:43] Reception123 bot? [14:44:01] oh nevermind [14:47:52] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA1Je [14:47:53] [02miraheze/puppet] 07paladox 0313e3574 - Increase upload_max_filesize to 10M [15:34:39] !log sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=loathsomecharacterswiki --report=1 loathsomecharacters_pages_full.xml on mw1 in a screen [15:34:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [16:06:35] Voidwalker: you deleted that page while I was in process of marking it for deletion :P [16:06:47] :P [17:13:33] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [18:29:36] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 3464 [19:01:12] $voice list [19:01:50] $log test test test [19:01:51] paladox, Saved item "test test test". [21:57:34] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [23:14:51] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA1C1 [23:14:52] [02miraheze/puppet] 07paladox 034e376cb - Add mediawiki grants to mhglobal db per T3597 [23:14:55] JohnLewis ^^ [23:16:24] !log apply new mediawiki grants [23:16:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [23:17:56] !log create mhglobal db [23:18:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [23:26:10] [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbvb3 [23:26:11] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fA1Wk [23:26:12] [02miraheze/mw-config] 07paladox 032d9a605 - Switch wgCreateWikiDatabase to mhglobal [23:26:14] [02mw-config] 07paladox opened pull request 03#2458: Switch wgCreateWikiDatabase to mhglobal - 13https://git.io/fA1WI [23:27:05] [02mw-config] 07paladox synchronize pull request 03#2458: Switch wgCreateWikiDatabase to mhglobal - 13https://git.io/fA1WI [23:27:06] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fA1Wq [23:27:08] [02miraheze/mw-config] 07paladox 032f516a7 - Update LocalSettings.php [23:27:17] [02mw-config] 07paladox synchronize pull request 03#2458: Switch wgCreateWikiDatabase to mhglobal - 13https://git.io/fA1WI [23:27:19] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fA1Wm [23:27:20] [02miraheze/mw-config] 07paladox 0391d61a4 - Update LocalSettings.php [23:29:13] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA1W3 [23:29:15] [02miraheze/mw-config] 07paladox 03c4df144 - Update Sitenotice.php [23:31:01] [02mw-config] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbvb3 [23:31:02] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/fA1WZ [23:31:04] [02miraheze/mw-config] 07paladox 030e0f104 - Set wiki's into read only mode [23:31:05] [02mw-config] 07paladox opened pull request 03#2459: Set wiki's into read only mode - 13https://git.io/fA1Wn [23:31:31] [02mw-config] 07paladox edited pull request 03#2458: Switch createwiki, matomo and centralauth to use mhglobal as db - 13https://git.io/fA1WI [23:35:56] [02mw-config] 07paladox synchronize pull request 03#2458: Switch createwiki, matomo and centralauth to use mhglobal as db - 13https://git.io/fA1WI [23:35:58] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fA1WR [23:35:59] [02miraheze/mw-config] 07paladox 0334d95a6 - Update LocalSettings.php [23:37:22] [02mw-config] 07paladox closed pull request 03#2459: Set wiki's into read only mode - 13https://git.io/fA1Wn [23:37:23] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA1Wu [23:37:25] [02miraheze/mw-config] 07paladox 03f825e52 - Set wiki's into read only mode (#2459) [23:37:30] [02mw-config] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbvb3 [23:37:32] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-2 [23:40:16] [02mw-config] 07paladox closed pull request 03#2458: Switch createwiki, matomo and centralauth to use mhglobal as db - 13https://git.io/fA1WI [23:40:18] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA1Wg [23:40:19] [02miraheze/mw-config] 07paladox 03d86593f - Switch createwiki, matomo and centralauth to use mhglobal as db (#2458) * Switch wgCreateWikiDatabase to mhglobal * Update LocalSettings.php * Update LocalSettings.php * Update LocalSettings.php [23:40:21] [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbvb3 [23:40:22] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1 [23:41:14] PROBLEM - mw1 Puppet on mw1 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 3 minutes ago with 0 failures [23:41:38] PROBLEM - mw3 Puppet on mw3 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 3 minutes ago with 0 failures [23:41:44] [02mw-config] 07JohnFLewis reviewed pull request 03#2458 commit - 13https://git.io/fA1WV [23:42:04] PROBLEM - test1 Puppet on test1 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 10 minutes ago with 0 failures [23:42:33] PROBLEM - mw2 Puppet on mw2 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 4 minutes ago with 0 failures [23:44:43] [02miraheze/ManageWiki] 07JohnFLewis pushed 032 commits to 03master [+0/-0/±3] 13https://git.io/fA1WK [23:44:44] [02miraheze/ManageWiki] 07JohnFLewis 03f8079b6 - convert usage of string to int and use incr not del/set [23:44:46] [02miraheze/ManageWiki] 07JohnFLewis 039fb417e - Merge branch 'master' of github.com:miraheze/ManageWiki [23:45:33] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 360 [23:45:47] miraheze/ManageWiki/master/9fb417e - John Lewis The build passed. https://travis-ci.org/miraheze/ManageWiki/builds/429107502 [23:45:51] [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fA1Wi [23:45:53] [02miraheze/mediawiki] 07JohnFLewis 03002d93e - update MW [23:46:47] [02mw-config] 07Amanda-Catherine commented on commit 03f825e52c2b5e8c7e73b02c63a5cdeda8ebf9b166 - 13https://git.io/fA1WP [23:49:15] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [23:49:37] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [23:50:05] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [23:50:08] [02mw-config] 07paladox commented on commit 03f825e52c2b5e8c7e73b02c63a5cdeda8ebf9b166 - 13https://git.io/fA1WD [23:50:33] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:50:45] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA1W9 [23:50:47] [02miraheze/mw-config] 07paladox 0379614e7 - Fix comment [23:51:14] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA1WQ [23:51:15] [02miraheze/mw-config] 07paladox 03ab8c6e4 - Take wikis out of read only mode [23:51:33] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fA1W5 [23:51:35] [02miraheze/mw-config] 07paladox 03a401f4b - Remove sitenoitce [23:53:31] !log drop tables cw_wikis, cw_requests, cw_comments, mw_permissions and matomo from metawiki; [23:53:33] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [23:53:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [23:55:20] !log drop database centralauth has been moved to a new db [23:55:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [23:55:41] uh [23:55:42] crap [23:56:03] Unknown database 'centralauth' [23:56:24] Voidwalker fixed temp, i thought i switched it to the new db [23:58:06] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]