[00:14:45] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 374 [00:16:45] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [00:46:41] !log removing images from the file storage [01:14:51] [02MirahezeMagic] 07The-Voidwalker opened pull request 03#60: add global interwiki - 13https://git.io/fhZzq [01:16:56] [02miraheze/MirahezeMagic] 07MacFan4000 pushed 032 commits to 03master [+0/-0/±4] 13https://git.io/fhZzY [01:16:57] [02miraheze/MirahezeMagic] 07The-Voidwalker 03298874e - add global interwiki [01:16:59] [02miraheze/MirahezeMagic] 07MacFan4000 03935601e - Merge pull request #60 from The-Voidwalker/patch-1 add global interwiki [01:17:00] [02MirahezeMagic] 07MacFan4000 closed pull request 03#60: add global interwiki - 13https://git.io/fhZzq [01:23:41] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_32 [+0/-0/±1] 13https://git.io/fhZzZ [01:23:43] [02miraheze/mediawiki] 07MacFan4000 032de421d - update mm [07:55:05] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhZVL [07:55:06] [02miraheze/CreateWiki] 07translatewiki 03b3e7b81 - Localisation updates from https://translatewiki.net. [07:55:08] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±12] 13https://git.io/fhZVt [07:55:09] [02miraheze/ManageWiki] 07translatewiki 0336c9ea1 - Localisation updates from https://translatewiki.net. [10:50:13] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhZry [10:50:14] [02miraheze/services] 07MirahezeSSLBot 03cfc1605 - BOT: Updating services config for wikis [12:20:17] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhZKL [12:20:19] [02miraheze/services] 07MirahezeSSLBot 03702ed63 - BOT: Updating services config for wikis [13:12:01] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 6511 [14:17:30] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 110 failures. Last run 3 minutes ago with 110 failures. Failed resources (up to 3 shown) [14:17:45] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Puppet has 118 failures. Last run 2 minutes ago with 118 failures. Failed resources (up to 3 shown): File[wiki.ciptamedia.org_private],File[athenapedia.org],File[athenapedia.org_private],File[podpedia.org] [14:25:29] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [14:25:44] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [14:55:26] Hello ty! If you have any questions feel free to ask and someone should answer soon. [15:01:56] does anyone know where I can read policy on what concepts for a wikia that Miraheze accepts? [15:02:17] and also if they know a way to transition a wiki as a mirror to an existing project through mass coping of files? [15:02:51] Wikia is deleting a bunch of projects lately, culling controversial ones, to prepare for the buyout from Fandom.com and I want to save some [16:45:14] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhZM3 [16:45:15] [02miraheze/services] 07MirahezeSSLBot 032d4b7b5 - BOT: Updating services config for wikis [17:42:02] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [18:33:07] PROBLEM - db4 Disk Space on db4 is WARNING: DISK WARNING - free space: / 49348 MB (13% inode=96%); [18:36:54] !log Renaming svwiki to psl631testwiki per T3967 [18:39:38] !log Renaming svwiki to psl631testwiki per T3967 [18:39:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:40:17] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhZyS [18:40:18] [02miraheze/services] 07MirahezeSSLBot 0353e2f9a - BOT: Updating services config for wikis [18:43:32] [02puppet] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbiAS [18:43:34] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/fhZy7 [18:43:35] [02miraheze/puppet] 07paladox 03a5c63fc - irc: Switch service to use systemd module [18:43:37] [02puppet] 07paladox opened pull request 03#967: irc: Switch service to use systemd module - 13https://git.io/fhZy5 [18:44:57] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+1/-1/±0] 13https://git.io/fhZyb [18:44:59] [02miraheze/puppet] 07paladox 03026e916 - Update and rename modules/irc/files/ircrcbot/ircrcbot.systemd to modules/irc/templates/initscripts/ircrcbot.systemd.erb [18:45:00] [02puppet] 07paladox synchronize pull request 03#967: irc: Switch service to use systemd module - 13https://git.io/fhZy5 [18:46:14] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/fhZyN [18:46:16] [02miraheze/puppet] 07paladox 034ff4779 - Update irclogbot.pp [18:46:17] [02puppet] 07paladox synchronize pull request 03#967: irc: Switch service to use systemd module - 13https://git.io/fhZy5 [18:46:42] what's the origin of Not-8d6a's name? [18:46:59] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+1/-1/±0] 13https://git.io/fhZyA [18:47:01] [02miraheze/puppet] 07paladox 039193724 - Update and rename modules/irc/files/logbot/adminbot.systemd to modules/irc/templates/initscripts/logbot.systemd.erb [18:47:02] [02puppet] 07paladox synchronize pull request 03#967: irc: Switch service to use systemd module - 13https://git.io/fhZy5 [18:47:04] sounds like the beginning of the hash of a terrible commit [18:48:04] [02puppet] 07paladox edited pull request 03#967: irc: Switch service to use systemd module - 13https://git.io/fhZy5 [18:54:35] [02puppet] 07paladox closed pull request 03#967: irc: Switch service to use systemd module - 13https://git.io/fhZy5 [18:54:37] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+2/-2/±2] 13https://git.io/fhZSI [18:54:38] [02miraheze/puppet] 07paladox 033ac3c71 - irc: Switch service to use systemd module (#967) * irc: Switch service to use systemd module * Update and rename modules/irc/files/ircrcbot/ircrcbot.systemd to modules/irc/templates/initscripts/ircrcbot.systemd.erb * Update irclogbot.pp * Update and rename modules/irc/files/logbot/adminbot.systemd to modules/irc/templates/initscripts/logbot.systemd.erb [18:54:56] shreyasminocha hi, im not sure where it get's it's name from [18:55:13] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-2 [18:55:15] [02puppet] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbiAS [18:55:16] hey. k, thanks [18:55:40] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhZSq [18:55:41] [02miraheze/puppet] 07paladox 03e32c628 - adminbot -> logbot [19:05:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhZSu [19:05:14] [02miraheze/services] 07MirahezeSSLBot 031f1e74c - BOT: Updating services config for wikis [19:37:10] PROBLEM - public.revi.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'public.revi.wiki' expires in 15 day(s) (Sat 26 Jan 2019 07:34:01 PM GMT +0000). [20:26:02] paladox: ^^ where’s the ssl bot? [20:26:22] hmm [20:26:40] public.revi.wiki redirects [20:27:18] hmm bot likley broken... [20:31:52] Jan 10 20:31:37 mw1 python3[22315]: 185.52.1.76 - - [10/Jan/2019 20:31:37] "POST /renew HTTP/1.1" 204 - [20:33:54] that's why the cert does not exist in /etc/letsencrypt/live/ [20:35:50] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhZHJ [20:35:51] [02miraheze/ssl] 07paladox 0395b073c - Update public.revi.wiki.crt [20:36:22] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhZHU [20:36:24] [02miraheze/ssl] 07MirahezeSSLBot 031da4276 - Bot: Update SSL cert for public.revi.wiki [20:43:10] RECOVERY - public.revi.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'public.revi.wiki' will expire on Wed 10 Apr 2019 07:36:15 PM GMT +0000. [21:42:54] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fhZQO [21:42:56] [02miraheze/mediawiki] 07paladox 03f3cd81d - Update MM [22:18:41] [02miraheze/mediawiki] 07paladox pushed 036 commits to 03REL1_32 [+0/-0/±11] 13https://git.io/fhZQb [22:18:42] [02miraheze/mediawiki] 0720after4 03c8f3baf - Bump wgVersion to 1.32.0-rc.2 Change-Id: I9315052211e9df3497e353a743c1a96e13ee9ca5 [22:18:44] [02miraheze/mediawiki] 0720after4 037ae4e88 - Bump $wgVersion to 1.32.0 Preparing for the MediaWiki 1.32.0 final tarball release. Change-Id: I9734b013f4cde3e8531107ea7b1f1356fec5bfb5 [22:18:45] [02miraheze/mediawiki] 07Brad Jorsch 0366f0b24 - Fix slow queries in migrateActors.php MariaDB really doesn't like the complicated OR in the join condition for the actor table, it winds up scanning the whole actor table to find the match. After trying several different options, the best bet seems to be to use subqueries to get the actor_id. MariaDB also doesn't like the DISTINCTed query for log_search, it gets [22:18:45] confused if the selected fields contain other fields much like it historically gets confused when GROUP BY contains fields that are constant in the WHERE clause. So we'll do the select from log_search in a subquery and then join with actor, and inject the constant ls_field into the rows as a constant field. Bug: T188327 Change-Id: I979c040441f83bdf36e2f4031152559391233e5f (cherry picked from commit [22:18:45] 117a6c51f2fad6f6395df742c404a359e31185fb) [22:18:47] [02miraheze/mediawiki] ... and 3 more commits. [22:32:31] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_32 [+0/-0/±1] 13https://git.io/fhZ7k [22:32:33] [02miraheze/mediawiki] 07paladox 03b0ad3b3 - Update CookieWarning to 995c3befeea4f8225ea6e0b1e44968939468ce5c [22:41:48] [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbvb3 [22:41:50] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fhZ7m [22:41:51] [02miraheze/mw-config] 07paladox 03110b6ec - Update Sitenotice.php [22:41:53] [02mw-config] 07paladox opened pull request 03#2596: Update Sitenotice.php - 13https://git.io/fhZ7Y [22:44:37] [02mw-config] 07paladox closed pull request 03#2596: Update Sitenotice.php - 13https://git.io/fhZ7Y [22:44:39] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhZ7G [22:44:40] [02miraheze/mw-config] 07paladox 037f8ee98 - Update Sitenotice.php (#2596) [22:44:42] [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbvb3 [22:44:43] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1 [22:52:51] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 313 [22:54:50] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [23:01:26] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhZ7R [23:01:28] [02miraheze/mw-config] 07paladox 03ae5b2fc - Set wgCookieSetOnIpBlock to true (mw 1.32 config) [23:02:01] Hello mirahezeuser8108! If you have any questions feel free to ask and someone should answer soon. [23:02:18] Version 1.32 :o [23:02:20] ? [23:02:21] * [23:02:45] soon [23:03:39] yeah!! :D [23:12:56] [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhZ7a [23:12:58] [02miraheze/CreateWiki] 07paladox 03a79ea53 - Set $IP for DBListGenerator.php [23:13:56] what's with that newline [23:15:42] was following the few lines below [23:17:15] he's a follower not a leader :P [23:17:21] [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fhZ7r [23:17:23] [02miraheze/CreateWiki] 07paladox 039ef4bf0 - Set $customGroup to interface-admin if on mw 1.32+ [23:17:25] [02CreateWiki] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vpJTL [23:17:26] [02CreateWiki] 07paladox opened pull request 03#107: Set $customGroup to interface-admin if on mw 1.32+ - 13https://git.io/fhZ7o [23:18:01] JohnLewis ha ha [23:18:04] uh 2 things [23:18:39] miraheze/CreateWiki/paladox-patch-1/9ef4bf0 - paladox The build was fixed. https://travis-ci.com/miraheze/CreateWiki/builds/96976106 [23:18:57] 1 thing actually; rather specific don't you think? maybe not everyone want's that to happen? [23:19:14] hmm [23:19:20] i guess so [23:19:52] just assign the userrights to 'crats, right? [23:20:03] ah [23:20:05] ok [23:20:08] * paladox does that [23:20:30] that too [23:20:54] [02CreateWiki] 07paladox closed pull request 03#107: Set $customGroup to interface-admin if on mw 1.32+ - 13https://git.io/fhZ7o [23:20:57] [02miraheze/CreateWiki] 07paladox deleted branch 03paladox-patch-1 [23:20:58] [02CreateWiki] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vpJTL [23:22:18] [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbvb3 [23:22:19] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fhZ7P [23:22:21] [02miraheze/mw-config] 07paladox 034a8091a - Grant interface-admin to crats [23:22:22] [02mw-config] 07paladox opened pull request 03#2597: Grant interface-admin to crats - 13https://git.io/fhZ7X [23:22:44] uh [23:22:50] 1) interface-admin isn't a user right [23:22:54] 2) it's not blacklisted [23:23:00] so that is 100% the wrong way to do thing [23:23:14] 3) sysops is not a usergroup [23:23:26] JohnLewis ok, mind doing it please? (so that i learn where to do this) [23:23:35] in the database [23:23:44] ManageWiki::modifyPermissions [23:24:44] hmm [23:25:30] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 98 failures. Last run 2 minutes ago with 98 failures. Failed resources (up to 3 shown) [23:27:02] paladox: give me 5 minutes I'll make it super easy for oyu [23:27:09] JohnLewis thanks! [23:27:23] in the mean time i'll depool mw1 [23:27:45] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Puppet has 109 failures. Last run 3 minutes ago with 109 failures. Failed resources (up to 3 shown): File[pwiki.arkcls.com_private],File[kunwok.org],File[kunwok.org_private],File[www.splat-teams.com] [23:28:03] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhZ79 [23:28:05] [02miraheze/puppet] 07paladox 03180753f - increase heap for puppetserver [23:29:43] !log depool mw1 [23:29:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [23:30:51] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhZ7F [23:30:53] [02miraheze/puppet] 07paladox 033f5c6e7 - Upgrade mw1 to MediaWiki 1.32 [23:33:29] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 13 seconds ago with 0 failures [23:34:40] PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 1 backends are down. mw1 [23:34:50] PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 1 backends are down. mw1 [23:35:40] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [23:35:44] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:36:00] PROBLEM - cp5 Varnish Backends on cp5 is CRITICAL: 1 backends are down. mw1 [23:39:53] [02miraheze/ManageWiki] 07JohnFLewis pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/fhZ7h [23:39:54] paladox [23:39:55] [02miraheze/ManageWiki] 07JohnFLewis 038624d36 - add modifyGroupPermission [23:40:02] * paladox looks [23:40:12] yay [23:40:13] thanks! [23:40:30] JohnLewis now how do we add it to users when there wiki is created? [23:40:46] Special:ManageWikiDefaultPermissions on metawiki [23:40:51] ok [23:41:22] that's amazing JohnLewis :) [23:42:03] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_32 [+0/-0/±1] 13https://git.io/fhZ7j [23:42:04] [02miraheze/mediawiki] 07paladox 03dd53a14 - Update ManageWiki [23:54:00] RECOVERY - cp5 Varnish Backends on cp5 is OK: All 5 backends are healthy [23:54:40] RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy [23:54:50] RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy [23:55:27] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 676