[00:04:49] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.87, 6.47, 5.14 [00:06:37] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.91, 6.93, 5.56 [00:06:47] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.33, 6.55, 5.35 [00:08:34] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.05, 6.20, 5.45 [00:10:44] PROBLEM - mw11 Puppet on mw11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [00:11:10] PROBLEM - jobrunner3 Puppet on jobrunner3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [00:11:56] PROBLEM - mw10 Puppet on mw10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [00:11:58] PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [00:12:01] [02mw-config] 07Universal-Omega opened pull request 03#3823: T7117: Update SQLs to 1.36; convert to ExtensionRegistry where possible with REL1_36 - 13https://git.io/JYhp2 [00:12:39] PROBLEM - mw8 Puppet on mw8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [00:13:03] miraheze/mw-config - Universal-Omega the build passed. [00:18:27] paladox, or JohnLewis, if either of you are around, mind restarting MirahezeRC bot and voicing it? [00:19:21] !log restart ircrcbot [00:19:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:21:48] thanks :) [00:34:43] RECOVERY - mw11 Puppet on mw11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:34:44] RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 22 seconds ago with 0 failures [00:35:05] RECOVERY - jobrunner3 Puppet on jobrunner3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:35:55] RECOVERY - mw10 Puppet on mw10 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:35:57] RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:45:02] PROBLEM - wiki.mlpwiki.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mlpwiki.net reverse DNS resolves to 192-185-16-85.unifiedlayer.com [00:46:20] paladox: how come the MediaWiki logo wasn't updated with 1.35.2? Does that need purged? [00:49:15] Universal_Omega, haven't we just deployed MW 1.35.2 only on Test 3 Wiki so far? [00:49:49] @Doug: no, it is everywhere I think. [00:50:04] [[Special:Version]] says 1.35.2 on meta so [00:50:05]

https://meta.miraheze.org/wiki/Special:Version [00:50:07] [ Version - Miraheze Meta ] - meta.miraheze.org [01:14:13] ah, yeah hadn't checked that [01:15:14] I didn't realize the upgrade to MW 1.35.2 was going to happen that quickly; thought there was going to be more testing [01:15:41] How major of an update to 1.35 is 1.35.2? Is it worth posting an update to the news section on Main Page? [01:16:16] dmehus: extensive testing is not needed on those minor upgrades. Just some testing to avoid fatal, which I assume was done. [01:16:31] And no don't need to put notice, didn't for 1.35.1 [01:16:44] Only for major upgrades I think. [01:17:26] Universal_Omega, oh when did we upgrade to 1.35.1? I didn't realize there's been one update already since 1.35 [01:18:15] Yeah there was. It wouldn't have gone from 1.35.0 to 1.35.2, but yeah we did update to 1.35.1 when it came out. [01:19:10] [[Module:Category handler/data]] [01:19:11]

https://meta.miraheze.org/wiki/Module:Category_handler/data [01:19:12] [ Module:Category handler/data - Miraheze Meta ] - meta.miraheze.org [01:20:32] [[Module:Category handler/config]] [01:20:32]

https://meta.miraheze.org/wiki/Module:Category_handler/config [01:20:33] [ Module:Category handler/config - Miraheze Meta ] - meta.miraheze.org [01:22:04] [[Module:Category handler/shared]] [01:22:05]

https://meta.miraheze.org/wiki/Module:Category_handler/shared [01:22:06] [ Module:Category handler/shared - Miraheze Meta ] - meta.miraheze.org [01:23:11] [[Module:Category handler/blacklist]] [01:23:12]

https://meta.miraheze.org/wiki/Module:Category_handler/blacklist [01:23:13] [ Module:Category handler/blacklist - Miraheze Meta ] - meta.miraheze.org [01:23:24] @Mister OwO You can do that in #bot-commands-spam [01:23:27] [02ManageWiki] 07Universal-Omega opened pull request 03#265: Blacklist downloaduserdata from preferences form type - 13https://git.io/JYjTl [01:23:46] Oh, my apology. [01:24:15] [02ManageWiki] 07Universal-Omega synchronize pull request 03#265: Blacklist downloaduserdata from preferences form type - 13https://git.io/JYjTl [01:24:32] miraheze/ManageWiki - Universal-Omega the build passed. [01:25:12] miraheze/ManageWiki - Universal-Omega the build passed. [01:48:51] Hello once again ! I try to read this “log” and I got a few questions concern it : 1. What is [C] ? 2. Does “in function” means a module is working ? 3. What is “tail call” ? 4. Some modules are highlighted in blue, what does that means ? Thank for reading and I’m sorry for being tech-illiterate. [01:48:52] https://cdn.discordapp.com/attachments/808001911868489748/829895602807504947/image0.png [01:51:11] @Mister OwO It appears that you are missing the [[Module:Namespace detect/data]] module on your wiki [01:51:11]

https://meta.miraheze.org/wiki/Module:Namespace_detect/data [01:51:12] [ Module:Namespace detect/data - Miraheze Meta ] - meta.miraheze.org [01:51:53] @dorito Yes I’m implement module per the machine’s request. [01:51:58] Oh, nevermind, you are missing [[Module:Namespace detect/config]]. [01:51:58]

https://meta.miraheze.org/wiki/Module:Namespace_detect/config [01:51:59] [ Module:Namespace detect/config - Miraheze Meta ] - meta.miraheze.org [01:52:34] Also, module/template related questions can usually go in #miraheze-relay instead of here, this channel is usually for reporting infrastructure problems or technical discussion [01:52:59] @dorito Oh, alright, thank. [02:52:10] !log jobrunner3: sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/w/cache/databases.json /srv/mediawiki/w/maintenance/runJobs.php [02:52:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:42:31] !log GDPR removal [03:42:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:54:57] !log delete logging entry on terribletvshowswiki [03:55:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:14:05] [02ManageWiki] 07Reception123 closed pull request 03#265: Blacklist downloaduserdata from preferences form type - 13https://git.io/JYjTl [05:14:07] [02miraheze/ManageWiki] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JYj2h [05:14:08] [02miraheze/ManageWiki] 07Universal-Omega 032c252c9 - Blacklist downloaduserdata from preferences form type (#265) [05:15:10] miraheze/ManageWiki - Reception123 the build passed. [05:20:56] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JYjad [05:20:58] [02miraheze/mediawiki] 07Reception123 03ecfe8a7 - Update ManageWiki [06:54:35] [02mediawiki] 07RhinosF1 closed pull request 03#1444: Dependabot: Switch to REL1_36 - 13https://git.io/JYbMt [06:54:37] [02miraheze/mediawiki] 07RhinosF1 pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JYjSh [06:54:38] [02miraheze/mediawiki] 07RhinosF1 0349087ad - Dependabot: Switch to REL1_36 (#1444) [06:54:40] [02mediawiki] 07RhinosF1 deleted branch 03RhinosF1-patch-1 - 13https://git.io/vbL5b [06:54:41] [02miraheze/mediawiki] 07RhinosF1 deleted branch 03RhinosF1-patch-1 [06:57:59] [02miraheze/mediawiki] 07RhinosF1 pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JYj9S [06:58:01] [02miraheze/mediawiki] 07RhinosF1 03a20b4b9 - Dependabot: Switch to REL1_36 (#1444) [07:17:26] [02miraheze/mediawiki] 07RhinosF1 pushed 031 commit to 03REL1_35 [+1/-0/±1] 13https://git.io/JYj5i [07:17:27] [02miraheze/mediawiki] 07RhinosF1 03b51dd00 - + SLF [07:24:29] [02miraheze/mediawiki] 07RhinosF1 pushed 031 commit to 03REL1_36 [+1/-0/±1] 13https://git.io/JYjdF [07:24:31] [02miraheze/mediawiki] 07RhinosF1 03f056cb6 - + SLF [07:26:34] [02miraheze/mediawiki] 07RhinosF1 pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JYjFt [07:26:36] [02miraheze/mediawiki] 07RhinosF1 038e9f78b - Update .gitmodules [07:26:57] [02miraheze/mediawiki] 07RhinosF1 pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JYjFs [07:26:58] [02miraheze/mediawiki] 07RhinosF1 038eaf20f - Update .gitmodules [07:28:00] [02miraheze/mw-config] 07RhinosF1 created branch 03REL1_36 13https://git.io/JYjF2 [07:28:02] [02mw-config] 07RhinosF1 created branch 03REL1_36 - 13https://git.io/vbvb3 [07:28:18] [02mw-config] 07RhinosF1 edited pull request 03#3823: T7117: Update SQLs to 1.36; convert to ExtensionRegistry where possible with REL1_36 - 13https://git.io/JYhp2 [07:28:38] [02mw-config] 07RhinosF1 closed pull request 03#3823: T7117: Update SQLs to 1.36; convert to ExtensionRegistry where possible with REL1_36 - 13https://git.io/JYhp2 [07:28:40] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03REL1_36 [+0/-0/±4] 13https://git.io/JYjFi [07:28:41] [02miraheze/mw-config] 07Universal-Omega 033c06cef - T7117: Update SQLs to 1.36; convert to ExtensionRegistry where possible with REL1_36 (#3823) [07:29:29] [02mw-config] 07RhinosF1 closed pull request 03#3817: Flaggedrevs: don't use 1.36 removed config for new installs - 13https://git.io/JYNpt [07:29:31] [02miraheze/mw-config] 07RhinosF1 deleted branch 03RhinosF1-patch-1 [07:29:33] [02mw-config] 07RhinosF1 deleted branch 03RhinosF1-patch-1 - 13https://git.io/vbvb3 [07:31:07] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JYjFx [07:31:09] [02miraheze/mw-config] 07RhinosF1 03d33828a - LS: remove gone FR stuff [07:32:05] [02mw-config] 07RhinosF1 opened pull request 03#3824: Update config for 1.36 - 13https://git.io/JYjbk [07:33:07] miraheze/mw-config - RhinosF1 the build passed. [07:44:57] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-4 [+0/-0/±2] 13https://git.io/JYjN6 [07:44:59] [02miraheze/mw-config] 07Reception123 03d25a61d - enable SecureLinkFixer globally T7116 [07:45:00] [02mw-config] 07Reception123 created branch 03Reception123-patch-4 - 13https://git.io/vbvb3 [07:45:04] [02mw-config] 07Reception123 opened pull request 03#3825: enable SecureLinkFixer globally T7116 - 13https://git.io/JYjN1 [07:46:08] miraheze/mw-config - Reception123 the build passed. [07:46:42] Looks good [07:46:57] RhinosF1: https://test3.miraheze.org/wiki/Test seems to work yeah [07:46:58] [ Test - Test3 ] - test3.miraheze.org [07:47:13] Then make global [07:47:24] [02mw-config] 07Reception123 closed pull request 03#3825: enable SecureLinkFixer globally T7116 - 13https://git.io/JYjN1 [07:47:26] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JYjAL [07:47:27] [02miraheze/mw-config] 07Reception123 03252c80e - enable SecureLinkFixer globally T7116 (#3825) [07:47:28] I'll manually merge config closer to the time to my config 1.36 branch [07:47:33] this was definitely a very easy install [07:47:36] [02mw-config] 07Reception123 deleted branch 03Reception123-patch-4 - 13https://git.io/vbvb3 [07:47:37] [02miraheze/mw-config] 07Reception123 deleted branch 03Reception123-patch-4 [08:15:12] what's going on with Freenode today [08:15:40] Net splits [08:15:53] Server<->Server is timing out due to network issues [08:15:56] yeah, though what's up with the excess flood messaging? [08:16:11] Random nonsense that comes with this [08:23:38] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/ManageWiki-2c252c9 [+0/-0/±1] 13https://git.io/JOeeZ [08:23:39] [02miraheze/mediawiki] 07dependabot[bot] 035308612 - Bump extensions/ManageWiki from `5f50e32` to `2c252c9` [08:23:41] [02mediawiki] 07dependabot[bot] opened pull request 03#1447: Bump extensions/ManageWiki from `5f50e32` to `2c252c9` - 13https://git.io/JOeen [08:23:42] [02mediawiki] 07dependabot[bot] labeled pull request 03#1447: Bump extensions/ManageWiki from `5f50e32` to `2c252c9` - 13https://git.io/JOeen [08:23:43] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/ManageWiki-2c252c9 - 13https://git.io/vbL5b [08:24:03] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/ArticleToCategory2-4921d6d [+0/-0/±1] 13https://git.io/JOeeR [08:24:04] [02miraheze/mediawiki] 07dependabot[bot] 03b9d3a00 - Bump extensions/ArticleToCategory2 from `116ad1b` to `4921d6d` [08:24:06] [02mediawiki] 07dependabot[bot] opened pull request 03#1448: Bump extensions/ArticleToCategory2 from `116ad1b` to `4921d6d` - 13https://git.io/JOee0 [08:24:07] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/ArticleToCategory2-4921d6d - 13https://git.io/vbL5b [08:24:09] [02mediawiki] 07dependabot[bot] labeled pull request 03#1448: Bump extensions/ArticleToCategory2 from `116ad1b` to `4921d6d` - 13https://git.io/JOee0 [08:24:21] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/vendor-69d1de4 [+0/-0/±1] 13https://git.io/JOee2 [08:24:23] [02miraheze/mediawiki] 07dependabot[bot] 03951c6bc - Bump vendor from `c21aeab` to `69d1de4` [08:24:24] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/vendor-69d1de4 - 13https://git.io/vbL5b [08:24:26] [02mediawiki] 07dependabot[bot] opened pull request 03#1449: Bump vendor from `c21aeab` to `69d1de4` - 13https://git.io/JOeea [08:24:27] [02mediawiki] 07dependabot[bot] labeled pull request 03#1449: Bump vendor from `c21aeab` to `69d1de4` - 13https://git.io/JOeea [08:24:29] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/SecureLinkFixer-33f71ca [+0/-0/±1] 13https://git.io/JOeeV [08:24:30] [02miraheze/mediawiki] 07dependabot[bot] 0323b901f - Bump extensions/SecureLinkFixer from `47f1267` to `33f71ca` [08:24:32] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/SecureLinkFixer-33f71ca - 13https://git.io/vbL5b [08:24:33] [02mediawiki] 07dependabot[bot] opened pull request 03#1450: Bump extensions/SecureLinkFixer from `47f1267` to `33f71ca` - 13https://git.io/JOeew [08:24:35] [02mediawiki] 07dependabot[bot] labeled pull request 03#1450: Bump extensions/SecureLinkFixer from `47f1267` to `33f71ca` - 13https://git.io/JOeew [08:24:53] We can just merge all these [08:25:01] Given it's 1.36 now [08:27:35] yup, no harm done to prod [08:36:49] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.27, 5.20, 4.35 [08:53:30] [02mediawiki] 07RhinosF1 closed pull request 03#1450: Bump extensions/SecureLinkFixer from `47f1267` to `33f71ca` - 13https://git.io/JOeew [08:53:32] [02miraheze/mediawiki] 07RhinosF1 pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JOeTn [08:53:34] [02miraheze/mediawiki] 07dependabot[bot] 03e2fcc50 - Bump extensions/SecureLinkFixer from `47f1267` to `33f71ca` (#1450) [08:53:35] [02miraheze/mediawiki] 07RhinosF1 deleted branch 03dependabot/submodules/REL1_36/extensions/SecureLinkFixer-33f71ca [08:53:37] [02mediawiki] 07RhinosF1 deleted branch 03dependabot/submodules/REL1_36/extensions/SecureLinkFixer-33f71ca - 13https://git.io/vbL5b [08:53:45] [02mediawiki] 07RhinosF1 closed pull request 03#1449: Bump vendor from `c21aeab` to `69d1de4` - 13https://git.io/JOeea [08:53:47] [02miraheze/mediawiki] 07RhinosF1 pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JOeTC [08:53:49] [02miraheze/mediawiki] 07dependabot[bot] 0367409f4 - Bump vendor from `c21aeab` to `69d1de4` (#1449) [08:53:57] [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/vendor-69d1de4 - 13https://git.io/vbL5b [08:53:58] [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/vendor-69d1de4 [08:54:02] [02mediawiki] 07RhinosF1 closed pull request 03#1448: Bump extensions/ArticleToCategory2 from `116ad1b` to `4921d6d` - 13https://git.io/JOee0 [08:54:04] [02miraheze/mediawiki] 07RhinosF1 pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JOeTl [08:54:05] [02miraheze/mediawiki] 07dependabot[bot] 03d37c1a6 - Bump extensions/ArticleToCategory2 from `116ad1b` to `4921d6d` (#1448) [08:54:07] [02miraheze/mediawiki] 07RhinosF1 deleted branch 03dependabot/submodules/REL1_36/extensions/ArticleToCategory2-4921d6d [08:54:08] [02mediawiki] 07RhinosF1 deleted branch 03dependabot/submodules/REL1_36/extensions/ArticleToCategory2-4921d6d - 13https://git.io/vbL5b [08:54:18] [02mediawiki] 07RhinosF1 closed pull request 03#1447: Bump extensions/ManageWiki from `5f50e32` to `2c252c9` - 13https://git.io/JOeen [08:54:20] [02miraheze/mediawiki] 07RhinosF1 pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JOeTB [08:54:21] [02miraheze/mediawiki] 07dependabot[bot] 03c6d5814 - Bump extensions/ManageWiki from `5f50e32` to `2c252c9` (#1447) [08:54:24] [02mediawiki] 07RhinosF1 deleted branch 03dependabot/submodules/REL1_36/extensions/ManageWiki-2c252c9 - 13https://git.io/vbL5b [08:54:26] [02miraheze/mediawiki] 07RhinosF1 deleted branch 03dependabot/submodules/REL1_36/extensions/ManageWiki-2c252c9 [08:56:06] [02puppet] 07RhinosF1 opened pull request 03#1735: [DNM] Switch test3 to 1.36 stuff - 13https://git.io/JOeT9 [08:56:51] [02puppet] 07RhinosF1 synchronize pull request 03#1735: [DNM] Switch test3 to 1.36 stuff - 13https://git.io/JOeT9 [09:54:00] RECOVERY - wiki.mlpwiki.net - reverse DNS on sslhost is OK: rDNS OK - wiki.mlpwiki.net reverse DNS resolves to cp10.miraheze.org [10:12:52] [02miraheze/mediawiki] 07RhinosF1 pushed 031 commit to 03REL1_36 [+0/-0/±2] 13https://git.io/JOeGp [10:12:54] [02miraheze/mediawiki] 07RhinosF1 0325f59ad - update exts now using 1.36 over master [10:13:14] !log restart jobchron on jobrunner3 [10:13:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:18:30] [02miraheze/mw-config] 07RhinosF1 pushed 032 commits to 03REL1_36 [+0/-0/±4] 13https://git.io/JOeZ7 [10:18:31] [02miraheze/mw-config] 07RhinosF1 039a5ec50 - Merge branch 'master' into REL1_36 [10:18:33] [02mw-config] 07RhinosF1 synchronize pull request 03#3824: Update config for 1.36 - 13https://git.io/JYjbk [10:19:26] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JOeZj [10:19:27] [02miraheze/puppet] 07JohnFLewis 03222d2ff - jobrunner: ensure latest not present [10:19:32] miraheze/mw-config - RhinosF1 the build passed. [10:20:40] JohnLewis: https://github.com/miraheze/puppet/pull/1735 is ready for when an rc comes out and we have prep done [10:20:41] [ [DNM] Switch test3 to 1.36 stuff by RhinosF1 · Pull Request #1735 · miraheze/puppet · GitHub ] - github.com [10:21:38] looks good [10:22:02] [02miraheze/mediawiki] 07RhinosF1 pushed 0311 commits to 03REL1_36 [+6/-10/±43] 13https://git.io/JOenC [10:22:03] [02miraheze/mediawiki] 07reedy 0324e5f4b - Update git submodules [10:22:05] [02miraheze/mediawiki] 07reedy 03314e680 - Update git submodules [10:22:06] [02miraheze/mediawiki] 07reedy 03659dd1c - Bring REL1_36 requirements into line with REL1_35. [10:22:08] [02miraheze/mediawiki] ... and 8 more commits. [10:23:25] hacks by SPF, core SQL and reception reviewing master extension list is all that's left on our end [10:30:45] JohnLewis: thanks for fixing, but now I wonder how it worked before if the changes never got deployed [10:35:12] PROBLEM - jobrunner4 Puppet on jobrunner4 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [10:35:30] Reception123: it didn't :P [10:35:37] PROBLEM - jobrunner3 Puppet on jobrunner3 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [10:35:48] I ran the LUA server side before deploy to see if it worked [10:36:52] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JOeCn [10:36:54] [02miraheze/puppet] 07JohnFLewis 0363c60c5 - rm double keystroke [10:38:58] ah, yeah I meant how come the import worked [10:39:22] "I ran the LUA server side before deploy to see if it worked" [10:39:44] yeah, saw that :) [10:56:34] [02miraheze/mediawiki] 07RhinosF1 pushed 031 commit to 03REL1_36 [+0/-0/±7] 13https://git.io/JOe8U [10:56:35] [02miraheze/mediawiki] 07RhinosF1 031dee36c - switch some exts back to master [11:22:13] [02mw-config] 07Reception123 deleted branch 03Reception123-patch-3 - 13https://git.io/vbvb3 [11:22:15] [02miraheze/mw-config] 07Reception123 deleted branch 03Reception123-patch-3 [11:22:16] [02miraheze/mw-config] 07Reception123 deleted branch 03revert-3818-RhinosF1-patch-2 [11:22:18] [02mw-config] 07Reception123 deleted branch 03revert-3818-RhinosF1-patch-2 - 13https://git.io/vbvb3 [13:04:58] PROBLEM - wiki.mlpwiki.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mlpwiki.net reverse DNS resolves to 192-185-16-85.unifiedlayer.com [14:03:40] PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 581.43 ms [14:31:20] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.89, 6.68, 6.11 [14:33:19] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.03, 7.36, 6.41 [14:39:18] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.10, 6.65, 6.46 [14:40:29] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.69, 6.91, 6.41 [14:43:19] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.27, 7.08, 6.69 [14:44:22] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.34, 6.50, 6.39 [14:47:20] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.13, 7.47, 6.92 [14:48:16] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.56, 7.00, 6.64 [14:49:20] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.53, 6.86, 6.77 [14:50:12] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.34, 6.68, 6.56 [14:53:22] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.88, 6.63, 6.71 [14:56:00] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.25, 7.55, 6.99 [15:01:20] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.57, 7.02, 6.71 [15:01:41] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.89, 6.95, 6.23 [15:05:12] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.84, 7.30, 6.55 [15:07:06] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.50, 6.61, 6.37 [15:07:17] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.56, 6.66, 6.66 [15:07:36] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.22, 6.24, 6.19 [15:07:41] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JOvkg [15:07:43] [02miraheze/puppet] 07paladox 03c8d82b9 - Fix typo [15:07:45] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.08, 6.17, 6.59 [15:09:37] RECOVERY - jobrunner3 Puppet on jobrunner3 is OK: OK: Puppet is currently enabled, last run 41 seconds ago with 0 failures [15:11:10] RECOVERY - jobrunner4 Puppet on jobrunner4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:11:34] RECOVERY - ping6 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 297.78 ms [15:19:19] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.14, 7.14, 6.68 [15:20:49] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.37, 6.41, 6.14 [15:21:18] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.08, 6.90, 6.68 [15:22:49] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.61, 6.39, 6.16 [15:23:18] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.26, 6.32, 6.49 [15:29:37] PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 355.71 ms [15:34:05] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.79, 7.59, 6.65 [15:35:16] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.64, 6.50, 5.87 [15:36:03] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.20, 7.22, 6.65 [15:37:14] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.14, 5.83, 5.69 [15:38:01] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.62, 6.22, 6.34 [15:45:50] [02puppet] 07RhinosF1 opened pull request 03#1736: Support well-known change password links - 13https://git.io/JOv3Z [15:46:06] paladox: ^ [15:46:28] why is that being done? [15:46:51] /.well-known is for acme [15:47:02] users shouldn't be using it. [15:47:30] paladox: that's used by chrome to add change password links when passwords are detected as compromised [15:47:30] RhinosF1 [15:48:11] paladox: ^ [15:48:42] ok [15:48:49] [02puppet] 07paladox synchronize pull request 03#1736: Support well-known change password links - 13https://git.io/JOv3Z [15:49:05] [02puppet] 07paladox synchronize pull request 03#1736: Support well-known change password links - 13https://git.io/JOv3Z [15:49:34] [02puppet] 07paladox closed pull request 03#1736: Support well-known change password links - 13https://git.io/JOv3Z [15:49:35] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JOvsv [15:49:37] [02miraheze/puppet] 07RhinosF1 0394e0757 - Support well-known change password links (#1736) [15:51:34] RECOVERY - ping6 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 256.30 ms [15:55:59] !log reception@jobrunner3:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=crappypastawiki --r "[[phab:T7106|Requested]]" /home/reception/cpdel.txt [15:56:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:04:49] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.72, 6.76, 5.81 [16:04:58] RECOVERY - wiki.mlpwiki.net - reverse DNS on sslhost is OK: rDNS OK - wiki.mlpwiki.net reverse DNS resolves to cp10.miraheze.org [16:06:49] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.10, 6.28, 5.74 [16:07:09] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JOvnS [16:07:11] [02miraheze/puppet] 07paladox 038697204 - Update openldap.pp [16:07:12] [02puppet] 07paladox synchronize pull request 03#1734: openldap: Add support for monitoring - 13https://git.io/JYhaq [16:13:37] PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 607.99 ms [16:14:34] .ask JohnLewis could we in theory allow other wikis to use IR? (Botswiki specifically) [16:14:35] RhinosF1: I'll pass that on when JohnLewis is around. [16:16:30] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JOvCK [16:16:31] [02miraheze/puppet] 07paladox 0369c1586 - Update openldap.pp [16:16:33] [02puppet] 07paladox synchronize pull request 03#1734: openldap: Add support for monitoring - 13https://git.io/JYhaq [16:16:47] [02puppet] 07paladox closed pull request 03#1734: openldap: Add support for monitoring - 13https://git.io/JYhaq [16:16:49] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JOvC1 [16:16:50] [02miraheze/puppet] 07paladox 03fa9aedd - openldap: Add support for monitoring (#1734) [16:17:58] [02puppet] 07paladox deleted branch 03paladox-patch-3 - 13https://git.io/vbiAS [16:18:00] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-3 [16:18:31] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JOvWq [16:18:33] [02miraheze/puppet] 07paladox 0327f4e9a - Fix [16:22:53] PROBLEM - ldap2 Puppet on ldap2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Openldap_database[monitor] [16:23:34] RECOVERY - ping6 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 289.79 ms [16:49:13] paladox: https://meta.miraheze.org/.well-known/change-password not working [16:49:14] [ 404 Not Found ] - meta.miraheze.org [17:04:47] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.81, 6.55, 5.82 [17:06:47] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.79, 6.30, 5.83 [17:07:46] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.13, 7.63, 6.50 [17:09:44] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.20, 6.72, 6.30 [17:11:40] PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 575.02 ms [17:21:36] PROBLEM - ping6 on cp3 is WARNING: PING WARNING - Packet loss = 0%, RTA = 317.86 ms [17:23:34] RECOVERY - ping6 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 256.10 ms [17:30:49] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.97, 6.27, 5.79 [17:31:08] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JOvVe [17:31:09] [02miraheze/puppet] 07paladox 03a2cab0d - Support well-known change password links part 2 [17:32:47] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.39, 7.45, 6.09 [17:34:14] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.36, 7.25, 6.19 [17:34:46] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.84, 7.74, 6.37 [17:34:47] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.28, 7.41, 6.36 [17:34:49] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.53, 6.88, 5.95 [17:36:11] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.48, 6.63, 6.10 [17:36:47] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.00, 7.12, 6.38 [17:36:49] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.43, 6.10, 5.78 [17:38:47] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.21, 6.38, 6.19 [17:38:48] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.34, 6.66, 6.27 [17:42:07] paladox: do you know how it's possible for a logged action (editing an abuse filter) not to show up in Special:RecentChanges? [17:42:16] (and yes of course I don't have a bot permission :) [17:42:38] Nope [17:43:01] Reception123: do you have RecentChanges filters on? [17:43:02] it shows up here but not in RC https://meta.miraheze.org/wiki/Special:Log?type=abusefilter&user=&page=&wpdate=&tagfilter=&wpfilters%5B%5D=newusers [17:43:03] [ Abuse filter log - Miraheze Meta ] - meta.miraheze.org [17:43:13] Universal_Omega: RhinosF1 can't see it either [17:44:21] oh wow, same issue on testwiki [17:44:40] Reception123: hmm, maybe it's a bug? [17:45:50] Universal_Omega: yeah, doesn't seem upstream though [17:46:33] Reception123: I'm not sure how it'd be a Miraheze issue? [17:46:33] and same on test3, so three wikis confirmed [17:46:47] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.94, 6.87, 6.50 [17:48:11] well if it was upstream someone had to have noticed for an extension like AbuseFilter and fixed+backported it [17:48:47] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.77, 6.79, 6.51 [17:53:49] I asked in #mediawiki, but if it was an upstream issue it'd be surprising that it was never found [17:53:56] RECOVERY - ldap2 Puppet on ldap2 is OK: OK: Puppet is currently enabled, last run 43 seconds ago with 0 failures [17:55:45] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JOvo6 [17:55:46] [02miraheze/puppet] 07paladox 03ece7d4f - Fix part 2 [17:55:48] [02puppet] 07paladox created branch 03paladox-patch-3 - 13https://git.io/vbiAS [17:55:49] [02puppet] 07paladox opened pull request 03#1737: Fix part 2 - 13https://git.io/JOvoi [17:55:51] Reception123: I know, but it must be an upstream issue, that's all that makes sense, unless it's some sort of configuration [17:56:15] yeah, I was thinking configuration or something [17:59:59] PROBLEM - ldap2 Puppet on ldap2 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Openldap_database[monitor],Openldap_access[admin-monitor-access] [18:02:19] rebuildrecentchanges.php on test3 did nothing [18:03:43] Universal_Omega: hm, I don't think it's intended that it doesn't appear in "All public logs" but only in "Abuse filter logs" is it? [18:04:51] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.29, 6.54, 5.95 [18:05:34] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.35, 7.51, 6.53 [18:06:49] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.39, 6.94, 6.14 [18:07:19] not a bug, intentional it seems [18:07:19] https://phabricator.wikimedia.org/T34959 [18:07:20] [ ⚓ T34959 Private filters should not be visible in recent changes ] - phabricator.wikimedia.org [18:07:31] even though the task mentions public filters, it was removed from all [18:08:07] but I don't get why even admins can't see it on RC, or why we can't at least choose to see it [18:12:49] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.42, 7.65, 6.80 [18:13:33] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.30, 7.16, 6.95 [18:16:53] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.69, 6.65, 6.51 [18:18:49] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.61, 7.60, 6.99 [18:18:53] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.95, 6.28, 6.39 [18:20:49] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.44, 7.26, 6.94 [18:21:31] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.06, 7.58, 7.09 [18:22:49] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.71, 8.04, 7.28 [18:23:30] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.95, 7.47, 7.13 [18:24:49] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.01, 7.28, 7.09 [18:26:09] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.73, 6.73, 6.18 [18:26:49] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.07, 6.43, 6.79 [18:26:51] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.79, 7.01, 6.65 [18:28:06] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.10, 6.18, 6.06 [18:28:50] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.92, 6.24, 6.41 [18:29:27] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.97, 5.91, 6.55 [19:22:59] PROBLEM - wiki.mlpwiki.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mlpwiki.net reverse DNS resolves to 192-185-16-85.unifiedlayer.com [20:01:57] RECOVERY - ldap2 Puppet on ldap2 is OK: OK: Puppet is currently enabled, last run 30 seconds ago with 0 failures [20:02:46] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JOvd5 [20:02:48] [02miraheze/puppet] 07paladox 0333961ce - Update openldap.pp [20:02:49] [02puppet] 07paladox synchronize pull request 03#1737: Fix part 2 - 13https://git.io/JOvoi [20:03:02] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JOvdb [20:03:03] [02miraheze/puppet] 07paladox 03b5ca87e - Update openldap.pp [20:03:05] [02puppet] 07paladox synchronize pull request 03#1737: Fix part 2 - 13https://git.io/JOvoi [20:03:23] [02puppet] 07paladox closed pull request 03#1737: Fix part 2 - 13https://git.io/JOvoi [20:03:25] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JOvdx [20:03:27] [02miraheze/puppet] 07paladox 031747896 - Fix part 2 (#1737) [20:03:28] [02puppet] 07paladox deleted branch 03paladox-patch-3 - 13https://git.io/vbiAS [20:03:29] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-3 [20:05:14] I noticed that AF, like month/2 months ago. Before it was visible in RC. [20:05:57] I think when i tested some filter on test wiki. [20:21:32] !log add cn=monitor,dc=miraheze,dc=org to ldap [20:21:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:21:39] !log add monitor db to ldap [20:21:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:23:12] it works!!! [20:36:21] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+3/-0/±1] 13https://git.io/JOvAg [20:36:22] [02miraheze/puppet] 07paladox 03dc6651d - Add prometheus::openldap_exporter [20:38:49]