[00:02:23] Hello henrietaMag! If you have any questions, feel free to ask and someone should answer soon. [00:02:33] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.62, 21.13, 16.74 [00:02:44] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 8.79, 5.90, 4.45 [00:04:29] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.90, 19.04, 16.51 [00:04:32] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JT9C8 [00:04:34] [02miraheze/mediawiki] 07paladox 038bd0a23 - Update LinkTitles to f8f0034a3636abea8ff3d27a88a39b77b0077dd4 Bug: T6385 [00:04:43] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 3.78, 5.19, 4.38 [00:12:56] PROBLEM - mw6 Current Load on mw6 is CRITICAL: CRITICAL - load average: 9.04, 6.81, 5.11 [00:13:57] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 8.90, 7.11, 5.34 [00:14:45] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 7.69, 7.49, 5.63 [00:14:56] PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 7.33, 7.06, 5.43 [00:15:09] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.09, 22.86, 19.57 [00:15:55] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 6.32, 6.60, 5.36 [00:15:58] PROBLEM - mw7 Current Load on mw7 is CRITICAL: CRITICAL - load average: 9.60, 6.92, 5.20 [00:16:43] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 5.47, 6.66, 5.54 [00:16:55] RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 5.99, 6.74, 5.50 [00:17:58] PROBLEM - mw7 Current Load on mw7 is WARNING: WARNING - load average: 6.85, 6.90, 5.41 [00:20:15] PROBLEM - jobrunner1 APT on jobrunner1 is CRITICAL: APT CRITICAL: 15 packages available for upgrade (2 critical updates). [00:20:53] PROBLEM - mw6 Current Load on mw6 is CRITICAL: CRITICAL - load average: 8.95, 7.73, 6.18 [00:20:59] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.96, 22.64, 20.32 [00:22:43] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 10.23, 7.95, 6.33 [00:22:53] PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 6.91, 7.54, 6.31 [00:23:00] @paladox ^ [00:23:12] you've already pinged me for that. [00:23:47] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 9.29, 7.72, 6.18 [00:23:56] PROBLEM - mw7 Current Load on mw7 is CRITICAL: CRITICAL - load average: 9.13, 7.90, 6.29 [00:24:43] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 6.94, 7.76, 6.48 [00:25:42] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 5.30, 6.97, 6.10 [00:25:57] PROBLEM - mw7 Current Load on mw7 is WARNING: WARNING - load average: 5.45, 7.02, 6.17 [00:25:59] PROBLEM - mw7 APT on mw7 is CRITICAL: APT CRITICAL: 15 packages available for upgrade (2 critical updates). [00:26:43] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 4.05, 6.42, 6.15 [00:26:59] ok [00:27:18] critical [00:27:23] that doesn't bode well [00:27:38] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 3.99, 5.91, 5.81 [00:27:56] RECOVERY - mw7 Current Load on mw7 is OK: OK - load average: 5.27, 6.42, 6.05 [00:28:45] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.78, 23.90, 22.30 [00:30:40] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.70, 25.26, 22.97 [00:32:36] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.67, 22.80, 22.35 [00:32:53] RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 6.76, 6.77, 6.50 [00:39:09] PROBLEM - ldap1 APT on ldap1 is CRITICAL: APT CRITICAL: 10 packages available for upgrade (4 critical updates). [00:40:19] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.21, 21.00, 21.23 [00:42:14] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.21, 19.89, 20.81 [00:44:09] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.22, 18.85, 20.35 [00:47:23] RECOVERY - wiki.alirezaivaz.ir - reverse DNS on sslhost is OK: rDNS OK - wiki.alirezaivaz.ir reverse DNS resolves to cp6.miraheze.org [00:48:20] blackwidowmovie0: alerts dont always mean anything sometimes it normals [00:48:41] Not to mention we actively monitor the alerts [00:49:13] So we dont need pinged, or told when something is alerting [00:50:27] PROBLEM - wiki.m.alirezaivaz.ir - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:53:48] RECOVERY - wiki.m.alirezaivaz.ir - reverse DNS on sslhost is OK: rDNS OK - wiki.m.alirezaivaz.ir reverse DNS resolves to cp7.miraheze.org [00:56:19] PROBLEM - wiki.alirezaivaz.ir - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.alirezaivaz.ir All nameservers failed to answer the query. [00:57:13] RECOVERY - wiki.m.alirezaivaz.ir - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.alirezaivaz.ir' will expire on Mon 28 Dec 2020 20:59:30 GMT +0000. [01:06:57] .t UTC [01:06:57] 2020-10-31 - 01:06:57UTC [01:10:21] @Zppix Oh, nice command. I didn't know about that one. ;) [01:10:27] .t UTC [01:10:27] 2020-10-31 - 01:10:26UTC [01:10:34] .help t [01:10:34] dmehus: The help for command t is too long; I'm sending it to you in a private message. [01:10:39] PROBLEM - wiki.m.alirezaivaz.ir - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.m.alirezaivaz.ir All nameservers failed to answer the query. [01:10:57] .t UTC -7 [01:10:57] Could not find timezone "UTC -7". [01:11:05] .t UTC -07:00 [01:11:05] Could not find timezone "UTC -07:00". [01:11:10] Doesnt work [01:11:12] Like that [01:11:12] oh [01:11:15] ah [01:11:20] for example imine is [01:11:25] .t America/Chicago [01:11:26] 2020-10-30 - 20:11:25CDT [01:11:30] ah! [01:11:35] uses the timezone names [01:11:40] .t America/Vancouver [01:11:41] 2020-10-30 - 18:11:40PDT [01:11:46] Kinda [01:11:49] .help t [01:11:49] Zppix: The help for command t is too long; I'm sending it to you in a private message. [01:11:50] cool thanks :) [01:12:06] .t America/Chicago [01:12:06] Universal_Omega: 2020-10-30 - 18:54:41UTC tell Universal_Omega Please check your DM from me [01:12:06] 2020-10-30 - 20:12:06CDT [01:12:21] does it accept accents? [01:12:34] Wym [01:12:44] like ~ ´ ^ [01:12:50] @Lake 🤔 Good question, like for foreign place names with accents? [01:12:58] You cant do irc cmds from discord anyway but probably [01:12:59] .t America/São Paulo [01:13:16] .t America/São Paulo [01:13:16] Could not find timezone "America/São Paulo". [01:13:16] .t America/São Paulo [01:13:17] Could not find timezone "America/São Paulo". [01:13:24] .t America/Sao Paulo [01:13:25] 2020-10-30 - 22:13:24-03 [01:13:31] Looks like no accents, @Lake [01:13:31] Nope [01:13:36] ooo [01:13:41] Thats probably a plugin level thing [01:13:42] .help t [01:13:42] Universal_Omega: The help for command t is too long; I'm sending it to you in a private message. [01:13:52] As MirahezeBot certaintly can understand unicode [01:14:02] (São means San btw, like in San Francisco) [01:14:08] @Zppix yeah. Is it part of #sopel core? [01:14:12] and San is a contraction of "saint" [01:14:16] I think [01:14:17] .help [01:14:17] Universal_Omega: I've published a list of my commands at: https://sopel.bots.miraheze.wiki/help_prod.html [01:14:28] @Lake ah, cool. I don't know if I knew that [01:15:04] https://en.wikipedia.org/wiki/Francis_of_Assisi [01:15:04] [WIKIPEDIA] Francis of Assisi | "Francis of Assisi (born Giovanni di Pietro di Bernardone; Italian: Francesco d'Assisi; Latin: Franciscus Assisiensis; 1181 or 1182 – 3 October 1226), venerated as Saint Francis of Assisi, also known in his ministry as Francesco, was an Italian Catholic friar, deacon, mystic, and preacher. He founded..." [01:16:38] @Lake Did you know we have @Wiki-Bot and @MarkusRost add some code to work in MirahezeMagic pseudo-interwiki wikilinks? So you can use like [[mh:dev:Help:Infobox 101]] [01:17:07] heh doesn't work through the relay [01:17:09] [[mh:dev:Help:Infobox 101]] [01:17:10] https://dev.miraheze.org/wiki/Help:Infobox_101 [01:17:13] [ Help:Infobox 101 - Miraheze Developers Wiki ] - dev.miraheze.org [01:17:38] oh yes, I've seen that I didn't know it worked with wikipedia though [01:18:07] yeah, works with any Miraheze wiki and anything in the Miraheze interwiki table 🙂 [01:18:41] {{wikipedia:Miraheze}} [01:18:43] https://en.wikipedia.org/wiki/Manga_Time_Kirara Not the correct result? Use !wiki !!en.wikipedia.org page Miraheze for a direct link or !wiki !!en.wikipedia.org search Miraheze for a list of all hits. [01:18:44] [WIKIPEDIA] Manga Time Kirara | "Manga Time Kirara (まんがタイムきらら, Manga Taimu Kirara) is a Japanese seinen manga magazine published by Houbunsha which mainly serializes four-panel manga. The magazine is sold on the ninth of each month and was first published as a special edition of Manga Time, another Houbunsha magazine, on May 17, 2002..." [01:18:57] Well that is an interesting search result [01:19:00] :GWchadThinkeyes: [01:19:48] Miraheze doesnt exist on enwiki [01:20:24] I remember someone saying the article on wikipedia "looked like an ad" [01:20:44] PROBLEM - puppet2 APT on puppet2 is CRITICAL: APT CRITICAL: 14 packages available for upgrade (2 critical updates). [01:22:22] As i am also a enwiki editor, i will say technically miraheze doesnt meet policy for an enwiki article [01:22:23] :/ [01:33:11] PROBLEM - mw6 APT on mw6 is CRITICAL: APT CRITICAL: 15 packages available for upgrade (2 critical updates). [01:34:00] icinga-miraheze: we get it your angry [01:42:08] I tried to make an article about Miraheze on enwiki. Got rejected as advertisment apparently. [01:42:34] Yeah it doent meet [[WP:GNG]] [01:42:45] .w WP:GNG [01:42:45] [WIKIPEDIA] Wikipedia:Notability | "On Wikipedia, notability is a test used by editors to decide whether a given topic warrants its own article.Information on Wikipedia must be verifiable; if no reliable, independent sources can be found on a topic, then it should not have a separate article. Wikipedia's concept of notability applies..." | https://en.wikipedia.org/wiki/Wikipedia%3ANotability [01:44:43] PROBLEM - graylog1 APT on graylog1 is CRITICAL: APT CRITICAL: 6 packages available for upgrade (2 critical updates). [01:47:09] yeah, though we do have some non-English Wikipedia Miraheze articles, where the notability guidelines are lower, so that's good at least. [01:47:48] Yeah [02:03:22] PROBLEM - cloud1 APT on cloud1 is CRITICAL: APT CRITICAL: 90 packages available for upgrade (2 critical updates). [02:13:10] PROBLEM - db11 APT on db11 is CRITICAL: APT CRITICAL: 29 packages available for upgrade (2 critical updates). [02:15:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JT9EN [02:15:13] [02miraheze/services] 07MirahezeSSLBot 0331ce89a - BOT: Updating services config for wikis [02:15:28] PROBLEM - wiki.m.alirezaivaz.ir - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:22:13] RECOVERY - wiki.m.alirezaivaz.ir - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.alirezaivaz.ir' will expire on Mon 28 Dec 2020 20:59:30 GMT +0000. [02:58:24] PROBLEM - ns1 APT on ns1 is CRITICAL: APT CRITICAL: 9 packages available for upgrade (3 critical updates). [03:02:18] PROBLEM - mon1 APT on mon1 is CRITICAL: APT CRITICAL: 15 packages available for upgrade (2 critical updates). [03:03:57] PROBLEM - cloud3 APT on cloud3 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (2 critical updates). [03:08:11] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.65, 18.56, 16.23 [03:10:08] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.97, 17.33, 16.08 [03:29:00] PROBLEM - mw6 Disk Space on mw6 is WARNING: DISK WARNING - free space: / 2076 MB (10% inode=75%); [03:38:15] when editing and selecting the "Link" button, I am unable to introduce a link by pressing enter, I have to move the mouse and press "Insert link" when before I could insert just with an enter [03:39:17] PROBLEM - phab1 APT on phab1 is CRITICAL: APT CRITICAL: 9 packages available for upgrade (2 critical updates). [03:47:33] now it works... [03:47:52] Great! [03:52:58] it comes and goes, in fact. again the enter in adding links doesn't work [03:54:02] Interesting. Maybe create a task at [[Phab:]] possibly? [03:54:02] https://phabricator.miraheze.org/ [03:54:03] [ Main Page ] - phabricator.miraheze.org [03:59:03] PROBLEM - mail1 APT on mail1 is CRITICAL: APT CRITICAL: 9 packages available for upgrade (2 critical updates). [04:20:54] PROBLEM - test2 APT on test2 is CRITICAL: APT CRITICAL: 17 packages available for upgrade (2 critical updates). [04:21:39] PROBLEM - wiki.m.alirezaivaz.ir - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:23:05] PROBLEM - mw5 APT on mw5 is CRITICAL: APT CRITICAL: 15 packages available for upgrade (2 critical updates). [05:09:37] RECOVERY - wiki.m.alirezaivaz.ir - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.alirezaivaz.ir' will expire on Mon 28 Dec 2020 20:59:30 GMT +0000. [05:11:50] PROBLEM - bacula2 APT on bacula2 is CRITICAL: APT CRITICAL: 7 packages available for upgrade (2 critical updates). [05:25:03] PROBLEM - mw5 Disk Space on mw5 is WARNING: DISK WARNING - free space: / 2067 MB (10% inode=75%); [05:36:02] PROBLEM - rdb2 APT on rdb2 is CRITICAL: APT CRITICAL: 8 packages available for upgrade (2 critical updates). [05:46:25] PROBLEM - cloud2 APT on cloud2 is CRITICAL: APT CRITICAL: 91 packages available for upgrade (2 critical updates). [05:47:03] PROBLEM - wiki.m.alirezaivaz.ir - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:49:43] PROBLEM - ns2 APT on ns2 is CRITICAL: APT CRITICAL: 8 packages available for upgrade (2 critical updates). [06:07:34] RECOVERY - wiki.m.alirezaivaz.ir - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.alirezaivaz.ir' will expire on Mon 28 Dec 2020 20:59:30 GMT +0000. [06:09:06] RECOVERY - mail1 APT on mail1 is OK: APT OK: 7 packages available for upgrade (0 critical updates). [06:10:43] RECOVERY - graylog1 APT on graylog1 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [06:11:11] RECOVERY - puppet2 APT on puppet2 is OK: APT OK: 12 packages available for upgrade (0 critical updates). [06:11:17] RECOVERY - phab1 APT on phab1 is OK: APT OK: 7 packages available for upgrade (0 critical updates). [06:11:25] RECOVERY - cloud1 APT on cloud1 is OK: APT OK: 88 packages available for upgrade (0 critical updates). [06:15:54] RECOVERY - mw7 APT on mw7 is OK: APT OK: 13 packages available for upgrade (0 critical updates). [06:18:13] RECOVERY - jobrunner1 APT on jobrunner1 is OK: APT OK: 13 packages available for upgrade (0 critical updates). [06:20:03] RECOVERY - rdb2 APT on rdb2 is OK: APT OK: 6 packages available for upgrade (0 critical updates). [06:20:51] RECOVERY - wiki.alirezaivaz.ir - reverse DNS on sslhost is OK: rDNS OK - wiki.alirezaivaz.ir reverse DNS resolves to cp6.miraheze.org [06:25:56] RECOVERY - wiki.m.alirezaivaz.ir - reverse DNS on sslhost is OK: rDNS OK - wiki.m.alirezaivaz.ir reverse DNS resolves to cp6.miraheze.org [06:25:56] RECOVERY - test2 APT on test2 is OK: APT OK: 15 packages available for upgrade (0 critical updates). [06:25:57] RECOVERY - bacula2 APT on bacula2 is OK: APT OK: 5 packages available for upgrade (0 critical updates). [06:31:05] RECOVERY - mw5 APT on mw5 is OK: APT OK: 13 packages available for upgrade (0 critical updates). [06:38:52] RECOVERY - cloud2 APT on cloud2 is OK: APT OK: 89 packages available for upgrade (0 critical updates). [06:40:22] RECOVERY - ns1 APT on ns1 is OK: APT OK: 6 packages available for upgrade (0 critical updates). [06:41:45] RECOVERY - ns2 APT on ns2 is OK: APT OK: 6 packages available for upgrade (0 critical updates). [06:43:00] PROBLEM - mw6 Disk Space on mw6 is CRITICAL: DISK CRITICAL - free space: / 1134 MB (5% inode=75%); [06:43:59] RECOVERY - mw6 APT on mw6 is OK: APT OK: 13 packages available for upgrade (0 critical updates). [06:45:07] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[php7.3-apcu] [06:47:08] RECOVERY - ldap1 APT on ldap1 is OK: APT OK: 6 packages available for upgrade (0 critical updates). [06:53:03] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 14 seconds ago with 0 failures [06:53:26] RECOVERY - misc1 APT on misc1 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [06:54:07] RECOVERY - cloud3 APT on cloud3 is OK: APT OK: 60 packages available for upgrade (0 critical updates). [06:54:42] PROBLEM - cp9 APT on cp9 is CRITICAL: APT CRITICAL: 8 packages available for upgrade (2 critical updates). [06:57:10] RECOVERY - db11 APT on db11 is OK: APT OK: 27 packages available for upgrade (0 critical updates). [06:57:12] RECOVERY - mon1 APT on mon1 is OK: APT OK: 13 packages available for upgrade (0 critical updates). [07:03:13] PROBLEM - ns1 Current Load on ns1 is CRITICAL: CRITICAL - load average: 2.97, 2.13, 1.01 [07:05:13] RECOVERY - ns1 Current Load on ns1 is OK: OK - load average: 0.08, 1.01, 0.81 [07:21:13] PROBLEM - gluster2 APT on gluster2 is CRITICAL: APT CRITICAL: 16 packages available for upgrade (2 critical updates). [07:33:35] PROBLEM - services2 APT on services2 is CRITICAL: APT CRITICAL: 10 packages available for upgrade (2 critical updates). [08:06:23] PROBLEM - wiki.serwerwanilia.pl - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.serwerwanilia.pl' expires in 15 day(s) (Mon 16 Nov 2020 08:00:57 GMT +0000). [08:30:48] PROBLEM - db12 APT on db12 is CRITICAL: APT CRITICAL: 29 packages available for upgrade (2 critical updates). [08:32:44] PROBLEM - cp6 APT on cp6 is CRITICAL: APT CRITICAL: 8 packages available for upgrade (2 critical updates). [09:52:21] PROBLEM - services1 APT on services1 is CRITICAL: APT CRITICAL: 10 packages available for upgrade (2 critical updates). [09:57:47] PROBLEM - jobrunner2 APT on jobrunner2 is CRITICAL: APT CRITICAL: 15 packages available for upgrade (2 critical updates). [10:14:36] [02miraheze/mediawiki] 07Reception123 pushed 032 commits to 03REL1_35 [+2/-0/±2] 13https://git.io/JT9pz [10:14:37] [02miraheze/mediawiki] 07Reception123 03464dbd6 - Install CleanChanges ext. [10:14:38] [02miraheze/mediawiki] 07Reception123 032089364 - Install TimeMachine ext. [10:29:53] PROBLEM - mw7 Disk Space on mw7 is WARNING: DISK WARNING - free space: / 2087 MB (10% inode=75%); [10:32:24] [02mw-config] 07Reception123 closed pull request 03#3336: Add CleanChanges extension (T6263) - 13https://git.io/JT1DR [10:32:25] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/JT9ha [10:32:27] [02miraheze/mw-config] 07Universal-Omega 0385fe298 - Add CleanChanges extension (T6263) (#3336) * Add CleanChanges extension * add CleanChanges extension * add CleanChanges extension * add Defaultuseroptions to CleanChanges * add CleanChanges extension [10:35:27] PROBLEM - misc1 APT on misc1 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [10:36:37] !log sudo -u www-data php /srv/mediawiki/w/maintenance/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki' [10:36:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:37:02] !log sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki' on mw* and jbr* [10:37:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:40:22] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JT9hA [10:40:23] [02miraheze/services] 07MirahezeSSLBot 030d6c9da - BOT: Updating services config for wikis [10:41:53] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.32, 21.18, 17.79 [10:43:50] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.89, 23.07, 18.91 [10:47:45] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.62, 21.32, 19.27 [10:51:36] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 32.22, 25.90, 21.42 [10:52:44] [02mw-config] 07Reception123 closed pull request 03#3334: Add TimeMachine extension (T6344) - 13https://git.io/JT1os [10:52:45] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/JT9j2 [10:52:47] [02miraheze/mw-config] 07Universal-Omega 03b2dee29 - Add TimeMachine extension (T6344) (#3334) * add TimeMachine extension * add TimeMachine extension * add TimeMachine extension * add TimeMachine extension [10:55:28] PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 7.21, 7.20, 5.95 [10:55:40] PROBLEM - mw7 Current Load on mw7 is WARNING: WARNING - load average: 7.53, 7.11, 5.77 [10:55:57] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_35 [+1/-0/±1] 13https://git.io/JT9jP [10:55:58] [02miraheze/mediawiki] 07Reception123 039454d8a - Add Nimbus skin [10:56:12] !log sudo -u www-data php /srv/mediawiki/w/maintenance/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki on mw* and jbr* [10:56:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:56:26] !log sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw* and jbr* [10:56:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:57:03] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JT9j1 [10:57:05] [02miraheze/mediawiki] 07Reception123 03a8f7322 - add ignore dirty for Nimbus [10:57:27] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.24, 23.65, 22.22 [10:57:36] PROBLEM - mw7 Current Load on mw7 is CRITICAL: CRITICAL - load average: 8.33, 7.36, 6.00 [10:59:23] PROBLEM - mw6 Current Load on mw6 is CRITICAL: CRITICAL - load average: 9.60, 7.94, 6.49 [10:59:23] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.16, 23.99, 22.52 [11:01:28] PROBLEM - mw7 Current Load on mw7 is WARNING: WARNING - load average: 7.31, 7.93, 6.59 [11:02:39] [02mw-config] 07Reception123 commented on pull request 03#3332: Add Nimbus skin (T6358) - 13https://git.io/JTHee [11:03:17] PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 7.43, 7.98, 6.86 [11:04:49] [02mw-config] 07Reception123 deleted a comment on pull request 03#3332: Add Nimbus skin (T6358) - 13https://git.io/JTHee [11:07:14] RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 5.43, 6.58, 6.54 [11:07:17] RECOVERY - mw7 Current Load on mw7 is OK: OK - load average: 5.29, 6.38, 6.33 [11:10:49] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [11:11:06] PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 6.77, 6.92, 6.68 [11:11:12] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [11:11:14] PROBLEM - test2 Puppet on test2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [11:12:07] PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [11:13:13] RECOVERY - test2 Puppet on test2 is OK: OK: Puppet is currently enabled, last run 38 seconds ago with 0 failures [11:14:04] RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:14:05] PROBLEM - mw7 Current Load on mw7 is CRITICAL: CRITICAL - load average: 8.33, 7.53, 6.79 [11:14:47] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:15:10] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:15:36] [02mw-config] 07Reception123 closed pull request 03#3332: Add Nimbus skin (T6358) - 13https://git.io/JT1G9 [11:15:38] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/JTHeP [11:15:39] [02miraheze/mw-config] 07Universal-Omega 0396ec469 - Add Nimbus skin (T6358) (#3332) * add Nimbus skin * add Nimbus skin * add Nimbus skin * add Nimbus skin [11:16:02] RECOVERY - mw7 Current Load on mw7 is OK: OK - load average: 4.93, 6.41, 6.46 [11:16:58] RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 5.32, 6.16, 6.51 [11:17:17] !log sudo -u www-data php /srv/mediawiki/w/maintenance/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki on mw* and jbr* [11:17:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:17:37] !log sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw* and jbr* [11:17:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:18:17] !log sudo umount /mnt/mediawiki-static and mount /mnt/mediawiki-static on jbr1 [11:18:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:20:43] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.36, 23.74, 23.91 [11:20:47] RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:20:58] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_35 [+1/-0/±1] 13https://git.io/JTHeN [11:21:00] [02miraheze/mediawiki] 07Reception123 0359cc1cb - Install DiscussionTools ext. [11:22:41] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.50, 23.92, 23.96 [11:22:54] PROBLEM - mw6 Current Load on mw6 is CRITICAL: CRITICAL - load average: 10.17, 7.38, 6.78 [11:24:00] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 7.07, 6.03, 5.14 [11:24:37] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.91, 23.67, 23.87 [11:24:53] PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 6.76, 7.18, 6.79 [11:25:57] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 5.49, 5.78, 5.14 [11:26:52] PROBLEM - mw6 Current Load on mw6 is CRITICAL: CRITICAL - load average: 8.35, 7.65, 7.01 [11:27:49] PROBLEM - mw7 Current Load on mw7 is WARNING: WARNING - load average: 7.89, 7.28, 6.75 [11:28:52] PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 6.66, 7.50, 7.05 [11:29:13] PROBLEM - test2 Puppet on test2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 1 minute ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki config] [11:29:45] RECOVERY - mw7 Current Load on mw7 is OK: OK - load average: 5.31, 6.72, 6.62 [11:32:53] RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 4.71, 6.25, 6.65 [11:40:08] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 18.83, 18.15, 20.39 [11:43:45] [02mw-config] 07Reception123 closed pull request 03#3325: Add DiscussionTools ext (T6356) - 13https://git.io/JTPyk [11:43:46] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/JTHfR [11:43:48] [02miraheze/mw-config] 07Universal-Omega 03244150a - Add DiscussionTools ext (T6356) (#3325) * Add DiscussionTools ext (T6356) * add DiscussionTools ext * add DiscussionTools ext * add DiscussionTools ext [11:46:23] !log sudo -u www-data php /srv/mediawiki/w/maintenance/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki on mw* and jbr* [11:46:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:47:09] !log sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw* and jbr* [11:47:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:49:27] [02mw-config] 07Reception123 closed pull request 03#3285: Rename Flow to StructuredDiscussions in ManageWiki, and resort it alp… - 13https://git.io/JTens [11:49:29] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JTHfy [11:49:30] [02miraheze/mw-config] 07dmehus 037b016d2 - Rename Flow to StructuredDiscussions in ManageWiki, and resort it alphabetically in the ManageWiki extensions list (#3285) Per this request on Discord (https://discord.com/channels/407504499280707585/407537962553966603/763915864353275916), users are having some difficulty locating StructuredDiscussions in Special:ManageWiki/Extensions, since we've renamed it to its [11:49:30] new name everywhere else on-wiki, the Extensions page, the Miraheze page, and even in ManageWiki itself. Former name should go in parentheses. I don't appear to be changing any database IDs, so likely no database changes are needed [11:49:31] [ Discord ] - discord.com [11:52:46] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 7.52, 5.79, 4.67 [11:53:13] RECOVERY - test2 Puppet on test2 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures [11:53:15] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 7.46, 5.96, 4.83 [11:54:09] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.75, 19.98, 19.69 [11:54:45] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 5.46, 5.64, 4.76 [11:55:21] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 4.97, 5.73, 4.91 [12:01:01] !log create basic LDAP accounts for all mail users (no mail settings) [12:01:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:04:08] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.90, 20.08, 20.31 [12:50:34] !log reception@jobrunner2:~$ sudo -u www-data /usr/local/bin/foreachwikiindblist /home/reception/kartographer.json /srv/mediawiki/w/extensions/ManageWiki/maintenance/toggleExtension.php jsonconfig [12:50:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:51:27] [02mw-config] 07Reception123 commented on pull request 03#3274: kartographer require jsonconfig instead of enable it with it - 13https://git.io/JTHIV [12:51:30] [02mw-config] 07Reception123 closed pull request 03#3274: kartographer require jsonconfig instead of enable it with it - 13https://git.io/JU9wa [12:51:32] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JTHIw [12:51:33] [02miraheze/mw-config] 07Universal-Omega 03a0e709c - kartographer require jsonconfig instead of enable it with it (#3274) * kartographer require jsonconfig * kartographer require jsonconfig instead of enable it with it [12:52:13] !log disable puppet on mon1 & install (--no-install-recommends) docker/docker-compose on mon1 [12:52:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:54:11] PROBLEM - mon1 Puppet on mon1 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 1 minute ago with 0 failures [12:55:13] PROBLEM - test2 Puppet on test2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki config] [12:57:32] SPF: I replied [13:05:20] PROBLEM - ns1 Current Load on ns1 is CRITICAL: CRITICAL - load average: 0.49, 2.80, 1.73 [13:07:14] RECOVERY - ns1 Current Load on ns1 is OK: OK - load average: 0.03, 1.32, 1.36 [13:08:40] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.35, 21.81, 19.18 [13:10:32] [02mw-config] 07Reception123 commented on pull request 03#3209: managewiki: migrate wgFooterIcons - 13https://git.io/JTHt2 [13:10:34] [02mw-config] 07Reception123 closed pull request 03#3209: managewiki: migrate wgFooterIcons - 13https://git.io/JUJsA [13:12:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 18.22, 20.38, 19.21 [13:26:37] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±3] 13https://git.io/JTHqD [13:26:39] [02miraheze/mw-config] 07Reception123 03403a752 - [WIP] managewiki: migrate wgFooterIcons bring back #3209 by @RhinosF1 since there were conflicts + add managewiki part [13:26:40] [02mw-config] 07Reception123 created branch 03Reception123-patch-1 - 13https://git.io/vbvb3 [13:26:49] [02mw-config] 07Reception123 opened pull request 03#3341: [WIP] managewiki: migrate wgFooterIcons - 13https://git.io/JTHqS [13:28:19] miraheze/mw-config/Reception123-patch-1/403a752 - Reception123 The build failed. https://travis-ci.org/miraheze/mw-config/builds/740410925 [13:29:00] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://git.io/JTHqx [13:29:01] [02miraheze/mw-config] 07Reception123 03e536fbb - fix [13:29:03] [02mw-config] 07Reception123 synchronize pull request 03#3341: [WIP] managewiki: migrate wgFooterIcons - 13https://git.io/JTHqS [13:32:53] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.86, 18.41, 18.07 [13:34:48] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.22, 16.78, 17.52 [13:35:19] PROBLEM - db7 APT on db7 is CRITICAL: APT CRITICAL: 29 packages available for upgrade (2 critical updates). [13:49:05] PROBLEM - cp3 APT on cp3 is CRITICAL: APT CRITICAL: 8 packages available for upgrade (2 critical updates). [13:51:36] PROBLEM - mw4 APT on mw4 is CRITICAL: APT CRITICAL: 15 packages available for upgrade (2 critical updates). [13:59:33] !log enable puppet on mon1 [13:59:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:59:43] !log (and I have removed the docker packages from mon1 as well) [13:59:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:59:51] Spookreeeno: alright [14:00:11] RECOVERY - mon1 Puppet on mon1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [14:01:18] !log enable jsonconfig on dannywiki required by Kartographer [14:01:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:03:30] !log remove crossreference from citronhatwiki, communitycentralbympteamwiki, dannywiki, educationpediyawiki, guiacatolicawiki, limpdwiki and tetsudouwiki [14:03:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:10:18] !log enable jsonconfig on polskajestwiki required by Kartographer [14:10:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:14:36] Hello blondiesinger[m]! If you have any questions, feel free to ask and someone should answer soon. [14:14:40] Hello Miraheze team! It is your musical friend. I am back !! And today is Halloween so I want every miraheze staff to sign with me please! Don't be shy! [14:15:23] !log enable jsonconfig on uaschoolswikiwiki required by Kartographer [14:15:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:16:17] !log enable jsonconfig on christipediawiki required by Kartographer [14:16:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:16:27] Hello rayparker[m]! If you have any questions, feel free to ask and someone should answer soon. [14:16:30] If there's somethin' strange in your neighborhood [14:16:32] Who ya gonna call? [14:16:37] (Ghostbusters!)If it's somethin' weird an' it don't look good [14:16:42] (Ghostbusters!)I ain't afraid o' no ghost [14:16:43] (Ghostbusters!)I ain't afraid o' no ghost [14:16:50] I ain't afraid o' no ghostIf you're seein' things runnin' through your head [14:16:52] Who can you call? [14:16:57] (Ghostbusters!) [14:17:07] An invisible man sleepin' in your bed [14:17:32] Oh who ya gonna call? [14:17:36] (Ghostbusters!) [14:17:44] If you're all alone, pick up the phone [14:17:47] And call [14:17:50] (Ghostbusters!) [14:17:56] I ain't afraid o' no ghost [14:17:59] I hear it likes the girls [14:18:02] I ain't afraid o' no ghost [14:18:05] Yeah, yeah, yeah, yeah [14:18:09] Who you gonna call? [14:18:11] (Ghostbusters!) [14:18:15] Mmm, if you've had a dose [14:18:18] Of a freaky ghost baby [14:18:21] You better call [14:18:39] NEXT SONG COME ON SING WITH ME DONT BE SHY RHINOSF1 RECEPTION123 ZPPIX VOIDWALKER PALADOX [14:21:26] !log root@test2:/home/paladox# /usr/local/bin/foreachwikiindblist /home/paladox/kartographer.json /srv/mediawiki/w/extensions/ManageWiki/maintenance/toggleExtension.php jsonconfig [14:21:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:25:58] !log clear managewiki cache [14:26:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:29:01] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.14, 20.74, 17.73 [14:29:10] paladox: how did you clear it? [14:30:01] I remove the json files to fix all wikis throwing "Uncaught ExtensionDependencyError: Kartographer requires JsonConfig:" since it apparently wasn't clearing even though i ran toggleExtension [14:30:05] JohnLewis ^ [14:30:52] So you rm'd 8 wikis files? [14:31:13] no, i just did them all. [14:31:23] which i see now was a mistake. [14:31:27] Mhm [14:32:45] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 7.44, 6.13, 4.37 [14:32:54] PROBLEM - mw6 Current Load on mw6 is CRITICAL: CRITICAL - load average: 10.13, 6.76, 4.79 [14:33:17] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 7.36, 5.74, 4.14 [14:34:43] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 6.37, 6.21, 4.62 [14:35:15] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 5.78, 5.82, 4.36 [14:35:56] PROBLEM - mw7 Current Load on mw7 is CRITICAL: CRITICAL - load average: 8.52, 7.53, 5.34 [14:36:31] JohnLewis: FYI, we had a report of a wiki showing 404 for a few seconds during the clear. Assuming expected. [14:36:53] PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 7.55, 8.00, 5.84 [14:36:56] That shouldn't? [14:36:58] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/JTHGh [14:37:00] [02miraheze/mw-config] 07paladox 03f34483b - Stop logging redis things It appears since the upgrade to 1.35, it's causing a load of spam to hit the redis log with stuff like "worthRefreshPopular(1604102439.6853, 60, 900, 1604104011.4142): p = 0.0012121212121212; refresh = N" [14:37:00] paladox: what command did you use? [14:37:01] [02mw-config] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbvb3 [14:37:03] [02mw-config] 07paladox opened pull request 03#3342: Stop logging redis things - 13https://git.io/JTHZe [14:37:14] [02mw-config] 07paladox edited pull request 03#3342: Stop logging redis things - 13https://git.io/JTHZe [14:37:27] JohnLewis only rm /srv/mediawiki/w/cache/* [14:37:37] PROBLEM - madzebrascience.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'madzebrascience.wiki' expires in 15 day(s) (Mon 16 Nov 2020 14:28:46 GMT +0000). [14:37:50] so, you removed ManageWiki cache, the database lists and i18n cache [14:37:56] RECOVERY - mw7 Current Load on mw7 is OK: OK - load average: 5.58, 6.62, 5.26 [14:38:16] the i18n cache should be in a seperate folder [14:38:34] miraheze/mw-config/paladox-patch-2/f34483b - paladox The build passed. https://travis-ci.org/miraheze/mw-config/builds/740422331 [14:38:35] okay, so ManageWiki and database lists [14:39:32] appears yeh, that's a mistake on my part. [14:40:41] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.53, 23.50, 21.42 [14:40:53] RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 5.95, 6.74, 5.80 [14:42:38] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.68, 24.86, 22.16 [14:43:39] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JTHZa [14:43:40] [02miraheze/ssl] 07MirahezeSSLBot 03ab36f2a - Bot: Update SSL cert for madzebrascience.wiki [14:44:33] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.39, 23.55, 22.03 [14:48:10] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JTHZF [14:48:12] [02miraheze/mw-config] 07paladox 035f71b7a - Change redis log level to error [14:48:14] [02mw-config] 07paladox created branch 03paladox-patch-3 - 13https://git.io/vbvb3 [14:48:15] [02mw-config] 07paladox opened pull request 03#3343: Change redis log level to error - 13https://git.io/JTHZb [14:48:25] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 12.86, 18.34, 20.28 [14:50:26] [02mw-config] 07paladox synchronize pull request 03#3343: Change redis log level to error - 13https://git.io/JTHZb [14:50:28] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JTHnI [14:50:29] [02miraheze/mw-config] 07paladox 038b377a0 - Update GlobalLogging.php [14:50:35] [02mw-config] 07paladox edited pull request 03#3343: Change redis log level to warning - 13https://git.io/JTHZb [14:50:45] [02mw-config] 07paladox closed pull request 03#3343: Change redis log level to warning - 13https://git.io/JTHZb [14:50:46] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JTHnL [14:50:48] [02miraheze/mw-config] 07paladox 034d9102b - Change redis log level to warning (#3343) [14:50:49] [02mw-config] 07paladox deleted branch 03paladox-patch-3 - 13https://git.io/vbvb3 [14:50:51] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-3 [14:52:21] miraheze/mw-config/paladox-patch-3/8b377a0 - paladox The build has errored. https://travis-ci.org/miraheze/mw-config/builds/740424418 [14:53:06] RECOVERY - mw5 Disk Space on mw5 is OK: DISK OK - free space: / 4212 MB (22% inode=75%); [14:53:54] RECOVERY - mw7 Disk Space on mw7 is OK: DISK OK - free space: / 4770 MB (25% inode=76%); [14:55:00] RECOVERY - mw6 Disk Space on mw6 is OK: DISK OK - free space: / 3587 MB (18% inode=75%); [14:55:35] !log blank redis.log / redis.log.1 on mw* and jobrunner*. [14:55:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:57:52] RECOVERY - madzebrascience.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'madzebrascience.wiki' will expire on Fri 29 Jan 2021 13:43:32 GMT +0000. [15:20:46] [02miraheze/mw-config] 07paladox deleted branch 03REL1_35 [15:20:48] [02mw-config] 07paladox deleted branch 03REL1_35 - 13https://git.io/vbvb3 [15:20:51] [02mw-config] 07paladox deleted branch 03wikiap-config - 13https://git.io/vbvb3 [15:20:53] [02miraheze/mw-config] 07paladox deleted branch 03wikiap-config [15:20:57] [02mw-config] 07paladox closed pull request 03#3342: Stop logging redis things - 13https://git.io/JTHZe [15:21:00] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-2 [15:21:01] [02mw-config] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbvb3 [15:33:27] Hello michaeljacks[m]! If you have any questions, feel free to ask and someone should answer soon. [15:33:28] Come on guys you know you wanna [15:33:32] It's close to midnight [15:33:36] Something evil's lurking in the dark [15:33:39] Under the moonlight [15:33:44] You see a sight that almost stops your heart [15:33:48] You try to scream [15:33:51] But terror takes the sound before you make it [15:33:54] You start to freeze [15:33:58] As horror looks you right between your eyes [15:34:03] You're paralyzed [15:34:06] 'Cause this is thriller [15:34:09] Thriller night [15:34:12] And no one's gonna save you [15:34:17] From the beast about to strike [15:34:21] You know it's thriller [15:34:23] Thriller night [15:34:35] You're fighting for your life [15:34:38] Inside a killer [15:34:40] Thriller tonight, yeah, ooh [15:34:42] Come on Zppix [15:34:45] Come on RhinosF1 [15:34:48] Come on Paladox [15:34:50] Come on Voidwalker [15:34:51] Come on Reception123 [15:34:55] You hear the door slam [15:34:58] And realize there's nowhere left to run [15:35:02] You feel the cold hand [15:35:05] And wonder if you'll ever see the sun [15:35:10] You close your eyes [15:39:09] PROBLEM - gluster1 APT on gluster1 is CRITICAL: APT CRITICAL: 12 packages available for upgrade (2 critical updates). [15:52:19] Hello troy12! If you have any questions, feel free to ask and someone should answer soon. [15:55:26] Hello BadWolf! If you have any questions, feel free to ask and someone should answer soon. [15:55:41] !log MariaDB [metawiki]> UPDATE cw_requests SET cw_status = 'declined' WHERE cw_id = '14998'; [15:55:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:56:53] PROBLEM - db13 APT on db13 is CRITICAL: APT CRITICAL: 29 packages available for upgrade (2 critical updates). [16:01:38] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JTH8r [16:01:40] [02miraheze/mediawiki] 07paladox 031d3888f - Update Cosmos [16:02:51] troy12: can we help? [16:03:03] .t [16:03:03] 2020-10-31 - 16:03:03UTC [16:05:52] .op [16:05:52] Attempting to OP... [16:06:00] 333333/mode #miraheze +qz *!*@gateway/shell/matrix.org/* [16:08:09] No, I don't need help thankfully, thanks [16:08:25] Just thought I'd join [16:08:51] Cool [16:10:48] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [16:11:05] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.87, 21.05, 19.62 [16:11:11] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [16:14:45] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [16:14:58] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 19.57, 20.01, 19.47 [16:15:09] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [16:25:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JTHBe [16:25:12] [02miraheze/services] 07MirahezeSSLBot 0352f2bf5 - BOT: Updating services config for wikis [16:25:36] [02miraheze/CreateWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JTHBJ [16:25:37] [02miraheze/CreateWiki] 07JohnFLewis 03d3d98a9 - TypeError not MWException [16:30:30] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 38.55, 25.45, 21.50 [16:34:22] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 15.76, 21.20, 20.68 [16:36:17] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 19.16, 19.77, 20.15 [17:13:41] @paladox and @Universal_Omega Update: @JohnLewis fixed the fatal exception error I reported on Discord ( https://discord.com/channels/407504499280707585/407537962553966603/771849719864623124 ) with this commit ( https://git.io/JTHBJ ) [17:13:41] [ Discord ] - discord.com [17:13:42] [ Comparing 88a7b05b5153...d3d98a978297 · miraheze/CreateWiki · GitHub ] - git.io [17:14:03] @dmehus: great! [17:14:03] Universal_Omega: 2020-10-31 - 16:27:39UTC tell Universal_Omega will do when you're online [17:14:33] greetings [17:14:50] @hispano76: hello! [17:16:28] :) [17:21:55] PROBLEM - rdb1 APT on rdb1 is CRITICAL: APT CRITICAL: 8 packages available for upgrade (2 critical updates). [17:26:20] [02mw-config] 07Universal-Omega opened pull request 03#3344: Add GoogleNewsSitemap extension (T6386) - 13https://git.io/JTHg3 [17:31:37] PROBLEM - cp7 APT on cp7 is CRITICAL: APT CRITICAL: 8 packages available for upgrade (2 critical updates). [17:33:23] Universal_Omega: you still want MirahezeBot in the channel? [17:34:53] @Spookreeeno: Oh, no, I didn't realize it was already in that channel. [17:44:14] !log sudo apt-get upgrade on cp7 [17:44:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:45:37] RECOVERY - cp7 APT on cp7 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:04:14] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.54, 23.03, 19.81 [18:06:09] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.73, 20.66, 19.31 [18:07:46] [02miraheze/ssl] 07Pix1234 created branch 03remove-vsfanwiki 13https://git.io/JTHVH [18:07:48] [02ssl] 07Pix1234 created branch 03remove-vsfanwiki - 13https://git.io/vxP9L [18:08:08] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 18.11, 19.86, 19.18 [18:08:32] [02miraheze/ssl] 07Pix1234 pushed 031 commit to 03remove-vsfanwiki [+0/-0/±1] 13https://git.io/JTHV7 [18:08:33] [02miraheze/ssl] 07Pix1234 03c83a626 - Remove vsfanwiki as it no longer points [18:08:57] [02miraheze/ssl] 07Pix1234 pushed 031 commit to 03remove-vsfanwiki [+0/-1/±0] 13https://git.io/JTHVF [18:08:59] [02miraheze/ssl] 07Pix1234 032a0a8fe - Delete vsfan.net.crt [18:09:13] [02ssl] 07Pix1234 opened pull request 03#367: Remove vsfanwiki as it no longer points to us - 13https://git.io/JTHVb [18:09:29] [02miraheze/ssl] 07Pix1234 pushed 031 commit to 03master [+0/-1/±1] 13https://git.io/JTHVx [18:09:31] [02miraheze/ssl] 07Pix1234 032d900b2 - Remove vsfanwiki as it no longer points to us (#367) * Remove vsfanwiki as it no longer points * Delete vsfan.net.crt [18:09:32] [02ssl] 07Pix1234 closed pull request 03#367: Remove vsfanwiki as it no longer points to us - 13https://git.io/JTHVb [18:09:34] [02ssl] 07Pix1234 deleted branch 03remove-vsfanwiki - 13https://git.io/vxP9L [18:09:35] [02miraheze/ssl] 07Pix1234 deleted branch 03remove-vsfanwiki [18:16:08] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.70, 21.48, 20.23 [18:24:08] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.59, 18.40, 19.30 [18:28:32] PROBLEM - ping6 on misc1 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 19.75 ms [18:30:32] RECOVERY - ping6 on misc1 is OK: PING OK - Packet loss = 0%, RTA = 18.01 ms [18:41:10] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.63, 18.91, 18.68 [18:45:10] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.61, 18.81, 18.76 [18:48:15] [02mw-config] 07Universal-Omega opened pull request 03#3345: Remove deleted wikis - 13https://git.io/JTHoB [19:13:05] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.98, 19.01, 17.10 [19:15:04] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 18.71, 18.65, 17.20 [19:53:16] [02mw-config] 07Universal-Omega synchronize pull request 03#3345: Remove deleted wikis - 13https://git.io/JTHoB [20:33:33] [02mw-config] 07Universal-Omega edited pull request 03#3345: Remove deleted wikis - 13https://git.io/JTHoB [20:40:53] PROBLEM - wiki.wikidadds.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Cannot make SSL connection. [20:41:42] PROBLEM - wiki.wikidadds.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.wikidadds.org reverse DNS resolves to any-in-2215.1e100.net [20:42:25] Zppix: ^ [20:43:09] Spookreeeno: the alert or gh? [20:43:26] Zppix: the alert. No longer pointing. [20:43:49] Ok [20:44:58] 25 critical issues on icinga :I [20:45:31] Most of them are apt [20:45:35] Wiki was deleted [20:46:07] [02miraheze/ssl] 07Pix1234 created branch 03Remove-maketruthmatteragainwiki 13https://git.io/JTHMn [20:46:08] [02ssl] 07Pix1234 created branch 03Remove-maketruthmatteragainwiki - 13https://git.io/vxP9L [20:46:48] [02miraheze/ssl] 07Pix1234 pushed 031 commit to 03Remove-maketruthmatteragainwiki [+0/-0/±1] 13https://git.io/JTHMC [20:46:49] [02miraheze/ssl] 07Pix1234 03c980bb4 - Remove maketruthmatteragainwiki as it no longer exists [20:47:18] [02miraheze/ssl] 07Pix1234 pushed 031 commit to 03Remove-maketruthmatteragainwiki [+0/-1/±0] 13https://git.io/JTHM0 [20:47:20] [02miraheze/ssl] 07Pix1234 039c17fe9 - Delete wiki.wikidadds.org.crt [20:47:32] [02ssl] 07Pix1234 opened pull request 03#368: Remove maketruthmatteragainwiki, no longer exists - 13https://git.io/JTHME [20:47:38] [02ssl] 07Pix1234 closed pull request 03#368: Remove maketruthmatteragainwiki, no longer exists - 13https://git.io/JTHME [20:47:40] [02miraheze/ssl] 07Pix1234 pushed 031 commit to 03master [+0/-1/±1] 13https://git.io/JTHMu [20:47:41] [02miraheze/ssl] 07Pix1234 0308ca7c4 - Remove maketruthmatteragainwiki, no longer exists (#368) * Remove maketruthmatteragainwiki as it no longer exists * Delete wiki.wikidadds.org.crt [20:47:43] [02ssl] 07Pix1234 deleted branch 03Remove-maketruthmatteragainwiki - 13https://git.io/vxP9L [20:47:44] [02miraheze/ssl] 07Pix1234 deleted branch 03Remove-maketruthmatteragainwiki [20:47:46] [02miraheze/ssl] 07Pix1234 pushed 032 commits to 03Remove-maketruthmatteragainwiki [+0/-1/±1] 13https://git.io/JTHMz [20:47:47] [02miraheze/ssl] 07Pix1234 03c980bb4 - Remove maketruthmatteragainwiki as it no longer exists [20:47:49] [02miraheze/ssl] 07Pix1234 039c17fe9 - Delete wiki.wikidadds.org.crt [20:47:50] [02ssl] 07Pix1234 created branch 03Remove-maketruthmatteragainwiki - 13https://git.io/vxP9L [20:47:52] [02miraheze/ssl] 07Pix1234 deleted branch 03Remove-maketruthmatteragainwiki [20:47:53] [02ssl] 07Pix1234 deleted branch 03Remove-maketruthmatteragainwiki - 13https://git.io/vxP9L [20:47:59] Lol i misclicked [20:48:05] Clicked it twice [20:48:31] Heh [20:48:51] Fun of doing gh on mobile [20:49:01] Ye [20:49:31] Hello gratefulRes! If you have any questions, feel free to ask and someone should answer soon. [20:49:38] .op [20:49:50] Hi gratefulRes how can we help you? [21:36:56] [02mw-config] 07Universal-Omega synchronize pull request 03#3345: Remove deleted wikis - 13https://git.io/JTHoB [21:38:24] [02mw-config] 07Universal-Omega synchronize pull request 03#3345: Remove deleted wikis - 13https://git.io/JTHoB [21:40:49] [02mw-config] 07Universal-Omega edited pull request 03#3345: Remove deleted wikis - 13https://git.io/JTHoB [21:40:59] [02mw-config] 07Universal-Omega edited pull request 03#3345: Remove deleted wikis - 13https://git.io/JTHoB [21:41:16] [02mw-config] 07Universal-Omega edited pull request 03#3345: Remove deleted wikis - 13https://git.io/JTHoB [21:55:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JTHHT [21:55:13] [02miraheze/services] 07MirahezeSSLBot 03328b605 - BOT: Updating services config for wikis [21:55:33] [02mw-config] 07Universal-Omega synchronize pull request 03#3345: Remove deleted wikis - 13https://git.io/JTHoB [21:58:58] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.79, 22.96, 19.70 [22:00:07] * hispano76 see [22:04:58] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.13, 19.20, 19.29 [22:14:57] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.29, 20.27, 19.42 [22:16:56] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 11.84, 17.16, 18.39 [22:17:32] [02mw-config] 07Universal-Omega synchronize pull request 03#3345: Remove deleted wikis - 13https://git.io/JTHoB [22:18:39] [02mw-config] 07Universal-Omega edited pull request 03#3345: Remove deleted wikis - 13https://git.io/JTHoB [22:21:07] [02mw-config] 07Universal-Omega edited pull request 03#3345: Remove deleted wikis - 13https://git.io/JTHoB [22:22:29] [02mw-config] 07Universal-Omega edited pull request 03#3345: Remove deleted wikis - 13https://git.io/JTHoB [22:25:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JTH78 [22:25:13] [02miraheze/services] 07MirahezeSSLBot 03ed0ecea - BOT: Updating services config for wikis [22:26:26] Finally finished the PR I have been working on for 5 hours! [22:27:33] There was a ton of leftover configurations from deleted wikis. [22:27:51] [02mw-config] 07paladox reviewed pull request 03#3345 commit - 13https://git.io/JTH7K [22:30:09] [02mw-config] 07paladox reviewed pull request 03#3345 commit - 13https://git.io/JTH7y [22:31:49] [02mw-config] 07paladox reviewed pull request 03#3345 commit - 13https://git.io/JTH7x [22:36:19] [02mw-config] 07Universal-Omega reviewed pull request 03#3345 commit - 13https://git.io/JTH50 [22:38:33] [02mw-config] 07Universal-Omega synchronize pull request 03#3345: Remove deleted wikis - 13https://git.io/JTHoB [22:38:59] [02mw-config] 07Universal-Omega reviewed pull request 03#3345 commit - 13https://git.io/JTH51 [22:40:27] [02mw-config] 07paladox reviewed pull request 03#3345 commit - 13https://git.io/JTH5N [22:48:16] [02mw-config] 07Universal-Omega reviewed pull request 03#3345 commit - 13https://git.io/JTHdu [22:52:08] [02ssl] 07Universal-Omega opened pull request 03#369: remove deleted wiki - 13https://git.io/JTHdj [22:54:50] [02ssl] 07paladox commented on pull request 03#369: remove deleted wiki - 13https://git.io/JTHFL [22:54:56] [02ssl] 07Pix1234 commented on pull request 03#369: remove deleted wiki - 13https://git.io/JTHFq [22:55:09] I misread paladox lol [22:55:10] [02ssl] 07paladox closed pull request 03#369: remove deleted wiki - 13https://git.io/JTHdj [22:55:12] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JTHFY [22:55:13] [02miraheze/ssl] 07Universal-Omega 03ba00476 - remove deleted wiki (#369) [22:55:16] heh [22:55:19] I suck at reading diffs [22:56:23] [02mw-config] 07paladox closed pull request 03#3345: Remove deleted wikis - 13https://git.io/JTHoB [22:56:24] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/JTHFB [22:56:26] [02miraheze/mw-config] 07Universal-Omega 034dfd33b - Remove deleted wikis (#3345) * Remove deleted wikis * remove more deleted wikis * remove more deleted wikis * remove deleted wikis * Remove deleted wikis * Finish removing rest of deleted wikis * + [22:58:44] Thanks for merging those! [23:05:41] PROBLEM - tl.awiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for tl.awiki.org could not be found [23:05:44] PROBLEM - gu.gyaanipedia.co.in - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for gu.gyaanipedia.co.in could not be found [23:12:23] RECOVERY - tl.awiki.org - reverse DNS on sslhost is OK: rDNS OK - tl.awiki.org reverse DNS resolves to cp6.miraheze.org [23:12:31] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.37, 21.78, 19.38 [23:12:40] RECOVERY - gu.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - gu.gyaanipedia.co.in reverse DNS resolves to cp6.miraheze.org [23:14:31] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.07, 22.14, 19.83 [23:18:31] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 23.76, 24.58, 21.37 [23:22:31] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.50, 23.75, 21.77 [23:38:32] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.19, 18.46, 19.79 [23:41:21] [02mw-config] 07Universal-Omega opened pull request 03#3346: Migrate Wikiapiary footer icons to ManageWiki. - 13https://git.io/JTHA7 [23:52:06] [02mw-config] 07Universal-Omega synchronize pull request 03#3346: Migrate Wikiapiary footer icons to ManageWiki. - 13https://git.io/JTHA7 [23:56:18] [02mw-config] 07Universal-Omega synchronize pull request 03#3346: Migrate Wikiapiary footer icons to ManageWiki. - 13https://git.io/JTHA7