[00:01:33] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 3821 MB (15% inode=93%); [01:07:14] !log set up 2G swap on db11, non-persistent [01:07:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:22:20] PROBLEM - jobrunner1 Current Load on jobrunner1 is WARNING: WARNING - load average: 7.36, 5.94, 4.82 [01:24:20] RECOVERY - jobrunner1 Current Load on jobrunner1 is OK: OK - load average: 5.70, 5.99, 4.98 [02:04:39] [02miraheze/mw-config] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJWi6 [02:04:41] [02miraheze/mw-config] 07Southparkfan 036594520 - Add global 5y anniversary notice, with opt out [02:06:19] miraheze/mw-config/master/6594520 - Ferran Tufan The build was broken. https://travis-ci.org/miraheze/mw-config/builds/710599913 [02:07:21] [02miraheze/mw-config] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJWiX [02:07:22] [02miraheze/mw-config] 07Southparkfan 03318ac97 - Increase font size [02:09:01] miraheze/mw-config/master/318ac97 - Ferran Tufan The build is still failing. https://travis-ci.org/miraheze/mw-config/builds/710600569 [02:12:12] ^ can ignore build error, syntax is invalid in php 7.2 but it's valid in php 7.3 [02:12:18] night :) [02:17:43] PROBLEM - misc1 Puppet on misc1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [02:17:44] PROBLEM - misc1 Current Load on misc1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [02:17:59] PROBLEM - misc1 NTP time on misc1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [02:18:15] PROBLEM - misc1 IMAP on misc1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:19:17] PROBLEM - misc1 SSH on misc1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:20:37] PROBLEM - misc1 Disk Space on misc1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [02:21:33] PROBLEM - misc1 SMTP on misc1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:21:37] PROBLEM - misc1 APT on misc1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [02:21:57] RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 10 minutes ago with 0 failures [02:22:01] RECOVERY - misc1 NTP time on misc1 is OK: NTP OK: Offset -0.0006358027458 secs [02:22:25] RECOVERY - misc1 IMAP on misc1 is OK: IMAP OK - 0.036 second response time on 185.52.1.76 port 143 [* OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS LOGINDISABLED] Dovecot ready.] [02:22:36] RECOVERY - misc1 Disk Space on misc1 is OK: DISK OK - free space: / 34634 MB (84% inode=99%); [02:23:25] RECOVERY - misc1 SSH on misc1 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u7 (protocol 2.0) [02:23:30] RECOVERY - misc1 SMTP on misc1 is OK: SMTP OK - 0.068 sec. response time [02:23:34] RECOVERY - misc1 APT on misc1 is OK: APT OK: 26 packages available for upgrade (0 critical updates). [02:29:24] Hello happy5thbirthday! If you have any questions, feel free to ask and someone should answer soon. [02:30:02] 🎉 [02:37:32] PROBLEM - misc1 Current Load on misc1 is WARNING: WARNING - load average: 0.01, 0.56, 1.98 [02:41:32] RECOVERY - misc1 Current Load on misc1 is OK: OK - load average: 0.05, 0.28, 1.54 [04:04:20] PROBLEM - jobrunner1 Current Load on jobrunner1 is CRITICAL: CRITICAL - load average: 8.03, 7.10, 5.49 [04:06:20] PROBLEM - jobrunner1 Current Load on jobrunner1 is WARNING: WARNING - load average: 7.17, 7.10, 5.68 [04:08:20] RECOVERY - jobrunner1 Current Load on jobrunner1 is OK: OK - load average: 4.74, 6.33, 5.57 [04:14:20] PROBLEM - jobrunner1 Current Load on jobrunner1 is WARNING: WARNING - load average: 5.72, 6.95, 6.16 [04:16:20] RECOVERY - jobrunner1 Current Load on jobrunner1 is OK: OK - load average: 6.80, 6.72, 6.16 [06:10:22] !log renamed animewiki to shihouwik [06:10:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:15:13] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJWHf [06:15:14] [02miraheze/services] 07MirahezeSSLBot 03ea401b4 - BOT: Updating services config for wikis [06:16:59] PROBLEM - dreamsit.com.br - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'dreamsit.com.br' expires in 15 day(s) (Fri 07 Aug 2020 06:08:05 GMT +0000). [06:17:38] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJWHL [06:17:40] [02miraheze/ssl] 07MirahezeSSLBot 0322b33c8 - Bot: Update SSL cert for dreamsit.com.br [06:23:41] RECOVERY - dreamsit.com.br - LetsEncrypt on sslhost is OK: OK - Certificate 'dreamsit.com.br' will expire on Tue 20 Oct 2020 05:17:32 GMT +0000. [06:55:41] Happy Birthday Miraheze! [06:55:46] Morning Reception123 [06:56:12] Morning [06:56:23] Happy birthday Miraheze :D [06:56:27] 5 years... [06:57:02] Yep [07:00:15] PROBLEM - wiki.valentinaproject.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.valentinaproject.org' expires in 15 day(s) (Fri 07 Aug 2020 06:56:21 GMT +0000). [07:00:43] [ANNOUNCEMENT] Miraheze celebrates its 5th Birthday today. Everyone behind MirahezeBot would like to wish Miraheze a very happy birthday. Congrats and good luck for many more years! Join the celebration via https://meta.miraheze.org/wiki/Miraheze-5-year [07:00:54] Morning, RhinosF1 and Reception123. 🙂 [07:01:06] Hey [07:01:11] Hi [07:01:14] And now it's just past midnight on the west coast so it's time for my sleep. 😛 [07:01:36] Have a good night [07:01:46] thanks [07:01:50] Good night :) [07:03:48] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJW7z [07:03:49] [02miraheze/ssl] 07MirahezeSSLBot 03f0a4648 - Bot: Update SSL cert for wiki.valentinaproject.org [07:11:59] .status mhmeta Happy Birthday Miraheze! [07:12:01] RhinosF1: Updating User:RhinosF1/Status to Happy Birthday Miraheze!! [07:12:09] RhinosF1: Updated! [07:13:55] RECOVERY - wiki.valentinaproject.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.valentinaproject.org' will expire on Tue 20 Oct 2020 06:03:41 GMT +0000. [09:18:20] PROBLEM - jobrunner1 Current Load on jobrunner1 is WARNING: WARNING - load average: 6.76, 6.86, 5.19 [09:20:20] RECOVERY - jobrunner1 Current Load on jobrunner1 is OK: OK - load average: 4.30, 5.90, 5.03 [11:32:21] PROBLEM - jobrunner1 Current Load on jobrunner1 is CRITICAL: CRITICAL - load average: 8.62, 7.26, 5.69 [11:34:22] RECOVERY - jobrunner1 Current Load on jobrunner1 is OK: OK - load average: 4.32, 6.10, 5.46 [13:27:03] PROBLEM - db7 Check MariaDB Replication on db7 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 131s [13:27:22] SPF|Cloud, paladox: ^ [13:28:58] it'll catch up. [13:29:34] 131s is hardly much diff [13:29:35] Zppix: 2020-07-21 - 20:26:37CDT tell Zppix ? [13:32:19] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.84, 19.66, 15.03 [13:35:02] Zppix: then it shouldn't be alerting [13:35:12] paladox: does it need to alert critical every day [13:35:40] I guess we should tweek it, going to leave it to SPF|Cloud as he's more an expert in the db side of things :) [13:36:16] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 33.25, 25.19, 18.16 [13:37:50] paladox: okay! [13:38:03] It's tweak though :) [13:38:21] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 6.45, 8.49, 4.96 [13:40:14] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.67, 22.34, 18.65 [13:40:20] RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 3.17, 6.60, 4.70 [13:42:30] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 71.47, 39.03, 25.02 [13:44:16] PROBLEM - zw.fontainebleau-avon.fr - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210' [13:44:20] PROBLEM - permanentfuturelab.wiki - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' [13:44:27] PROBLEM - www.lab612.at - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:105a::10,51.222.27.129' [13:44:29] PROBLEM - wiki.villagecollaborative.net - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.222.27.129' [13:44:35] PROBLEM - tep.wiki - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' [13:44:37] PROBLEM - sims.miraheze.org - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.222.27.129' [13:44:44] paladox: ^ is another going off too fern [13:44:46] Often [13:44:47] PROBLEM - enc.for.uz - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' [13:47:45] i have no idea why it tried using cp9 [13:47:51] SPF|Cloud ^ [13:50:20] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJlti [13:50:22] [02miraheze/services] 07MirahezeSSLBot 0315263ec - BOT: Updating services config for wikis [13:50:31] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.65, 23.09, 22.80 [13:50:58] RECOVERY - zw.fontainebleau-avon.fr - DNS on sslhost is OK: DNS OK: 0.034 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [13:51:03] RECOVERY - permanentfuturelab.wiki - DNS on sslhost is OK: DNS OK: 0.036 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [13:51:15] RECOVERY - www.lab612.at - DNS on sslhost is OK: DNS OK: 0.053 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [13:51:23] RECOVERY - sims.miraheze.org - DNS on sslhost is OK: DNS OK: 0.038 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [13:51:24] RECOVERY - wiki.villagecollaborative.net - DNS on sslhost is OK: DNS OK: 0.034 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [13:51:35] RECOVERY - tep.wiki - DNS on sslhost is OK: DNS OK: 0.034 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [13:51:38] RECOVERY - enc.for.uz - DNS on sslhost is OK: DNS OK: 0.037 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [13:52:44] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 55.50, 30.48, 25.26 [13:58:42] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.61, 21.89, 23.16 [14:00:41] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.62, 23.71, 23.69 [14:02:39] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 13.88, 20.69, 22.64 [14:06:36] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 31.23, 25.08, 24.04 [14:08:35] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.66, 23.82, 23.69 [14:10:33] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 31.07, 25.96, 24.41 [14:12:35] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.31, 23.50, 23.72 [14:16:33] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 32.94, 25.17, 24.11 [14:30:34] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 8.96, 7.36, 5.01 [14:32:31] PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 6.57, 6.88, 5.10 [14:34:28] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 38.38, 18.83, 9.65 [14:42:43] PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 3.47, 7.77, 7.94 [14:43:30] RECOVERY - db7 Check MariaDB Replication on db7 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 0s [14:48:32] RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 2.46, 4.27, 6.30 [14:49:12] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 9.45, 16.57, 23.95 [14:57:07] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 9.23, 13.15, 19.39 [15:42:33] Hello PichuVI! If you have any questions, feel free to ask and someone should answer soon. [16:25:32] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2645 MB (10% inode=93%); [16:31:29] Wow, #irc-relay has been quiet for the past 9-10 hours. That's not a lot of conversation in that span. [16:43:53] hello [16:44:24] if I do a desambiguation page, that page counts as a real page in the counter. Is there a way that page counts like it was a redirection? [16:45:04] No it doesn't get counted as a page. [16:45:26] I think it might need turning on via Extension:Disambigator though [16:48:53] maybe is because I did it as a normal page, as I don't know how to as a real disambiguation. Do I need to request that extension or I can activate it myself? [16:49:16] puedes activarla en ManageWiki [16:55:49] ^ [16:57:30] gracias / thank you [16:58:10] I spent a minute trying to figure out where the "tabulator" (tabulador) was, and it was a tab (pestaña). I think that can be worded differently [16:58:30] in Spanish [16:59:06] Ah! [16:59:13] "Una vez que termines, presiona la pestaña llamada "enviar" para guardar tus cambios" instead "Una vez que has hecho, presiona el tabulador que se llama "presenta" para guardar tus cambios." [17:00:22] PROBLEM - wiki.grottocenter.org - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' [17:00:27] Can I propose that change officially somewhere? in phabricator? or do you have another service to translate by chains? [17:01:09] Jakeukalane: which url do you see it on and I'll find where to fix the translation [17:01:16] Is it for Spanish? [17:02:03] yes [17:02:07] wiki/Especial:ManageWiki/extensions [17:02:31] I will reword all the parragraph [17:02:43] https://usercontent.irccloud-cdn.com/file/wsGF5SmC/ManageWiki.png [17:02:48] RhinosF1: ^ [17:05:31] Jakeukalane: https://translatewiki.net/w/i.php?title=Special:Translate&showMessage=managewiki-header-extensions&group=mwgithub-managewiki&language=es&filter=&optional=1&action=translate [17:05:32] [ Translate - translatewiki.net ] - translatewiki.net [17:05:33] https://pastebin.com/raw/yzGmWhYC [17:05:55] thank you [17:06:11] Jakeukalane: you can sign up for translatewiki and edit it there [17:06:58] that's what I wanted, I am in several of those pages already :) [17:07:07] RECOVERY - wiki.grottocenter.org - DNS on sslhost is OK: DNS OK: 0.037 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [17:07:34] Good [17:08:35] Hello Jakeukalane_! If you have any questions, feel free to ask and someone should answer soon. [18:09:29] just received the mail that I have permissions to edit, now [18:11:46] just send my translation [18:11:51] sent* [18:15:00] PROBLEM - jobrunner1 Current Load on jobrunner1 is CRITICAL: CRITICAL - load average: 19.60, 11.40, 6.97 [18:26:35] PROBLEM - jobrunner1 Current Load on jobrunner1 is WARNING: WARNING - load average: 6.44, 7.81, 7.37 [18:30:26] RECOVERY - jobrunner1 Current Load on jobrunner1 is OK: OK - load average: 3.83, 5.94, 6.73 [19:30:58] [02mw-config] 07dmehus commented on pull request 03#3168: Update LocalSettings.php - 13https://git.io/JJluI [19:57:10] PROBLEM - jobrunner1 Current Load on jobrunner1 is CRITICAL: CRITICAL - load average: 8.15, 6.89, 5.55 [19:59:06] PROBLEM - jobrunner1 Current Load on jobrunner1 is WARNING: WARNING - load average: 5.77, 7.42, 5.98 [20:01:09] RECOVERY - jobrunner1 Current Load on jobrunner1 is OK: OK - load average: 3.12, 5.83, 5.56 [20:09:53] this is a known visualization problem https://usercontent.irccloud-cdn.com/file/nMYzlBra/visualizationproblem.png [20:13:47] PROBLEM - jobrunner1 Current Load on jobrunner1 is CRITICAL: CRITICAL - load average: 12.23, 8.74, 6.85 [20:16:09] hispano76: if it's an svg, yeah [20:17:43] PROBLEM - jobrunner1 Current Load on jobrunner1 is WARNING: WARNING - load average: 7.70, 7.87, 6.93 [20:19:39] PROBLEM - jobrunner1 Current Load on jobrunner1 is CRITICAL: CRITICAL - load average: 13.26, 9.28, 7.51 [20:22:07] not SVG [20:22:44] happens with jpg and png [20:23:58] the image is of https://commons.wikimedia.org/wiki/File:Andres_manuel_lopez_obrador_oct05.jpg RhinosF1 [20:23:59] [ File:Andres manuel lopez obrador oct05.jpg - Wikimedia Commons ] - commons.wikimedia.org [20:24:15] Hmm [20:24:17] paladox: ^ [20:24:48] (problem also occurs with images hosted on Miraheze Commons) [20:26:35] hmm? [20:27:47] paladox: same as the svg issue or? [20:28:08] what's the same as the svg issue? That's commons.wikimedia.org, we don't control that domain. [20:28:29] https://usercontent.irccloud-cdn.com/file/1HMvgXSg/Example%20on%20MHCommons.png [20:28:37] hmm [20:28:43] that's the same as the svg image [20:28:48] it's doing 10px [20:29:01] paladox: RhinosF1 ^ [20:29:15] I'll let paladox look into it [20:29:30] is this only occuring on photos sourced from wikimedia and miraheze commons? [20:29:46] [02mw-config] 07paladox closed pull request 03#3168: Update LocalSettings.php - 13https://git.io/JJskA [20:29:48] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJlgQ [20:29:49] [02miraheze/mw-config] 07dmehus 03f8b2af7 - Update LocalSettings.php (#3168) In the case of "wikitech," per discussion with @RhinosF1 on Discord following a declined wiki creation request. Though we may not need it imminently, it seems prudent to reserve this subdomain for potential Miraheze use as a public or private wiki in the future. Likewise, for "gazetteer," per the several declined wiki requests which [20:29:49] @Pix1234 and I have declined, this one seeks to replicate our Gazetteer of Wikis page on Meta without some sort of community discussion and clearly articulating how we could not improve upon the data available in/provided by the WikiDiscover special page. We may want to wildcard "gazetteer" to include "gazeteer" as a misspelling. [20:31:21] miraheze/mw-config/master/f8b2af7 - Doug Mehus The build is still failing. https://travis-ci.org/miraheze/mw-config/builds/710884565 [20:34:19] paladox: ^ [20:34:52] Sitenotice on ohp7.2 [20:35:38] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJl23 [20:35:40] [02miraheze/mw-config] 07paladox 03dddcc24 - Fix [20:35:48] php7.2 error, works on php7.3 [20:37:10] miraheze/mw-config/master/dddcc24 - paladox The build was fixed. https://travis-ci.org/miraheze/mw-config/builds/710886185 [20:37:12] An extension has broken images [20:37:28] i just have to figure out which extension.. [20:37:45] paladox: I know [20:37:55] you know? because i didn't [20:38:55] paladox: no, for php7.2 [20:38:59] oh [20:39:01] 21:35:49 php7.2 error, works on php7.3 [20:39:23] RhinosF1 in you're opinion which extension would you think would mostly affect images? [20:39:27] *your [20:39:36] paladox: is it affecting every wiki? [20:39:50] yes, any wiki that has it enabled [20:39:57] Since it works on Johns test delete wiki [20:40:05] That's not every wiki [20:40:11] What extension? [20:40:14] If it's working on some not others [20:40:20] Then work out the difference [20:40:29] And slowly turn things off [20:40:33] Until it works [20:45:56] yes i know, that's why i asked you if you had an extension in mind [20:46:59] hum, check skin citizen [20:48:08] is one of the most recent extensions/skins I've enabled [20:48:59] paladox: best to do is just look at the minimally reproducible set and work from there [20:49:10] And yeah look at changes around when it broke [20:49:28] @RhinosF1 and @Hispano76 Regarding the blurry images, I've heard some people on [[community noticeboard]] say they found a workaround whereby they create their SVG images in a desktop graphics program like Inkscape instead of ImageMagick and it seems to resolve any blurry image problems. I've personally never used an online graphics rendering / conversion program, other than, well, maybe Facebook's or Twitter's when cropping my profile [20:49:29] picture/avatar. [20:49:42] oh [20:49:46] it's citizen [20:49:48] RhinosF1 hispano76 ^ [20:50:07] paladox: ah! I'll talk to the developer then. [20:50:13] @paladox what's "citizen"? [20:50:18] a skin [20:50:23] ah [20:50:24] I use inkscape for image rendering [20:51:14] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JJl2H [20:51:16] [02miraheze/mediawiki] 07paladox 031571d75 - Update Citizen [20:52:04] RhinosF1 https://github.com/StarCitizenTools/mediawiki-skins-Citizen/blob/524ba6b9b9949bf45223aa3601dfb06af53c88a5/includes/CitizenHooks.php#L88 [20:52:04] [ mediawiki-skins-Citizen/CitizenHooks.php at 524ba6b9b9949bf45223aa3601dfb06af53c88a5 · StarCitizenTools/mediawiki-skins-Citizen · GitHub ] - github.com [20:55:06] paladox: that's your issue then! [20:56:59] :) [21:02:23] PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [21:02:54] PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [21:03:26] PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [21:05:22] RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures [21:05:45] PROBLEM - cyberneticeye.xyz - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210,51.89.160.142' [21:05:51] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.49, 24.31, 19.67 [21:06:04] paladox: can we Revert them dns alerts? [21:06:19] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [21:06:20] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [21:06:25] They're going off for nothing way too often [21:07:51] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 15.46, 21.11, 19.07 [21:08:14] RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 51 seconds ago with 0 failures [21:08:54] RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:09:51] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.50, 19.63, 18.82 [21:10:01] Hey Voidwalker [21:11:08] hi [21:11:43] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JJlaD [21:11:44] [02miraheze/mediawiki] 07paladox 03988d1f7 - Update Citizen [21:12:32] RECOVERY - cyberneticeye.xyz - DNS on sslhost is OK: DNS OK: 0.036 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:13:11] How's Voidwalker on our 5th Birthday [21:13:53] doin all right [21:14:22] Great! [21:14:50] !log rebuild lc on mw* and jobrunner1 [21:14:50] I gonna try and finish my big MirahezeBot update at some point this week [21:15:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:16:18] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures [21:16:20] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 47 seconds ago with 0 failures [21:20:51] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JJlVk [21:20:52] [02miraheze/mediawiki] 07paladox 0315278ba - Update Tweeki [21:23:04] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 6.91, 5.97, 4.42 [21:23:25] hispano76 should work now [21:23:45] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 37.90, 26.38, 21.43 [21:24:01] PROBLEM - gluster1 Current Load on gluster1 is CRITICAL: CRITICAL - load average: 8.69, 5.85, 4.08 [21:24:11] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 4 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.89.160.142/cpweb, 2607:5300:205:200::2ac4/cpweb [21:24:47] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 8.25, 6.99, 5.04 [21:25:54] PROBLEM - innersphere.tk - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210,51.89.160.142' [21:25:57] PROBLEM - theatlas.pw - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210,51.89.160.142' [21:25:58] PROBLEM - wiki.ripto.gq - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210,51.89.160.142' [21:25:58] RECOVERY - gluster1 Current Load on gluster1 is OK: OK - load average: 6.59, 6.26, 4.46 [21:26:07] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [21:26:12] PROBLEM - vmcodex.net - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210' [21:26:14] PROBLEM - sahitya.shaunak.in - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210,51.89.160.142' [21:26:19] PROBLEM - orain.org - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210' [21:26:23] PROBLEM - wiki.grottocenter.org - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210' [21:26:23] PROBLEM - sims.miraheze.org - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210' [21:26:38] PROBLEM - dreamsit.com.br - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210,51.89.160.142' [21:26:40] PROBLEM - www.programming.red - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210' [21:26:40] PROBLEM - wiki.campaign-labour.org - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210' [21:26:44] PROBLEM - storytime.jdstroy.cf - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210,51.89.160.142' [21:26:45] PROBLEM - vault.aics.cf - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210,51.89.160.142' [21:26:46] PROBLEM - spiral.wiki - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210' [21:26:46] PROBLEM - duepedia.uk.to - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210' [21:26:46] PROBLEM - mr.gyaanipedia.co.in - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210' [21:26:47] PROBLEM - secularknowledge.com - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210,51.89.160.142' [21:26:50] PROBLEM - test1.miraheze.org - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210' [21:26:53] PROBLEM - www.mh142.com - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210' [21:26:59] PROBLEM - disabled.life - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210' [21:27:00] PROBLEM - www.modesofdiscourse.com - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210,51.89.160.142' [21:27:02] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 9.94, 7.75, 5.48 [21:27:06] PROBLEM - wiki.animalrebellion.cz - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210' [21:27:07] PROBLEM - bn.gyaanipedia.co.in - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210,51.89.160.142' [21:27:18] PROBLEM - guia.esporo.net - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210,51.89.160.142' [21:27:21] PROBLEM - adadevelopersacademy.wiki - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210' [21:27:21] PROBLEM - wiki.mobilityengineer.com - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210,51.89.160.142' [21:27:23] PROBLEM - wiki.openhatch.org - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210,51.89.160.142' [21:27:45] PROBLEM - wiki.bullshit.systems - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210,51.89.160.142' [21:28:04] flood XD [21:28:38] Yeah! works! thanks! :D [21:28:52] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 6.62, 7.70, 5.85 [21:29:02] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 6.36, 7.28, 5.60 [21:29:07] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JJlV8 [21:29:08] [02miraheze/dns] 07paladox 0388dc06b - Up timeout to 10 [21:29:10] [02dns] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbQXl [21:29:11] [02dns] 07paladox opened pull request 03#169: Up timeout to 10 - 13https://git.io/JJlV4 [21:29:25] paladox: I was just about to say deal with that [21:30:47] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 4.82, 6.68, 5.69 [21:31:01] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 5.31, 6.57, 5.53 [21:31:24] PROBLEM - meta.gyaanipedia.co.in - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,51.77.107.210,51.89.160.142' [21:31:28] PROBLEM - wiki.casadocarvalho.net - DNS on sslhost is CRITICAL: DNS CRITICAL - expected '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142' but got '2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.89.160.142' [21:31:39] Go away icinga-miraheze [21:31:46] There's nothing wrong [21:32:33] RECOVERY - innersphere.tk - DNS on sslhost is OK: DNS OK: 0.077 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:32:39] RECOVERY - theatlas.pw - DNS on sslhost is OK: DNS OK: 0.037 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:32:41] RECOVERY - wiki.ripto.gq - DNS on sslhost is OK: DNS OK: 0.036 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:02] RECOVERY - orain.org - DNS on sslhost is OK: DNS OK: 0.041 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:06] RECOVERY - vmcodex.net - DNS on sslhost is OK: DNS OK: 0.055 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:08] RECOVERY - sahitya.shaunak.in - DNS on sslhost is OK: DNS OK: 0.036 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:08] RECOVERY - wiki.grottocenter.org - DNS on sslhost is OK: DNS OK: 0.041 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:09] RECOVERY - sims.miraheze.org - DNS on sslhost is OK: DNS OK: 0.040 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:18] RECOVERY - dreamsit.com.br - DNS on sslhost is OK: DNS OK: 0.052 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:23] RECOVERY - www.programming.red - DNS on sslhost is OK: DNS OK: 0.052 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:23] RECOVERY - wiki.campaign-labour.org - DNS on sslhost is OK: DNS OK: 0.078 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:28] RECOVERY - storytime.jdstroy.cf - DNS on sslhost is OK: DNS OK: 0.064 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:28] RECOVERY - vault.aics.cf - DNS on sslhost is OK: DNS OK: 0.061 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:36] RECOVERY - spiral.wiki - DNS on sslhost is OK: DNS OK: 0.038 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:37] RECOVERY - duepedia.uk.to - DNS on sslhost is OK: DNS OK: 0.061 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:37] RECOVERY - mr.gyaanipedia.co.in - DNS on sslhost is OK: DNS OK: 0.101 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:37] RECOVERY - secularknowledge.com - DNS on sslhost is OK: DNS OK: 0.155 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:41] RECOVERY - disabled.life - DNS on sslhost is OK: DNS OK: 0.153 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:41] RECOVERY - www.modesofdiscourse.com - DNS on sslhost is OK: DNS OK: 0.028 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:42] RECOVERY - test1.miraheze.org - DNS on sslhost is OK: DNS OK: 0.032 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:46] ._. [21:33:49] RECOVERY - www.mh142.com - DNS on sslhost is OK: DNS OK: 0.056 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:54] RECOVERY - wiki.animalrebellion.cz - DNS on sslhost is OK: DNS OK: 0.036 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:54] RECOVERY - bn.gyaanipedia.co.in - DNS on sslhost is OK: DNS OK: 0.097 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:33:56] RECOVERY - guia.esporo.net - DNS on sslhost is OK: DNS OK: 0.051 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:34:03] RECOVERY - adadevelopersacademy.wiki - DNS on sslhost is OK: DNS OK: 0.038 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:34:03] RECOVERY - wiki.mobilityengineer.com - DNS on sslhost is OK: DNS OK: 0.047 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:34:08] RECOVERY - wiki.openhatch.org - DNS on sslhost is OK: DNS OK: 0.031 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:34:30] !log MariaDB [incidents]> update incidents set i_published = NULL where i_id = 33; - db11 [21:34:30] RECOVERY - wiki.bullshit.systems - DNS on sslhost is OK: DNS OK: 0.043 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:34:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:36:19] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [21:36:20] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [21:37:29] Happy birthday ;) [21:37:38] 🥳🥳🥳🥳🥳 [21:38:16] RECOVERY - meta.gyaanipedia.co.in - DNS on sslhost is OK: DNS OK: 0.025 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:38:26] RECOVERY - wiki.casadocarvalho.net - DNS on sslhost is OK: DNS OK: 0.035 seconds response time. sslhost returns 2001:41d0:800:1056::2,2001:41d0:800:105a::10,51.77.107.210,51.89.160.142 [21:39:12] Thanks eth01 [21:40:22] Is eth01 a human or bot users? [21:41:27] Human [21:41:33] He owns fosshost [21:41:46] Which provides the servers for bots+tools [21:42:04] Plus I think we're looking at a few cache proxies [21:45:41] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 10.34, 15.97, 22.36 [21:46:18] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:46:20] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:49:41] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 11.00, 14.31, 20.27 [21:56:51] !log upgrade gluster to 7.7 on gluster 1 & 2 [21:56:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:57:56] !log upgrade puppet-agent on gluster 1 & 2 [21:58:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:59:42] !log upgrade gluster & puppet-agent on mw 4,5,6,7 [21:59:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:01:03] !log upgrade phabricator on phab1 [22:01:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:06:14] PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [22:06:15] !log upgrade gluster & puppet-agent on jobrunner1 & test2 [22:06:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:06:22] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 8.40, 4.87, 3.48 [22:06:38] paladox: why's mw5 puppet upset? [22:06:41] .!log paladox is logging a lot [22:06:54] mutante: it's update time! [22:07:04] PROBLEM - phab1 Puppet on phab1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[php7.3-apcu] [22:07:20] RhinosF1: PHP version too ?:) [22:07:24] oh heh [22:07:29]