[00:29:19] !log running optimize table searchindex on chakuwikiwiki [00:33:31] and I'm off [00:33:33] night [00:35:21] Hello orbitron68! If you have any questions, feel free to ask and someone should answer soon. [00:35:52] Hello! [00:37:53] * hispano76 greetings [00:39:10] [02mw-config] 07The-Voidwalker commented on pull request 03#3661: add wgARENamespaces to ManageWikiNamespaces - 13https://git.io/JtJhU [00:41:51] hi @orbitron68 :) [00:42:57] [02mw-config] 07dmehus commented on pull request 03#3661: add wgARENamespaces to ManageWikiNamespaces - 13https://git.io/JtJh3 [02:16:27] PROBLEM - wiki.joust.ro - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.joust.ro All nameservers failed to answer the query. [02:23:11] RECOVERY - wiki.joust.ro - reverse DNS on sslhost is OK: rDNS OK - wiki.joust.ro reverse DNS resolves to cp7.miraheze.org [04:13:03] [02mw-config] 07Universal-Omega reviewed pull request 03#3661 commit - 13https://git.io/JtUk6 [04:40:45] PROBLEM - rdb1 APT on rdb1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [04:44:45] RECOVERY - rdb1 APT on rdb1 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [06:22:00] [02mw-config] 07Universal-Omega reviewed pull request 03#3661 commit - 13https://git.io/JtUk6 [09:37:30] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 9.63, 4.64, 2.21 [09:43:27] RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 1.35, 4.13, 2.93 [09:56:34] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 8 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:1056::2/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb [09:57:13] PROBLEM - cp9 Stunnel Http for mw4 on cp9 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [09:57:30] PROBLEM - cp3 Stunnel Http for mw4 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [09:57:41] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb [09:57:43] PROBLEM - mw4 MediaWiki Rendering on mw4 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:58:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [09:58:51] F [09:58:57] I think we just lost mw4 [09:59:11] RECOVERY - cp9 Stunnel Http for mw4 on cp9 is OK: HTTP OK: HTTP/1.1 200 OK - 14912 bytes in 0.312 second response time [09:59:30] RECOVERY - cp3 Stunnel Http for mw4 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 14912 bytes in 1.163 second response time [09:59:38] RECOVERY - mw4 MediaWiki Rendering on mw4 is OK: HTTP OK: HTTP/1.1 200 OK - 20047 bytes in 0.250 second response time [09:59:40] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [09:59:41] Reception123, paladox: ^ [10:00:45] Can someone also fix the number of icinga alerts active? [10:01:09] We have 2 servers failing puppet [10:03:53] mw4.miraheze.org don't work [10:03:58] And that's a load spike for sure [10:05:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtUcx [10:05:13] [02miraheze/services] 07MirahezeSSLBot 03d89ed27 - BOT: Updating services config for wikis [10:13:17] RhinosF1: hmm I'm able to ssh to it [10:13:22] guess I could reboot [10:13:28] can't really do more harm than good [10:14:40] !log depool mw4 [10:14:49] PROBLEM - cp6 Current Load on cp6 is CRITICAL: CRITICAL - load average: 6.05, 8.82, 4.86 [10:14:51] !log repool mw4 [10:15:07] !log reboot mw4 (before repool, whoops) [10:15:45] !log sudo service logbot start [10:15:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:15:52] !log depooled mw4, rebooted mw4, repooled mw4 [10:15:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:16:39] RhinosF1: I'm able to ping mw4 now so should be fine [10:16:59] Reception123: ok [10:18:49] RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 0.65, 4.35, 3.92 [10:51:22] PROBLEM - ping4 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 44%, RTA = 311.83 ms [10:51:35] Reception123: ^ [10:51:50] I think today is the day if everything I touch fails [10:51:58] Or look at tbh [10:53:20] RECOVERY - ping4 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 233.66 ms [10:59:32] PROBLEM - ping4 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 60%, RTA = 335.87 ms [10:59:39] PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 90%, RTA = 336.08 ms [11:01:30] RECOVERY - ping4 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 234.09 ms [11:01:37] RECOVERY - ping6 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 239.25 ms [11:09:44] :( [11:17:17] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 10.50, 7.18, 3.29 [11:19:16] RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 1.87, 4.95, 2.94 [12:14:01] PROBLEM - cp6 Current Load on cp6 is WARNING: WARNING - load average: 4.91, 5.93, 3.86 [12:15:55] RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 1.94, 4.45, 3.56 [13:00:32] PROBLEM - wikiescola.com.br - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikiescola.com.br could not be found [13:07:25] RECOVERY - wikiescola.com.br - reverse DNS on sslhost is OK: rDNS OK - wikiescola.com.br reverse DNS resolves to cp6.miraheze.org [13:22:04] PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 44%, RTA = 338.04 ms [13:24:02] RECOVERY - ping6 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 236.72 ms [13:55:38] PROBLEM - munwiki.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Cannot make SSL connection.22875109717824:error:14094438:SSL routines:ssl3_read_bytes:tlsv1 alert internal error:../ssl/record/rec_layer_s3.c:1544:SSL alert number 80 [14:02:49] PROBLEM - cp6 Current Load on cp6 is CRITICAL: CRITICAL - load average: 3.81, 6.16, 3.48 [14:10:49] RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 1.12, 4.85, 4.66 [14:22:21] RECOVERY - munwiki.info - LetsEncrypt on sslhost is OK: OK - Certificate 'munwiki.info' will expire on Fri 26 Mar 2021 01:17:21 GMT +0000. [15:03:46] PROBLEM - cp6 Current Load on cp6 is CRITICAL: CRITICAL - load average: 5.30, 12.61, 8.19 [15:10:36] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 27.06, 22.67, 18.30 [15:10:52] PROBLEM - rupowerrangersfanon.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for rupowerrangersfanon.tk could not be found [15:10:53] PROBLEM - wiki.cyberfurs.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.cyberfurs.org could not be found [15:10:56] PROBLEM - wikipariksha.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikipariksha.com could not be found [15:11:01] PROBLEM - wiki.seredrau.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.seredrau.xyz could not be found [15:12:30] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 16.22, 20.28, 17.98 [15:13:36] RECOVERY - munwiki.info - reverse DNS on sslhost is OK: rDNS OK - munwiki.info reverse DNS resolves to cp6.miraheze.org [15:17:32] RECOVERY - rupowerrangersfanon.tk - reverse DNS on sslhost is OK: rDNS OK - rupowerrangersfanon.tk reverse DNS resolves to cp6.miraheze.org [15:17:35] RECOVERY - wiki.cyberfurs.org - reverse DNS on sslhost is OK: rDNS OK - wiki.cyberfurs.org reverse DNS resolves to cp7.miraheze.org [15:17:38] RECOVERY - wikipariksha.com - reverse DNS on sslhost is OK: rDNS OK - wikipariksha.com reverse DNS resolves to cp7.miraheze.org [15:18:00] RECOVERY - wiki.seredrau.xyz - reverse DNS on sslhost is OK: rDNS OK - wiki.seredrau.xyz reverse DNS resolves to cp6.miraheze.org [15:19:08] PROBLEM - cp6 Current Load on cp6 is WARNING: WARNING - load average: 1.16, 3.12, 5.76 [15:22:58] RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 0.71, 2.42, 4.95 [15:47:56] Question I just wondered...can @MediaWiki administrators depool and repool the mw servers, since they have access? Or is that one of those "in theory, yes, but in practice, leave for SRE" things? [15:56:08] It's only a SRE thing [15:58:12] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JtU9X [15:58:13] [02miraheze/ssl] 07Reception123 0382cd37b - add highstreethistory.uk cert [15:59:00] @Doug yes, since depooling is done on cp servers [15:59:15] so if one was a cache admin and mw admin they could potentially, only mw-admins can't reboot servers so that wouldn't work either [16:02:57] I mean in theory they are ways to bring a server off [16:03:32] But they involve stopping services so they fail and then the cache proxy will detect that and depool [16:03:58] But that's not depooling a server and I wouldn't recommend that outside of emergencies [16:04:14] paladox, Reception123: can you fix puppet on anywhere it's stopped [16:04:25] where is it stopped? [16:09:41] RhinosF1 [16:26:30] Paladox: icings.miraheze.org? [16:26:34] *icinga [16:26:43] i don't see it stopped on icinga [16:27:29] oh [16:28:20] someone was testing on jobrunner2 [16:28:38] --- a/LocalSettings.php [16:28:38] +++ b/LocalSettings.php [16:28:38] @@ -3893,3 +3893,4 @@ if ( !defined( 'MW_NO_EXTENSION_MESSAGES' ) ) { [16:28:38] // Last Stuff [16:28:38] $wi->config->extractAllGlobals( $wi->dbname ); [16:28:39] $wgConf = $wi->config; [16:28:40] +$wgCreateWikiPersistentModelFile = '/mnt/mediawiki-static/requestmodel.phpml'; [16:28:54] including in the CW extension [16:28:57] which i've fixed now [16:30:09] paladox: I saw test2 and a jobrunner earlier [16:30:12] That's JohnLewis [16:30:49] RECOVERY - jobrunner2 Puppet on jobrunner2 is OK: OK: Puppet is currently enabled, last run 58 seconds ago with 0 failures [16:31:18] RECOVERY - test2 Puppet on test2 is OK: OK: Puppet is currently enabled, last run 13 seconds ago with 0 failures [16:33:07] @paladox @Reception123 ah, thanks 🙂 [16:33:54] @RhinosF1 thanks too for your added insight 🙂 [16:34:54] @Doug: I can't depool a server but I can crash it which will make cp* depool [16:35:14] !log add ipv6 address to dbbackup1 [16:35:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:35:42] (Not that I recommend crashing servers without good reason) [16:38:04] PROBLEM - dbbackup1 APT on dbbackup1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [16:38:13] PROBLEM - dbbackup1 NTP time on dbbackup1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [16:38:17] PROBLEM - dbbackup1 Puppet on dbbackup1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [16:38:39] PROBLEM - Host dbbackup1 is DOWN: PING CRITICAL - Packet loss = 100% [16:42:00] Paladox; thought I got rid of that on jobrunner2. I had to use a production server because test2 doesn’t have enough memory [16:42:01] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtU7u [16:42:02] [02miraheze/dns] 07paladox 030c54c37 - dbbackup1: add ipv6 address [16:42:45] JohnLewis ah ok [16:46:55] RECOVERY - Host dbbackup1 is UP: PING OK - Packet loss = 0%, RTA = 94.53 ms [16:53:46] !log root@dbbackup1:/etc/mysql/conf.d# swapoff -a [16:53:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:57:52] @RhinosF1 lol [17:13:52] dmehus: yeah [17:52:17] PROBLEM - cp6 Current Load on cp6 is CRITICAL: CRITICAL - load average: 8.02, 8.75, 4.76 [17:56:07] RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 0.95, 4.70, 3.99 [18:26:23] RECOVERY - dbbackup1 APT on dbbackup1 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:26:43] RECOVERY - dbbackup1 NTP time on dbbackup1 is OK: NTP OK: Offset 0.001652032137 secs [18:26:48] RECOVERY - dbbackup1 Puppet on dbbackup1 is OK: OK: Puppet is currently enabled, last run 27 minutes ago with 0 failures [18:26:53] PROBLEM - dbbackup1 Current Load on dbbackup1 is CRITICAL: CRITICAL - load average: 4.79, 4.64, 4.61 [18:27:33] RECOVERY - ping6 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 101.85 ms [18:27:41] !log experimenting with request limits to produce a model file which can be stored in memory [18:27:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:55:43] PROBLEM - cp6 Current Load on cp6 is WARNING: WARNING - load average: 3.34, 5.72, 3.93 [18:57:43] RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 1.57, 4.24, 3.60 [18:59:34] heh I just remembered this was possible here [18:59:35] !night [18:59:35] Good night, sweet dreams and dream of the miraheze servers without errors! [18:59:37] :P [19:00:29] Might wanna remove the error part. LOL. [19:04:05] Let them dream! [19:06:37] * RhinosF1 wonders what will be next to go wrong this week [19:18:57] !log reboot dbbackup1 [19:18:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:22:54] RECOVERY - dbbackup1 Current Load on dbbackup1 is OK: OK - load average: 0.31, 0.18, 0.07 [19:31:12] @Reception123 that's cool [19:31:14] !help [19:31:27] Oh, how do I get @wm-bot3's help? [19:31:42] @wm-bot3 !help [19:31:56] @wm-bot5 !help [19:32:03] @wm-bot5 .help [19:32:09] @wm-bot5 help [19:32:32] https://meta.wikimedia.org/wiki/Wm-bot [19:32:32] I am running http://meta.wikimedia.org/wiki/WM-Bot version wikimedia bot v. 2.8.1.0 [libirc v. 1.0.3] my source code is licensed under GPL and located at https://github.com/benapetr/wikimedia-bot I will be very happy if you fix my bugs or implement new features [19:32:32] @help [19:32:32] [ wm-bot - Meta ] - meta.wikimedia.org [19:32:33] [ wm-bot - Meta ] - meta.wikimedia.org [19:32:34] [ GitHub - benapetr/wikimedia-bot: IRC bot that is being used on number of wikimedia channels ] - github.com [19:32:40] oh, thanks @RhinosF1 [19:32:46] Think obvious [19:33:50] yeah [19:34:09] @seen BurningPrincess1 [19:34:09] dmehus: Last time I saw BurningPrincess1 they were leaving the channel #miraheze at 1/7/2021 9:30:25 PM (7d22h3m44s ago) [19:34:17] cool :) [19:34:58] You are trusted and identified by the name .*@miraheze/.* [19:34:58] @whoami [19:36:05] Weird that `!night` isn't in the listed commands. [19:36:28] http://wm-bot.wmflabs.org/dump/%23miraheze.htm [19:36:28] @info [19:36:30] [ #miraheze ] - wm-bot.wmflabs.org [19:37:08] Night is custom to here [19:37:51] When was the CW AI feature deployed? [19:39:33] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtUj6 [19:39:35] [02miraheze/puppet] 07JohnFLewis 03b65f108 - jobrunner: increase memory for RequestWikiAIJob to 1000M [19:47:53] @R4356th A day or two ago, but there's memory issues. We're trying a workaround. [19:48:51] It won't initially approve wikis, though, without rigorous testing and agreed upon approval tolerance thresholds. If it is implemented, it will just assign a score. [19:48:56] initially [19:49:38] dmehus: we might have a workaround [19:49:59] Yeah, I did read the task but was surprised to see a notification from CW about this. [19:51:37] @R4356th ah [19:56:49] PROBLEM - dbbackup1 Current Load on dbbackup1 is CRITICAL: CRITICAL - load average: 4.43, 3.09, 1.48 [20:14:51] [02puppet] 07Reception123 commented on pull request 03#1592: Update csp_whitelist.yaml - 13https://git.io/JtTvW [20:17:46] PROBLEM - cp6 Current Load on cp6 is CRITICAL: CRITICAL - load average: 6.18, 4.89, 2.92 [20:19:43] RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 3.41, 4.90, 3.20 [20:23:43] PROBLEM - cp6 Current Load on cp6 is WARNING: WARNING - load average: 3.03, 5.15, 3.74 [20:25:43] RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 1.51, 3.98, 3.49 [20:51:05] PROBLEM - cp6 Current Load on cp6 is CRITICAL: CRITICAL - load average: 8.65, 6.51, 4.10 [20:53:00] RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 3.00, 4.94, 3.80 [21:26:23] [02puppet] 07dmehus commented on pull request 03#1592: Update csp_whitelist.yaml - 13https://git.io/JtTkT [21:27:46] [02puppet] 07Reception123 commented on pull request 03#1592: Update csp_whitelist.yaml - 13https://git.io/JtTkG [21:28:09] [02puppet] 07dmehus commented on pull request 03#1592: Update csp_whitelist.yaml - 13https://git.io/JtTkn [21:28:34] [02puppet] 07dmehus edited pull request 03#1592: Add Flickr and Pixabay to CSP whitelist - 13https://git.io/JLxFX [21:29:16] [02puppet] 07Reception123 closed pull request 03#1592: Add Flickr and Pixabay to CSP whitelist - 13https://git.io/JLxFX [21:29:17] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtTkC [21:29:19] [02miraheze/puppet] 07dmehus 038bf2097 - Update csp_whitelist.yaml (#1592) Common sense addition of the world's largest photo sharing repository, or, at the very least, CreativeCommons-licensed photo sharing repository for use with external images. Likewise, Pixabay is a very large repository of royalty free images licensed under a Pixabay License requiring attribution only. [21:43:42] Hello TwentyOneX! If you have any questions, feel free to ask and someone should answer soon. [21:45:04] Hello folks. Is it possible to style the interwiki link? So instead of w:link the 'w' is replaced by a custom icon (such as Wikipedia's logo). [22:02:03] TwentyOneX: not natively [22:16:50] Via CSS hacks? [22:24:07] TwentyOneX: and js maybe [22:26:10] Are there any resources on this that I could look at? [22:26:41] not sure, Voidwalker might know [22:29:18] You can customize the display of links, for example see https://meta.wikimedia.org/wiki/Help:Piped_link [22:29:19] [ Help:Piped link - Meta ] - meta.wikimedia.org [22:30:06] but using a custom icon (for all interwiki links without other customization) would undoubtedly require some CSS/JS trickery [22:32:55] [02CreateWiki] 07paladox deleted branch 03paladox-patch-4 - 13https://git.io/vpJTL [22:32:56] [02miraheze/CreateWiki] 07paladox deleted branch 03paladox-patch-4 [22:33:31] Ok, thank you. My CSS/JS are probably not what they should be so I think I may have to abandon this idea for now. [22:39:07] @TwentyOneX, see @robla's [[mh:electowiki:]]. They have custom styled interwiki link icons, but not sure how it's done, likely CSS/JS as @Void suggested 🙂 [22:39:08] https://electowiki.miraheze.org/wiki/ [22:39:09] [ Electowiki, the election methods wiki ] - electowiki.miraheze.org [22:39:39] Command sent from Discord by Doug: [22:39:40] .tell @TwentyOneX, see @robla's [[mh:electowiki:]]. They have custom styled interwiki link icons, but not sure how it's done, likely CSS/JS as @Void suggested 🙂 [22:39:40] MH-Discord: I'll pass that on when @TwentyOneX is around. [22:39:40] https://electowiki.miraheze.org/wiki/ [22:39:41] [ Electowiki, the election methods wiki ] - electowiki.miraheze.org [22:39:54] Command sent from Discord by Doug: [22:39:54] .gj MirahezeBot [22:39:54] You're doing good work, MirahezeBot! [22:48:11] [02puppet] 07dmehus opened pull request 03#1595: Remove `z.moatads.com` from CSP whitelist - 13https://git.io/JtTqK [22:48:30] Oh! there's also possibly templates that you could use, now that I think about it [22:51:08] [02puppet] 07dmehus closed pull request 03#1595: Remove `z.moatads.com` from CSP whitelist - 13https://git.io/JtTqK [22:51:58] [02puppet] 07dmehus commented on pull request 03#1595: Remove `z.moatads.com` from CSP whitelist - 13https://git.io/JtTq7 [22:53:55] @Voidwalker, Oh, really? Did I rekindle something you remember seeing on another wiki? [22:55:08] somewhat, I seem to recall there being a solution where you could have {{interwiki|wiki|Page}} and control the output using switch statements and the like [22:55:16] No idea where I saw it though. [22:55:34] might even be thinking of templates like {{country}} from somewhere or another [22:55:57] @Voidwalker ah, okay, interesting. I'll poke around `electowikiwiki` later when I get a chance then [23:06:29] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 5.68, 5.13, 3.89 [23:08:28] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 3.75, 4.66, 3.87 [23:15:39] @Doug - what was the question? [23:18:14] @robla Oh, we were just wondering where you got your interwiki link icons from. I know another sysop on `electowikiwiki` installed them, but wondered if you can maybe ask them where they got them from? [23:22:00] @Doug - could you ask me that question on my electowiki talk page? (i.e. here: https://electowiki.miraheze.org/wiki/User_talk:RobLa ?). I can probably pester User:Psephomancy to give you an answer. [23:22:01] [ User talk:RobLa - Electowiki ] - electowiki.miraheze.org [23:26:35] @robla sure, thanks :) [23:26:39] will do