[00:00:08] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jvkg7
[00:00:10] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot 035230153 - BOT: Updating services config for wikis
[00:02:49] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 1.21, 1.79, 1.29
[00:04:46] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.47, 1.15, 1.15
[00:25:54] <paladox>	 !log root@mw1:/home/paladox# sudo -u www-data php /srv/mediawiki/w/maintenance/importImages.php --wiki=thefinalrumblewiki --skip-dupes --search-recursively TFR_Wikia_Images/ (per request on discord)
[00:26:00] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[01:23:36] <paladox>	 !log restart php7.3-fpm on lizardfs6
[01:23:43] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[03:07:03] <MH-Discord>	 <Technoturnovers> I went to my new wiki (aranziaronzo), but I can't make or edit any pages
[03:19:40] <MH-Discord>	 <Void> hmm, looks like the default permissions were not set
[03:24:19] <icinga-miraheze>	 PROBLEM - misc4 Puppet on misc4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_clone_phabricator-extensions]
[03:27:12] <MH-Discord>	 <Void> not sure why that is, but I'm checking a few things right now
[03:32:11] <MH-Discord>	 <Void> @Technoturnovers created https://phabricator.miraheze.org/T5119 and someone with proper access should be able to fix it
[03:32:12] <ZppixBot>	 [ ⚓ T5119 Reset permissions of toastycraftwiki and aranziaronzowiki ] - phabricator.miraheze.org
[03:32:18] <icinga-miraheze>	 RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 59 seconds ago with 0 failures
[03:32:59] <MH-Discord>	 <Technoturnovers> ill test it
[06:26:15] <icinga-miraheze>	 RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 3193 MB (13% inode=94%);
[08:45:19] <Not-5a0a>	 [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JvkSc
[08:45:20] <Not-5a0a>	 [02miraheze/ssl] 07Reception123 03ce6d0d7 - add wiki.patriam.cc cert
[08:51:48] <Reception123>	 !log reception@mw1:/srv/mediawiki/w/maintenance$ sudo -u www-data php deleteBatch.php --wiki=thefinalrumblewiki /home/reception/deletebatch.txt
[08:51:54] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[13:34:05] <Not-5a0a>	 [02MatomoAnalytics] 07AlirezaIvaz opened pull request 03#17: Add Persian translation - 13https://git.io/Jvk5M
[13:46:47] <RhinosF1>	 Zppix: https://publictestwiki.com/wiki/TestWiki:Request_permissions#.E3.81.9D.E3.82.89.E3.81.9F.E3.81.93_.28Status:_Open.29
[13:46:48] <ZppixBot>	 [ TestWiki:Request permissions - TestWiki ] - publictestwiki.com
[13:48:10] <Reception123>	 I've already handled it
[13:48:24] <RhinosF1>	 Thx
[13:52:27] <Not-5a0a>	 [02MatomoAnalytics] 07AlirezaIvaz commented on pull request 03#17: Add Persian translation - 13https://git.io/Jvkd8
[13:54:15] <paladox>	 !log root@mw1:/srv/mediawiki/w/maintenance# sudo -u www-data php rebuildall.php --wiki=simswiki
[13:54:21] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[14:13:36] <RhinosF1>	 paladox: can you do my request on discord
[14:14:08] <paladox>	 Why do we need Module:Documentation on loginwiki?
[14:16:39] <RhinosF1>	 paladox: because a template is throwing an error about it not being there
[14:16:57] <paladox>	 ok
[14:17:23] <paladox>	 i'm busy with something else, so cannot at the moment :)
[14:17:35] <RhinosF1>	 paladox: okay and 2 actually
[14:19:05] <paladox>	 ok
[14:29:18] <Not-5a0a>	 [02landing] 07AlirezaIvaz synchronize pull request 03#25: Add Persian Support - 13https://git.io/JexFj
[14:33:30] <Not-5a0a>	 [02landing] 07AlirezaIvaz commented on pull request 03#25: Add Persian Support - 13https://git.io/JvkFM
[14:35:59] <Not-5a0a>	 [02landing] 07RhinosF1 commented on pull request 03#25: Add Persian Support - 13https://git.io/JvkFS
[14:39:49] <Not-5a0a>	 [02landing] 07AlirezaIvaz commented on pull request 03#25: Add Persian Support - 13https://git.io/Jvkbt
[14:40:14] <Not-5a0a>	 [02landing] 07AlirezaIvaz edited a comment on pull request 03#25: Add Persian Support - 13https://git.io/Jvkbt
[14:50:12] <Not-5a0a>	 [02landing] 07RhinosF1 commented on pull request 03#25: Add Persian Support - 13https://git.io/Jvkb1
[14:57:48] <paladox>	 !log root@mw1:/home/paladox# sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=loginwiki --report=1 Wikipedia-20200119145611.xml
[14:57:50] <paladox>	 RhinosF1 ^
[14:57:54] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[15:00:17] <RhinosF1>	 paladox: perfect
[15:00:29] <RhinosF1>	 FYI: the log pinged me anyway
[15:01:38] <paladox>	 Why would the log ping you?
[15:02:08] <RhinosF1>	 paladox: can you import with templates pls? It mentions loginwiki which pages me
[15:02:20] <paladox>	 i did?
[15:02:36] <RhinosF1>	 paladox: it’s missing a dependency
[15:02:46] <paladox>	 oh, well i'm not sure how to then
[15:02:49] <Not-5a0a>	 [02landing] 07AlirezaIvaz commented on pull request 03#25: Add Persian Support - 13https://git.io/Jvkbx
[15:02:56] <paladox>	 i just unclicked the button to include the full revision
[15:03:06] <RhinosF1>	 paladox: import Module:Message_Box
[15:03:15] <paladox>	 ok
[15:05:02] <paladox>	 !log root@mw1:/home/paladox# sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=loginwiki --report=1 Wikipedia-20200119150417.xml
[15:05:11] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[15:06:50] <RhinosF1>	 paladox: https://en.wikipedia.org/wiki/Module:Message_box? Not showing yet
[15:07:03] <paladox>	 ofc not, it's still importing...
[15:07:19] <paladox>	 i found the box that says "Include templates"
[15:08:12] <paladox>	 So i'm re-importing
[15:08:22] <paladox>	 RhinosF1 that would include it, right?
[15:08:32] <paladox>	 or is that module seperate and not needed by module:doc?
[15:09:01] <RhinosF1>	 paladox: it’s all part of module:documentation’s requirements
[15:09:06] <paladox>	 ok
[15:09:10] <RhinosF1>	 See https://login.miraheze.org/wiki/Template:Documentation
[15:09:12] <ZppixBot>	 [ Template:Documentation - Miraheze Login Wiki ] - login.miraheze.org
[15:18:41] <Not-5a0a>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvkNG
[15:18:42] <Not-5a0a>	 [02miraheze/puppet] 07paladox 03f62008a - matomo: Set browser_archiving_disabled_enforce to 1
[15:19:11] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2650 MB (10% inode=94%);
[15:39:16] <Not-5a0a>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvkNP
[15:39:18] <Not-5a0a>	 [02miraheze/puppet] 07paladox 03d5d39b0 - matomo: Increase memory_limit to 400MB
[15:43:17] <Not-5a0a>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvkNS
[15:43:19] <Not-5a0a>	 [02miraheze/puppet] 07paladox 03835736f - matomo: Only up memory_limit for cli
[15:43:58] <Not-5a0a>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvkNH
[15:43:59] <Not-5a0a>	 [02miraheze/puppet] 07paladox 03f769702 - Fix
[15:50:40] <icinga-miraheze>	 PROBLEM - db5 Current Load on db5 is WARNING: WARNING - load average: 3.66, 2.49, 1.42
[15:52:39] <icinga-miraheze>	 PROBLEM - db5 Current Load on db5 is CRITICAL: CRITICAL - load average: 4.15, 3.07, 1.76
[15:54:38] <icinga-miraheze>	 PROBLEM - db5 Current Load on db5 is WARNING: WARNING - load average: 3.68, 3.33, 2.02
[15:56:36] <icinga-miraheze>	 RECOVERY - db5 Current Load on db5 is OK: OK - load average: 3.21, 3.26, 2.15
[16:01:03] <icinga-miraheze>	 PROBLEM - db5 Current Load on db5 is CRITICAL: CRITICAL - load average: 4.01, 4.29, 2.90
[16:03:04] <icinga-miraheze>	 PROBLEM - db5 Current Load on db5 is WARNING: WARNING - load average: 3.30, 3.90, 2.92
[16:05:04] <icinga-miraheze>	 PROBLEM - db5 Current Load on db5 is CRITICAL: CRITICAL - load average: 8.54, 5.74, 3.70
[16:05:07] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvkAL
[16:05:09] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot 03ad87e88 - BOT: Updating services config for wikis
[16:06:50] <RhinosF1>	 paladox: what you done to db5
[16:07:23] <paladox>	 i'm running a matomo archive script
[16:08:02] <RhinosF1>	 ok
[16:11:00] <icinga-miraheze>	 PROBLEM - db5 Current Load on db5 is WARNING: WARNING - load average: 3.03, 3.74, 3.40
[16:12:59] <icinga-miraheze>	 RECOVERY - db5 Current Load on db5 is OK: OK - load average: 2.66, 3.36, 3.30
[16:15:31] <icinga-miraheze>	 PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Package[php7.3-apcu],Package[php7.3-redis]
[16:23:33] <icinga-miraheze>	 RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[16:26:09] <hispano76>	 hello
[16:32:43] <RhinosF1>	 hi
[16:33:22] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 2.18, 2.91, 1.79
[16:35:21] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 1.16, 1.79, 1.57
[16:37:21] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.33, 0.98, 1.28
[16:40:55] <RhinosF1>	 .status mhmeta Around-A
[16:40:58] <ZppixBot>	 RhinosF1: Updating User:RhinosF1/Status to Around-A!
[16:41:07] <ZppixBot>	 RhinosF1: Updated!
[16:41:19] <RhinosF1>	 thx ZppixBot 
[16:49:20] <hispano76>	 the deleteBatch.php maintenance script could be given temporary permission not to appear in Recent Changes in my wiki? because I have seen that it does appear according to the #Miraheze-feed logs
[16:50:13] <hispano76>	 curiosity
[16:52:12] <icinga-miraheze>	 PROBLEM - misc2 Puppet on misc2 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 10 minutes ago with 0 failures
[16:54:05] <icinga-miraheze>	 PROBLEM - db5 Current Load on db5 is WARNING: WARNING - load average: 3.70, 3.02, 2.54
[16:56:03] <icinga-miraheze>	 RECOVERY - db5 Current Load on db5 is OK: OK - load average: 1.87, 2.60, 2.45
[17:03:08] <RhinosF1>	 hispano76: give bot to the user
[17:04:48] <hispano76>	 The script account does not yet exist on my wikis
[17:05:45] <RhinosF1>	 hispano76: one sec
[17:06:31] <RhinosF1>	 hispano76: you'll have to wait until it does
[17:06:59] <hispano76>	 hum
[17:07:25] <hispano76>	 Well, when I ask for it, I'll ask for it. 
[17:07:39] <RhinosF1>	 ok
[17:20:51] <icinga-miraheze>	 PROBLEM - bacula1 Bacula Private Git on bacula1 is WARNING: WARNING: Full, 4396 files, 9.233MB, 2020-01-11 17:17:00 (1.1 weeks ago)
[17:29:36] <hispano76>	 https://phabricator.miraheze.org/T5120 done
[17:29:37] <ZppixBot>	 [ ⚓ T5120 Category deletion request with deleteBatch.php on UcroniasWiki and HispanoWiki ] - phabricator.miraheze.org
[17:32:16] <RhinosF1>	 paladox: ^
[17:34:42] <paladox>	 !log root@mw1:/srv/mediawiki/w/maintenance# sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=ucroniaswiki batch
[17:34:56] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[17:35:25] <RhinosF1>	 paladox: see my comment, have you marked them bot
[17:35:37] <paladox>	 you carn't mark it as a bot
[17:35:47] <paladox>	 i doin't see an option for setting it as a bot
[17:35:57] <RhinosF1>	 paladox: assign the right via Special:UserRights to the account
[17:36:02] <RhinosF1>	 or get hispano76 to
[17:36:39] <paladox>	 there is no user account :)
[17:36:45] <paladox>	 It's a system account
[17:37:27] <paladox>	 it's run under "Delete page script"
[17:38:42] <RhinosF1>	 paladox: https://ucronias.miraheze.org/w/index.php?title=Especial%3APermisosUsuarios&user=Delete+page+script&uselang=en
[17:38:43] <ZppixBot>	 [ User rights - Ucronías ] - ucronias.miraheze.org
[17:38:59] <paladox>	 oh
[17:39:04] <paladox>	 i doin't have perms to change that
[17:39:47] <RhinosF1>	 paladox: you can do it for technical requests, or hispano76 
[17:39:50] <RhinosF1>	 will have to
[17:40:05] <RhinosF1>	 we have a sysadmin group
[17:40:25] <paladox>	 yes, that does not grant me the permission to assign rights
[17:40:48] <paladox>	 https://imgur.com/a/nM4WGX9
[17:40:49] <ZppixBot>	 [ Imgur: The magic of the Internet ] - imgur.com
[17:40:50] <paladox>	 is what i see
[17:41:06] <paladox>	 Anyways, someone else will have to do it now, going out now :)
[17:41:11] <RhinosF1>	 paladox: assign userrights to the sysadmin group
[17:41:18] <paladox>	 ok
[17:42:06] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 2.49, 2.85, 1.78
[17:44:02] <paladox>	 done
[17:45:29] <paladox>	 !log root@mw1:/srv/mediawiki/w/maintenance# sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=hispanowiki batch2
[17:45:31] <paladox>	 RhinosF1 hispano76 ^
[17:45:40] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[17:46:02] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 1.50, 1.88, 1.72
[17:46:26] <RhinosF1>	 paladox: as bot?
[17:46:37] <paladox>	 yes, as the flag mentioned
[17:46:50] <paladox>	 i only granted Pseudobots
[17:47:07] <RhinosF1>	 paladox: good, on both wikis
[17:47:59] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 2.13, 2.05, 1.82
[17:48:19] <RhinosF1>	 paladox: you did not
[17:48:25] <RhinosF1>	 https://hispano.miraheze.org/wiki/Especial:PermisosUsuarios/Delete_page_script
[17:48:26] <ZppixBot>	 [ Permisos de usuario - Hispano ] - hispano.miraheze.org
[17:49:05] <RhinosF1>	 paladox: how can you add the bot group without having permission to do so
[17:49:55] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 1.30, 1.58, 1.67
[17:51:18] <paladox>	 I did..
[17:51:19] <paladox>	 I granted it temporarily 
[17:51:20] <paladox>	 Then removed it from myself
[17:51:21] <paladox>	 Wierd
[17:51:22] <paladox>	 Still showing in the logs (for deletion)
[17:51:55] <RhinosF1>	 paladox: from you? you need to give it to the script!!!
[17:52:21] <RhinosF1>	 use the links I've gave you after adding userrights to the sysadmin global group
[17:52:50] <paladox>	 Oh for god sake
[17:52:51] <paladox>	 https://hispano.miraheze.org/wiki/Especial:Registro?type=rights&user=&page=&wpdate=&tagfilter=
[17:52:52] <paladox>	 It did it temporarily til midnight the 18th
[17:52:53] <paladox>	 Oh
[17:52:54] <ZppixBot>	 [ Registro de permisos de usuario - Hispano ] - hispano.miraheze.org
[17:52:54] <paladox>	 Nvm
[17:52:55] <paladox>	 Anyways I’m now mobile so cannot stop the script :/
[17:52:56] <paladox>	 That is what I did
[17:53:27] <RhinosF1>	 paladox: you never added userrights to sysadmin so how?
[17:53:53] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 0.58, 2.09, 2.06
[17:54:40] <paladox>	 I did?
[17:54:41] <paladox>	 I did it to the global group
[17:54:42] <paladox>	 As we are not local sysadmins
[17:54:43] <paladox>	 But I changed the perm through his Wiki
[17:54:44] <paladox>	 Oh
[17:54:45] <paladox>	 Bugger
[17:54:46] <paladox>	 I know what I did
[17:54:47] <paladox>	 I did it for one of his wikis
[17:54:48] <paladox>	 But not the other one
[17:55:22] <RhinosF1>	 paladox: where in the global group have you added userrights
[17:55:50] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 1.33, 1.59, 1.85
[17:56:19] <paladox>	 https://ucronias.miraheze.org/wiki/Ucron%C3%ADas:Portada
[17:56:20] <paladox>	 Is the wiki I did it too
[17:56:20] <ZppixBot>	 [ Ucronías ] - ucronias.miraheze.org
[17:56:21] <paladox>	 https://ucronias.miraheze.org/wiki/Especial:Registro/gblrights
[17:56:23] <ZppixBot>	 [ Registro de permisos globales - Ucronías ] - ucronias.miraheze.org
[17:56:42] <RhinosF1>	 paladox: why? Global stuff from meta
[17:56:50] <RhinosF1>	 then add the right on both wikis
[17:57:28] <paladox>	 I released I did that wrong
[17:57:33] <paladox>	 *reliased
[17:57:40] <paladox>	 So sorry
[17:57:45] <paladox>	 Also sorry hispano76
[17:57:47] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.75, 1.19, 1.63
[17:58:31] <RhinosF1>	 paladox: it's hispano76 that you need to apologize to. I'm just baffled. You should be able to fix it from mobile.
[18:00:20] <paladox>	 RhinosF1: fix it how?
[18:00:21] <paladox>	 Because the script would have ran by then :)
[18:00:28] <paladox>	 And also I did apologise to him :) (and also to you)
[18:00:58] <RhinosF1>	 paladox: it takes like 30s. It's not done
[18:01:40] <paladox>	 RhinosF1: not done?
[18:02:11] <RhinosF1>	 paladox: no
[18:02:18] <RhinosF1>	 delete batch is a slow script
[18:05:04] <paladox>	 Done, granted the right to the user
[18:06:22] <paladox>	 RhinosF1: anything else I need to do? :)
[18:06:34] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 1.12, 2.64, 2.30
[18:07:07] <RhinosF1>	 paladox: no, you've done everything right now
[18:08:18] <paladox>	 Ok
[18:08:19] <paladox>	 Thanks for your help :)
[18:08:21] <hispano76>	 Ha ha, that's good. XD Nah, no problem.  :)
[18:10:28] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 0.91, 1.29, 1.81
[18:10:53] <RhinosF1>	 hi Voidwalker 
[18:11:00] <Voidwalker>	 hi
[18:11:50] <RhinosF1>	 hows Voidwalker 
[18:12:25] <Voidwalker>	 pretty good
[18:12:57] <RhinosF1>	 im still hungry
[18:14:29] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 1.29, 1.38, 1.69
[18:14:32] <RhinosF1>	 Voidwalker: can you do that mw upgrade for zppixbot wiki
[18:15:01] <hispano76>	 Sometimes it happens :)
[18:15:30] <Voidwalker>	 oh, yeah, I'll take a look at that after I get some other work done
[18:15:46] <RhinosF1>	 Voidwalker: kk, im around for a bit
[18:15:53] <icinga-miraheze>	 PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 1 backends are down. mw2
[18:15:58] <RhinosF1>	 want to get a good rest today though
[18:17:51] <icinga-miraheze>	 RECOVERY - cp3 Varnish Backends on cp3 is OK: All 6 backends are healthy
[18:20:34] * paladox at the harvester
[18:20:52] <RhinosF1>	 enjoy paladox!
[18:21:11] <RhinosF1>	 I've not done them in a bit, done toby carvery a bit
[18:23:13] <paladox>	 I live next to the Toby carvery
[18:23:56] <hispano76>	 Oh, yeah. It's done. :)
[18:23:58] <RhinosF1>	 paladox: do you use it? Mine has been poor recently
[18:24:02] <RhinosF1>	 hispano76: :)
[18:26:26] <paladox>	 Yes
[18:26:27] <paladox>	 I’ve been there a ton of times
[18:27:13] <RhinosF1>	 paladox: cool
[18:33:21] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 12.11, 4.60, 2.41
[18:37:21] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.16, 1.07, 1.51
[18:49:23] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 4.79, 7.78, 4.28
[19:03:34] <icinga-miraheze>	 PROBLEM - cp4 Stunnel Http for mw3 on cp4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[19:03:41] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 0.19, 0.91, 1.87
[19:05:34] <icinga-miraheze>	 RECOVERY - cp4 Stunnel Http for mw3 on cp4 is OK: HTTP OK: HTTP/1.1 200 OK - 15288 bytes in 4.602 second response time
[19:07:35] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 1.07, 1.09, 1.58
[19:11:33] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 4.31, 2.10, 1.73
[19:15:26] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.51, 1.36, 1.66
[20:32:48] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 28.65, 16.13, 7.27
[20:50:41] <hispano76>	 Miraheze no working! 
[20:51:07] <RhinosF1>	 hispano76: what error?
[20:52:27] <hispano76>	 ERR_CONNECTION_TIMED_OUT the problem is that if Wikimedia, Wikia and other websites work 
[20:52:50] <RhinosF1>	 paladox: ^
[20:53:13] <RhinosF1>	 I just got 2039ms on lfs6 according to your script
[20:53:28] <paladox>	 works for me
[20:53:39] <hispano76>	 no for me
[20:53:57] <RhinosF1>	 paladox: try lfs6
[20:54:07] <paladox>	 yeh that is normal
[20:54:11] <RhinosF1>	 Lfs6 is showing 2000+ but all over servers fine
[20:54:12] <paladox>	 lizardfs is in the UK
[20:54:16] <RhinosF1>	 I know
[20:54:24] <paladox>	 2,000 ms is normal :)
[20:54:40] <paladox>	 https://grafana.miraheze.org/d/W9MIkA7iz/miraheze-cluster?orgId=1&var-job=node&var-node=cp4.miraheze.org&var-port=9100
[20:54:40] <RhinosF1>	 hispano76: you’re hitting lizardfs6, try refreshing a few times.
[20:54:40] <ZppixBot>	 [ Grafana ] - grafana.miraheze.org
[20:55:01] <icinga-miraheze>	 PROBLEM - cp3 Current Load on cp3 is WARNING: WARNING - load average: 0.84, 1.98, 1.28
[20:55:10] <hispano76>	 Well, it's working again.
[20:55:10] <RhinosF1>	 paladox: what you showing in English?
[20:55:11] <paladox>	 looks like it's due to cp4
[20:55:14] <RhinosF1>	 Ah
[20:55:19] <RhinosF1>	 hispano76: good
[20:57:02] <icinga-miraheze>	 RECOVERY - cp3 Current Load on cp3 is OK: OK - load average: 0.41, 1.43, 1.16
[20:59:59] <MH-Discord>	 <Technoturnovers> how long will it take for my wiki (aronziaronzo) to have its permissions reset?
[21:01:17] <Voidwalker>	 paladox, you around?
[21:01:39] <paladox>	 yeh
[21:02:00] <Voidwalker>	 could you take a look at https://phabricator.miraheze.org/T5119
[21:02:01] <ZppixBot>	 [ ⚓ T5119 Reset permissions of toastycraftwiki and aranziaronzowiki ] - phabricator.miraheze.org
[21:02:13] <paladox>	 yup, will in a few :)
[21:02:25] <paladox>	 (well bit)
[21:05:08] <RhinosF1>	 Voidwalker: don’t forget MW upgrade for ZB wiki.
[21:09:47] <icinga-miraheze>	 PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 5.52, 7.36, 6.71
[21:12:17] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 0.76, 1.28, 1.83
[21:13:44] <icinga-miraheze>	 RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 5.02, 5.69, 6.29
[21:14:14] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 2.99, 2.49, 2.18
[21:30:05] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 1.80, 1.38, 1.89
[21:32:10] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 2.29, 1.83, 1.94
[21:32:20] <paladox>	 Voidwalker doing now
[21:32:57] <icinga-miraheze>	 PROBLEM - cp3 Stunnel Http for mw1 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[21:33:10] <icinga-miraheze>	 PROBLEM - cp4 Stunnel Http for mw1 on cp4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[21:33:45] <icinga-miraheze>	 PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 1 backends are down. mw1
[21:33:57] <paladox>	 !log root@mw1:/srv/mediawiki/w/extensions/ManageWiki/maintenance# sudo -u www-data php populateGroupPermissionsWithDefaults.php --wiki=aranziaronzowiki --overwrite -T5119
[21:34:07] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 1.84, 1.88, 1.93
[21:34:11] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[21:34:26] <paladox>	 !log root@mw1:/srv/mediawiki/w/extensions/ManageWiki/maintenance# sudo -u www-data php populateGroupPermissionsWithDefaults.php --wiki=toastycraftwiki --overwrite -T5119
[21:34:36] <RhinosF1>	 paladox: assigned, resolving
[21:34:37] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[21:34:44] <paladox>	 ok
[21:34:45] <paladox>	 Voidwalker done
[21:34:55] <paladox>	 @Technoturnovers hi, done!
[21:34:57] <icinga-miraheze>	 RECOVERY - cp3 Stunnel Http for mw1 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15295 bytes in 0.481 second response time
[21:34:57] <RhinosF1>	 hispano76: https://phabricator.miraheze.org/T5122#97555
[21:34:59] <ZppixBot>	 [ ⚓ T5122 Category deletion request with deleteBatch.php on UcroniasWiki and HispanoWiki ] - phabricator.miraheze.org
[21:35:02] <Voidwalker>	 ty
[21:35:11] <icinga-miraheze>	 RECOVERY - cp4 Stunnel Http for mw1 on cp4 is OK: HTTP OK: HTTP/1.1 200 OK - 15287 bytes in 0.220 second response time
[21:35:12] <paladox>	 i presume he does
[21:35:33] <paladox>	 RhinosF1 anyways it's permanent  from the last time
[21:35:42] <icinga-miraheze>	 RECOVERY - cp3 Varnish Backends on cp3 is OK: All 6 backends are healthy
[21:36:01] <hispano76>	 RhinosF1: see
[21:36:06] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 9.00, 4.92, 3.15
[21:36:44] <RhinosF1>	 paladox: https://phabricator.miraheze.org/T5122 then next pls
[21:36:45] <ZppixBot>	 [ ⚓ T5122 Category deletion request with deleteBatch.php on UcroniasWiki and HispanoWiki ] - phabricator.miraheze.org
[21:37:05] <paladox>	 ok
[21:37:16] <paladox>	 !log root@mw1:/srv/mediawiki/w/maintenance# sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=ucroniaswiki batch - T5122
[21:37:21] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[21:37:46] <paladox>	 done
[21:38:01] <paladox>	 !log root@mw1:/srv/mediawiki/w/maintenance# sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=hispanowiki batch2 - T5122
[21:38:06] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[21:39:30] <RhinosF1>	 .mhca Hookps33
[21:39:30] <ZppixBot>	 https://meta.miraheze.org/wiki/Special:CentralAuth/Hookps33
[21:39:48] <RhinosF1>	 paladox: thx
[21:39:51] <RhinosF1>	 Night all
[21:44:27] <paladox>	 !log ALTER TABLE /*_*/searchindex MODIFY COLUMN si_title varchar(255) BINARY NOT NULL default ''; - simswiki (fixing an issue when rebuilding search index)
[21:44:37] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[21:45:30] <paladox>	 !log root@mw1:/srv/mediawiki/w/maintenance# sudo -u www-data php rebuildall.php --wiki=simswiki
[21:45:39] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[21:45:54] <icinga-miraheze>	 PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.66, 8.31, 7.19
[21:47:53] <icinga-miraheze>	 PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.28, 7.46, 7.12
[21:51:50] <icinga-miraheze>	 PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 11.00, 8.52, 7.57
[21:55:46] <icinga-miraheze>	 PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.37, 7.67, 7.62
[21:55:48] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 1.84, 1.59, 1.89
[21:57:45] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 2.11, 1.81, 1.91
[21:59:44] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 1.46, 1.54, 1.77
[21:59:45] <icinga-miraheze>	 RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.83, 5.42, 6.62
[22:01:54] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 4.13, 2.90, 2.26
[22:11:53] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 1.41, 1.61, 1.94
[22:13:53] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 2.16, 2.35, 2.20
[22:19:49] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 0.97, 1.31, 1.72
[22:21:52] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 4.68, 2.74, 2.17
[22:25:46] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 1.01, 1.49, 1.75
[22:27:43] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 2.30, 2.22, 1.99
[22:30:24] <paladox>	 !log hacked rebuildtextindex.php on mw1 to output some debugging info
[22:30:33] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[22:31:38] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 1.47, 1.79, 1.88
[22:33:35] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 1.13, 1.37, 1.69
[22:34:40] <icinga-miraheze>	 PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.03, 7.86, 6.77
[22:36:39] <icinga-miraheze>	 RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.29, 6.34, 6.42
[22:44:38] <icinga-miraheze>	 PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 9.45, 7.49, 6.45
[22:46:37] <icinga-miraheze>	 PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.74, 7.12, 6.55
[22:52:32] <icinga-miraheze>	 RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 6.55, 6.57, 6.48
[22:56:29] <icinga-miraheze>	 PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.04, 6.96, 6.88
[22:58:29] <icinga-miraheze>	 RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 5.68, 6.60, 6.75
[23:09:24] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 1.45, 2.21, 1.82
[23:11:21] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 1.39, 1.63, 1.66
[23:34:11] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 0.41, 2.02, 1.91
[23:36:08] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.30, 1.13, 1.58