[00:01:35] RECOVERY - mon1 Disk Space on mon1 is OK: DISK OK - free space: / 5695 MB (12% inode=92%); [00:14:54] .op [00:52:05] @dmehus I'm about to publish a talk page message, can you look at it? [00:53:43] BTW Why ru opped? [01:12:50] @blackwidowmovie0 Seen, and I replied. I will reply to your most recent reply if you fix your signature. Also, can you fix your [[Special:Preferences]] to use `{{User:BlackWidowMovie0/signature}}` via transclusion instead of the deleted `{{subst:BlackWidowMovie0000Editor}}` via substitution, please? [01:13:59] As to why I am opped, I am just ensuring that your sockpuppet IRC is globally banned in the #miraheze official community channels, which @MacFan4000 informs me that it is. You only need one account in #miraheze official community channels. So, I will now deop. [01:14:04] .deop [01:15:12] .tell MacFan4000 Cc: from #miraheze - As to why I am opped, I am just ensuring that your sockpuppet IRC is globally banned in the #miraheze official community channels, which @MacFan4000 informs me that it is. You only need one account in #miraheze official community channels. So, I will now deop. [01:15:12] dmehus: I'll pass that on when MacFan4000 is around. [01:36:50] @dmehus I left all channels [01:37:25] @dmehus {{Done}} [01:38:30] @dmehus I don't know how to fix my signature. [01:38:37] we've tried [01:40:20] @dmehus created new signature [01:43:55] @dmehus can you reply now? [01:44:03] sorry for the 5 pings [01:48:08] @blackwidowmovie0 Okay, thanks for fixing and adding your signature. I will reply before I go to bed tonight. [01:48:55] ok [01:49:19] note that I probably won't see it before 8:15 AM PST tomorrow [01:50:07] if you don't reply before 7:30 PM PST tonight [01:51:24] ok [01:56:10] @dmehus Cocopuff2018 is spamming my IRC DMs [01:56:16] how do I block him? [02:05:31] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.84, 18.28, 14.76 [02:05:45] PROBLEM - db7 Check MariaDB Replication on db7 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 174s [02:07:30] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 32.79, 22.52, 16.67 [02:28:56] @blackwidowmovie0 Tell him you do not wish him to DM you, and if he continues, you can click his name and hit "Ignore..." [02:32:08] PROBLEM - gluster2 Disk Space on gluster2 is WARNING: DISK WARNING - free space: / 58919 MB (10% inode=83%); [02:59:33] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 11.43, 17.19, 23.06 [03:09:37] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.70, 21.54, 22.21 [03:11:45] PROBLEM - test2 Puppet on test2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [03:11:45] RECOVERY - db7 Check MariaDB Replication on db7 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 0s [03:13:35] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 14.87, 18.83, 21.03 [03:15:35] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 11.08, 16.18, 19.80 [03:37:42] RECOVERY - test2 Puppet on test2 is OK: OK: Puppet is currently enabled, last run 46 seconds ago with 0 failures [05:59:27] PROBLEM - dc-multiverse.dcwikis.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'dc-multiverse.dcwikis.com' expires in 15 day(s) (Sat 26 Dec 2020 05:51:56 GMT +0000). [06:03:22] RECOVERY - jobrunner1 APT on jobrunner1 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:03:58] RECOVERY - cp3 APT on cp3 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:05:46] RECOVERY - cp7 APT on cp7 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:06:35] RECOVERY - db7 APT on db7 is OK: APT OK: 50 packages available for upgrade (0 critical updates). [06:06:47] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JIavg [06:06:49] [02miraheze/ssl] 07MirahezeSSLBot 039ce5709 - Bot: Update SSL cert for dc-multiverse.dcwikis.com [06:07:38] RECOVERY - cp9 APT on cp9 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:10:35] RECOVERY - mail1 APT on mail1 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:14:40] RECOVERY - bacula2 APT on bacula2 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:15:21] RECOVERY - db13 APT on db13 is OK: APT OK: 50 packages available for upgrade (0 critical updates). [06:20:46] RECOVERY - ns2 APT on ns2 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:21:45] RECOVERY - ldap1 APT on ldap1 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:22:27] RECOVERY - mon1 APT on mon1 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:24:42] RECOVERY - cloud3 APT on cloud3 is OK: APT OK: 78 packages available for upgrade (0 critical updates). [06:27:52] RECOVERY - gluster1 APT on gluster1 is OK: APT OK: 28 packages available for upgrade (0 critical updates). [06:27:56] RECOVERY - mw5 APT on mw5 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:28:10] RECOVERY - puppet2 APT on puppet2 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:29:55] RECOVERY - graylog1 APT on graylog1 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [06:33:15] RECOVERY - dc-multiverse.dcwikis.com - LetsEncrypt on sslhost is OK: OK - Certificate 'dc-multiverse.dcwikis.com' will expire on Wed 10 Mar 2021 05:06:40 GMT +0000. [06:35:50] RECOVERY - mw6 APT on mw6 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:37:32] RECOVERY - phab1 APT on phab1 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:38:09] RECOVERY - cp6 APT on cp6 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:39:01] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JIakg [06:39:03] [02miraheze/ssl] 07Reception123 03f3ad3e0 - re-add oecumene.org cert [06:40:47] RECOVERY - test2 APT on test2 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:41:46] RECOVERY - services2 APT on services2 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:42:03] RECOVERY - mw4 APT on mw4 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:48:31] PROBLEM - mw7 APT on mw7 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [06:49:05] RECOVERY - jobrunner2 APT on jobrunner2 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:50:24] PROBLEM - oecumene.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - oecumene.org All nameservers failed to answer the query. [06:50:30] RECOVERY - mw7 APT on mw7 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:50:38] RECOVERY - ns1 APT on ns1 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:51:42] RECOVERY - cloud2 APT on cloud2 is OK: APT OK: 99 packages available for upgrade (0 critical updates). [06:51:47] RECOVERY - db12 APT on db12 is OK: APT OK: 50 packages available for upgrade (0 critical updates). [06:52:26] RECOVERY - db11 APT on db11 is OK: APT OK: 50 packages available for upgrade (0 critical updates). [06:52:46] RECOVERY - cloud1 APT on cloud1 is OK: APT OK: 98 packages available for upgrade (0 critical updates). [06:54:40] RECOVERY - services1 APT on services1 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:54:44] RECOVERY - rdb2 APT on rdb2 is OK: APT OK: 24 packages available for upgrade (0 critical updates). [06:59:57] RECOVERY - rdb1 APT on rdb1 is OK: APT OK: 24 packages available for upgrade (0 critical updates). [07:00:21] RECOVERY - gluster2 APT on gluster2 is OK: APT OK: 32 packages available for upgrade (0 critical updates). [07:01:49] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/JIatk [07:01:50] [02miraheze/dns] 07Reception123 0346284d1 - add oecumene.org zone [07:05:04] PROBLEM - oecumene.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'oecumene.org' expired on Sun 01 Nov 2020 03:45:49 GMT +0000. [07:18:18] RECOVERY - oecumene.org - reverse DNS on sslhost is OK: rDNS OK - oecumene.org reverse DNS resolves to cp6.miraheze.org [07:34:06] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JIaY5 [07:34:08] [02miraheze/ssl] 07Reception123 033cec8df - manually renew oecumene.org cert [07:59:18] RECOVERY - oecumene.org - LetsEncrypt on sslhost is OK: OK - Certificate 'oecumene.org' will expire on Wed 10 Mar 2021 06:33:25 GMT +0000. [10:22:27] Thanks @dmehus [12:25:26] !log root@jobrunner1:/home/paladox# sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/w/cache/databases.json /srv/mediawiki/w/maintenance/runJobs.php [12:25:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:53:21] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±8] 13https://git.io/JIVkt [12:53:22] [02miraheze/MirahezeMagic] 07translatewiki 03cb05597 - Localisation updates from https://translatewiki.net. [12:53:23] [ Main page - translatewiki.net ] - translatewiki.net [12:53:24] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JIVkq [12:53:25] [02miraheze/ManageWiki] 07translatewiki 03696cc07 - Localisation updates from https://translatewiki.net. [12:53:26] [ Main page - translatewiki.net ] - translatewiki.net [12:53:27] [02miraheze/DataDump] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JIVkm [12:53:28] [02miraheze/DataDump] 07translatewiki 03f42aa7e - Localisation updates from https://translatewiki.net. [12:53:29] [ Main page - translatewiki.net ] - translatewiki.net [13:19:38] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JIVmG [13:19:39] [02miraheze/puppet] 07paladox 0313c3027 - matomo: Upgrade to 4.0.5 [13:53:06] @dmehus I thought you'd respond to the message [14:24:11] @blackwidowmovie0 I will this morning. Sorry was tired last night and fell asleep before 9 pm. [14:26:34] totally fine [15:01:54] @dmehus respond as soon as you can [15:01:55] thanks [15:18:40] !log disable queued tracker on matomo [15:18:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:34:06] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.04, 19.88, 17.34 [15:36:04] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 13.30, 17.52, 16.80 [16:15:31] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.56, 18.64, 16.59 [16:17:31] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.42, 20.71, 17.52 [16:17:41] * hispano76 greetings [16:18:01] @blackwidowmovie0 replied [16:18:09] hi @hispano76 :) [16:18:43] :) [16:18:47] Hi hispano76 👋 [16:19:28] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 18.74, 19.74, 17.55 [16:20:18] :) [16:25:21] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.83, 20.80, 18.50 [16:30:20] thanks @dmehus [16:30:34] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JIVdT [16:30:36] [02miraheze/mediawiki] 07paladox 036a91b67 - Update LastModified [16:31:04] @dmehus replied to you in a minute [16:31:15] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 18.98, 19.70, 18.75 [16:39:06] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.65, 22.62, 20.38 [16:41:04] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.95, 20.94, 20.02 [16:43:03] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.14, 19.48, 19.61 [17:13:15] @blackwidowmovie0 ack [17:13:27] ? [17:13:34] ack = acknowledged [17:13:37] ah [17:13:47] I thought it was an "ack!" [17:13:54] yes I did too heh [17:14:01] lol [17:32:39] @Reception123 @paladox @dmehus again requesting an unban from discord [17:35:39] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.28, 20.18, 18.17 [17:39:34] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.75, 18.91, 18.20 [17:51:13] [02mw-config] 07MacFan4000 opened pull request 03#3554: Convert from travis to GitHub actions - 13https://git.io/JIwUl [17:52:41] [02mw-config] 07MacFan4000 commented on pull request 03#3554: Convert from travis to GitHub actions - 13https://git.io/JIwUV [18:01:15] @dmehus when can you respond? [18:03:02] @Universal_Omega getting internal error [18:03:04] [a369487aa128571cc0153e7f] 2020-12-10 18:02:40: Fatal exception of type "MWException" [18:03:08] ```[a369487aa128571cc0153e7f] 2020-12-10 18:02:40: Fatal exception of type "MWException"``` [18:13:12] @blackwidowmovie0 Later today, probably [18:13:23] ok [18:13:28] !ops and @paladox ^ see the above DB exception error(s) [18:13:28] * SigmaBotMH yelps for help [18:14:08] Yeah, it happened when I tried to change my signature in Special:Preferences on Meta [18:14:26] oh, hrm, that shouldn't happen, afaik [18:14:59] unless your signature code was too long, but even still, should have better error handling, which would be an upstream task [18:15:55] @dmehus I tried adding a `
`tag and then it blanked [18:16:08] and went to the error [18:21:44] "CAS update failed on user_touched. The version of the user to be saved is older than the current version." [18:21:56] Huh [18:22:11] ? [18:23:32] @paladox ty for that. Is that saying that @blackwidowmovie0 tried to edit an old version of their signature or something? Any upstream task about it? [18:23:54] that shouldn't be possible [18:24:11] @Doug no and multiple old ones [18:24:18] Best bet is an extension [18:24:27] But would need a full trace to see [18:24:48] @RhinosF1 ack and yeah [18:50:34] @dmehus I'd like a Dormancy Policy exception for starwarswiki and mcuwiki, as well as marvelwiki [19:02:12] starwarswiki only has 3 pages [19:02:20] marvelwiki has none [19:02:29] While not a steward, I don't feel exemptions are necessary for wikis with almost no content [19:02:40] mcuwiki also doesn't seem to have pages atm [19:02:50] Hello guest16! If you have any questions, feel free to ask and someone should answer soon. [19:04:26] @blackwidowmovie0 I agree with @Reception123 💯. `mcuwiki` may have qualified prior to its deletion and recreation, but not atm. [19:04:47] ok [19:05:02] Yeah, the reason for DP exemptions is mainly to protect content from being deleted, since it's being read [19:05:05] I need to check in with Rhinos on the Data Dump [19:05:07] yeah [19:05:11] if there is almost no content, there isn't any sense in having one [19:05:16] ^ [19:05:32] ok [19:07:16] Also if wikis are really active, they arguably don't need a Dormancy Policy exemption, either...wikis like Crappy Games Wiki wouldn't need one as there's no danger of that one going inactive. Circumstances can change, obviously, and then it would be considered, but for me it has to have two things: content to be read + need (i.e. relatively inactive wikis) [19:10:20] ok [19:48:52] @dmehus feel free to respond to my message whenever [20:07:12] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.36, 21.13, 17.57 [20:09:08] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.53, 21.21, 18.04 [20:15:02] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 19.79, 19.67, 18.25 [20:18:28] @blackwidowmovie0 There is no need to re-ping a user three, four, or five times, in a short period of time, as it is quite disruptive. This is an active channel used for user help requests and by system administrators and stewards alike for monitoring Miraheze's technical infrastructure and responding to request. If you continue to ping users repeatedly, you will, unfortunately, have to be muted in this channel for a short period. [20:18:51] s/to request/to requests [20:18:51] dmehus meant to say: @blackwidowmovie0 There is no need to re-ping a user three, four, or five times, in a short period of time, as it is quite disruptive. This is an active channel used for user help requests and by system administrators and stewards alike for monitoring Miraheze's technical infrastructure and responding to requests. If you continue to ping users repeatedly, you will, unfortunately, have to be muted in this channel for a sho [20:19:01] @dmehus I pinged you once there [20:20:09] @blackwidowmovie0 No, you pinged me that time, and at least twice in the past two or three hours to look at your talk page. That's excessive. Please do not continue to debate me on this, as it is unhelpful and not a good look for you, to be honest [20:25:51] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.41, 21.21, 19.28 [20:27:49] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.62, 20.51, 19.32 [20:29:47] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 12.02, 17.40, 18.32 [20:59:40] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.02, 22.46, 19.11 [21:01:38] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.81, 22.48, 19.51 [21:03:36] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 31.09, 24.66, 20.60 [21:05:34] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.27, 23.40, 20.61 [21:08:52] PROBLEM - wiki.qadrishattari.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.qadrishattari.xyz All nameservers failed to answer the query. [21:11:28] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.68, 20.39, 20.32 [21:14:00] what is with all these issues? [21:15:40] RECOVERY - wiki.qadrishattari.xyz - reverse DNS on sslhost is OK: rDNS OK - wiki.qadrishattari.xyz reverse DNS resolves to cp6.miraheze.org [21:16:02] They're just the cloud servers burping, essentially, when the loads get a bit above whatever the preset tolerance levels are. Usually nothing worth noting, though may indicate peak periods of network traffic based on system resource utilization. Usually self correct momentarily [21:29:09] ok [21:42:50] Add him to the block list with what ever client you use [21:50:09] @paladox block list? [21:50:16] I have IRCCloud [22:06:57] @blackwidowmovie0 I think @paladox was replying to me, but am not quite sure what he meant by thet. Can DM me. [22:07:20] what'd you ask? [22:07:42] Nothing. He was probably just replying to one of my comments above. [22:10:52] no, i was replying to blackwidowmovie0 [22:12:05] 👍🏽 @paladox [22:13:02] @paladox, ah I see what you mean, thanks. You meant for @blackwidowmovie0 to ignore @icinga-miraheze. [22:13:24] No, it was in response to coco dm'ing him [22:13:35] oh [22:13:36] @paladox I think he meant for was about coco [22:13:40] whoops [22:13:43] wrong ping [22:13:46] sorry [22:14:04] ok, thanks for the clarification, paladox [22:14:20] yeah that makes sense, though @blackwidowmovie0, you could just also ignore the @icinga-miraheze messages too, if you find them to be extraneous [22:14:45] @dmehus I was just curious why there are so many messages [22:14:51] ok [22:14:55] I can ignore if it gets annoying, tho [22:16:16] yeah [22:48:15] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JIwXc [22:48:16] [02miraheze/puppet] 07paladox 03d538d1c - Varnish: Add connect-src 'self' to csp if host is mon1.miraheze.org See https://github.com/matomo-org/matomo/issues/16935 [22:48:17] [ Version 4 can break websites with a Content Security Policy · Issue #16935 · matomo-org/matomo · GitHub ] - github.com [22:48:18] [02puppet] 07paladox created branch 03paladox-patch-4 - 13https://git.io/vbiAS [22:48:21] [02puppet] 07paladox opened pull request 03#1551: Varnish: Add connect-src 'self' to csp if host is mon1.miraheze.org - 13https://git.io/JIwXW [22:49:46] [02puppet] 07paladox closed pull request 03#1551: Varnish: Add connect-src 'self' to csp if host is mon1.miraheze.org - 13https://git.io/JIwXW [22:49:47] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JIwXR [22:49:49] [02miraheze/puppet] 07paladox 03565d80d - Varnish: Add connect-src 'self' to csp if host is mon1.miraheze.org (#1551) See https://github.com/matomo-org/matomo/issues/16935 [22:49:50] [ Version 4 can break websites with a Content Security Policy · Issue #16935 · matomo-org/matomo · GitHub ] - github.com [22:49:50] [02puppet] 07paladox deleted branch 03paladox-patch-4 - 13https://git.io/vbiAS [22:49:52] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-4 [22:52:00] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JIwXS [22:52:01] [02miraheze/puppet] 07paladox 030fd8c54 - varnish: Fix [22:57:06] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 41.98, 25.40, 19.12 [22:57:34] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 8 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:1056::2/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb [22:58:00] PROBLEM - gluster1 Current Load on gluster1 is WARNING: WARNING - load average: 6.87, 5.67, 3.77 [22:59:06] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.15, 23.84, 19.34 [22:59:34] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 3 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 2001:41d0:800:1056::2/cpweb [23:01:04] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.61, 24.63, 20.19 [23:03:03] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.74, 22.16, 19.81 [23:03:28] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [23:03:35] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [23:03:51] RECOVERY - gluster1 Current Load on gluster1 is OK: OK - load average: 5.86, 6.06, 4.60 [23:05:01] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 28.87, 23.81, 20.63 [23:06:59] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.79, 22.41, 20.49 [23:10:58] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 9.57, 16.98, 18.82 [23:18:58] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.90, 19.77, 19.30 [23:20:59] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 12.44, 17.10, 18.39 [23:24:05] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JIwD5 [23:24:07] [02miraheze/puppet] 07paladox 03f50ef69 - Matomo: Disable login plugin