[01:54:54] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 100.59 ms [02:00:56] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 99.97 ms [02:13:20] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 100.30 ms [02:21:24] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 99.25 ms [02:30:36] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 102.34 ms [02:40:37] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 99.98 ms [03:03:24] !log universalomega@jobrunner1:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/runJobs.php --wiki=testwiki [03:03:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:18:47] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-3/±1] 13https://git.io/JLhH4 [03:18:49] [02miraheze/mediawiki] 07Universal-Omega 038f6fd21 - Removed unused extensions: ArticleFeedbackv5, FeaturedFeeds, and MultiUpload [03:18:50] [02mediawiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b [03:19:48] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JLhHE [03:19:50] [02miraheze/mw-config] 07Universal-Omega 037a991fb - Remove unused FeaturedFeeds [03:20:10] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JLhHu [03:20:12] [02miraheze/mw-config] 07Universal-Omega 036697d50 - Remove unused FeaturedFeeds [03:20:47] miraheze/mw-config - Universal-Omega the build passed. [03:20:56] [02mediawiki] 07Universal-Omega opened pull request 03#981: Removed unused extensions: ArticleFeedbackv5, FeaturedFeeds, and MultiUpload - 13https://git.io/JLhH2 [03:21:07] miraheze/mw-config - Universal-Omega the build passed. [03:21:42] [02mediawiki] 07Universal-Omega closed pull request 03#981: Removed unused extensions: ArticleFeedbackv5, FeaturedFeeds, and MultiUpload - 13https://git.io/JLhH2 [03:21:44] [02miraheze/mediawiki] 07Universal-Omega pushed 032 commits to 03REL1_35 [+0/-6/±2] 13https://git.io/JLhHw [03:21:45] [02miraheze/mediawiki] 07Universal-Omega 03a849b3a - Merge pull request #981 from miraheze/Universal-Omega-patch-1 Removed unused extensions: ArticleFeedbackv5, FeaturedFeeds, and MultiUpload [03:21:47] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [03:21:48] [02mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b [04:02:51] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 103.06 ms [04:04:51] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 99.06 ms [04:56:24] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JLh7h [04:56:25] [02miraheze/landing] 07Universal-Omega 03d2ace73 - Fix typos [04:57:22] miraheze/landing - Universal-Omega the build passed. [05:14:05] Hello Yahya! If you have any questions, feel free to ask and someone should answer soon. [05:41:17] PROBLEM - cp6 Current Load on cp6 is CRITICAL: CRITICAL - load average: 1.78, 6.04, 3.24 [05:43:17] RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 0.42, 4.17, 2.88 [11:47:51] PROBLEM - cp6 Current Load on cp6 is CRITICAL: CRITICAL - load average: 10.26, 4.68, 2.38 [11:49:49] RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 2.63, 3.56, 2.23 [13:42:15] !log ulimit -a 950000 on dbbackup1 [13:42:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:44:51] !log try a second mariabackup --prepare on the db12 backup [13:44:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:02:23] !log imported replica grants on db12 [14:02:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:09:33] !log db12 imported to dbbackup1 [15:09:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:13:29] [02miraheze/mw-config] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JLjWS [15:13:30] [02miraheze/mw-config] 07Southparkfan 03d98a5ff - CreateWiki: do not create wikis on db13 [15:14:24] miraheze/mw-config - Southparkfan the build passed. [15:40:14] !log increase soft open files limit to 16384 on db13 [15:40:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:43:58] !log dumping db13 to dbbackup1 [15:44:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:48:22] PROBLEM - cp6 Current Load on cp6 is CRITICAL: CRITICAL - load average: 43.97, 27.42, 12.02 [15:48:44] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 36.25, 29.58, 19.25 [15:50:45] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 15.56, 23.96, 18.45 [15:52:44] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 12.23, 19.88, 17.61 [16:02:09] PROBLEM - cp6 Current Load on cp6 is WARNING: WARNING - load average: 1.26, 2.68, 5.50 [16:06:06] RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 0.95, 2.08, 4.67 [16:31:05] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 102.17 ms [16:33:05] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 96.90 ms [16:37:13] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 100.44 ms [16:49:14] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 100.00 ms [17:00:22] db13 backup transferred, preparing now [17:03:30] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 100.50 ms [17:08:02] !log prepare db13 backup and stop db12 replication temporarily (performance) [17:08:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:15:31] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 96.25 ms [17:21:39] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 138.30 ms [17:23:35] !log dbbackup1: start db12 & db13 replication :) [17:23:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:27:39] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 98.39 ms [17:28:08] [02miraheze/mw-config] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JLjEm [17:28:09] [02miraheze/mw-config] 07Southparkfan 034dca8cc - Allow wiki creations on c4 [17:28:57] miraheze/mw-config - Southparkfan the build passed. [17:33:50] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 103.75 ms [17:55:26] @SPF|Cloud Did we previously not permit wiki creations in the c4 database cluster? Is this part of a larger strategy to better utilize our available storage space across our database servers? [17:56:04] @SPF|Cloud Oh nevermind, it was a temporary disabling :P [17:57:57] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 98.15 ms [18:13:16] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JLju3 [18:13:18] [02miraheze/mw-config] 07Universal-Omega 03c81eec8 - Change wgLocalisationCacheConf to use storeClass [18:13:19] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [18:13:22] [02mw-config] 07Universal-Omega opened pull request 03#3651: Change wgLocalisationCacheConf to use storeClass - 13https://git.io/JLjus [18:14:19] miraheze/mw-config - Universal-Omega the build passed. [18:22:39] [02mw-config] 07Universal-Omega edited pull request 03#3651: Change wgLocalisationCacheConf to use storeClass - 13https://git.io/JLjus [18:30:25] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 103.56 ms [18:32:25] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 98.95 ms [18:39:05] PROBLEM - gluster2 Disk Space on gluster2 is WARNING: DISK WARNING - free space: / 58913 MB (10% inode=82%); [18:44:28] !log delete db7 on cloud2 [18:44:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:08:32] [02mw-config] 07paladox closed pull request 03#3651: Change wgLocalisationCacheConf to use storeClass - 13https://git.io/JLjus [19:08:34] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JLjgl [19:08:35] [02miraheze/mw-config] 07Universal-Omega 036f9e112 - Change wgLocalisationCacheConf to use storeClass (#3651) [19:08:37] [02mw-config] 07paladox deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [19:08:38] [02miraheze/mw-config] 07paladox deleted branch 03Universal-Omega-patch-1 [19:09:31] miraheze/mw-config - paladox the build passed. [19:28:39] Hello xdjibi! If you have any questions, feel free to ask and someone should answer soon. [19:28:47] Hi there ! [19:28:59] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 101.14 ms [19:29:24] I have a quick question regarding authentication on my private wiki. [19:29:26] hi xdjibi! [19:29:34] Hi Reception. [19:29:44] Happy new year 2021 ! [19:29:54] xdjibi: happy new year :) [19:30:04] Thnx. :) [19:30:23] I have changed my password just in case. [19:30:48] But I can't access my Wiki from this computer anymore. [19:31:03] I keep getting this message : Votre session de connexion semble avoir des problèmes ; cette action a été annulée en prévention d’un éventuel piratage de session. Veuillez soumettre le formulaire de nouveau. [19:31:14] It works from another computer. [19:31:28] Could you please try clearing your cookies? [19:31:31] ^ [19:31:39] Sure. [19:35:08] PROBLEM - jobrunner2 MediaWiki Rendering on jobrunner2 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 648 bytes in 0.060 second response time [19:35:35] 503 Backend fetch failed [19:35:46] PROBLEM - test2 MediaWiki Rendering on test2 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 648 bytes in 0.052 second response time [19:35:55] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JLj2z [19:35:56] [02miraheze/mw-config] 07paladox 03c2489c0 - Revert "Change wgLocalisationCacheConf to use storeClass (#3651)" This reverts commit 6f9e112effe962bb55585828195a4ecf39c1badc. [19:36:16] PROBLEM - cp6 Varnish Backends on cp6 is CRITICAL: 4 backends are down. mw4 mw5 mw6 mw7 [19:36:18] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 44% [19:36:40] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 8 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:1056::2/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb [19:36:54] miraheze/mw-config - paladox the build passed. [19:36:56] PROBLEM - cp7 Varnish Backends on cp7 is CRITICAL: 2 backends are down. mw4 mw5 [19:37:03] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 51.77.107.210/cpweb, 2001:41d0:800:1056::2/cpweb [19:37:07] RECOVERY - jobrunner2 MediaWiki Rendering on jobrunner2 is OK: HTTP OK: HTTP/1.1 200 OK - 20532 bytes in 0.263 second response time [19:37:08] Since I am connected through my browser, I may have to quit, restart my browser and come back. [19:38:16] RECOVERY - cp6 Varnish Backends on cp6 is OK: All 7 backends are healthy [19:38:17] RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 4% [19:38:41] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [19:38:55] RECOVERY - cp7 Varnish Backends on cp7 is OK: All 7 backends are healthy [19:39:05] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [19:40:05] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JLj2S [19:40:07] [02miraheze/mw-config] 07paladox 0312690c8 - Change wgLocalisationCacheConf to use storeClass [19:40:08] [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbvb3 [19:40:10] [02mw-config] 07paladox opened pull request 03#3652: Change wgLocalisationCacheConf to use storeClass - 13https://git.io/JLj29 [19:41:00] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 99.91 ms [19:41:14] miraheze/mw-config - paladox the build passed. [19:43:48] RECOVERY - test2 MediaWiki Rendering on test2 is OK: HTTP OK: HTTP/1.1 200 OK - 20559 bytes in 0.346 second response time [19:45:09] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 108.05 ms [19:48:01] Everything's ok after cleaning my cookies. I could have thought to it... Thank you for your help ! [19:49:01] xdjibi: great :) you're welcome [19:49:05] if you need anything else feel free to ask here [19:49:42] Reception123 And thank you for your work ! [19:49:59] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JLjaO [19:50:00] [02miraheze/mw-config] 07Universal-Omega 0391875f1 - Install purge user right with extension [19:50:02] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [19:50:04] [02mw-config] 07Universal-Omega opened pull request 03#3653: Install purge user right with extension - 13https://git.io/JLja3 [19:50:20] :) [19:50:59] miraheze/mw-config - Universal-Omega the build passed. [19:51:00] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JLjac [19:51:02] [02miraheze/mw-config] 07Universal-Omega 0350941d1 - Update LocalExtensions.php [19:51:03] [02mw-config] 07Universal-Omega synchronize pull request 03#3653: Install purge user right with extension - 13https://git.io/JLja3 [19:51:59] miraheze/mw-config - Universal-Omega the build passed. [20:09:15] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 99.19 ms [20:09:32] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/JLjVc [20:09:33] [02miraheze/mw-config] 07paladox 03f0c6893 - Add WikibaseLexeme to extension-list [20:09:35] [02mw-config] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbvb3 [20:09:37] [02mw-config] 07paladox opened pull request 03#3654: Add WikibaseLexeme to extension-list - 13https://git.io/JLjVC [20:09:46] [02mw-config] 07paladox closed pull request 03#3654: Add WikibaseLexeme to extension-list - 13https://git.io/JLjVC [20:09:47] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JLjVl [20:09:49] [02miraheze/mw-config] 07paladox 03dc9a9e7 - Add WikibaseLexeme to extension-list (#3654) [20:09:50] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-2 [20:09:52] [02mw-config] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbvb3 [20:10:40] miraheze/mw-config - paladox the build passed. [20:10:45] miraheze/mw-config - paladox the build passed. [20:10:57] !log rebuild lc on mw[4567] and jobrunner[12] [20:11:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:34] !log rebuild lc on test2 [20:11:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:12:59] [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JLjVu [20:13:00] [02miraheze/DataDump] 07Universal-Omega 0307e29e6 - Use SidebarBeforeOutput hook instead [20:13:02] [02DataDump] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/fhhKV [20:13:05] [02DataDump] 07Universal-Omega opened pull request 03#15: Use SidebarBeforeOutput hook instead - 13https://git.io/JLjVz [20:14:00] miraheze/DataDump - Universal-Omega the build passed. [20:14:07] [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JLjVK [20:14:08] [02miraheze/DataDump] 07Universal-Omega 038281b3f - Use SidebarBeforeOutput hook instead [20:14:10] [02DataDump] 07Universal-Omega synchronize pull request 03#15: Use SidebarBeforeOutput hook instead - 13https://git.io/JLjVz [20:14:53] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 34.45, 20.74, 14.34 [20:15:10] miraheze/DataDump - Universal-Omega the build passed. [20:16:48] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.21, 20.71, 15.07 [20:18:03] [02DataDump] 07paladox closed pull request 03#15: Use SidebarBeforeOutput hook instead - 13https://git.io/JLjVz [20:18:04] [02miraheze/DataDump] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JLjVS [20:18:06] [02miraheze/DataDump] 07Universal-Omega 032b7ff8e - Use SidebarBeforeOutput hook instead (#15) * Use SidebarBeforeOutput hook instead * Use SidebarBeforeOutput hook instead [20:18:07] [02DataDump] 07paladox deleted branch 03Universal-Omega-patch-1 - 13https://git.io/fhhKV [20:18:09] [02miraheze/DataDump] 07paladox deleted branch 03Universal-Omega-patch-1 [20:18:43] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.34, 23.36, 16.71 [20:19:00] miraheze/DataDump - paladox the build passed. [20:19:23] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JLjVd [20:19:24] [02miraheze/mediawiki] 07paladox 0322d3f26 - Update DataDump [20:21:06] dmehus: the only unintended consequence is a bigger settings file [20:21:28] PROBLEM - mw6 Current Load on mw6 is CRITICAL: CRITICAL - load average: 10.01, 8.56, 6.05 [20:22:43] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.93, 22.95, 18.13 [20:23:29] PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 9.07, 8.74, 6.43 [20:23:47] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 27.03, 21.89, 17.85 [20:25:44] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 18.05, 20.18, 17.70 [20:27:18] PROBLEM - mw7 Current Load on mw7 is CRITICAL: CRITICAL - load average: 10.87, 9.32, 6.91 [20:29:17] RECOVERY - mw7 Current Load on mw7 is OK: OK - load average: 6.48, 8.22, 6.80 [20:29:27] RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 6.60, 8.28, 7.09 [20:30:44] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.90, 19.45, 18.55 [20:33:23] [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JLjwz [20:33:24] [02miraheze/DataDump] 07Universal-Omega 03fda1205 - Add available rights [20:33:26] [02DataDump] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/fhhKV [20:33:39] [02DataDump] 07Universal-Omega opened pull request 03#16: Add available rights to extension.json - 13https://git.io/JLjwg [20:34:37] miraheze/DataDump - Universal-Omega the build passed. [20:52:24] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JLjrq [20:52:26] [02miraheze/mw-config] 07Universal-Omega 03e3424da - Remove $wgAvailableRights where unneeded [20:52:27] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3 [20:52:29] [02mw-config] 07Universal-Omega opened pull request 03#3655: Remove $wgAvailableRights where unneeded - 13https://git.io/JLjrm [20:53:27] miraheze/mw-config - Universal-Omega the build passed. [20:58:15] PROBLEM - wiki.mcpirevival.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mcpirevival.tk All nameservers failed to answer the query. [21:02:55] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JLjr6 [21:02:56] [02miraheze/mw-config] 07Universal-Omega 030b1c9de - Remove unused wmgUseFeaturedFeeds [21:03:52] miraheze/mw-config - Universal-Omega the build passed. [21:04:53] RECOVERY - wiki.mcpirevival.tk - reverse DNS on sslhost is OK: rDNS OK - wiki.mcpirevival.tk reverse DNS resolves to cp6.miraheze.org [21:06:53] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JLjrQ [21:06:54] [02miraheze/mw-config] 07Universal-Omega 0309593a9 - Move DismissableSiteNotice to GlobalExtensions [21:06:56] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3 [21:06:57] [02mw-config] 07Universal-Omega opened pull request 03#3656: Move DismissableSiteNotice to GlobalExtensions - 13https://git.io/JLjr7 [21:07:31] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JLjrF [21:07:33] [02miraheze/mw-config] 07Universal-Omega 03b38f88d - Update LocalExtensions.php [21:07:34] [02mw-config] 07Universal-Omega synchronize pull request 03#3656: Move DismissableSiteNotice to GlobalExtensions - 13https://git.io/JLjr7 [21:07:57] miraheze/mw-config - Universal-Omega the build passed. [21:08:16] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JLjoe [21:08:18] [02miraheze/mw-config] 07Universal-Omega 039da9562 - Update LocalSettings.php [21:08:19] [02mw-config] 07Universal-Omega synchronize pull request 03#3656: Move DismissableSiteNotice to GlobalExtensions - 13https://git.io/JLjr7 [21:08:32] miraheze/mw-config - Universal-Omega the build passed. [21:09:19] miraheze/mw-config - Universal-Omega the build passed. [21:11:45] @RhinosF1 okay [21:15:02] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 102.65 ms [21:21:03] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 99.32 ms [21:25:12] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 100.42 ms [21:35:13] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 99.44 ms [21:41:20] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 104.76 ms [21:57:21] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 99.64 ms [22:10:08] [02miraheze/ssl] 07Pix1234 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JLj6v [22:10:10] [02miraheze/ssl] 07Pix1234 033202e7d - add celeste.ink [22:14:28] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 3.27, 6.84, 3.81 [22:16:28] RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 0.72, 4.72, 3.41 [22:20:45] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 100.28 ms [22:22:45] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 99.46 ms [22:31:41] PROBLEM - cp7 Puppet on cp7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[celeste.ink_private] [22:33:08] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±2] 13https://git.io/JLjis [22:33:09] [02miraheze/mediawiki] 07Universal-Omega 03d1cb013 - Change Video extension to use REL1_35 branch and github fork repo [22:33:11] [02mediawiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b [22:33:41] PROBLEM - cp6 Puppet on cp6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[celeste.ink_private] [22:35:30] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[celeste.ink_private] [22:35:42] PROBLEM - jobrunner2 Puppet on jobrunner2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[celeste.ink_private] [22:36:34] PROBLEM - test2 Puppet on test2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[celeste.ink_private] [22:36:44] PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[celeste.ink_private] [22:36:52] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[celeste.ink_private] [22:36:56] PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[celeste.ink_private] [22:37:18] PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[celeste.ink_private] [22:38:05] PROBLEM - cp9 Puppet on cp9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[celeste.ink_private] [22:38:24] [02mediawiki] 07Universal-Omega opened pull request 03#982: Change Video extension to use REL1_35 branch and github fork repo - 13https://git.io/JLji6 [22:41:08] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 102.55 ms [22:45:13] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 99.15 ms [22:46:31] PROBLEM - cp3 Puppet on cp3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[celeste.ink_private] [23:00:14] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JLjPz [23:00:16] [02miraheze/services] 07MirahezeSSLBot 03bbc04f3 - BOT: Updating services config for wikis [23:03:33] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JLjP6 [23:03:35] [02miraheze/mediawiki] 07Universal-Omega 038153c05 - Update Video [23:03:36] [02mediawiki] 07Universal-Omega synchronize pull request 03#982: Change Video extension to use REL1_35 branch and github fork repo - 13https://git.io/JLji6 [23:06:39] [02mediawiki] 07Universal-Omega closed pull request 03#982: Change Video extension to use REL1_35 branch and github fork repo - 13https://git.io/JLji6 [23:06:41] [02miraheze/mediawiki] 07Universal-Omega pushed 033 commits to 03REL1_35 [+0/-0/±5] 13https://git.io/JLjPM [23:06:42] [02miraheze/mediawiki] 07Universal-Omega 03ca48306 - Merge pull request #982 from miraheze/Universal-Omega-patch-1 Change Video extension to use REL1_35 branch and github fork repo [23:06:44] [02mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b [23:06:45] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1