[00:14:53] !log update mw_namespaces set ns_aliases = '["Image"]' where ns_dbname = 'metawiki' and ns_namespace_name = 'File'; on db4 [00:14:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:15:03] !log update mw_namespaces set ns_aliases = '["Image_talk"]' where ns_dbname = 'metawiki' and ns_namespace_name = 'File_talk'; on db4 [00:15:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:41:20] [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhqeQ [00:41:22] [02miraheze/ManageWiki] 07paladox 036b3ea1f - Use ManageWikiCDB instead of ManageWiki in cache key [00:41:58] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fhqe7 [00:41:59] [02miraheze/mediawiki] 07paladox 03e65929b - Update ManageWiki [00:53:12] [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhqvI [00:53:14] [02miraheze/ManageWiki] 07paladox 03df1af80 - Revert "Use ManageWikiCDB instead of ManageWiki in cache key" This reverts commit 6b3ea1fc7df6e19221a84c8fd80ce92a9732eaed. [00:53:46] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fhqvt [00:53:48] [02miraheze/mediawiki] 07paladox 03e09bb0f - Revert "Update ManageWiki" This reverts commit e65929bd5922d849cd2efe0b6f9cb1201a5b8836. [01:15:07] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 5 failures. Last run 2 minutes ago with 5 failures. Failed resources (up to 3 shown) [01:16:51] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Puppet has 113 failures. Last run 2 minutes ago with 113 failures. Failed resources (up to 3 shown): File[madgenderscience.wiki],File[madgenderscience.wiki_private],File[wiki.kourouklides.com],File[wiki.kourouklides.com_private] [01:16:57] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 172 failures. Last run 3 minutes ago with 172 failures. Failed resources (up to 3 shown) [01:24:51] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 12 seconds ago with 0 failures [01:24:56] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:25:11] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:05:05] PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 1 backends are down. mw2 [02:07:05] RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy [02:21:27] PROBLEM - mw3 JobQueue on mw3 is UNKNOWN: NRPE: Unable to read output [02:23:44] PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 1 backends are down. mw3 [02:24:13] PROBLEM - cp5 Varnish Backends on cp5 is CRITICAL: 1 backends are down. mw3 [02:25:28] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 151777 [02:25:44] RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy [02:26:05] well, at least JobQueue has gone down a little :/ [02:26:13] RECOVERY - cp5 Varnish Backends on cp5 is OK: All 5 backends are healthy [02:26:40] heh [02:43:08] [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fhqUU [02:43:09] [02miraheze/ManageWiki] 07paladox 034d447d6 - ManageWikiCDB: Fix up so that the cache key is not constantly updated [02:43:11] [02ManageWiki] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vpSns [02:43:12] [02ManageWiki] 07paladox opened pull request 03#47: ManageWikiCDB: Fix up so that the cache key is not constantly updated - 13https://git.io/fhqUT [02:45:01] [02ManageWiki] 07paladox closed pull request 03#47: ManageWikiCDB: Fix up so that the cache key is not constantly updated - 13https://git.io/fhqUT [02:45:03] [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhqUt [02:45:04] [02miraheze/ManageWiki] 07paladox 030b616b2 - ManageWikiCDB: Fix up so that the cache key is not constantly updated (#47) [02:45:06] [02ManageWiki] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vpSns [02:45:07] [02miraheze/ManageWiki] 07paladox deleted branch 03paladox-patch-1 [02:46:17] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fhqUq [02:46:19] [02miraheze/mediawiki] 07paladox 03fe16efc - Update ManageWiki [03:41:34] Hello sapphie_willie! If you have any questions feel free to ask and someone should answer soon. [04:00:13] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhqTz [04:00:15] [02miraheze/services] 07MirahezeSSLBot 038207401 - BOT: Updating services config for wikis [04:08:36] 151 thousand jobs what [06:01:13] I just need y'all to do better ;P @PuppyKun [06:16:51] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Puppet has 105 failures. Last run 2 minutes ago with 105 failures. Failed resources (up to 3 shown): File[froggy.info],File[froggy.info_private],File[wiki.inebriation-confederation.com],File[wiki.inebriation-confederation.com_private] [06:16:57] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 166 failures. Last run 3 minutes ago with 166 failures. Failed resources (up to 3 shown) [06:44:56] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:46:51] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [06:56:57] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 125 failures. Last run 3 minutes ago with 125 failures. Failed resources (up to 3 shown) [06:58:51] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Puppet has 90 failures. Last run 3 minutes ago with 90 failures. Failed resources (up to 3 shown): File[wiki.gesamtschule-nordkirchen.de_private],File[wiki.teamwizardry.com],File[wiki.teamwizardry.com_private],File[wiki.ciptamedia.org] [07:04:51] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 8 seconds ago with 0 failures [07:04:56] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:16:51] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Puppet has 100 failures. Last run 2 minutes ago with 100 failures. Failed resources (up to 3 shown): File[athenapedia.org_private],File[podpedia.org],File[podpedia.org_private],File[dariawiki.org] [07:16:57] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 119 failures. Last run 3 minutes ago with 119 failures. Failed resources (up to 3 shown) [07:24:51] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures [07:24:56] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 53 seconds ago with 0 failures [07:36:51] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Puppet has 111 failures. Last run 2 minutes ago with 111 failures. Failed resources (up to 3 shown): File[wiki.gesamtschule-nordkirchen.de],File[wiki.gesamtschule-nordkirchen.de_private],File[wiki.teamwizardry.com],File[wiki.teamwizardry.com_private] [07:36:57] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 120 failures. Last run 3 minutes ago with 120 failures. Failed resources (up to 3 shown) [07:54:51] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 9 seconds ago with 0 failures [07:54:56] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [08:06:51] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Puppet has 117 failures. Last run 2 minutes ago with 117 failures. Failed resources (up to 3 shown): File[athenapedia.org_private],File[podpedia.org],File[podpedia.org_private],File[dariawiki.org] [08:06:57] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 111 failures. Last run 3 minutes ago with 111 failures. Failed resources (up to 3 shown) [08:14:51] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 11 seconds ago with 0 failures [08:14:56] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [08:26:51] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Puppet has 108 failures. Last run 2 minutes ago with 108 failures. Failed resources (up to 3 shown): File[wikibase.revi.wiki_private],File[programming.red],File[programming.red_private],File[wiki.gesamtschule-nordkirchen.de] [08:26:57] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 128 failures. Last run 3 minutes ago with 128 failures. Failed resources (up to 3 shown) [08:44:51] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 6 seconds ago with 0 failures [08:44:56] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [08:56:51] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Puppet has 128 failures. Last run 2 minutes ago with 128 failures. Failed resources (up to 3 shown): File[sdiy.info],File[sdiy.info_private],File[wikibase.revi.wiki],File[wikibase.revi.wiki_private] [08:56:57] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 142 failures. Last run 3 minutes ago with 142 failures. Failed resources (up to 3 shown) [09:24:51] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 7 seconds ago with 0 failures [09:24:56] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [09:36:51] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Puppet has 99 failures. Last run 2 minutes ago with 99 failures. Failed resources (up to 3 shown): File[wiki.gesamtschule-nordkirchen.de_private],File[wiki.teamwizardry.com],File[wiki.teamwizardry.com_private],File[wiki.ciptamedia.org] [09:36:57] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 118 failures. Last run 3 minutes ago with 118 failures. Failed resources (up to 3 shown) [09:54:51] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 17 seconds ago with 0 failures [09:54:56] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [10:06:51] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Puppet has 126 failures. Last run 2 minutes ago with 126 failures. Failed resources (up to 3 shown): File[wiki.gesamtschule-nordkirchen.de],File[wiki.gesamtschule-nordkirchen.de_private],File[wiki.teamwizardry.com],File[wiki.teamwizardry.com_private] [10:06:57] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 115 failures. Last run 3 minutes ago with 115 failures. Failed resources (up to 3 shown) [10:40:14] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhqCd [10:40:16] [02miraheze/services] 07MirahezeSSLBot 039c36ee0 - BOT: Updating services config for wikis [10:44:56] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures [10:46:51] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [10:56:51] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Puppet has 100 failures. Last run 2 minutes ago with 100 failures. Failed resources (up to 3 shown): File[athenapedia.org],File[athenapedia.org_private],File[podpedia.org],File[podpedia.org_private] [10:56:57] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 119 failures. Last run 3 minutes ago with 119 failures. Failed resources (up to 3 shown) [11:24:56] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 48 seconds ago with 0 failures [11:26:51] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:37:55] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhq8R [11:37:57] [02miraheze/puppet] 07paladox 03111cac9 - Update puppet1.yaml [11:44:10] PROBLEM - bacula1 Puppet on bacula1 is CRITICAL: CRITICAL: Puppet has 4 failures. Last run 2 minutes ago with 4 failures. Failed resources (up to 3 shown) [11:44:18] PROBLEM - misc4 Puppet on misc4 is CRITICAL: CRITICAL: Puppet has 14 failures. Last run 2 minutes ago with 14 failures. Failed resources (up to 3 shown) [11:44:18] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 329 failures. Last run 2 minutes ago with 329 failures. Failed resources (up to 3 shown) [11:44:25] PROBLEM - lizardfs2 Puppet on lizardfs2 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 2 minutes ago with 3 failures. Failed resources (up to 3 shown) [11:44:25] PROBLEM - db4 Puppet on db4 is CRITICAL: CRITICAL: Puppet has 6 failures. Last run 2 minutes ago with 6 failures. Failed resources (up to 3 shown) [11:44:30] PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Puppet has 325 failures. Last run 2 minutes ago with 325 failures. Failed resources (up to 3 shown) [11:44:41] PROBLEM - misc3 Puppet on misc3 is CRITICAL: CRITICAL: Puppet has 10 failures. Last run 3 minutes ago with 10 failures. Failed resources (up to 3 shown) [11:44:57] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 326 failures. Last run 2 minutes ago with 326 failures. Failed resources (up to 3 shown) [11:45:04] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown) [11:45:11] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 324 failures. Last run 3 minutes ago with 324 failures. Failed resources (up to 3 shown) [11:45:26] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 324 failures. Last run 3 minutes ago with 324 failures. Failed resources (up to 3 shown) [11:45:39] PROBLEM - lizardfs1 Puppet on lizardfs1 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown) [11:45:46] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 328 failures. Last run 3 minutes ago with 328 failures. Failed resources (up to 3 shown) [11:46:05] PROBLEM - misc2 Puppet on misc2 is CRITICAL: CRITICAL: Puppet has 7 failures. Last run 3 minutes ago with 7 failures. Failed resources (up to 3 shown) [11:46:52] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Puppet has 292 failures. Last run 3 minutes ago with 292 failures. Failed resources (up to 3 shown): File[/etc/sudoers],File[/home/nagiosre],File[/etc/nginx/mime.types],File[/etc/nginx/fastcgi_params] [11:52:24] RECOVERY - lizardfs2 Puppet on lizardfs2 is OK: OK: Puppet is currently enabled, last run 6 seconds ago with 0 failures [11:52:25] RECOVERY - db4 Puppet on db4 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures [11:52:41] RECOVERY - misc3 Puppet on misc3 is OK: OK: Puppet is currently enabled, last run 17 seconds ago with 0 failures [11:53:04] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 46 seconds ago with 0 failures [11:53:18] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 12 seconds ago with 0 failures [11:53:25] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 28 seconds ago with 0 failures [11:53:38] RECOVERY - lizardfs1 Puppet on lizardfs1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:53:49] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 58 seconds ago with 0 failures [11:54:05] RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:54:10] RECOVERY - bacula1 Puppet on bacula1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:54:14] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:54:17] RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:54:29] RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:54:51] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 32 seconds ago with 0 failures [11:54:56] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [14:20:14] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhq22 [14:20:16] [02miraheze/services] 07MirahezeSSLBot 033f05c9e - BOT: Updating services config for wikis [16:00:18] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhqPj [16:00:20] [02miraheze/services] 07MirahezeSSLBot 037df309d - BOT: Updating services config for wikis [16:10:18] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhqXp [16:10:19] [02miraheze/services] 07MirahezeSSLBot 03121b894 - BOT: Updating services config for wikis [16:30:15] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhqDv [16:30:17] [02miraheze/services] 07MirahezeSSLBot 035ed3ea6 - BOT: Updating services config for wikis [20:45:40] Hello mirahezeuser! If you have any questions feel free to ask and someone should answer soon.