[00:03:04] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:22] PROBLEM - misc4 Puppet on misc4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:42] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:04:02] PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:04:30] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:11:02] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 4 seconds ago with 0 failures [00:11:22] RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 12 seconds ago with 0 failures [00:11:42] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 30 seconds ago with 0 failures [00:12:02] RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 18 seconds ago with 0 failures [00:12:28] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [04:03:08] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 353 [04:15:09] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [04:59:08] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 307 [05:50:35] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpx7j [05:50:37] [02miraheze/mw-config] 07Reception123 036fc2ba2 - exempt ildrilwiki from DP per SN [05:52:20] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpx5U [05:52:21] [02miraheze/mw-config] 07Reception123 03830d05e - revert "exempt ildrilwiki from DP per SN" already done [08:25:13] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpxxJ [08:25:14] [02miraheze/services] 07MirahezeSSLBot 03b93dfa8 - BOT: Updating services config for wikis [13:00:16] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpplI [13:00:18] [02miraheze/services] 07MirahezeSSLBot 03bc5fdca - BOT: Updating services config for wikis [16:34:11] HTTP CRITICAL - Unable to open TCP socket [16:47:21] [02miraheze/mediawiki] 07paladox pushed 038 commits to 03REL1_32 [+2/-0/±28] 13https://git.io/fppQE [16:47:22] [02miraheze/mediawiki] 07AaronSchulz 034ca6000 - Create JobQueueEnqueueUpdate class to call JobQueueGroup::pushLazyJobs() This assures that MergeableUpdate tasks that lazy push job will actually have those jobs run instead of being added after the lone callback update to call JobQueueGroup::pushLazyJobs() already ran. This also makes it more obvious that push will happen, since a mergeable update is added each [16:47:22] time lazyPush() is called and a job is buffered, rather than rely on some magic callback enqueued into DeferredUpdates at just the right point in multiple entry points. Bug: T207809 Change-Id: I13382ef4a17a9ba0fd3f9964b8c62f564e47e42d (cherry picked from commit 6030e9cf2c1df7929e2319602aa4d37aa641de11) [16:47:23] [02miraheze/mediawiki] 07legoktm 03276507a - Upgrade wikimedia/ip-set to 1.3.0 Bug: T209756 Depends-On: Ice4e86cc9927fc74433c6185397b2bde62f10bca Change-Id: I034ca4a1135cfcba93d4c636a4cdd8789d91537c [16:47:25] [02miraheze/mediawiki] 07legoktm 03f136cfb - Update git submodules * Update vendor from branch 'REL1_32' to 384dcfad311e8337b9d87eeffaa640bfb8bce98c - Upgrade wikimedia/ip-set to 1.3.0 Change-Id: Ice4e86cc9927fc74433c6185397b2bde62f10bca [16:47:26] [02miraheze/mediawiki] ... and 5 more commits. [16:58:34] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fpp7d [16:58:35] [02miraheze/mediawiki] 07paladox 032f9f201 - Update liberty [17:43:24] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fppNG [17:43:26] [02miraheze/mediawiki] 07paladox 0327d2192 - Update Echo [18:22:44] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpppN [18:22:46] [02miraheze/mw-config] 07paladox 0310b6767 - Make wmincSisterProjects a empty array [18:24:33] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpphf [18:24:35] [02miraheze/mw-config] 07paladox 034decd16 - Make wmincExistingWikis default to null and wmincMultilingualProjects to empty array [18:27:09] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fppht [18:27:10] [02miraheze/mw-config] 07paladox 03a407507 - BlogPage also requires Comments [18:30:35] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpphR [18:30:37] [02miraheze/mw-config] 07paladox 03610e814 - set wmincSisterProjects defaults [18:40:53] [02miraheze/MirahezeMagic] 07JohnFLewis pushed 031 commit to 03master [+2/-0/±1] 13https://git.io/fppjq [18:40:54] [02miraheze/MirahezeMagic] 07JohnFLewis 038d56337 - base for GlobalNewFiles [18:41:47] [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fppjC [18:41:49] [02miraheze/mediawiki] 07JohnFLewis 034a85e4c - update MM [18:48:32] * paladox looks at JohnLewis [18:48:43] please revert or disable puppet [18:48:55] * paladox does mw1 [18:49:00] so at least one mw works [18:49:07] JohnLewis you have a syntax error in that file [18:49:11] missing [02miraheze/MirahezeMagic] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpheq [18:50:05] [02miraheze/MirahezeMagic] 07JohnFLewis 035d7b9af - add [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpheG [18:50:28] [02miraheze/MirahezeMagic] 07paladox 03967c1d7 - fix syntax error and add missing global [18:51:01] [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fphec [18:51:02] [02miraheze/mediawiki] 07JohnFLewis 0350b42f0 - update MM [18:51:03] PROBLEM - mw1 Puppet on mw1 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 10 minutes ago with 0 failures [18:55:04] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:25:42] [02miraheze/MirahezeMagic] 07JohnFLewis pushed 032 commits to 03master [+0/-0/±2] 13https://git.io/fphJC [19:25:44] [02miraheze/MirahezeMagic] 07JohnFLewis 037669cad - add class [19:25:45] [02miraheze/MirahezeMagic] 07JohnFLewis 034449f3b - Merge branch 'master' of www.github.com:miraheze/MirahezeMagic [19:26:13] [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fphJl [19:26:15] [02miraheze/mediawiki] 07JohnFLewis 0379c1523 - pull MM [19:29:40] [02miraheze/MirahezeMagic] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fphJK [19:29:41] [02miraheze/MirahezeMagic] 07JohnFLewis 03aba2bdb - fix hook name [19:30:17] [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fphJ1 [19:30:19] [02miraheze/mediawiki] 07JohnFLewis 0363a8df4 - pull more MM [19:33:26] paladox: https://github.com/miraheze/mw-config/commit/a4075079fa88cd2879283815edc0a86b38d59da2 isn't correct [19:33:26] Title: [ BlogPage also requires Comments · miraheze/mw-config@a407507 · GitHub ] - github.com [19:33:32] it only supports a single check [19:33:39] JohnLewis oh [19:33:48] JohnLewis can we get it to support a array? [19:33:50] (please)? [19:34:05] the whole thing needs to changed to be more advanced [19:34:16] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fphUm [19:34:17] [02miraheze/mw-config] 07paladox 03441bbea - Revert "BlogPage also requires Comments" This reverts commit a4075079fa88cd2879283815edc0a86b38d59da2. [19:35:31] [02ssl] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vxP9L [19:35:32] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fphUC [19:35:34] [02miraheze/ssl] 07paladox 038ced74f - Update www.netazar.org.crt Also add netazar.org to the cert [19:35:35] [02ssl] 07paladox opened pull request 03#114: Update www.netazar.org.crt - 13https://git.io/fphU8 [19:36:38] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fphUa [19:36:40] [02miraheze/ssl] 07paladox 0397d2f62 - Update redirects.yaml [19:36:41] [02ssl] 07paladox synchronize pull request 03#114: Update www.netazar.org.crt - 13https://git.io/fphU8 [19:37:29] [02ssl] 07paladox closed pull request 03#114: Update www.netazar.org.crt - 13https://git.io/fphU8 [19:37:31] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fphUw [19:37:32] [02miraheze/ssl] 07paladox 03da7dced - Update www.netazar.org.crt (#114) * Update www.netazar.org.crt Also add netazar.org to the cert * Update redirects.yaml [19:37:34] [02ssl] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vxP9L [19:37:35] [02miraheze/ssl] 07paladox deleted branch 03paladox-patch-1 [19:39:39] JohnLewis ok [19:43:34] PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 2 backends are down. mw2 mw3 [19:44:19] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 2 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb [19:45:31] RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy [19:46:13] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [20:07:10] !log deleting cristianopediawiki and tallerdecristianopedia wiki's ref T3895 [20:07:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:10:15] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fphLJ [20:10:17] [02miraheze/services] 07MirahezeSSLBot 0384073f4 - BOT: Updating services config for wikis [20:26:21] [02miraheze/MirahezeMagic] 07JohnFLewis pushed 031 commit to 03master [+1/-1/±0] 13https://git.io/fphtM [20:26:23] [02miraheze/MirahezeMagic] 07JohnFLewis 03531059f - rename sql so it matches name [20:28:20] !log renamed mhglobal table from gfn_files to gnf_files [20:28:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [21:02:52] [02miraheze/puppet] 07Southparkfan pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/fphOe [21:02:54] [02miraheze/puppet] 07Southparkfan 03e2b67ea - add my own .vimrc Because in 2018 we should be able again to paste stuff with just a single right mouse click. [21:03:13] SPF|Cloud let's make that global :P [21:03:40] feel free to copy for yourself [21:04:00] ok [21:05:07] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/fphOq [21:05:09] [02miraheze/puppet] 07paladox 037ed3b08 - Add vimrc.local to /etc/vim/vimrc.local Will fix vim so we can copy text without having to do ":set mouse=r" [21:05:10] [02puppet] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbiAS [21:05:20] [02puppet] 07paladox opened pull request 03#935: Add vimrc.local to /etc/vim/vimrc.local - 13https://git.io/fphOm [21:05:33] mouse r? [21:06:10] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+1/-0/±0] 13https://git.io/fphOW [21:06:12] [02miraheze/puppet] 07paladox 0328aaddc - Create vimrc.local [21:06:13] [02puppet] 07paladox synchronize pull request 03#935: Add vimrc.local to /etc/vim/vimrc.local - 13https://git.io/fphOm [21:06:45] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/fphOB [21:06:47] [02miraheze/puppet] 07paladox 03478e8ab - Update init.pp [21:06:48] [02puppet] 07paladox synchronize pull request 03#935: Add vimrc.local to /etc/vim/vimrc.local - 13https://git.io/fphOm [21:07:07] SPF|Cloud yeh [21:07:11] i always do mouse=r [21:08:22] [02puppet] 07paladox closed pull request 03#935: Add vimrc.local to /etc/vim/vimrc.local - 13https://git.io/fphOm [21:08:24] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/fphOw [21:08:25] [02miraheze/puppet] 07paladox 03c9c907c - Add vimrc.local to /etc/vim/vimrc.local (#935) * Add vimrc.local to /etc/vim/vimrc.local Will fix vim so we can copy text without having to do ":set mouse=r" * Create vimrc.local * Update init.pp [21:08:27] [02puppet] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbiAS [21:08:28] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-2 [21:09:43] shrug, LeaseWeb still offers the HP DL120G7 for €50/mo.. [21:15:19] is it bad I use nano and not vim :P [21:35:40] meh no, at least nano wasn't affected by this issue :P [21:36:18] true :P [22:00:58] [02puppet] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbiAS [22:00:59] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/fphni [22:01:01] [02miraheze/puppet] 07paladox 03fc916d9 - Raise table-definition-cache and table-open-cache to 800 [22:01:02] [02puppet] 07paladox opened pull request 03#936: Raise table-definition-cache and table-open-cache to 800 - 13https://git.io/fphnP [22:32:37] [02puppet] 07paladox created branch 03paladox-patch-3 - 13https://git.io/vbiAS [22:32:38] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fphWx [22:32:40] [02miraheze/puppet] 07paladox 0383f8e9c - Increase max-allowed-packet to 64M [22:32:42] [02puppet] 07paladox opened pull request 03#937: Increase max-allowed-packet to 64M - 13https://git.io/fphWp [22:45:56] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-2/±0] 13https://git.io/fph8Y [22:45:58] [02miraheze/puppet] 07paladox 03b6e9ba2 - Remove old php module [22:47:30] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-7/±3] 13https://git.io/fph8G [22:47:32] [02miraheze/puppet] 07paladox 03dffa44c - Remove "acme" module [23:33:41] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+5/-2/±1] 13https://git.io/fphR6 [23:33:42] [02miraheze/puppet] 07paladox 036a9ddab - Update icinga2 irc bot to use ircecho Also seperate the class a bit.