[00:33:57] PROBLEM - puppet last run on cp1060 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [01:01:57] RECOVERY - puppet last run on cp1060 is OK: OK: Puppet is currently enabled, last run 39 seconds ago with 0 failures [01:25:17] PROBLEM - puppet last run on mw1174 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [01:38:57] PROBLEM - puppet last run on db1075 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [01:54:17] RECOVERY - puppet last run on mw1174 is OK: OK: Puppet is currently enabled, last run 48 seconds ago with 0 failures [02:07:57] RECOVERY - puppet last run on db1075 is OK: OK: Puppet is currently enabled, last run 52 seconds ago with 0 failures [02:19:30] !log l10nupdate@tin scap sync-l10n completed (1.29.0-wmf.16) (duration: 07m 29s) [02:19:37] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [02:24:53] !log l10nupdate@tin ResourceLoader cache refresh completed at Sun Mar 19 02:24:53 UTC 2017 (duration 5m 23s) [02:24:58] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [03:12:07] PROBLEM - puppet last run on mw1171 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [03:22:07] PROBLEM - puppet last run on analytics1032 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [03:24:17] PROBLEM - puppet last run on db1063 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [03:40:07] RECOVERY - puppet last run on mw1171 is OK: OK: Puppet is currently enabled, last run 9 seconds ago with 0 failures [03:52:07] RECOVERY - puppet last run on analytics1032 is OK: OK: Puppet is currently enabled, last run 52 seconds ago with 0 failures [03:52:17] RECOVERY - puppet last run on db1063 is OK: OK: Puppet is currently enabled, last run 17 seconds ago with 0 failures [04:04:27] PROBLEM - puppet last run on wtp1009 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [04:33:27] RECOVERY - puppet last run on wtp1009 is OK: OK: Puppet is currently enabled, last run 53 seconds ago with 0 failures [04:42:27] PROBLEM - puppet last run on cp3035 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [05:10:27] RECOVERY - puppet last run on cp3035 is OK: OK: Puppet is currently enabled, last run 7 seconds ago with 0 failures [07:32:41] (03PS1) 10ArielGlenn: keep fewer xml/sql dumps [puppet] - 10https://gerrit.wikimedia.org/r/343535 [07:33:30] (03CR) 10jerkins-bot: [V: 04-1] keep fewer xml/sql dumps [puppet] - 10https://gerrit.wikimedia.org/r/343535 (owner: 10ArielGlenn) [07:33:53] (03PS2) 10ArielGlenn: keep fewer xml/sql dumps [puppet] - 10https://gerrit.wikimedia.org/r/343535 [07:34:11] wat! I only changed the numbers [07:34:50] (03CR) 10jerkins-bot: [V: 04-1] keep fewer xml/sql dumps [puppet] - 10https://gerrit.wikimedia.org/r/343535 (owner: 10ArielGlenn) [07:35:07] the use of import is deprecated in site.pp [07:35:17] thanks jenkins, very helpful [07:35:24] s/jenkins/rake/ [07:44:04] (03PS3) 10ArielGlenn: keep fewer xml/sql dumps [puppet] - 10https://gerrit.wikimedia.org/r/343535 [07:45:04] (03CR) 10jerkins-bot: [V: 04-1] keep fewer xml/sql dumps [puppet] - 10https://gerrit.wikimedia.org/r/343535 (owner: 10ArielGlenn) [07:48:07] PROBLEM - puppet last run on mendelevium is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [07:48:18] (03PS4) 10ArielGlenn: keep fewer xml/sql dumps [puppet] - 10https://gerrit.wikimedia.org/r/343535 [08:08:06] (03PS5) 10ArielGlenn: keep fewer xml/sql dumps [puppet] - 10https://gerrit.wikimedia.org/r/343535 [08:13:28] (03CR) 10ArielGlenn: [C: 032] keep fewer xml/sql dumps [puppet] - 10https://gerrit.wikimedia.org/r/343535 (owner: 10ArielGlenn) [08:17:07] RECOVERY - puppet last run on mendelevium is OK: OK: Puppet is currently enabled, last run 51 seconds ago with 0 failures [09:10:27] PROBLEM - puppet last run on labstore1004 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [09:12:27] PROBLEM - Check HHVM threads for leakage on mw1169 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [09:38:27] RECOVERY - puppet last run on labstore1004 is OK: OK: Puppet is currently enabled, last run 35 seconds ago with 0 failures [09:49:06] (03PS1) 10Giuseppe Lavagetto: Add a stage to switch datacenter [switchdc] - 10https://gerrit.wikimedia.org/r/343537 [09:54:21] 06Operations, 06Commons, 10Datasets-General-or-Unknown, 07Community-Wishlist-Survey-2016: Back up of Commons files - https://phabricator.wikimedia.org/T160229#3112788 (10Nemo_bis) >>! In T160229#3106840, @Dzahn wrote: > I am wondering how is this task related to "skills required: javascript, css, etc" at a... [10:05:19] 06Operations, 06Commons, 10Datasets-General-or-Unknown, 07Community-Wishlist-Survey-2016: Back up of Commons files - https://phabricator.wikimedia.org/T160229#3092719 (10Joe) >>! In T160229#3112788, @Nemo_bis wrote: >>>! In T160229#3106840, @Dzahn wrote: >> I am wondering how is this task related to "skill... [10:05:37] PROBLEM - puppet last run on cp4020 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [10:08:13] (03PS4) 10ArielGlenn: dumps: Redesign progress report page [puppet] - 10https://gerrit.wikimedia.org/r/339332 (https://phabricator.wikimedia.org/T155697) (owner: 10Ladsgroup) [10:09:23] (03CR) 10ArielGlenn: [C: 032] dumps: Redesign progress report page [puppet] - 10https://gerrit.wikimedia.org/r/339332 (https://phabricator.wikimedia.org/T155697) (owner: 10Ladsgroup) [10:17:07] PROBLEM - parsoid on wtp1004 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:17:57] RECOVERY - parsoid on wtp1004 is OK: HTTP OK: HTTP/1.1 200 OK - 1014 bytes in 0.019 second response time [10:18:27] PROBLEM - Check HHVM threads for leakage on mw1168 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [10:21:27] RECOVERY - Check HHVM threads for leakage on mw1168 is OK: OK [10:22:24] (03PS4) 10ArielGlenn: add api job handler, config file in yaml, siteinfo props jobs [dumps] - 10https://gerrit.wikimedia.org/r/338899 (https://phabricator.wikimedia.org/T38178) [10:22:26] (03PS1) 10ArielGlenn: move xml content dump jobs out to separate module [dumps] - 10https://gerrit.wikimedia.org/r/343539 [10:22:28] (03PS1) 10ArielGlenn: move prefetch-finding code out to separate class [dumps] - 10https://gerrit.wikimedia.org/r/343540 [10:22:30] (03PS1) 10ArielGlenn: move stub-related code in page content dumps out to separate class [dumps] - 10https://gerrit.wikimedia.org/r/343541 [10:22:32] (03PS1) 10ArielGlenn: [WIP] wow not even done, lots of code yet to do, in the middle of changes here, don't even bother looking at it [dumps] - 10https://gerrit.wikimedia.org/r/343542 [10:22:41] damn fail [10:22:48] (03CR) 10jerkins-bot: [V: 04-1] move prefetch-finding code out to separate class [dumps] - 10https://gerrit.wikimedia.org/r/343540 (owner: 10ArielGlenn) [10:22:56] * apergos goes to abandon the three changes that weren't supposed to go in now [10:22:56] (03CR) 10jerkins-bot: [V: 04-1] add api job handler, config file in yaml, siteinfo props jobs [dumps] - 10https://gerrit.wikimedia.org/r/338899 (https://phabricator.wikimedia.org/T38178) (owner: 10ArielGlenn) [10:23:00] (03CR) 10jerkins-bot: [V: 04-1] move stub-related code in page content dumps out to separate class [dumps] - 10https://gerrit.wikimedia.org/r/343541 (owner: 10ArielGlenn) [10:23:02] (03CR) 10jerkins-bot: [V: 04-1] [WIP] wow not even done, lots of code yet to do, in the middle of changes here, don't even bother looking at it [dumps] - 10https://gerrit.wikimedia.org/r/343542 (owner: 10ArielGlenn) [10:23:04] yeah yeah hush jenkins [10:23:45] actually maybe I'll leave em in for now and just ignore [10:23:47] sigh [10:25:24] (03PS5) 10ArielGlenn: add api job handler, config file in yaml, siteinfo props jobs [dumps] - 10https://gerrit.wikimedia.org/r/338899 (https://phabricator.wikimedia.org/T38178) [10:28:38] (03CR) 10ArielGlenn: [C: 032] add api job handler, config file in yaml, siteinfo props jobs [dumps] - 10https://gerrit.wikimedia.org/r/338899 (https://phabricator.wikimedia.org/T38178) (owner: 10ArielGlenn) [10:33:37] RECOVERY - puppet last run on cp4020 is OK: OK: Puppet is currently enabled, last run 31 seconds ago with 0 failures [10:35:46] (03PS5) 10ArielGlenn: write hash sums, dumpruninfo, status report additionally in json [dumps] - 10https://gerrit.wikimedia.org/r/336395 (https://phabricator.wikimedia.org/T147177) [10:38:17] RECOVERY - Check HHVM threads for leakage on mw1169 is OK: OK [10:43:10] !log ariel@tin Started deploy [dumps/dumps@87d748b]: dump magic words and namespace info [10:43:12] !log ariel@tin Finished deploy [dumps/dumps@87d748b]: dump magic words and namespace info (duration: 00m 02s) [10:43:16] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [10:43:20] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [10:48:53] (03CR) 10Volans: [C: 04-1] "Minor things inline" (033 comments) [switchdc] - 10https://gerrit.wikimedia.org/r/342806 (https://phabricator.wikimedia.org/T160178) (owner: 10Giuseppe Lavagetto) [11:17:17] PROBLEM - puppet last run on labcontrol1001 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [11:45:17] RECOVERY - puppet last run on labcontrol1001 is OK: OK: Puppet is currently enabled, last run 16 seconds ago with 0 failures [12:21:10] PROBLEM - puppet last run on mw1181 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [12:49:27] RECOVERY - puppet last run on mw1181 is OK: OK: Puppet is currently enabled, last run 14 seconds ago with 0 failures [13:42:16] (03PS10) 10Mbch331: Remove exception on Other Projects sidebar for Dutch Wikipedia [mediawiki-config] - 10https://gerrit.wikimedia.org/r/341195 (https://phabricator.wikimedia.org/T159634) [13:52:27] PROBLEM - puppet last run on mc1025 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [13:57:49] (03PS16) 10BBlack: [POC] DNS zones to puppet repo [puppet] - 10https://gerrit.wikimedia.org/r/342887 [14:20:28] RECOVERY - puppet last run on mc1025 is OK: OK: Puppet is currently enabled, last run 38 seconds ago with 0 failures [14:32:27] PROBLEM - puppet last run on wtp1011 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [15:01:27] RECOVERY - puppet last run on wtp1011 is OK: OK: Puppet is currently enabled, last run 41 seconds ago with 0 failures [15:07:13] (03CR) 10BBlack: "PS16 corrected some earlier oversights and mistakes, and now also passes compiler checks (output looks sane)." [puppet] - 10https://gerrit.wikimedia.org/r/342887 (owner: 10BBlack) [15:14:17] PROBLEM - puppet last run on db1044 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [15:30:25] (03CR) 10Paladox: "> I'm sounding like a broken record. Any rewrite rules is a" [puppet] - 10https://gerrit.wikimedia.org/r/340900 (https://phabricator.wikimedia.org/T156120) (owner: 10Paladox) [15:33:47] PROBLEM - dhclient process on thumbor1001 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [15:33:57] PROBLEM - salt-minion processes on thumbor1001 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [15:35:37] RECOVERY - dhclient process on thumbor1001 is OK: PROCS OK: 0 processes with command name dhclient [15:35:47] RECOVERY - salt-minion processes on thumbor1001 is OK: PROCS OK: 1 process with regex args ^/usr/bin/python /usr/bin/salt-minion [15:42:17] RECOVERY - puppet last run on db1044 is OK: OK: Puppet is currently enabled, last run 24 seconds ago with 0 failures [16:17:17] PROBLEM - puppet last run on lvs1004 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [16:31:17] PROBLEM - puppet last run on ms-be1008 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [16:45:17] RECOVERY - puppet last run on lvs1004 is OK: OK: Puppet is currently enabled, last run 17 seconds ago with 0 failures [16:55:17] PROBLEM - puppet last run on db1084 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [16:59:17] RECOVERY - puppet last run on ms-be1008 is OK: OK: Puppet is currently enabled, last run 0 seconds ago with 0 failures [17:24:17] RECOVERY - puppet last run on db1084 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures [17:48:30] (03PS1) 10Dereckson: Add pa.wikisource new wiki on RESTBase [puppet] - 10https://gerrit.wikimedia.org/r/343552 (https://phabricator.wikimedia.org/T160859) [18:19:16] (03PS6) 10ArielGlenn: write hash sums, dumpruninfo, status report additionally in json [dumps] - 10https://gerrit.wikimedia.org/r/336395 (https://phabricator.wikimedia.org/T147177) [18:21:40] (03CR) 10ArielGlenn: [C: 032] write hash sums, dumpruninfo, status report additionally in json [dumps] - 10https://gerrit.wikimedia.org/r/336395 (https://phabricator.wikimedia.org/T147177) (owner: 10ArielGlenn) [18:22:06] (03PS3) 10ArielGlenn: use the various json outputs to write a combined file for status api use [dumps] - 10https://gerrit.wikimedia.org/r/342310 (https://phabricator.wikimedia.org/T147177) [18:30:43] 06Operations, 10Gerrit: Decide how to support polygerrit - https://phabricator.wikimedia.org/T158479#3113039 (10Paladox) This now works without rewrites too :) [18:31:17] (03CR) 10ArielGlenn: [C: 032] use the various json outputs to write a combined file for status api use [dumps] - 10https://gerrit.wikimedia.org/r/342310 (https://phabricator.wikimedia.org/T147177) (owner: 10ArielGlenn) [18:32:19] (03PS3) 10ArielGlenn: have dump monitor collect current run json files and produce index.json [dumps] - 10https://gerrit.wikimedia.org/r/342311 (https://phabricator.wikimedia.org/T147177) [18:33:27] PROBLEM - puppet last run on ganeti1001 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [18:37:21] (03CR) 10ArielGlenn: [C: 032] have dump monitor collect current run json files and produce index.json [dumps] - 10https://gerrit.wikimedia.org/r/342311 (https://phabricator.wikimedia.org/T147177) (owner: 10ArielGlenn) [18:37:49] (03PS2) 10ArielGlenn: add a version number to status file output!! [dumps] - 10https://gerrit.wikimedia.org/r/342312 [18:38:32] (03CR) 10ArielGlenn: [C: 032] add a version number to status file output!! [dumps] - 10https://gerrit.wikimedia.org/r/342312 (owner: 10ArielGlenn) [18:39:54] !log ariel@tin Started deploy [dumps/dumps@8cff500]: generate json status files for use by downloaders [18:39:56] !log ariel@tin Finished deploy [dumps/dumps@8cff500]: generate json status files for use by downloaders (duration: 00m 02s) [18:40:00] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [18:40:06] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [18:46:33] huh [18:46:47] that was one deploy, not two [18:49:27] PROBLEM - puppet last run on elastic1045 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [19:02:27] RECOVERY - puppet last run on ganeti1001 is OK: OK: Puppet is currently enabled, last run 18 seconds ago with 0 failures [19:17:27] RECOVERY - puppet last run on elastic1045 is OK: OK: Puppet is currently enabled, last run 42 seconds ago with 0 failures [19:43:14] apergos: that was a start/finish message, not two deploys [19:43:56] which means I see that every time and only today am I so brain dead I don't get it [19:43:56] nice [19:44:04] great time to do deploys too, heh [19:59:27] PROBLEM - puppet last run on analytics1045 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [20:29:27] RECOVERY - puppet last run on analytics1045 is OK: OK: Puppet is currently enabled, last run 46 seconds ago with 0 failures [20:48:29] 06Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikipedia Khowar - https://phabricator.wikimedia.org/T160865#3113140 (10MF-Warburg) [20:57:05] 06Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikipedia Kabye - https://phabricator.wikimedia.org/T160868#3113180 (10MF-Warburg) [21:05:39] 06Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikipedia Khowar - https://phabricator.wikimedia.org/T160865#3113193 (10Luke081515) [21:05:45] 06Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikipedia Kabye - https://phabricator.wikimedia.org/T160868#3113194 (10Luke081515) [21:06:11] 06Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikipedia Khowar - https://phabricator.wikimedia.org/T160865#3113140 (10Luke081515) [21:06:17] 06Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikipedia Kabye - https://phabricator.wikimedia.org/T160868#3113180 (10Luke081515) [21:10:33] 06Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikipedia Khowar - https://phabricator.wikimedia.org/T160865#3113199 (10MF-Warburg) [21:17:19] (03PS2) 10Dereckson: Add pa.wikisource new wiki on RESTBase [puppet] - 10https://gerrit.wikimedia.org/r/343552 (https://phabricator.wikimedia.org/T149522) [21:17:38] 06Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikipedia Kabiye - https://phabricator.wikimedia.org/T160868#3113204 (10MF-Warburg) [21:22:36] (03PS1) 10Dereckson: DNS for khw. and kbp. projects [dns] - 10https://gerrit.wikimedia.org/r/343572 (https://phabricator.wikimedia.org/T160865) [21:31:41] (03PS1) 10Dereckson: RESTBase: add kbp. and khw.wikipedia [puppet] - 10https://gerrit.wikimedia.org/r/343584 (https://phabricator.wikimedia.org/T160865) [21:44:53] 06Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests, 13Patch-For-Review: Create Wikipedia Kabiye - https://phabricator.wikimedia.org/T160868#3113254 (10Dereckson) @tomasz Could you help for a logo please? Project name is **Wikipediya**. [21:46:16] 06Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests, 13Patch-For-Review: Create Wikipedia Kabiye - https://phabricator.wikimedia.org/T160868#3113256 (10tomasz) @Dereckson: Absolutely! Do we know what the subline ("The Free Encyclopedia") should be? [21:48:08] 06Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests, 13Patch-For-Review: Create Wikipedia Kabiye - https://phabricator.wikimedia.org/T160868#3113259 (10MF-Warburg) I asked on https://meta.wikimedia.org/wiki/Requests_for_new_languages/Wikipedia_Kabiye#Other_discussion [21:48:47] (03PS1) 10Dereckson: Add khw.wikipedia logos to static resources [mediawiki-config] - 10https://gerrit.wikimedia.org/r/343585 (https://phabricator.wikimedia.org/T160865) [21:52:55] 06Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests, 13Patch-For-Review: Create Wikipedia Khowar - https://phabricator.wikimedia.org/T160865#3113140 (10Esc3300) Wikidata Item: https://www.wikidata.org/wiki/Q28971670 [21:53:14] 06Operations, 10Wikidata, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests, 13Patch-For-Review: Create Wikipedia Khowar - https://phabricator.wikimedia.org/T160865#3113265 (10Esc3300) [21:53:34] 06Operations, 10Wikidata, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests, 13Patch-For-Review: Create Wikipedia Khowar - https://phabricator.wikimedia.org/T160865#3113266 (10Dereckson) >>! In T160865#3113262, @Esc3300 wrote: > Wikidata Item: https://www.wikidata.org/wiki/Q28971670 What do you wish... [21:58:55] 06Operations, 10Wikidata, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests, 13Patch-For-Review: Create Wikipedia Khowar - https://phabricator.wikimedia.org/T160865#3113270 (10Esc3300) No, but it should be created, otherwise WDQS can't decode URLs to the corresponding Wikipedia name. [22:01:37] 06Operations, 10Wikidata, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests, 13Patch-For-Review: Create Wikipedia Khowar - https://phabricator.wikimedia.org/T160865#3113271 (10Esc3300) Interwikis need to be imported to Wikidata as well: https://www.wikidata.org/wiki/Wikidata:Bot_requests#Import_inter... [22:01:40] 06Operations, 10Wikidata, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests, 13Patch-For-Review: Create Wikipedia Khowar - https://phabricator.wikimedia.org/T160865#3113272 (10Dereckson) Okay. If you've a LDAP login, you can edit [[ https://wikitech.wikimedia.org/wiki/Add_a_wiki | this procedure page... [22:05:50] 06Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests, 13Patch-For-Review: Create Wikipedia Kabiye - https://phabricator.wikimedia.org/T160868#3113180 (10Esc3300) - Import request for interwikis: https://www.wikidata.org/wiki/Wikidata:Bot_requests#Import_interwikis_from_Kabiye_Wikipedia... [22:06:17] 06Operations, 10Wikidata, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests, 13Patch-For-Review: Create Wikipedia Kabiye - https://phabricator.wikimedia.org/T160868#3113276 (10Esc3300) [22:46:00] grabbing a csrf token via curl, and then hardcoding it into a script, is a terrible hack. [22:54:27] PROBLEM - puppet last run on kafka1018 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:12:37] PROBLEM - puppet last run on ms-be1018 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:22:27] RECOVERY - puppet last run on kafka1018 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [23:41:37] RECOVERY - puppet last run on ms-be1018 is OK: OK: Puppet is currently enabled, last run 30 seconds ago with 0 failures [23:57:37] PROBLEM - puppet last run on cp1053 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues