[00:00:41] And now why the fuck is it commiting via HTTPS [00:00:51] Wut [00:01:06] it's asking for a password [00:01:14] PUSH STAGING Pushing changes to staging area... [00:01:14] Username for 'https://phabricator.wikimedia.org': reedy [00:01:14] Password for 'https://reedy@phabricator.wikimedia.org': [00:01:33] Wrong remote? [00:01:39] (idk) [00:01:40] I think you can push to git-ssh.wikimedia.org? not sure [00:01:40] fatal: unable to access 'https://phabricator.wikimedia.org/diffusion/PHSTAGE/harbormaster-staging.git/': The requested URL returned error: 403 [00:01:40] STAGING FAILED Unable to push changes to the staging area. [00:01:40] Updating commit message... [00:01:40] Created a new Differential revision: [00:01:40] Revision URI: https://phabricator.wikimedia.org/D50 [00:01:48] This is just retarded [00:02:35] Unit Test Errors 1 Broken · View Full Results · Excuse: What is this I don't even. [00:20:11] you broke it [00:20:32] Because I didn't have 5 different python-whatevers installed to run scap stuff [00:28:24] {{sofixit}} {{runs}} [01:18:27] Hmm [01:18:33] Reedy: Yo [01:26:22] ostriches: Hi [01:27:15] You haz problems w/ Differential? [01:27:35] I got there, eventually [01:27:40] PITA etc [01:28:38] It tries to do a lot more, and isn't exactly always obvious with what it was trying to do [01:28:39] Reedy: Same early teething as Gerrit, imho. Gotta either have SSH working with a key or use the vcs-specific password for HTTPS. [01:28:52] Glad you got your patch up, accepted. [01:28:52] I had cloned the repo using HTTPS [01:28:58] uh, ssh [01:29:06] But then it was asking for my username and password [01:29:14] for staging stuff [01:29:20] which was something wtf-ish [01:30:08] So, you can have arcanist push to a staging env. as part of your push. Kinda neat and we're playing with it. [01:30:25] Yeah, just seems a bit weird it needs a seperate set of credentials entering [01:30:54] Reedy: Probably because the staging push is a separate repo and you're opening a 2nd connection to it. [01:31:15] But why does it use SSH for one and HTTPS for the other? [01:31:30] Seems... counter intuitive [01:35:23] Iono, ask mukunda when he's about [01:36:12] !log deploying scap master@54d93b3 [01:36:18] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [01:36:22] Reedy: Fix should be out soon [01:36:27] sweet thanks [01:36:48] yw [01:39:55] !log reedy@tin Purged l10n cache for 1.27.0-wmf.1 [01:40:01] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [01:40:05] should've been a noop, but seems to work :) [01:42:10] go team [01:42:14] * ostriches goes back to his weekend [02:20:58] !log l10nupdate@tin Synchronized php-1.27.0-wmf.6/cache/l10n: l10nupdate for 1.27.0-wmf.6 (duration: 06m 07s) [02:21:04] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [03:15:48] 6operations, 6Labs: Investigate why nscd is used in labs - https://phabricator.wikimedia.org/T100564#1806213 (10yuvipanda) a:3yuvipanda [03:35:41] PROBLEM - puppet last run on mw1216 is CRITICAL: CRITICAL: Puppet has 1 failures [03:35:51] PROBLEM - puppet last run on mw1252 is CRITICAL: CRITICAL: Puppet has 1 failures [03:51:13] PROBLEM - puppet last run on db1016 is CRITICAL: CRITICAL: puppet fail [03:51:52] PROBLEM - puppet last run on antimony is CRITICAL: CRITICAL: puppet fail [03:52:12] PROBLEM - puppet last run on db1068 is CRITICAL: CRITICAL: puppet fail [03:54:12] PROBLEM - puppet last run on mw2055 is CRITICAL: CRITICAL: Puppet has 1 failures [03:58:22] PROBLEM - puppet last run on mw2057 is CRITICAL: CRITICAL: Puppet has 1 failures [04:01:31] RECOVERY - puppet last run on mw1216 is OK: OK: Puppet is currently enabled, last run 20 seconds ago with 0 failures [04:01:42] RECOVERY - puppet last run on mw1252 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [04:18:11] RECOVERY - puppet last run on db1068 is OK: OK: Puppet is currently enabled, last run 48 seconds ago with 0 failures [04:18:22] RECOVERY - puppet last run on mw2055 is OK: OK: Puppet is currently enabled, last run 24 seconds ago with 0 failures [04:19:02] RECOVERY - puppet last run on db1016 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [04:19:12] PROBLEM - Incoming network saturation on labstore1003 is CRITICAL: CRITICAL: 11.11% of data above the critical threshold [100000000.0] [04:19:41] RECOVERY - puppet last run on antimony is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [04:24:13] RECOVERY - puppet last run on mw2057 is OK: OK: Puppet is currently enabled, last run 43 seconds ago with 0 failures [04:42:53] PROBLEM - puppet last run on labvirt1001 is CRITICAL: CRITICAL: Puppet has 3 failures [04:45:11] RECOVERY - Incoming network saturation on labstore1003 is OK: OK: Less than 10.00% above the threshold [75000000.0] [05:08:52] RECOVERY - puppet last run on labvirt1001 is OK: OK: Puppet is currently enabled, last run 34 seconds ago with 0 failures [05:48:56] (03CR) 10MZMcBride: "This is a pretty sad changeset. The whole search situation has become rather unfortunate." [puppet] - 10https://gerrit.wikimedia.org/r/246891 (https://phabricator.wikimedia.org/T114443) (owner: 10Ori.livneh) [05:53:57] (03CR) 10Ori.livneh: "Kaldari had a specific need for it, and I saw that it would be easy to satisfy. I do not agree that it signals an endorsement of (or compl" [puppet] - 10https://gerrit.wikimedia.org/r/246891 (https://phabricator.wikimedia.org/T114443) (owner: 10Ori.livneh) [05:56:20] (03Abandoned) 10Zhuyifei1999: Add *.mil to server-side upload whitelist [mediawiki-config] - 10https://gerrit.wikimedia.org/r/252908 (https://phabricator.wikimedia.org/T118554) (owner: 10Zhuyifei1999) [06:12:20] (03CR) 10Kaldari: "Neither Ori nor myself have anything to do with search development, and even if this script were killed with fire it would have absolutely" [puppet] - 10https://gerrit.wikimedia.org/r/246891 (https://phabricator.wikimedia.org/T114443) (owner: 10Ori.livneh) [06:30:32] PROBLEM - puppet last run on restbase2006 is CRITICAL: CRITICAL: Puppet has 2 failures [06:30:41] PROBLEM - puppet last run on mw1061 is CRITICAL: CRITICAL: Puppet has 1 failures [06:31:08] (03CR) 10Aaron Schulz: "What exactly is the problem with expanded this script for a few add-hoc JS/CSS uses? Does that really lock us into it? (note: I don't have" [puppet] - 10https://gerrit.wikimedia.org/r/246891 (https://phabricator.wikimedia.org/T114443) (owner: 10Ori.livneh) [06:31:43] PROBLEM - puppet last run on eventlog2001 is CRITICAL: CRITICAL: Puppet has 1 failures [06:31:43] PROBLEM - puppet last run on mw2081 is CRITICAL: CRITICAL: Puppet has 1 failures [06:31:53] PROBLEM - puppet last run on mw2018 is CRITICAL: CRITICAL: Puppet has 1 failures [06:31:53] PROBLEM - puppet last run on mw2050 is CRITICAL: CRITICAL: Puppet has 1 failures [06:32:12] PROBLEM - puppet last run on mw2043 is CRITICAL: CRITICAL: Puppet has 1 failures [06:32:23] PROBLEM - puppet last run on mw1158 is CRITICAL: CRITICAL: Puppet has 1 failures [06:33:42] PROBLEM - puppet last run on mw2207 is CRITICAL: CRITICAL: Puppet has 3 failures [06:33:43] PROBLEM - puppet last run on mw2073 is CRITICAL: CRITICAL: Puppet has 2 failures [06:33:43] PROBLEM - puppet last run on mw2024 is CRITICAL: CRITICAL: Puppet has 1 failures [06:33:51] PROBLEM - puppet last run on mw2129 is CRITICAL: CRITICAL: Puppet has 1 failures [06:33:51] PROBLEM - puppet last run on mw2158 is CRITICAL: CRITICAL: Puppet has 1 failures [06:33:51] PROBLEM - puppet last run on mw2045 is CRITICAL: CRITICAL: Puppet has 3 failures [06:56:01] RECOVERY - puppet last run on mw2081 is OK: OK: Puppet is currently enabled, last run 20 seconds ago with 0 failures [06:56:22] RECOVERY - puppet last run on mw2043 is OK: OK: Puppet is currently enabled, last run 25 seconds ago with 0 failures [06:56:33] RECOVERY - puppet last run on restbase2006 is OK: OK: Puppet is currently enabled, last run 28 seconds ago with 0 failures [06:56:41] RECOVERY - puppet last run on mw1061 is OK: OK: Puppet is currently enabled, last run 4 seconds ago with 0 failures [06:57:52] RECOVERY - puppet last run on eventlog2001 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:57:53] RECOVERY - puppet last run on mw2207 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:58:01] RECOVERY - puppet last run on mw2073 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:58:02] RECOVERY - puppet last run on mw2129 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:58:02] RECOVERY - puppet last run on mw2018 is OK: OK: Puppet is currently enabled, last run 41 seconds ago with 0 failures [06:58:02] RECOVERY - puppet last run on mw2158 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:58:02] RECOVERY - puppet last run on mw2050 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:58:04] RECOVERY - puppet last run on mw2045 is OK: OK: Puppet is currently enabled, last run 17 seconds ago with 0 failures [06:59:52] RECOVERY - puppet last run on mw2024 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:26:12] RECOVERY - puppet last run on mw1158 is OK: OK: Puppet is currently enabled, last run 8 seconds ago with 0 failures [07:46:13] PROBLEM - DPKG on krypton is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [07:46:31] PROBLEM - RAID on krypton is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [07:46:32] PROBLEM - HTTP on krypton is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:46:32] PROBLEM - configured eth on krypton is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [07:46:52] PROBLEM - Disk space on krypton is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [07:47:11] PROBLEM - salt-minion processes on krypton is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [07:47:12] PROBLEM - grafana.wikimedia.org on krypton is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:47:22] PROBLEM - Check size of conntrack table on krypton is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [07:47:32] PROBLEM - grafana-admin.wikimedia.org on krypton is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:47:32] PROBLEM - puppet last run on krypton is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [07:47:43] PROBLEM - dhclient process on krypton is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [08:31:58] What's https://wikitech.wikimedia.org/wiki/Incident_documentation/20151109-OrganizationalOutage about? Is it meant as a joke of some kind, or...? [08:47:52] tto: It's a joke in poor taste. I'm going to delete it. [08:48:04] ori: I thought as much. Thanks [08:51:43] PROBLEM - SSH on krypton is CRITICAL: Server answer [08:53:33] RECOVERY - SSH on krypton is OK: SSH OK - OpenSSH_6.7p1 Debian-5 (protocol 2.0) [09:02:02] RECOVERY - grafana-admin.wikimedia.org on krypton is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 534 bytes in 7.592 second response time [09:02:05] <_joe_> !log rebooting krypton [09:02:10] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [09:02:42] RECOVERY - DPKG on krypton is OK: All packages OK [09:03:01] RECOVERY - RAID on krypton is OK: OK: no RAID installed [09:03:01] RECOVERY - HTTP on krypton is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 575 bytes in 0.003 second response time [09:03:02] RECOVERY - configured eth on krypton is OK: OK - interfaces up [09:03:02] RECOVERY - Disk space on krypton is OK: DISK OK [09:03:32] RECOVERY - grafana.wikimedia.org on krypton is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 522 bytes in 0.001 second response time [09:03:32] RECOVERY - salt-minion processes on krypton is OK: PROCS OK: 1 process with regex args ^/usr/bin/python /usr/bin/salt-minion [09:03:33] RECOVERY - Check size of conntrack table on krypton is OK: OK: nf_conntrack is 0 % full [09:03:51] RECOVERY - puppet last run on krypton is OK: OK: Puppet is currently enabled, last run 20 seconds ago with 0 failures [09:04:01] RECOVERY - dhclient process on krypton is OK: PROCS OK: 0 processes with command name dhclient [11:52:52] PROBLEM - puppet last run on db2023 is CRITICAL: CRITICAL: puppet fail [12:10:58] !log uploading upgraded mariadb package for trusty, too [12:11:02] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [12:16:59] !log restarting mysql at db1015 to finish upgrade/maintenance process [12:17:02] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [12:21:21] RECOVERY - puppet last run on db2023 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:50:20] (03CR) 10Paladox: "@Chad the tags are then hidden which means it is harder to find them a download them." [puppet] - 10https://gerrit.wikimedia.org/r/250449 (owner: 10Paladox) [14:19:13] !log reedy@tin Synchronized php-1.27.0-wmf.6/extensions/BounceHandler/: Pull in a few fixes and improvements for BounceHandler (duration: 01m 12s) [14:19:17] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [14:26:19] (03PS5) 10Reedy: Temporary: Enable 'error' log [mediawiki-config] - 10https://gerrit.wikimedia.org/r/250852 [14:28:07] !log reedy@tin Synchronized wmf-config/InitialiseSettings.php: Temporarily enable error log. Will revert in a few minutes (duration: 00m 27s) [14:28:11] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [14:30:16] Krinkle: hmm.. it's not creating the file on disk on fluorine [14:31:11] !log reedy@tin Synchronized wmf-config/InitialiseSettings.php: revert last, no file created on fluorine (duration: 00m 27s) [14:31:15] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [14:31:31] Well that sucks [14:35:01] 6operations, 10Flow, 10MediaWiki-Redirects, 3Collaboration-Team-Current, and 2 others: Flow notification links on mobile point to desktop - https://phabricator.wikimedia.org/T107108#1806622 (10QuimGil) This problem can be reproduced today: 1. Watch a Flow topic and get it updated so it generates notificat... [14:45:42] PROBLEM - Kafka Broker Replica Max Lag on kafka1018 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [5000000.0] [14:48:03] PROBLEM - Kafka Broker Replica Max Lag on kafka1014 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [5000000.0] [14:49:22] PROBLEM - Kafka Broker Replica Max Lag on kafka1018 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [5000000.0] [14:53:33] PROBLEM - Kafka Broker Replica Max Lag on kafka1014 is CRITICAL: CRITICAL: 75.00% of data above the critical threshold [5000000.0] [15:00:41] RECOVERY - Kafka Broker Replica Max Lag on kafka1018 is OK: OK: Less than 1.00% above the threshold [1000000.0] [15:01:12] RECOVERY - Kafka Broker Replica Max Lag on kafka1014 is OK: OK: Less than 1.00% above the threshold [1000000.0] [15:13:43] (03CR) 10Reedy: [C: 032] Remove execute bit from php files [mediawiki-config] - 10https://gerrit.wikimedia.org/r/253149 (owner: 10Reedy) [15:14:04] (03Merged) 10jenkins-bot: Remove execute bit from php files [mediawiki-config] - 10https://gerrit.wikimedia.org/r/253149 (owner: 10Reedy) [15:31:13] PROBLEM - Unmerged changes on repository mediawiki_config on mira is CRITICAL: There is one unmerged change in mediawiki_config (dir /srv/mediawiki-staging/). [15:32:24] "Exception encountered, of type "Exception" [15:32:46] Bsadowski1: Where? Doing what? [15:33:02] Meta [15:33:37] !log reedy@tin Synchronized wmf-config/: noop after chmod (duration: 00m 27s) [15:33:41] Viewing a page on Special:CentralAuth [15:33:41] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [15:34:41] Bsadowski1: Does it give you a code in some brackets? [15:35:01] RECOVERY - Unmerged changes on repository mediawiki_config on mira is OK: No changes to merge. [15:35:31] nope [15:35:36] Didn't give me anything else [15:35:49] Only happened once so far [15:36:34] meta.wikimedia.org, Reedy [15:36:49] 6operations, 10Wikimedia-Mailing-lists: Upgrade Mailman to version 3 - https://phabricator.wikimedia.org/T52864#1806672 (10MartinK) p:5Lowest>3High [15:40:50] 2015-11-15 15:31:52 mw1250 metawiki exception ERROR: [1fb254b8] /wiki/Special:CentralAuth/%E4%B8%89%E5%AE%85%E3%81%B2%E3%82%8D%E3%81%BF%E3%83%87%E3%83%A2%E3%82%AF%E3%83%A9%E3%82%B7%E3%83%BC Exception from line 2137 of /srv/mediawiki/php-1.27.0-wmf.6/extensions/CentralAuth/includes/CentralAuthUser.php: Could not find local user data for 三宅ひろみデモクラシー@jawiktionary {"exception_id":"1fb254b8"} [15:40:56] Bsadowski1: That user? [15:43:12] yp [15:43:14] yep* [15:43:28] lol [15:44:11] "Could not find local user data" [15:44:12] ? [15:44:24] But there is user data.. [15:44:52] https://phabricator.wikimedia.org/T115198#1717796 [15:45:33] It works fine for me. [15:58:36] 6operations: ganglia eqiad misc hosts includes numerous with ip rather than hostname - https://phabricator.wikimedia.org/T118690#1806677 (10Reedy) 3NEW [16:18:54] 6operations: ganglia eqiad misc hosts shows various openstack vms - https://phabricator.wikimedia.org/T118690#1806701 (10Reedy) [16:41:36] !log stopping eventlogging_sync for manual resync on dbstore1002 and db1047 [16:41:40] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [16:42:03] PROBLEM - puppet last run on cp3020 is CRITICAL: CRITICAL: puppet fail [17:08:23] RECOVERY - puppet last run on cp3020 is OK: OK: Puppet is currently enabled, last run 20 seconds ago with 0 failures [17:09:41] PROBLEM - puppet last run on mw1250 is CRITICAL: CRITICAL: Puppet has 1 failures [17:34:02] RECOVERY - puppet last run on mw1250 is OK: OK: Puppet is currently enabled, last run 14 seconds ago with 0 failures [18:03:53] !log disabling puppet, restarting mysql on es2008, es2009, es2010 for configuration check/upgrade [18:03:57] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [18:17:32] PROBLEM - HTTP 5xx req/min on graphite1001 is CRITICAL: CRITICAL: 26.67% of data above the critical threshold [500.0] [18:21:40] ^text esams had a glitch there some minutes ago [18:21:58] <_joe_> yup [18:22:03] <_joe_> hi :) [18:22:06] hi [18:22:09] <_joe_> at least I was just passing by [18:22:14] <_joe_> you are outright working! [18:22:22] <_joe_> tsk tsk [18:22:37] I do not have an excuse :-( [18:30:42] RECOVERY - HTTP 5xx req/min on graphite1001 is OK: OK: Less than 1.00% above the threshold [250.0] [18:32:08] 6operations, 7Database, 5Patch-For-Review: Set up TLS for MariaDB replication - https://phabricator.wikimedia.org/T111654#1806739 (10jcrespo) Too notes: * Install libjemalloc1 as dependency of the new package * I do not think an expiration time makes the setup more secure if it is not used for client authent... [19:38:57] (03PS2) 10Yuvipanda: etherpad: Add an autorestarter [puppet] - 10https://gerrit.wikimedia.org/r/253048 [19:39:30] (03PS3) 10Yuvipanda: etherpad: Add an autorestarter [puppet] - 10https://gerrit.wikimedia.org/r/253048 [19:45:40] (03CR) 10Umherirrender: "Please revisit this one-year-waiting-for-merge patch set and actually merge it or abandon it. Thanks." [software] - 10https://gerrit.wikimedia.org/r/141473 (owner: 10ArielGlenn) [19:47:11] (03CR) 10Umherirrender: "Please revisit this three-month-waiting-for-merge patch set and actually merge it or abandon it. Thanks." [dumps] - 10https://gerrit.wikimedia.org/r/207699 (owner: 10Dereckson) [19:51:20] (03CR) 10Umherirrender: "Please revisit this long-already-+2 patch set and decide to rebase+merge or abandon it. Thanks." [puppet] - 10https://gerrit.wikimedia.org/r/126031 (owner: 10Faidon Liambotis) [19:59:03] 6operations, 7Database, 5Patch-For-Review: Set up TLS for MariaDB replication - https://phabricator.wikimedia.org/T111654#1806764 (10jcrespo) I've done a test installation of the above between es2008 and its slaves. When I compared: On es2008: ``` tcpdump -i eth0 -s 0 -l -w - src host es1014.eqiad.wmnet | s... [21:45:03] PROBLEM - puppet last run on mw2102 is CRITICAL: CRITICAL: Puppet has 1 failures [21:51:22] PROBLEM - Kafka Broker Replica Max Lag on kafka1012 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [5000000.0] [21:53:32] PROBLEM - puppet last run on db2041 is CRITICAL: CRITICAL: Puppet has 1 failures [22:06:32] RECOVERY - Kafka Broker Replica Max Lag on kafka1012 is OK: OK: Less than 1.00% above the threshold [1000000.0] [22:13:23] RECOVERY - puppet last run on mw2102 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:19:52] RECOVERY - puppet last run on db2041 is OK: OK: Puppet is currently enabled, last run 6 seconds ago with 0 failures [22:56:40] 6operations, 7Database, 5Patch-For-Review: Set up TLS for MariaDB replication - https://phabricator.wikimedia.org/T111654#1806871 (10JanZerebecki) Having an expiration date is a formalized promise that we are able to do key rotation. If one is not able to do key rotation / replacement then one can not recove... [22:56:42] (03CR) 10MZMcBride: "Don't all three of you have access to mwgrep? It doesn't seem very surprising that you all would be in favor of adding another feature to " [puppet] - 10https://gerrit.wikimedia.org/r/246891 (https://phabricator.wikimedia.org/T114443) (owner: 10Ori.livneh)