[00:35:35] PROBLEM - Puppet errors on tools-exec-1404 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [01:10:34] RECOVERY - Puppet errors on tools-exec-1404 is OK: OK: Less than 1.00% above the threshold [0.0] [02:08:45] PROBLEM - Puppet errors on tools-exec-1441 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [02:38:43] RECOVERY - Puppet errors on tools-exec-1441 is OK: OK: Less than 1.00% above the threshold [0.0] [03:25:10] PROBLEM - Puppet errors on tools-exec-1415 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [04:21:55] PROBLEM - Puppet errors on tools-exec-1429 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [04:25:06] RECOVERY - Puppet errors on tools-exec-1415 is OK: OK: Less than 1.00% above the threshold [0.0] [04:48:42] PROBLEM - Puppet errors on tools-exec-1405 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [04:56:55] RECOVERY - Puppet errors on tools-exec-1429 is OK: OK: Less than 1.00% above the threshold [0.0] [05:01:59] 10Striker, 10Project-Admins: Allow self-service creation of Maniphest projects for Tools - https://phabricator.wikimedia.org/T144111#3484151 (10bd808) [05:48:42] RECOVERY - Puppet errors on tools-exec-1405 is OK: OK: Less than 1.00% above the threshold [0.0] [06:36:11] PROBLEM - Puppet errors on tools-exec-1431 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [07:06:08] RECOVERY - Puppet errors on tools-exec-1431 is OK: OK: Less than 1.00% above the threshold [0.0] [08:47:09] PROBLEM - Puppet errors on tools-worker-1005 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [09:17:21] PROBLEM - Puppet errors on tools-webgrid-generic-1401 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [09:27:10] RECOVERY - Puppet errors on tools-worker-1005 is OK: OK: Less than 1.00% above the threshold [0.0] [09:57:22] RECOVERY - Puppet errors on tools-webgrid-generic-1401 is OK: OK: Less than 1.00% above the threshold [0.0] [11:12:08] (03PS11) 10Paladox: Connect wikibugs to irc over ssl [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/328663 (https://phabricator.wikimedia.org/T141089) [11:12:11] (03CR) 10Paladox: "bump" [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/328663 (https://phabricator.wikimedia.org/T141089) (owner: 10Paladox) [11:17:54] (03PS4) 10Paladox: Add project phab-* [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/333531 [11:17:57] (03CR) 10Paladox: "bump" [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/333531 (owner: 10Paladox) [11:18:07] (03PS6) 10Paladox: Add phabricator-upstream to #wikimedia-dev and #wikimedia-devtools [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/333553 [11:18:10] (03CR) 10Paladox: "bump" [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/333553 (owner: 10Paladox) [13:18:20] PROBLEM - Puppet errors on tools-webgrid-generic-1401 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [14:03:20] RECOVERY - Puppet errors on tools-webgrid-generic-1401 is OK: OK: Less than 1.00% above the threshold [0.0] [14:30:25] PROBLEM - Puppet errors on tools-exec-1411 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [15:05:25] RECOVERY - Puppet errors on tools-exec-1411 is OK: OK: Less than 1.00% above the threshold [0.0] [15:16:42] * zhuyifei1999_ is making a list of tools that use external script/css/fonts/etc. with slimerjs [15:18:58] BAN THEM [15:19:00] BAN THEM ALL [15:19:09] lol +1 [15:37:50] the number of such tools are unbelievable [15:43:38] 10Cloud-Services, 10WMF-Legal, 10Epic, 10Privacy: [EPIC] Protect end-user privacy by restricting non-consentual third-party browser interactions - https://phabricator.wikimedia.org/T133919#3484423 (10zhuyifei1999) [16:25:31] 10Cloud-VPS, 10cloud-services-team (Kanban): New Trusty base images hang on boot - https://phabricator.wikimedia.org/T172064#3484445 (10Andrew) [16:29:38] 10Cloud-VPS, 10cloud-services-team (Kanban): New Trusty base images hang on boot - https://phabricator.wikimedia.org/T172064#3484460 (10Andrew) [16:29:49] 10Cloud-VPS, 10cloud-services-team (Kanban): New Trusty base images hang on boot - https://phabricator.wikimedia.org/T172064#3484445 (10Andrew) There are quite a few google hits about hangs after that 'random: nonblocking pool is initialized' message. Things I've tried: - Removing nfs-client from the base im... [16:40:30] PROBLEM - Puppet errors on tools-webgrid-lighttpd-1416 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [17:15:26] RECOVERY - Puppet errors on tools-webgrid-lighttpd-1416 is OK: OK: Less than 1.00% above the threshold [0.0] [17:35:24] bd808: just making sure, openstreepmap is also considered external and should not be loaded by browser directly right? [17:35:57] I remember wmf has a local install of the maps service but I can't remember the name [17:39:04] zhuyifei1999_: maps.wikimedia.org? [17:39:21] yeah thanks [17:39:49] difficult to remember that one.. ;D [17:41:40] 10Tools, 10Privacy: Hunt for Toolforge tools that loads resources for third party sites - https://phabricator.wikimedia.org/T172065#3484471 (10zhuyifei1999) [17:45:36] 103 tools :( [17:53:04] * zhuyifei1999_ will work on ^ later [17:54:38] quiddity: I think a phame post about fontcdn will definitely help [17:56:28] agreed! I was thinking we should get more details about cdnjs into it, too. Please do either poke at the draft, or leave notes below it or here that I can adapt. https://etherpad.wikimedia.org/p/cloudfontcdn [17:58:15] I'm terrible at writing these [17:58:54] cdnjs basically provides a lot of FOSS libraries [17:59:34] I think yuvi made the mirror [17:59:56] yup [18:00:14] https://phabricator.wikimedia.org/T96799 [18:00:17] Maybe you could throw together a minimal documentation page, for devs, at wikitech? [18:00:32] for fontcdn and/or cdnjs [18:01:17] basically just need links to the tools, links to the source, and showing a few examples for how devs should import the libraries/fonts into their tools [18:01:19] +1, didn't know it existed, will modify any of my tools which are in that list :) [18:01:39] hmm will do [18:03:12] How about a sub section "Resources" in https://wikitech.wikimedia.org/wiki/Help:Toolforge/Web ? [18:03:54] sure, that sounds good. +1 for mergism! [18:04:01] lol [18:12:32] * zhuyifei1999_ is such a bad writer, need some time [18:15:12] TheresNoTime: oh if you get your tools fixed please tell me which ones so I don't have to create subtasks for your tool :P (I'm lazy) [18:21:54] quiddity: does "common resources" sound right for this case? [18:22:38] Maybe with subheaders for cdnjs and fontcdn (so that they stand out in the ToC) ? [18:23:16] hmm [18:23:20] or just "Common resources - cdnjs and fontcdn" to keep it compact? [18:23:34] are there any/many other Common resources? [18:24:17] and maps from http://maps.wikimedia.org/ [18:24:46] a few tools are including directly from OSM and google maps [18:25:08] https://phabricator.wikimedia.org/P5825 [18:25:23] :o [18:25:39] I don't see other major resources [18:26:38] and "common resources" => probably not, google says it's an economics term [18:28:20] Headers can be fixed. Eventualism! Getting the links and examples in there, is the important part. (Maybe "== External libraries ==" ?) [18:28:56] I'm trying to think of a single term for FOSS libraries, FOSS fonts, and OSM maps that does not imply user's own static assets [18:29:08] assets? [18:29:36] hmm external assets, yeah [18:29:45] :) [18:49:35] quiddity: https://wikitech.wikimedia.org/wiki/Help:Toolforge/Web#External_assets [18:51:03] showing examples is somewhat difficult though [18:52:41] honestly front end devs should know how to include CSS/JS/Fonts. If I show real examples of various tools I would be biased (I'd link to those tools I'm aware of) [19:10:28] makes sense. [19:14:00] (I hate the way {{collapse}} makes section anchors scroll to the wrong place in Firefox. :< cf. T67468 ) [19:14:00] T67468: Redirects to section are off in Firefox 29.0.1 if there are collapsed elements above the section - https://phabricator.wikimedia.org/T67468 [19:14:59] yeah. I didn't know there's a ticket for that [19:27:52] re: cdnjs libraries, I see that our mirror is recommending outdated versions for "Use latest". https://tools.wmflabs.org/cdnjs/ E.g. Angular-touch is at version 1.6.5 but our mirror says "Use latest (1.5.7)". Is that intentional, or should I file a bug? [19:27:54] (IIUC, it is *not* related to https://github.com/cdnjs/cdnjs#latest-version-url-support and we should actually be linking devs to the latest available version in our UI, as they do at https://cdnjs.com/) [19:28:59] PROBLEM - Puppet errors on tools-exec-1420 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [19:32:10] https://tools-static.wmflabs.org/cdnjs/ajax/libs/angular-touch/ looks okay though [19:32:16] yeah file a bug [19:32:28] cc me [19:33:56] the relevant code for generating the index is https://github.com/wikimedia/labs-tools-cdnjs-index [19:35:16] 10Toolforge: cdnjs mirror not recommending latest version - https://phabricator.wikimedia.org/T172074#3484646 (10Quiddity) [19:35:53] * quiddity wanders off into the Big Blue Room for the rest of the day. o/ [19:36:41] @seen yuvipanda [19:37:08] wm-bot: hello? [19:42:10] 10Tool-Zppixbot, 10User-Zppix: add a feature to remind a certain user to do something - https://phabricator.wikimedia.org/T171931#3484664 (10Zppix) p:05Triage>03Normal a:03Zppix This is possible... will work on it ASAP [19:45:16] 10Tool-Zppixbot, 10User-Zppix: add a feature to remind a certain user to do something - https://phabricator.wikimedia.org/T171931#3484673 (10Zppix) 05Open>03Resolved https://github.com/Pix1234/ZppixBot-Source/commit/1e592af7aa4aca4d369cf5db1e2aa14ea3137470 [19:54:03] (03Draft2) 10Zppix: Due to rebranding of cloud i must again change my projects in this config. [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/368590 [19:55:40] bd808: I pm'ed yuvi and he said to ping you about this cdnjs issue [19:58:22] @ping [19:58:31] umm wm-bot appears to died zhuyifei1999_ [20:03:10] 10Cloud-Services, 10Quarry: Consider moving Quarry to be an installation of Redash - https://phabricator.wikimedia.org/T169452#3484686 (10yuvipanda) As a note, @zhuyifei1999 has graciously offered to look at some of the outstanding Quarry issues. I've given them merge rights + labs admin. [20:03:55] RECOVERY - Puppet errors on tools-exec-1420 is OK: OK: Less than 1.00% above the threshold [0.0] [20:10:23] !log quarry Yuvi gave me access after I asked about T76126 [20:10:26] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Quarry/SAL [20:10:26] T76126: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126 [20:20:54] 10cloud-services-team (Kanban), 10wikitech.wikimedia.org: removing a user from projectadmin on wikitech produces a blank page - https://phabricator.wikimedia.org/T172077#3484722 (10Andrew) [20:40:51] 10cloud-services-team (Kanban), 10wikitech.wikimedia.org: removing a user from projectadmin on wikitech produces a blank page - https://phabricator.wikimedia.org/T172077#3484722 (10bd808) A few errors in logstash that could be related: * https://logstash.wikimedia.org/app/kibana#/doc/logstash-*/logstash-2017.0... [20:40:57] 10Cloud-VPS, 10cloud-services-team (Kanban): New Trusty base images hang on boot - https://phabricator.wikimedia.org/T172064#3484740 (10Andrew) - building with a 4.x kernel instead of the default trusty kernel - rearranging the disk volumes to be /sda rather than /vda [20:43:00] !log tools.irclogbot added Reception123 as a maintainer (im assisting him with how toolforge works and helping him with a ircbot) [20:43:02] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.irclogbot/SAL [21:06:20] zhuyifei1999_: the frontend on tools is probably just out of date for cndjs. Did you make a task for it? [21:06:40] quiddity did [21:06:48] https://phabricator.wikimedia.org/T172074#3484646 [21:07:52] 10Toolforge, 10Tools: cdnjs mirror not recommending latest version - https://phabricator.wikimedia.org/T172074#3484761 (10bd808) [21:13:35] 10Cloud-VPS, 10cloud-services-team (Kanban): New Trusty base images hang on boot - https://phabricator.wikimedia.org/T172064#3484763 (10Andrew) Here are similar log snippets from an old, working image. Boot: ``` * Starting LDAP connection daemon nslcd ^[[80G ^M^[[74G[ OK ]^M * Stopping Handle applyi... [21:14:51] !log quarry `sudo git fetch; sudo git checkout 172eb7e` on /srv/quarry T76126 [21:14:53] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Quarry/SAL [21:14:53] T76126: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126 [21:17:07] !log quarry `sudo service uwsgi restart` T76126 [21:17:09] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Quarry/SAL [21:18:47] 10Toolforge, 10Tools: cdnjs mirror not recommending latest version - https://phabricator.wikimedia.org/T172074#3484646 (10bd808) The generator script is blowing up with: ``` Traceback (most recent call last): File "generate.py", line 31, in 'version': package['version'], KeyError: 'version' ``` [21:22:13] 10Quarry, 10Patch-For-Review: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3484768 (10zhuyifei1999) 05Open>03Resolved Package `python-xlsxwriter` was hand installed on `quarry-main-01` with `sudo apt install python-xlsxwriter`. This should be now fixed; pl... [21:25:14] (03Draft2) 10Zppix: Announce inital release of bot source code [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/368598 [21:25:17] (03CR) 10Zppix: [C: 032] Announce inital release of bot source code [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/368598 (owner: 10Zppix) [21:25:24] (03Merged) 10jenkins-bot: Announce inital release of bot source code [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/368598 (owner: 10Zppix) [21:27:54] (03Draft2) 10Zppix: fix typos [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/368599 [21:27:56] (03CR) 10Zppix: [C: 032] fix typos [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/368599 (owner: 10Zppix) [21:28:03] (03Merged) 10jenkins-bot: fix typos [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/368599 (owner: 10Zppix) [22:09:03] 10Toolforge, 10Tools: cdnjs mirror not recommending latest version - https://phabricator.wikimedia.org/T172074#3484783 (10zhuyifei1999) Where is cdnjsurl pointing to? I can't seem to reproduce this on https://cdnjs.com/packages.json [22:09:38] re: cdnjs, might https://phabricator.wikimedia.org/T172074 be related to https://phabricator.wikimedia.org/T144215 ? [22:11:08] (03PS1) 10BryanDavis: Handle packages missing a version key [labs/tools/cdnjs-index] - 10https://gerrit.wikimedia.org/r/368600 (https://phabricator.wikimedia.org/T172074) [22:11:08] quiddity: T144215 should affect tools-static if it were a problem [22:11:08] T144215: Setup monitoring for cdnjs git pull - https://phabricator.wikimedia.org/T144215 [22:11:10] (03PS1) 10BryanDavis: Add a README [labs/tools/cdnjs-index] - 10https://gerrit.wikimedia.org/r/368601 [22:11:51] nod. /me goes back to the too-hot outside, and then a movie theatre. [22:11:54] quiddity: I think the index is only generated when somebody thinks to do it [22:12:05] I've updated [22:12:14] and might just cron an update [22:15:37] (03CR) 10Zhuyifei1999: "template.html refers back to this information in:" [labs/tools/cdnjs-index] - 10https://gerrit.wikimedia.org/r/368600 (https://phabricator.wikimedia.org/T172074) (owner: 10BryanDavis) [22:16:39] READMEs are good. We like READMEs. <= lol [22:16:43] +1 [22:16:51] (03CR) 10BryanDavis: "> I don't think None makes sense in these cases. I'm pretty sure" [labs/tools/cdnjs-index] - 10https://gerrit.wikimedia.org/r/368600 (https://phabricator.wikimedia.org/T172074) (owner: 10BryanDavis) [22:17:34] zhuyifei1999_: whatever value in the giant list of things tripped on that missing key probably looks goofy in the index, but meh [22:17:46] * zhuyifei1999_ is looking [22:18:20] gerrit apparently doesn't think I'm cool enough to merge in that repo :/ [22:18:33] {u'license': u'MIT', u'description': u'Isomorphic WHATWG Fetch API, for Node & Browserify', u'repository': {u'url': u'https://github.com/matthew-andrews/isomorphic-fetch.git', u'type': u'git'}, u'author': u'Matt Andrews (http://mattandre.ws/)', u'filename': u'fetch-npm-browserify.min.js', u'keywords': [u'fetch', u'api', u'node', u'browserify'], u'autoupdate': {u'source': u'git', u'target': [22:18:33] u'https://github.com/matthew-andrews/isomorphic-fetch.git', u'fileMap': [{u'files': [u'fetch-!(npm-node|bower)*'], u'basePath': u''}]}, u'name': u'isomorphic-fetch'} [22:18:41] ^ is the one to blame [22:19:04] hmm, checking upstream [22:20:11] upstream does not seem to have this [22:21:22] https://github.com/cdnjs/cdnjs/issues/11054 hmm [22:24:20] (03PS1) 10BryanDavis: Allow review by toollabs-trusted [labs/tools/cdnjs-index] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/368602 [22:24:37] https://tools-static.wmflabs.org/cdnjs/ajax/libs/isomorphic-fetch/ an empty one indeed [22:25:59] PROBLEM - Puppet errors on tools-exec-1437 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [22:26:10] (03CR) 10Zhuyifei1999: "For the record, the issue maker is: https://tools-static.wmflabs.org/cdnjs/ajax/libs/isomorphic-fetch/" [labs/tools/cdnjs-index] - 10https://gerrit.wikimedia.org/r/368600 (https://phabricator.wikimedia.org/T172074) (owner: 10BryanDavis) [22:27:30] (03CR) 10Yuvipanda: [V: 032 C: 032] Allow review by toollabs-trusted [labs/tools/cdnjs-index] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/368602 (owner: 10BryanDavis) [22:28:42] (03CR) 10BryanDavis: [V: 032 C: 032] Handle packages missing a version key [labs/tools/cdnjs-index] - 10https://gerrit.wikimedia.org/r/368600 (https://phabricator.wikimedia.org/T172074) (owner: 10BryanDavis) [22:28:58] (03CR) 10BryanDavis: [V: 032 C: 032] Add a README [labs/tools/cdnjs-index] - 10https://gerrit.wikimedia.org/r/368601 (owner: 10BryanDavis) [22:37:20] 10Toolforge, 10Tools, 10cloud-services-team (Kanban), 10Patch-For-Review, 10User-bd808: cdnjs mirror not recommending latest version - https://phabricator.wikimedia.org/T172074#3484801 (10bd808) p:05Triage>03Normal a:03bd808 [22:38:29] 10cloud-services-team (Kanban), 10wikitech.wikimedia.org, 10MW-1.30-release-notes (WMF-deploy-2017-08-01_(1.30.0-wmf.12)), 10Patch-For-Review, 10User-bd808: removing a user from projectadmin on wikitech produces a blank page - https://phabricator.wikimedia.org/T172077#3484806 (10bd808) p:05Triage>03Hi... [22:45:53] 10Toolforge, 10Tools, 10cloud-services-team (Kanban), 10Patch-For-Review, 10User-bd808: cdnjs mirror not recommending latest version - https://phabricator.wikimedia.org/T172074#3484810 (10bd808) 05Open>03Resolved I fixed the index generation script so that it would deal with the busted https://tools-... [23:01:02] RECOVERY - Puppet errors on tools-exec-1437 is OK: OK: Less than 1.00% above the threshold [0.0] [23:02:02] hey guys, anyone with more permission on nfs of tools project, nfs-tools:/project/tools/project around? I did something wrong and don't have permission to revert my work, it would be nice if someone could help me. [23:07:34] !help [23:07:34] ebraminio: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team [23:07:40] ebraminio: I don't have more permissions, but might be able to help if you explain your issue [23:08:18] ebraminio: hi. what needs fixing? [23:10:12] bd808: Can I send a pm? [23:10:19] sure [23:13:02] zhuyifei1999_: Thank you for your help, zhuyifei, btw :) [23:13:37] np, did nothing though [23:18:24] PROBLEM - Puppet errors on tools-bastion-03 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [23:20:32] !log tools.paws Fixed permissions for uid 6254475's homedir [23:20:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.paws/SAL [23:26:08] zhuyifei1999_: but your willingness is highly valuable, keep up the good work :) [23:53:25] RECOVERY - Puppet errors on tools-bastion-03 is OK: OK: Less than 1.00% above the threshold [0.0]