[01:32:08] <wikibugs>	 06Labs, 10Tool-Labs, 06Community-Tech-Tool-Labs, 07Documentation: Create a "my first Pywikibot bot" tutorial for Tool Labs - https://phabricator.wikimedia.org/T134495#2683383 (10bd808) >>! In T134495#2682642, @Vaishnav980123 wrote: > I would like to work on this bug.  @Vaishnav980123 awesome! Do you have e...
[01:57:23] <shinken-wm>	 PROBLEM - Puppet staleness on tools-worker-1005 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]
[02:29:55] <zhuyifei1999_>	 mhashemi: uh. fyi: https://wikitech.wikimedia.org/wiki/Help:Tool_Labs/Database#Connection_handling_policy
[02:56:05] <wm-bot>	 Change on 12www.mediawiki.org a page OAuth/For Developers was modified, changed by Tgr (WMF) link https://www.mediawiki.org/w/index.php?diff=2251775 edit summary: Undo revision 1663121 by [[Special:Contributions/Salwati6|Salwati6]] ([[User talk:Salwati6|talk]]): test edit? does not make much sense
[02:57:09] <wm-bot>	 Change on 12www.mediawiki.org a page OAuth/For Developers was modified, changed by Tgr (WMF) link https://www.mediawiki.org/w/index.php?diff=2251776 edit summary: /* Application Approval */
[03:32:09] <wikibugs>	 06Labs, 06Operations, 10wikitech.wikimedia.org: Can't login wikitech - https://phabricator.wikimedia.org/T144805#2610832 (10Liuxinyu970226) I also have this problem since March, before that I never set that thing
[03:39:25] <wikibugs>	 10Tool-Labs-tools-Erwin's-tools: For related changes make category changes switchable. - https://phabricator.wikimedia.org/T146594#2683471 (10Akoopal) If I understand you correctly you want to just always hide wikidata and category edits? I do think it is usefull to see the wikidata-edits, marked as such, and si...
[04:35:03] <shinken-wm>	 PROBLEM - Free space - all mounts on tools-worker-1018 is CRITICAL: CRITICAL: tools.tools-worker-1018.diskspace._var_lib_docker.byte_percentfree (No valid datapoints found)tools.tools-worker-1018.diskspace.root.byte_percentfree (<100.00%)
[05:26:35] <wikibugs>	 06Labs, 06Operations, 10wikitech.wikimedia.org: Can't login wikitech - https://phabricator.wikimedia.org/T144805#2683492 (10zhuyifei1999) March? sounds like related to T130892. Pinging @csteipp @dpatrick @jcrespo
[06:34:29] <wikibugs>	 06Labs, 10Labs-Infrastructure, 10DBA, 07Upstream: db1069: convert user_groups table to InnoDB across all the wikis - https://phabricator.wikimedia.org/T146121#2683543 (10Marostegui) S3 tables have been converted to InnoDB.
[06:43:12] <wikibugs>	 06Labs, 10Labs-Infrastructure, 10DBA, 07Upstream: db1069: convert user_groups table to InnoDB across all the wikis - https://phabricator.wikimedia.org/T146121#2683563 (10Marostegui) S4 (commonswiki database) table has been converted
[06:47:23] <wikibugs>	 06Labs, 10Labs-Infrastructure, 10DBA, 07Upstream: db1069: convert user_groups table to InnoDB across all the wikis - https://phabricator.wikimedia.org/T146121#2683567 (10Marostegui) S5 (dewiki and wikidatawiki) table converted
[06:50:57] <wikibugs>	 06Labs, 10Labs-Infrastructure, 10DBA, 07Upstream: db1069: convert user_groups table to InnoDB across all the wikis - https://phabricator.wikimedia.org/T146121#2683573 (10Marostegui) S6 (frwiki, jawiki, ruwiki) converted
[06:53:14] <wikibugs>	 06Labs, 10Labs-Infrastructure, 10DBA, 07Upstream: db1069: convert user_groups table to InnoDB across all the wikis - https://phabricator.wikimedia.org/T146121#2683575 (10Marostegui) S7 tables converted
[06:56:29] <wikibugs>	 06Labs, 10Labs-Infrastructure, 10DBA, 07Upstream: mysqld process hang in db1069 - S2 mysql instance - https://phabricator.wikimedia.org/T145077#2683577 (10Marostegui)
[06:56:31] <wikibugs>	 06Labs, 10Labs-Infrastructure, 10DBA, 07Upstream: db1069: convert user_groups table to InnoDB across all the wikis - https://phabricator.wikimedia.org/T146121#2683576 (10Marostegui) 05Open>03Resolved
[07:55:03] <grrrit-wm>	 (03PS2) 10Lokal Profil: Re-factor test of getCommonscatTemplates [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/313760 (https://phabricator.wikimedia.org/T145574) 
[07:55:08] <grrrit-wm>	 (03CR) 10Lokal Profil: Re-factor test of getCommonscatTemplates (031 comment) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/313760 (https://phabricator.wikimedia.org/T145574) (owner: 10Lokal Profil)
[08:04:32] <grrrit-wm>	 (03CR) 10Lokal Profil: "Looks good at a first glance. Will look into it deeper later." [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/313766 (https://phabricator.wikimedia.org/T145333) (owner: 10Jean-Frédéric)
[08:47:37] <wikibugs>	 10Wikibugs, 07Easy, 13Patch-For-Review: Change Project-Creators to Project-Admins in channels.yaml - https://phabricator.wikimedia.org/T142851#2683673 (10Vaishnav980123) @Paladox I am really sorry that I removed the claim once after assigning it. I didn't knew that I can't do that once after adding my claim.
[09:50:14] <wikibugs>	 10Wikibugs, 07Easy, 13Patch-For-Review: Change Project-Creators to Project-Admins in channels.yaml - https://phabricator.wikimedia.org/T142851#2683749 (10Paladox) Yep sorry I didn't realise that there was a hackathon yesterday so sorry for mistakenly thinking you were a spammer.  I won't be doing that again,...
[09:57:37] <grrrit-wm>	 (03CR) 10Lokal Profil: [C: 032] Updating .gitignore [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/313755 (owner: 10Lokal Profil)
[09:59:28] <grrrit-wm>	 (03Merged) 10jenkins-bot: Updating .gitignore [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/313755 (owner: 10Lokal Profil)
[10:08:04] <wikibugs>	 06Labs, 10Labs-Infrastructure: Experiment with Linux KSM (dedupe memory shared by instances) on labs infra - https://phabricator.wikimedia.org/T146037#2683791 (10hashar) p:05Triage>03Low
[10:09:27] <godog>	 provisioning a new jessie instance in deployment-prep failed with https://phabricator.wikimedia.org/T123734#2683773 is this known? deployment-prep specific?
[10:10:51] <yuvipanda>	 godog: was there another instance of that name before?
[10:10:53] <wikibugs>	 06Labs, 10Labs-Infrastructure: Plan deprecation of all precise instances in Labs - https://phabricator.wikimedia.org/T143349#2565438 (10hashar) For CI , we need to keep some Precise instances which are used to run Zend PHP 5.3 tests.   That is until MediaWiki 1.23 LTS reaches end of life in May 2017 ([[ https:...
[10:11:13] <godog>	 yuvipanda: good point, I don't know, is there a way to find out?
[10:11:38] <yuvipanda>	 godog: not entirely sure. I'd recommend deleting it and recreating with an incremneted counter number
[10:11:47] <yuvipanda>	 godog: not the most useful answer, but that error is pretty much unrecoverable
[10:12:04] <godog>	 ack, I'll try that thanks yuvipanda !
[10:16:59] <godog>	 yuvipanda: yep that was it -- thanks!
[11:54:16] <grrrit-wm>	 (03CR) 10Jean-Frédéric: [C: 032] Re-factor test of getCommonscatTemplates [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/313760 (https://phabricator.wikimedia.org/T145574) (owner: 10Lokal Profil)
[11:55:41] <grrrit-wm>	 (03Merged) 10jenkins-bot: Re-factor test of getCommonscatTemplates [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/313760 (https://phabricator.wikimedia.org/T145574) (owner: 10Lokal Profil)
[13:10:28] <wikibugs>	 10Tool-Labs-tools-Erwin's-tools: For related changes make category changes switchable. - https://phabricator.wikimedia.org/T146594#2684233 (10Nemo_bis) > I do think it is usefull to see the wikidata-edits, marked as such, and similar to see the category edits.   Ok then, nevermind.  > Do you know which rc_type n...
[14:47:29] <wikibugs>	 06Labs, 06Operations, 10wikitech.wikimedia.org: Can't login wikitech - https://phabricator.wikimedia.org/T144805#2684464 (10jcrespo) Of those, @dpatrick is probably the right person that knows, but I am standing by in case something is needed from my side.
[14:58:38] <wikibugs>	 06Labs: I get lags during stats reading through API - https://phabricator.wikimedia.org/T147109#2684507 (10Anomie) This seems very unlikely to have anything at all to do with the API beyond that the program is trying to access it. Removing #MediaWiki-API.
[14:59:57] <shinken-wm>	 RECOVERY - Host tools-secgroup-test-103 is UP: PING OK - Packet loss = 0%, RTA = 0.79 ms
[15:23:20] <shinken-wm>	 PROBLEM - Host tools-secgroup-test-103 is DOWN: CRITICAL - Host Unreachable (10.68.21.22)
[15:38:35] <shinken-wm>	 RECOVERY - Host secgroup-lag-102 is UP: PING OK - Packet loss = 0%, RTA = 0.95 ms
[15:40:09] <Krenair>	 !log deployment-prep upgraded cache-upload04 to varnish4. hieradata is set on the prefix deployment-cache-upload
[15:40:14] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL, Master
[15:47:01] <shinken-wm>	 PROBLEM - Host secgroup-lag-102 is DOWN: CRITICAL - Host Unreachable (10.68.17.218)
[16:18:53] <wikibugs>	 06Labs, 10Tool-Labs: Create more trusty nodes in anticipation of the default for jsub switching to trusty - https://phabricator.wikimedia.org/T147205#2684787 (10yuvipanda)
[16:21:40] <wikibugs>	 06Labs, 10Tool-Labs: Create more trusty nodes in anticipation of the default for jsub switching to trusty - https://phabricator.wikimedia.org/T147205#2684807 (10bd808)
[16:22:57] <wikibugs>	 06Labs, 10Tool-Labs: Create more trusty nodes in anticipation of the default for jsub switching to trusty - https://phabricator.wikimedia.org/T147205#2684787 (10bd808)
[16:22:59] <wikibugs>	 06Labs, 10Tool-Labs, 06Community-Tech-Tool-Labs, 07Epic, 15User-bd808: Make jsub / qsub default to trusty instances - https://phabricator.wikimedia.org/T94792#2684811 (10bd808)
[16:24:41] <wikibugs>	 06Labs, 10Tool-Labs, 06Community-Tech-Tool-Labs, 07Epic, 15User-bd808: Make jsub / qsub default to trusty instances - https://phabricator.wikimedia.org/T94792#1172741 (10bd808) Announced planned date (week of 2016-10-17) for switch of default from Precise to Trusty on labs-announce: https://lists.wikimed...
[17:05:56] <wikibugs>	 06Labs, 06Operations, 10Wikimedia-IRC-RC-Server, 10wikitech.wikimedia.org, 13Patch-For-Review: Enable irc feed for wikitech.wikimedia.org site - https://phabricator.wikimedia.org/T36685#2685039 (10Meno25)
[17:06:21] <wikibugs>	 06Labs, 10wikitech.wikimedia.org: [wikitech] Use SSL in interwiki map for WMF wikis - https://phabricator.wikimedia.org/T37826#2685042 (10Meno25)
[17:06:37] <wikibugs>	 06Labs, 10wikitech.wikimedia.org: Specal:NovaRole - sort members alphabetically in Add member dialog - https://phabricator.wikimedia.org/T38516#2685045 (10Meno25)
[18:23:27] <wikibugs>	 06Labs, 10Horizon, 13Patch-For-Review: Horizon dashboard for managing instance puppet config - https://phabricator.wikimedia.org/T91990#2685453 (10Andrew)
[18:23:29] <wikibugs>	 06Labs, 10Horizon, 13Patch-For-Review: Create puppet backend with REST api for labs instance configuration - https://phabricator.wikimedia.org/T133412#2685452 (10Andrew) 05Open>03Resolved
[18:24:04] <wikibugs>	 06Labs, 10Horizon, 07Tracking: Make OpenStack Horizon useful for production labs - https://phabricator.wikimedia.org/T87279#2685457 (10Andrew)
[18:24:06] <wikibugs>	 06Labs, 10Horizon, 13Patch-For-Review: Horizon dashboard for managing instance puppet config - https://phabricator.wikimedia.org/T91990#1100592 (10Andrew) 05Open>03Resolved
[18:44:21] <Highchiller>	 Hey guys, my supervisor Howard Cohl wants to give me access to one of the instances like bastion.wmflabs.org, but he forget how to do it. Can you explain me/him how he can set this up?
[18:51:36] <Krenair>	 Highchiller, I don't know who Howard Cohl is but have you created an account on wikitech.wikimedia.org?
[18:52:35] <bd808>	 Highchiller: You need to have a Wikitech account, configure your ssh public key, and then be added to a Labs project as a member. -- https://wikitech.wikimedia.org/wiki/Help:Access
[18:57:28] <Highchiller>	 He simply don't know where he can add me to a labs project as a member. (I already have an account on wikitech)
[18:58:49] <Krenair>	 what do you want to do in labs exactly?
[18:59:08] <Krenair>	 he might not be able to add you to where you want to go
[19:11:50] <Howie>	 Hi. I am admin @Hcohl and I would like to give a new user access to an instance drmf-beta. Can you help me remember how to do this?
[19:12:24] <Howie>	 I am admin for math project
[19:13:44] <chasemp>	 Howie: go to https://wikitech.wikimedia.org/wiki/Special:NovaProject and select your project, add member and then add member again for project admin once they are in the project
[19:14:22] <Howie>	 I am here now: https://wikitech.wikimedia.org/w/index.php?title=Special:NovaProject&action=addmember&projectid=math
[19:14:56] <tom29739>	 Howie, that's the right page
[19:15:21] <tom29739>	 just put the user you want to add to your project in the box and press submit.
[19:15:23] <Howie>	 I tried to submit his username, but it has given me no response.
[19:15:33] <tom29739>	 (usernames are case-sensitive)
[19:15:38] <Howie>	 oh wait
[19:16:21] <Howie>	 Ok cool. and this will give him access to all math instances? 
[19:18:00] <Krenair>	 yes, unless you have other access restrictions on any of those instances
[19:19:04] <Howie>	 Ok. thanks. He's trying to access it now.
[19:22:01] <tom29739>	 Howie, he won't be able to create new instances or delete them though, unless you make him a project admin.
[19:22:51] <Howie>	 tom29739: yes I understand that. We just need him to be able to access the instances, not create any instances.
[19:23:02] <tom29739>	 Ah, OK.
[19:37:18] <shinken-wm>	 PROBLEM - Puppet run on tools-docker-builder-01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[19:45:22] <myrcx>	 yuvi/any Quarry people - my query 12390 shows its been running for a week (I doubt it is)
[19:45:53] <wm-bot>	 Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Tobias47n9e was created, changed by Tobias47n9e link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Tobias47n9e edit summary: Created page with "{{Tools Access Request |Justification=I would like to host a website (Django framework) for the Commons Mobile App. The existing page is here (https://commons-app.github.io/)...."
[19:49:39] <Krenair>	 yeah doesn't appear to actually be executing myrcx 
[19:50:09] <myrcx>	 Krenair: thanks for checking :)
[19:51:57] <bd808>	 !log tools.jouncebot Updated to e7c333d (Only log on_join for our own nick)
[19:52:01] <labs-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.jouncebot/SAL, Master
[19:53:46] <Krenair>	 krenair@quarry-main-01:~$ sudo -i mysql quarry -se "select count(*) from query_run where status = 2;"
[19:53:46] <Krenair>	 count(*)
[19:53:47] <Krenair>	 968
[19:54:24] <Krenair>	 2 is QueryRun.STATUS_RUNNING
[21:00:27] <wm-bot>	 Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/G was created, changed by G link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/G edit summary: Created page with "{{Tools Access Request |Justification=I have created the tool IsbnCheckAndFormat, that has been uploaded to Toolserver by Cyroxx and to toollabs by Ireas. As both are inactive..."
[21:08:19] <wikibugs>	 06Labs, 10Beta-Cluster-Infrastructure: Replace all class imports on Labs with role imports - https://phabricator.wikimedia.org/T147233#2686048 (10Andrew)
[21:37:22] <wikibugs>	 06Labs, 10Labs-Infrastructure, 10DBA, 07Upstream: mysqld process hang in db1069 - S2 mysql instance - https://phabricator.wikimedia.org/T145077#2686158 (10jcrespo) I would say T146121 mitigates this issue by a lot. Maybe closing it as resolved or stalled, unless we expect a proper fix from upstream?
[21:45:43] <wikibugs>	 06Labs, 10Beta-Cluster-Infrastructure, 13Patch-For-Review: Replace all class imports on Labs with role imports - https://phabricator.wikimedia.org/T147233#2686205 (10Andrew)
[21:53:14] <wikibugs>	 06Labs, 10Beta-Cluster-Infrastructure, 13Patch-For-Review: Replace all class imports on Labs with role imports - https://phabricator.wikimedia.org/T147233#2686255 (10Andrew)
[22:10:39] <addshore>	 *waves*
[22:10:53] <addshore>	 Who here is a tool labs admin then? bd808?
[22:11:08] <bd808>	 addshore: what's up?
[22:11:11] <addshore>	 pm :0
[22:11:13] <addshore>	 :)
[22:11:30] <bd808>	 *nod*
[22:14:32] <chasemp>	 I'm around but in a meeting if things are up :)
[22:36:40] <wikibugs>	 06Labs, 10Beta-Cluster-Infrastructure, 13Patch-For-Review: Replace all class imports on Labs with role imports - https://phabricator.wikimedia.org/T147233#2686339 (10Andrew)
[23:05:39] <wikibugs>	 10Wikibugs, 07Easy, 13Patch-For-Review: Change Project-Creators to Project-Admins in channels.yaml - https://phabricator.wikimedia.org/T142851#2686379 (10Paladox) @Vaishnav980123 if you want to try, you could copy my patch that is linked above in gerrit and we can go with your patch if you want?
[23:20:54] <shinken-wm>	 PROBLEM - Host tools-secgroup-test-102 is DOWN: CRITICAL - Host Unreachable (10.68.21.170)
[23:45:50] <shinken-wm>	 PROBLEM - Puppet run on tools-services-02 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0]
[23:48:08] <wikibugs>	 06Labs, 10Tool-Labs, 06Collaboration-Team-Triage, 06Community-Tech-Tool-Labs, and 5 others: Enable Flow on wikitech (labswiki and labtestwiki), then turn on for Tool talk namespace - https://phabricator.wikimedia.org/T127792#2686484 (10Mattflaschen-WMF) We should either: * Update wikitech-static scripts im...