[00:13:41] <shinken-wm>	 RECOVERY - Puppet errors on tools-exec-1417 is OK: OK: Less than 1.00% above the threshold [0.0]
[00:32:42] <wikibugs_>	 10PAWS, 10Toolforge: Mysterious iptables rule suddenly required to keep networking inside pods working - https://phabricator.wikimedia.org/T177363#3655934 (10yuvipanda)
[00:37:03] <bd808>	 HaeB: PAWS is back. What broke it is still a bit mysterious
[00:38:14] <HaeB>	 bd808: \o/ thanks
[00:38:22] <HaeB>	 (wmf now)
[00:38:35] <HaeB>	 *cough* wfm i mean
[00:39:03] <bd808>	 HaeB: it was all Yuvi. Buy him a milkshake sometime :)
[00:41:16] <wikibugs_>	 10PAWS, 10Toolforge: Mysterious iptables rule suddenly required to keep networking inside pods working - https://phabricator.wikimedia.org/T177363#3655973 (10bd808) First notification that it was broken came on irc at 2017-10-03T21:34. From the last activity report it seems likely that things were working with...
[00:49:42] <wikibugs_>	 10PAWS, 10Toolforge: Mysterious iptables rule suddenly required to keep networking inside pods working - https://phabricator.wikimedia.org/T177363#3655987 (10yuvipanda) on a personal note, at some point in the debugging I was ready to give up and let PAWS die - thankfully with some encouragement from @bd808 an...
[00:49:59] <wikibugs_>	 10PAWS, 10Toolforge: PAWS outage of unknown cause - https://phabricator.wikimedia.org/T177363#3655990 (10yuvipanda)
[01:55:52] <HaeB>	 bd808: will be happy to ;) in the meantime, please convey my appreciations to mater yuvi
[02:08:53] <wikibugs_>	 10Tool-Pageviews: Add URL parameters to show/hide log scale and start Y-axis from zero - https://phabricator.wikimedia.org/T140783#3656015 (10jeremyb)
[02:10:59] <wikibugs_>	 10Tool-Pageviews: Add URL parameters to show/hide log scale and start Y-axis from zero - https://phabricator.wikimedia.org/T140783#2475849 (10jeremyb) @MusikAnimal does this still work? I don't see any way to get the page to load with the "Logarithmic scale" box already checked. (with `&autolog=false`, `&autolog...
[02:23:47] <wikibugs_>	 10Tool-Pageviews: Add URL parameters to show/hide log scale and start Y-axis from zero - https://phabricator.wikimedia.org/T140783#3656045 (10MusikAnimal) >>! In T140783#3656016, @jeremyb wrote: > @MusikAnimal does this still work? I don't see any way to get the page to load with the "Logarithmic scale" box alre...
[02:37:28] <wikibugs_>	 10Tool-Pageviews: Add URL parameters to show/hide log scale and start Y-axis from zero - https://phabricator.wikimedia.org/T140783#3656051 (10jeremyb) yes please!  but...  https://www.w3.org/Provider/Style/URI.html
[02:41:54] <wikibugs_>	 10Tool-Pageviews: Add logscale option - https://phabricator.wikimedia.org/T177369#3656055 (10MusikAnimal)
[02:42:04] <wikibugs_>	 10Tool-Pageviews: Add URL parameters to show/hide log scale and start Y-axis from zero - https://phabricator.wikimedia.org/T140783#2475849 (10MusikAnimal) >>! In T140783#3656051, @jeremyb wrote: > yes please! >  > but... >  > https://www.w3.org/Provider/Style/URI.html  Hehe yes, the old parameter will still work...
[02:42:38] <wikibugs_>	 10Tool-Pageviews: Add logscale option - https://phabricator.wikimedia.org/T177369#3656055 (10MusikAnimal)
[02:50:04] <shinken-wm>	 PROBLEM - Puppet errors on tools-bastion-03 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0]
[03:04:40] <shinken-wm>	 PROBLEM - Puppet errors on tools-exec-1417 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0]
[03:30:02] <shinken-wm>	 RECOVERY - Puppet errors on tools-bastion-03 is OK: OK: Less than 1.00% above the threshold [0.0]
[03:39:40] <shinken-wm>	 RECOVERY - Puppet errors on tools-exec-1417 is OK: OK: Less than 1.00% above the threshold [0.0]
[03:51:03] <shinken-wm>	 PROBLEM - Puppet errors on tools-bastion-03 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0]
[04:56:02] <shinken-wm>	 RECOVERY - Puppet errors on tools-bastion-03 is OK: OK: Less than 1.00% above the threshold [0.0]
[05:35:41] <shinken-wm>	 PROBLEM - Puppet errors on tools-exec-1417 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0]
[06:30:14] <shinken-wm>	 PROBLEM - Puppet errors on tools-webgrid-lighttpd-1412 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0]
[06:34:41] <shinken-wm>	 PROBLEM - Puppet errors on tools-exec-1440 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0]
[06:38:43] <shinken-wm>	 PROBLEM - Puppet errors on tools-exec-1438 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0]
[06:40:01] <shinken-wm>	 PROBLEM - Puppet errors on tools-webgrid-lighttpd-1411 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0]
[06:55:21] <shinken-wm>	 PROBLEM - Puppet errors on tools-webgrid-lighttpd-1424 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0]
[07:09:41] <shinken-wm>	 RECOVERY - Puppet errors on tools-exec-1440 is OK: OK: Less than 1.00% above the threshold [0.0]
[07:10:13] <shinken-wm>	 RECOVERY - Puppet errors on tools-webgrid-lighttpd-1412 is OK: OK: Less than 1.00% above the threshold [0.0]
[07:14:54] <awight>	 bd808: ^ genius alert
[07:15:02] <shinken-wm>	 RECOVERY - Puppet errors on tools-webgrid-lighttpd-1411 is OK: OK: Less than 1.00% above the threshold [0.0]
[07:16:25] <TheFartingNigga>	 awight: anyone can change the topic here, dumbass
[07:16:30] <TheFartingNigga>	 you dont need ops
[07:16:47] <awight>	 boring
[07:18:45] <shinken-wm>	 RECOVERY - Puppet errors on tools-exec-1438 is OK: OK: Less than 1.00% above the threshold [0.0]
[07:20:57] <NIGGGGGGGGGGGGER>	 !ops
[07:20:58] <wm-bot>	 NIGGGGGGGGGGGGER: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team
[07:21:32] <NIGGGGGGGGGGGGER>	 ChanServ,  bd808,  icinga-wm,  shinken-wm,  stashbot,  wikibugs_,  wm-bot,  abartov,  abbe98[m],  abian,  addshore,  Akoopal,  akosiaris,  AlexZ,  AmandaNP,  Amir1,  andre__,  andrewbogott,  anomie,  aude,  Audrey,  basile,  bblack,  bearloga,  Betacommand,  brion,  chasemp,  CIA,  closedmouth,  comets: 
[07:21:44] <NIGGGGGGGGGGGGER>	 cormacparle,  cscott,  csyogi,  Cyberpower678,  Danny_B,  dapatrick,  DatGuy,  dcausse,  Dispenser,  doctaxon,  dr0ptp4kt,  dungodung,  e,  Earwig,  eddiegp,  edsu,  ema,  enterprisey,  Esther,  FastLizard4,  fluff,  Freddy2001,  Garnig,  gehel,  ggp,  gilles,  godog,  greg-g,  gwicke: 
[07:21:50] <Zackary>	 ey AlexZ if you would pls?
[07:21:51] <NIGGGGGGGGGGGGER>	 hi _joe_ 
[07:22:10] <NIGGGGGGGGGGGGER>	 dont kick me, nigger.  or i'll have to call my buddies at the Ku Klux Klan
[07:22:25] <NIGGGGGGGGGGGGER>	 and we shall all hail Hitler
[07:25:26] <NIGGGGGGGGGGGGER>	 !ops
[07:25:26] <wm-bot>	 NIGGGGGGGGGGGGER: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team
[07:25:36] <NIGGGGGGGGGGGGER>	 !ops fart
[07:25:36] <wm-bot>	 NIGGGGGGGGGGGGER: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team
[07:25:43] <NIGGGGGGGGGGGGER>	 pooooooooooooooooooooooooooop
[07:28:15] <_joe_>	 http://img.chan4chan.com/img/2009-03-28/dear_italian.jpg
[07:28:15] <NIGGGGGGGGGGGGER>	 elukey: hello
[07:28:19] <NIGGGGGGGGGGGGER>	 are you a nigger?
[07:28:28] <NIGGGGGGGGGGGGER>	 _joe_: do you still suck dicks?
[07:30:23] <shinken-wm>	 RECOVERY - Puppet errors on tools-webgrid-lighttpd-1424 is OK: OK: Less than 1.00% above the threshold [0.0]
[07:30:49] <Zackary>	 welp
[07:31:11] <Matthew_>	 Same time, no worries :)
[07:31:16] <_joe_>	 thanks
[07:31:18] <Zackary>	 :)
[07:31:33] <Zackary>	 wonder why the topic isn't ops only tho
[07:31:37] <_joe_>	 I'm in the process of reporting this genius to his provider and authorities
[07:33:08] <Matthew_>	 Zackary: Because theoretically topic change abuse doesn't happen that often.  All tech channels are set up that way. 
[07:33:19] <Zackary>	 ah
[07:33:39] * Matthew_ shrugs
[07:41:54] <jynus>	 I am not an ops, but I normally help informing of issues through topic changes, for example
[07:48:51] <wikibugs_>	 10Toolforge, 10Tools, 10cloud-services-team (FY2017-18), 10Community-Liaisons (Oct-Dec 2017), 10Goal: Find and promote tools and their authors - https://phabricator.wikimedia.org/T176677#3656333 (10Qgil) This task is a #goal. Please define the #cloud-services-team  support request following the template...
[08:17:03] <shinken-wm>	 PROBLEM - Puppet errors on tools-bastion-03 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0]
[08:20:40] <shinken-wm>	 RECOVERY - Puppet errors on tools-exec-1417 is OK: OK: Less than 1.00% above the threshold [0.0]
[08:41:41] <shinken-wm>	 PROBLEM - Puppet errors on tools-exec-1417 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0]
[08:47:03] <shinken-wm>	 PROBLEM - Puppet errors on tools-webgrid-lighttpd-1413 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0]
[08:57:05] <shinken-wm>	 RECOVERY - Puppet errors on tools-bastion-03 is OK: OK: Less than 1.00% above the threshold [0.0]
[09:22:04] <shinken-wm>	 RECOVERY - Puppet errors on tools-webgrid-lighttpd-1413 is OK: OK: Less than 1.00% above the threshold [0.0]
[09:27:09] <shinken-wm>	 PROBLEM - Puppet errors on tools-exec-1407 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0]
[09:31:46] <wikibugs_>	 10PAWS: PAWS - Redirect loop detected - https://phabricator.wikimedia.org/T175454#3656583 (10Liridon) Today it works.
[09:36:04] <gehel>	 Hey! I need to merge https://gerrit.wikimedia.org/r/#/c/380993/ related to "striker". Anyone knows anything about striker?
[09:44:18] <gehel>	 bd808: when you are around, could you have a look at https://gerrit.wikimedia.org/r/#/c/380993/ ? Please and thank you!
[09:46:39] <shinken-wm>	 RECOVERY - Puppet errors on tools-exec-1417 is OK: OK: Less than 1.00% above the threshold [0.0]
[10:02:09] <shinken-wm>	 RECOVERY - Puppet errors on tools-exec-1407 is OK: OK: Less than 1.00% above the threshold [0.0]
[10:12:40] <shinken-wm>	 PROBLEM - Puppet errors on tools-exec-1417 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0]
[10:13:29] <shinken-wm>	 PROBLEM - Puppet errors on tools-bastion-02 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0]
[10:48:31] <shinken-wm>	 RECOVERY - Puppet errors on tools-bastion-02 is OK: OK: Less than 1.00% above the threshold [0.0]
[10:54:52] <wikibugs_>	 (03PS134) 10Ricordisamoa: Initial commit [labs/tools/wikidata-slicer] - 10https://gerrit.wikimedia.org/r/241296
[11:03:16] <wikibugs_>	 (03CR) 10Ricordisamoa: [C: 04-2] "PS134 updates ESLint from ~4.7.1 to ~4.8.0" [labs/tools/wikidata-slicer] - 10https://gerrit.wikimedia.org/r/241296 (owner: 10Ricordisamoa)
[11:30:37] <shinken-wm>	 PROBLEM - Puppet errors on tools-webgrid-generic-1404 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0]
[11:53:02] <shinken-wm>	 PROBLEM - Puppet errors on tools-webgrid-lighttpd-1413 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0]
[12:10:36] <shinken-wm>	 RECOVERY - Puppet errors on tools-webgrid-generic-1404 is OK: OK: Less than 1.00% above the threshold [0.0]
[12:32:52] <shinken-wm>	 PROBLEM - Puppet errors on tools-exec-1431 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0]
[12:53:03] <shinken-wm>	 RECOVERY - Puppet errors on tools-webgrid-lighttpd-1413 is OK: OK: Less than 1.00% above the threshold [0.0]
[13:07:53] <shinken-wm>	 RECOVERY - Puppet errors on tools-exec-1431 is OK: OK: Less than 1.00% above the threshold [0.0]
[13:14:50] <wikibugs_>	 10PAWS: PAWS - Redirect loop detected - https://phabricator.wikimedia.org/T175454#3657228 (10Vodenbot) Today I can start my server normally.
[13:19:04] <andrewbogott>	 !log pluggableauth migrating 'cindy' to labvirt1017
[13:19:06] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Pluggableauth/SAL
[13:19:37] <andrewbogott>	 !log deployment-prep migrating 'deployment-kafka-jumbo-1' to labvirt1017
[13:19:46] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL
[13:24:00] <andrewbogott>	 !log pluggableauth migrating 'oidc-google' to labvirt1017
[13:24:02] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Pluggableauth/SAL
[13:25:58] <andrewbogott>	 !log reading-web-staging migrating proton-staging to labvirt1017
[13:26:00] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Reading-web-staging/SAL
[13:27:49] <andrewbogott>	 !log wikibrain migrating wikibrain-embeddings-02 to labvirt1017
[13:27:51] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikibrain/SAL
[13:32:06] <andrewbogott>	 !log project-smtp migrating smtp-test1 to labvirt1017
[13:32:08] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Project-smtp/SAL
[13:35:03] <andrewbogott>	 !log suggestbot moving suggestbot-prod to labvirt1017
[13:35:04] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Suggestbot/SAL
[13:35:30] <andrewbogott>	 !log twl moving twlight-prod to labvirt1017
[13:35:32] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Twl/SAL
[13:36:25] <andrewbogott>	 !log twl moving twlight-staging to labvirt1017
[13:36:27] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Twl/SAL
[13:40:09] <andrewbogott>	 !log wmam migrating 'wikikids' to labvirt1017
[13:40:11] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wmam/SAL
[13:40:23] <andrewbogott>	 !log mobile migrating 'zim-proto' to labvirt1017
[13:40:25] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Mobile/SAL
[14:11:42] <sowjanya>	 Hi, I am sowjanya. I have created an LDAP account for toolforge by following steps in the link https://wikitech.wikimedia.org/wiki/Help:Getting_Started#Creating_an_account
[14:12:18] <sowjanya>	 I have done this few hours ago and I am waiting for the request to be approved.
[14:12:58] <sowjanya>	 !help
[14:12:58] <wm-bot>	 sowjanya: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team
[14:13:51] <sowjanya>	 Approximately, how long does it take for a toolforge account to be approved?
[14:15:47] <TNT|away>	 sowjanya: what is your LDAP username? "Sowjanya"?
[14:16:09] <sowjanya>	 sowjanyavemuri
[14:16:46] <andrewbogott>	 sowjanya: done
[14:17:10] <sowjanya>	 Thanks a lot!
[14:27:39] <shinken-wm>	 PROBLEM - Puppet errors on tools-exec-1411 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0]
[14:32:38] <Nudin_WMDE>	 Technical Advice IRC meeting starting in 30 minutes in channel #wikimedia-tech, hosts: @addshore & @Andrew-WMDE - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting
[14:33:30] <sowjanya>	 !help
[14:33:30] <wm-bot>	 sowjanya: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team
[14:33:46] <TNT|away>	 sowjanya: ask away :)
[14:34:21] <sowjanya>	 I got the approval but I am unable to create a tool
[14:35:43] <TNT|away>	 sowjanya: how are you attempting to create a tool, talk us through what you've tried so far
[14:35:58] <sowjanya>	 After visiting the https://toolsadmin.wikimedia.org/tools/ page I had an option to request for joining in toolforge project 
[14:36:24] <sowjanya>	 but I couldn't see a create a tool button as specified in the link https://wikitech.wikimedia.org/wiki/Help:Toolforge/My_first_Flask_OAuth_tool
[14:37:10] <TNT|away>	 Okay, and if you go to https://toolsadmin.wikimedia.org/tools/create/ what happens? You were only recently added to the `project-tools` group
[14:38:13] <sowjanya>	 I get an error "You are not currently authorized to view the URI /tools/create/"
[14:38:48] <TNT|away>	 Well you're definitely in the group, try logging out (https://toolsadmin.wikimedia.org/auth/logout/) and back in?
[14:39:28] <sowjanya>	 Worked:)
[14:39:58] <TNT|away>	 Awesome :)
[14:41:26] <sowjanya>	 Thank you :)
[14:42:01] <TNT|away>	 No problem, good luck!
[14:55:56] <Cyberpower678>	 Well I just wasted 5 minutes.
[15:00:33] <Nudin_WMDE>	 Technical Advice IRC meeting starting now in channel #wikimedia-tech, hosts: @addshore & @Andrew-WMDE - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting
[15:05:35] <Amir1>	 chasemp: hey, Did you see this? https://phabricator.wikimedia.org/T167114#3646244
[15:07:37] <shinken-wm>	 RECOVERY - Puppet errors on tools-exec-1411 is OK: OK: Less than 1.00% above the threshold [0.0]
[15:20:25] <wikibugs_>	 10Striker: https://toolsadmin.wikimedia.org/tools/create/ returns 403 rather than redirecting to login - https://phabricator.wikimedia.org/T177407#3657604 (10bd808)
[15:21:59] <wikibugs_>	 10Cloud-Services, 10DBA, 10Tracking: Wikireplica service for tools and labs - issues and missing available views (tracking) - https://phabricator.wikimedia.org/T150767#3657622 (10jcrespo)
[15:22:16] <wikibugs_>	 10Data-Services, 10DBA, 10Tracking: Wikireplica service for tools and labs - issues and missing available views (tracking) - https://phabricator.wikimedia.org/T150767#2795855 (10jcrespo)
[15:23:07] <wikibugs_>	 10Data-Services, 10DBA: Some queries to new replica hosts are dramatically slower than labsdb; missing indexes? - https://phabricator.wikimedia.org/T177096#3657633 (10jcrespo)
[15:23:10] <wikibugs_>	 10Data-Services, 10DBA, 10Tracking: Wikireplica service for tools and labs - issues and missing available views (tracking) - https://phabricator.wikimedia.org/T150767#2795855 (10jcrespo)
[15:48:30] <wikibugs_>	 10Data-Services, 10DBA, 10Patch-For-Review: Some queries to new replica hosts are dramatically slower than labsdb; missing indexes? - https://phabricator.wikimedia.org/T177096#3657738 (10Marostegui) >>! In T177096#3657674, @gerritbot wrote: > Change 382170 had a related patch set uploaded (by Jcrespo; owner:...
[15:54:05] <bd808>	 gehel: I don't have ops/puppet +2, but yeah merge that logstash config change when you can.
[15:54:19] <gehel>	 bd808: Ok, I'll merge right now.
[15:54:42] <gehel>	 bd808: I have no idea what striker is or how to check it isn't broken after my change... so could you have a look?
[15:55:02] <bd808>	 yeah. the app is https://toolsadmin.wmflabs.org/
[15:55:18] <gehel>	 DNS error...
[15:55:38] <bd808>	 doh. toolsadmin.wikimedia.org
[15:56:10] <gehel>	 right, that worked!
[15:56:17] <bd808>	 the logstash collector is busted for other un-debugged reasons but I can at least make sure the uwsgi container is fine
[15:56:31] <gehel>	 it probably require a restart to pick up the change?
[15:56:39] <bd808>	 the code is deployed on californium
[15:57:13] <bd808>	 it should auto restart when that config changes I think, but I'll double check it all
[15:58:10] <gehel>	 running puppet, I'll see if something restarts...
[15:58:38] <gehel>	 yep, refresh was triggered
[15:58:53] <gehel>	 and the application is still responding.
[15:59:07] <gehel>	 Given what you said, I'm not going to check that logs are received in logstash...
[15:59:20] <bd808>	 yeah :/
[15:59:30] <bd808>	 someday I'll care enought to debug it
[15:59:48] <bd808>	 today it runs on one node and I can read the logs locally from disk
[16:00:23] <bd808>	 it worked with udp transport but when I switched it to tcp for longer message sizes it stopped working
[16:00:59] <bd808>	 not sure if the python client there or the logstash side is having problems now
[16:01:45] <gehel>	 no idea either...
[16:05:47] <wikibugs_>	 10Data-Services, 10DBA, 10Patch-For-Review: Some queries to new replica hosts are dramatically slower than labsdb; missing indexes? - https://phabricator.wikimedia.org/T177096#3657823 (10jcrespo) This should fix things:  ``` root@labsdb1010[enwiki]> ALTER TABLE archive ADD KEY `user_timestamp` (`ar_user`,`ar...
[16:40:21] <Mridu>	 bd808: hi! Just pinged to know how should I proceed with writing the application proposal for outreachy?
[16:50:45] <Mridu>	 bd808: Hi! Should I proceed with writing the application proposal?
[16:51:38] <bd808>	 Mridu: Yes, you can start drafting a proposal about what you would do in the internship
[16:52:11] * bd808 is in a meeting
[17:23:11] <Sowjanya>	 !help
[17:23:11] <wm-bot>	 Sowjanya: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team
[17:23:29] <bd808>	 hi Sowjanya. what problem are you having?
[17:23:48] <Sowjanya>	 I am trying to create my first auth tool following steps from link https://wikitech.wikimedia.org/wiki/Help:Toolforge/My_first_Flask_OAuth_tool
[17:24:10] <Sowjanya>	 I get an error when I run the command "webservice --backend=kubernetes python shell"
[17:24:53] <Sowjanya>	 The error I encountered is 'pykube.exceptions.HTTPError: namespaces "my_first_tool" not found'
[17:25:19] <bd808>	 Sowjanya: oh! That's a known bug.
[17:25:51] <bd808>	 the problem is that toolsadmin should not allow you to put underscores in the tool name
[17:26:44] <bd808>	 so you need to make a new tool with an name that uses '-' instead of '_'
[17:26:52] <Sowjanya>	 ohh.. How can we overcome this?
[17:27:24] <bd808>	 the bug is T176681
[17:27:24] <stashbot>	 T176681: Striker should not allow tool names to include '_' for Kubernetes compatibility - https://phabricator.wikimedia.org/T176681
[17:30:33] <Sowjanya>	 Is there a way to notify the user while creating the tool that _ is not allowed ?
[17:30:51] <bd808>	 Sowjanya: yes, but I need to write that into the app :/
[17:31:19] <bd808>	 I didn't know this was a problem until a couple of weeks ago
[17:32:06] <Sowjanya>	 oh.. Can I try to fix this issue?
[17:33:58] <bd808>	 Sowjanya: you could definitely try. There is some info at https://wikitech.wikimedia.org/wiki/Toolsadmin.wikimedia.org about the application 
[17:34:38] <bd808>	 The application has a mediawiki-vagrant role to setup a development environment
[17:37:58] <Sowjanya>	 As a temporary fix, we could possibly mention the regex [a-z0-9]([-a-z0-9]*[a-z0-9]) that needs to be followed while creating the new tool in the tutorial wiki link?
[17:42:35] <wikibugs_>	 10Data-Services, 10DBA, 10Tracking: Wikireplica service for tools and labs - issues and missing available views (tracking) - https://phabricator.wikimedia.org/T150767#3658252 (10jcrespo)
[17:42:38] <wikibugs_>	 10Data-Services, 10cloud-services-team (FY2017-18), 10DBA, 10Goal: Migrate all users to new Wiki Replica cluster and decommission old hardware - https://phabricator.wikimedia.org/T142807#3658253 (10jcrespo)
[17:42:40] <wikibugs_>	 10Data-Services, 10DBA, 10Patch-For-Review: Some queries to new replica hosts are dramatically slower than labsdb; missing indexes? - https://phabricator.wikimedia.org/T177096#3658249 (10jcrespo) 05Open>03Resolved a:03jcrespo @MusikAnimal Your query takes now 3 second cold, 0.13 seconds hot on the new...
[17:42:48] <wikibugs_>	 10cloud-services-team (Kanban): Remove non-interactive bots from #wikimedia-cloud - https://phabricator.wikimedia.org/T177427#3658254 (10Andrew)
[18:00:26] <wikibugs_>	 (03PS1) 10Mridubhatnagar: Improve error message of become [labs/toollabs] - 10https://gerrit.wikimedia.org/r/382200 (https://phabricator.wikimedia.org/T149511)
[18:33:12] <wikibugs_>	 10Toolforge, 10Tools, 10cloud-services-team (FY2017-18), 10Community-Liaisons (Oct-Dec 2017), 10Goal: Promote Toolforge Tools and their maintainers within Wikimedia communities - https://phabricator.wikimedia.org/T176677#3658534 (10bd808)
[18:33:40] <wikibugs_>	 10cloud-services-team, 10Operations: Upgrade to puppet 4 (4.8 or newer) - https://phabricator.wikimedia.org/T177254#3658537 (10herron)
[18:33:57] <wikibugs_>	 10cloud-services-team, 10Operations: Upgrade to puppet 4 (4.8 or newer) - https://phabricator.wikimedia.org/T177254#3652273 (10herron)
[18:45:21] <madhuvishy>	 Sowjanya: That idea sounds good, one suggestion is that we add what the naming rules are in english rather than regex because many people may not be able to read that :) Otherwise, go for it!
[18:47:01] <Sowjanya>	 Great! will work on that
[19:03:37] <chasemp>	 test
[19:06:44] <mutante>	 works
[19:08:16] <chasemp>	 tx mutante, turns out I had irc bouncer isses and had no idea, I thought "its really quiet..." :)
[19:11:48] <mutante>	 :)
[19:24:20] <wikibugs_>	 10Toolforge, 10Outreachy (Round-15), 10Patch-For-Review: Outreachy - webservice microtask for Sowjanyavemuri - https://phabricator.wikimedia.org/T176624#3658693 (10Sowjanyavemuri)
[19:24:58] <wikibugs_>	 10Toolforge, 10Outreachy (Round-15), 10Patch-For-Review: Outreachy - webservice microtask for Sowjanyavemuri - https://phabricator.wikimedia.org/T176624#3631678 (10Sowjanyavemuri)
[19:29:10] <wikibugs_>	 10Toolforge, 10Outreachy (Round-15), 10Patch-For-Review: Outreachy - webservice microtask for Sowjanyavemuri - https://phabricator.wikimedia.org/T176624#3658721 (10Sowjanyavemuri)
[19:39:42] <wikibugs_>	 10Toolforge, 10Outreachy (Round-15): Improvements for the Toolforge 'webservice' command - https://phabricator.wikimedia.org/T175768#3658768 (10bd808)
[19:39:47] <wikibugs_>	 10Toolforge, 10Outreachy (Round-15), 10Patch-For-Review: Outreachy - webservice microtask for Mridu_Bhatnagar - https://phabricator.wikimedia.org/T176018#3658766 (10bd808) 05Open>03Resolved @Mridu_Bhatnagar Your gerrit patch looks good. I think we can call this microtask done. Your next step is to write...
[19:42:04] <wikibugs_>	 10cloud-services-team (Kanban), 10Patch-For-Review: Replace kernel and reboot labvirt1015, 1016, 1017, 1018 - https://phabricator.wikimedia.org/T176044#3658777 (10Andrew) 05Open>03Resolved Every labvirt is now running Linux labvirt1008 4.4.0-81-generic #104~14.04.1-Ubuntu SMP Wed Jun 14 12:45:52 UTC 2017 x...
[19:44:28] <wikibugs_>	 10Data-Services, 10DBA, 10Patch-For-Review: Some queries to new replica hosts are dramatically slower than labsdb; missing indexes? - https://phabricator.wikimedia.org/T177096#3658782 (10MusikAnimal) Lightning fast! :D Many thanks for the prompt assistance
[19:55:58] <wikibugs_>	 (03CR) 10Merlijn van Deen: [C: 04-1] "Thanks for this patch! I've left a few suggestions as inline comments." (033 comments) [labs/toollabs] - 10https://gerrit.wikimedia.org/r/382200 (https://phabricator.wikimedia.org/T149511) (owner: 10Mridubhatnagar)
[20:13:47] <wikibugs_>	 10Cloud-Services, 10cloud-services-team (Kanban): Remove non-interactive bots from #wikimedia-cloud - https://phabricator.wikimedia.org/T177427#3658831 (10bd808)
[20:15:16] <bd808>	 hello irc channel users! If you have strong feelings for or against moving icinga-wm, shinken-wm, and wikibugs out of this channel to a notification/monitoring channel, speak up at T177427
[20:15:16] <stashbot>	 T177427: Remove non-interactive bots from #wikimedia-cloud - https://phabricator.wikimedia.org/T177427
[20:19:11] <mutante>	 i would leave it to individual users to filter bot messages
[20:19:29] <mutante>	 these separate notification channels tend to just be abandoned
[20:21:13] <bd808>	 mutante: that's a fair point that I have heard (and given) before.
[20:21:20] <mutante>	 notifications work when people actually see them, separate channel tends to be like permanent mute, nobody wants more channels
[20:21:48] <mutante>	 but i still don't call this is a _strong_ feeling :)
[20:22:10] <bd808>	 Quite a few {{cn}} of our visitors here are new to irc and probably don't know how to silence bots. They may even be popping in using a web client that really doesn't keep any session-to-session preferences.
[20:23:13] <bd808>	 I'm actually personally ok with bot noise, but mostly because I have a pretty fancy irc client and configuration to make them less annoying
[20:23:51] <mutante>	 fair point. though seeing wikibugs tells you what others are working on and makes people look at tickets out of curiosity.. and then they see stuff and comment
[20:24:13] <chasemp>	 the contrast is I have blocked wikibugs as it makes irc unusable for me
[20:24:16] <bd808>	 shinken and icinga ... they jsut make noise :)
[20:24:18] <mutante>	 if it wasn't here, i think it would just be quieter but not necessarily lead to more conversation that would be prevented by bots 
[20:24:50] <bd808>	 its hard to know one way or the other without some experiments
[20:25:17] <mutante>	 i know that many people have wikibugs blocked, but then you have this situation:
[20:25:23] <harej>	 i already ignored the bots
[20:25:29] <mutante>	 foo: ^ could you take a look?
[20:25:33] <mutante>	 bar: ?
[20:25:44] <harej>	 solution: link directly to the thing
[20:25:49] <chasemp>	 yes please
[20:25:54] <bd808>	 so much that
[20:25:55] <chasemp>	 mutante: I don't know if that's a point for or against tbh
[20:25:59] <mutante>	 how is anyone going to see that thing?
[20:26:27] <bd808>	 I get lots of after hours pings on my phone that look like "<some channel> <some user> bd808: ^"
[20:26:49] <chasemp>	 the biggest thing I hate is wikibugs messages triggering my irc ping
[20:27:04] <chasemp>	 that and the volume and duplication
[20:27:08] <mutante>	 when does wikibugs do that?
[20:27:11] <chasemp>	 reading on irc what I would read in email 
[20:27:13] <bd808>	 (omg we are having a discussion!)
[20:27:21] <chasemp>	 mutante: my irc client is responsible
[20:27:23] <chasemp>	 i.e.
[20:27:35] <chasemp>	 wikibugs: @chasemp can you look at foo?
[20:27:37] <chasemp>	 as a comment on a task
[20:27:42] <chasemp>	 that wikibugs rebroadcasts in irc
[20:27:45] <chasemp>	 taht I also get via email
[20:27:46] <chasemp>	 etc
[20:28:24] <chasemp>	 I've more or less made peace with being forced to not show wikibugs
[20:28:25] <mutante>	 i have never head wikibugs address me by name
[20:28:29] <mutante>	 had
[20:28:38] <chasemp>	 mutante: no I"m saying teh comment from the task has my username in it
[20:28:40] <chasemp>	 which triggers an irc ping
[20:28:55] <chasemp>	 you are dzahn on phab
[20:29:01] <paladox>	 mutante your's is dzahn but your irc name is mutante heh :)
[20:29:19] <chasemp>	 that^
[20:29:27] <chasemp>	 heh, that was intentional irony btw
[20:29:36] <wikibugs_>	 10Cloud-Services, 10cloud-services-team (Kanban): Remove non-interactive bots from #wikimedia-cloud - https://phabricator.wikimedia.org/T177427#3658254 (10Matthewrbowker) I would support this change, sometimes it's difficult to follow conversations with the bots constantly interrupting.  `#wikimedia-cloud-feed...
[20:30:15] <mutante>	 eh ok, so the difference is that and .. i don't read that in email
[20:30:38] <mutante>	 because i really dislike email
[20:31:16] <mutante>	 prefers notifications where i would respond
[20:31:42] <paladox>	 why not forward your emails to irc heh
[20:33:01] <mutante>	 i think the actual solution would be that the icinga notifications are sent to the project owner (using whichever way to notify them)
[20:33:08] <wikibugs_>	 10PAWS: Cannot Access Notebooks in PAWS - https://phabricator.wikimedia.org/T177441#3658852 (10Cbouwense)
[20:33:21] <mutante>	 little point in creating them just to ignore them again
[20:33:47] * paladox has a do not disturbe on the mac so i doint have to ignore in irc :)
[20:33:50] <chasemp>	 icinga notifications are by project iiuc but Tools come here
[20:33:57] <chasemp>	 deployment-prep goes to releng etc
[20:34:08] <mutante>	 paladox: "do not disturb" = "ignore" ?:)
[20:34:22] <paladox>	 lol, it hides the notifications from a fly out
[20:34:36] <paladox>	 as when someone sends me a heep ton of pm's it will go over my screen.
[20:34:50] <paladox>	 though i use it rarely
[20:35:04] <paladox>	 and not for irc
[20:37:43] <paladox>	 though i must say, i gave up building my irc client, it kept failing to build most times so i just payed for it on the mac store.
[20:44:03] <shinken-wm>	 PROBLEM - Puppet errors on tools-webgrid-lighttpd-1413 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0]
[20:49:21] <musikanimal>	 bd808: is there a "Powered by Wikimedia Cloud VPS" badge yet?
[20:49:39] <musikanimal>	 I know there is a Toolforge one
[20:50:00] <bd808>	 I haven't made a Cloud VPS one, no
[20:50:07] <bd808>	 just these -- https://tools-static.wmflabs.org/toolforge/
[20:50:49] <musikanimal>	 obviously not important, but XTools still says "Powered by Tool Labs"
[20:50:53] <musikanimal>	 I guess I could at least change it to Toolforge
[20:51:13] <bd808>	 we can make a cloud VPS one too :)
[20:51:33] <musikanimal>	 that'd be awesome! I would do it myself if I were any bit good at that kind of stuff
[20:56:09] <bd808>	 musikanimal: write a ticket to remind me plz :)
[20:56:15] <musikanimal>	 sure thing
[20:59:19] <wikibugs_>	 10cloud-services-team: Create banner image for Wikimedia Cloud VPS - https://phabricator.wikimedia.org/T177442#3658923 (10MusikAnimal)
[21:06:57] <wikibugs_>	 10Cloud-VPS, 10cloud-services-team (Kanban): Create banner image for Wikimedia Cloud VPS - https://phabricator.wikimedia.org/T177442#3658961 (10bd808)
[21:11:47] <wikibugs_>	 10Toolforge: Tool naming convention - https://phabricator.wikimedia.org/T177439#3658973 (10Aklapper)
[21:12:42] <shinken-wm>	 RECOVERY - Puppet errors on tools-exec-1417 is OK: OK: Less than 1.00% above the threshold [0.0]
[21:19:02] <shinken-wm>	 RECOVERY - Puppet errors on tools-webgrid-lighttpd-1413 is OK: OK: Less than 1.00% above the threshold [0.0]
[21:30:08] <wikibugs_>	 10Toolforge: Tool naming convention - https://phabricator.wikimedia.org/T177439#3658985 (10Sowjanyavemuri)
[21:32:31] <wikibugs_>	 10Toolforge: Tool naming convention - https://phabricator.wikimedia.org/T177439#3658988 (10Sowjanyavemuri)
[21:41:23] <wikibugs_>	 10Toolforge: Tool naming convention - https://phabricator.wikimedia.org/T177439#3658994 (10Sowjanyavemuri) Hi @Aklapper, Made a few changes to the description of the task as suggested.  Thanks for the suggestions.
[21:52:19] <wikibugs_>	 10Toolforge, 10Outreachy (Round-15), 10Patch-For-Review: Outreachy - webservice microtask for Mridu_Bhatnagar - https://phabricator.wikimedia.org/T176018#3611196 (10srishakatux) @Mridu_Bhatnagar Just making sure.. that you've checked whether or not you meet the eligibility criteria listed here https://www.ou...
[22:18:34] <wikibugs_>	 10Toolforge, 10Outreachy (Round-15): Improvements for the Toolforge 'webservice' command - https://phabricator.wikimedia.org/T175768#3602769 (10srishakatux) This message is for candidates considering to apply to the Outreachy program:  Just making sure that you already know:  * Deadline for submitting applicat...