[07:27:08] <harej>	 I think PAWS is having some trouble
[07:29:46] * zhuyifei1999_ looks
[07:31:21] <zhuyifei1999_>	 !log tools.paws stopped a few inactive servers
[07:31:22] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.paws/SAL
[07:31:50] <harej>	 Hopefully not too passive aggressive :) https://phabricator.wikimedia.org/T195030
[07:31:53] <zhuyifei1999_>	 harej: working now?
[07:35:33] <harej>	 zhuyifei1999_: it seems to hang
[07:35:43] <zhuyifei1999_>	 hmm
[07:36:49] <zhuyifei1999_>	 idk then
[07:36:52] <zhuyifei1999_>	 chicocvenancio: ^
[09:09:48] <arturo>	 vgutierrez: https://phabricator.wikimedia.org/T194665
[10:19:31] <wikibugs_>	 (03PS1) 10Jean-Frédéric: Allow to override replicas database credentials [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/433949
[10:28:59] <arturo>	 pablohn6: https://tools.wmflabs.org/admin/oge/status
[10:40:36] <arturo>	 yeah, something is wrong with PAWS
[10:40:43] <arturo>	 it won't spawn my server
[10:56:38] <Krenair>	 !log deployment-prep amended uncommitted changes into HEAD commit (notified author) so I can unbreak puppet updates, also removed my old POC secure redirect puppet patch
[10:56:42] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL
[12:41:14] <Krenair>	 chasemp, arturo: hey, either of you around?
[12:42:57] <arturo>	 Krenair: o/
[12:44:05] <Krenair>	 arturo, do you know how to add/update records under DNS zones in Horizon?
[12:44:47] <arturo>	 Krenair: not from the top of my head, but I can search for some docs..
[12:45:01] <Krenair>	 It used to be obvious but I can't see any way to do it anymore
[12:45:12] <arturo>	 which project?
[12:45:38] <arturo>	 let's see if I have a big bold button
[12:47:15] <Krenair>	 deployment-prep
[12:49:24] <arturo>	 I'm not even part of that project
[12:51:19] <Krenair>	 ok
[12:57:24] <Krenair>	 arturo, added aborrero to deployment-prep projectadmins
[12:58:34] <arturo>	 Krenair: what would you like to add?
[12:59:30] <Krenair>	 arturo, secureredirtest.beta.wmflabs.org IN A 208.80.155.164
[12:59:40] <Krenair>	 to the beta.wmflabs.org domain
[13:02:00] <arturo>	 ACK
[13:02:42] <Krenair>	 it looks like horizon has no policy permissions set up for designate...
[13:03:06] <arturo>	 Krenair: I don't any button for that
[13:03:15] <Krenair>	 yeah
[13:08:15] <Krenair>	 hmm, I49b0c811dc8e59fe9351ba4c530572476826faa0 is relatively recent in this area
[13:08:55] <Krenair>	 doubt it would be I7e02bc3a7bcb16119f141bc333648fdddfcb7405
[13:10:36] <Krenair>	 oh hold on
[13:10:47] <Krenair>	 if you git grep zone_primary_or_admin
[13:10:56] <Krenair>	 it shows a definition in ocata but not mitaka or liberty
[13:11:43] <Krenair>	 I wonder if it is I7e02bc3a7bcb16119f141bc333648fdddfcb7405...
[13:20:05] <pablohn6>	 ping arturo :) 
[13:20:35] <arturo>	 hey pablohn6 I'm currently busy doing some stuff with vgutierrez 
[13:21:10] <arturo>	 bd808: pablohn6 is here in the hackathon and would like to collab with us. I already did some introductory explanations of our services
[13:21:37] <arturo>	 or harej ^^^
[13:22:52] <bd808>	 arturo: awesome. I'm in the hacking hallway just past the side hall where food is served.
[13:23:03] <bd808>	 I have the stickers too. :)
[13:23:26] <arturo>	 pablohn6: let me know if you need help to find Bryan (bd808 here)
[13:24:33] <pablohn6>	 I am going to try to find him :) 
[13:25:16] <arturo>	 pablohn6: please grab some debian stickers :-P hopefully you can get rid of that $OTHER distribution eventually ...
[13:25:17] <arturo>	 xD
[13:26:40] <harej>	 the other distribution based on debian?
[13:27:57] <arturo>	 RPM based... so even worse :-P
[13:28:46] <bd808>	 We all have preferences, but its not friendly to pick on other peoples choices folks.
[13:29:02] <arturo>	 you are right, sorry
[13:30:01] <pablohn6>	 still trying to find bd808 , there is a problem in this kind of events when you born without orientation sense 
[13:30:30] <arturo>	 pablohn6: will go help you, on my way...
[13:30:51] <pablohn6>	 I have arrived (I do not why) to a Wikidata room 
[13:31:10] <pablohn6>	 I am going to a better place, maybe de Guernika picture
[13:40:20] <bd808>	 pablohn6: https://www.mediawiki.org/wiki/Technical_Document_Re-working_Group/WriteTheDocs
[13:44:00] <Krenair>	 arturo, would you mind logging in as novaadmin and creating my record for now?
[13:45:20] <Krenair>	 although I have a funny feeling novoaadmin's permissions may also be broken right now
[13:46:20] <arturo>	 Krenair: ok, give me some minutes, finishing some stuff
[13:46:22] <Krenair>	 thanks
[13:53:12] <Krenair>	 another complication
[13:53:31] <Krenair>	 I just found hieradata/hosts/labweb100* which show that the hosts behind horizon.wikimedia.org should be using ocata
[13:53:37] <Krenair>	 which should work fine
[13:53:38] <Krenair>	 :|
[13:56:18] <bd808>	 Krenair: yeah, I think we are running Horizon from ocata. All the apis are versioned though, so it should mostly work fine.
[13:56:46] <bd808>	 I think we have found a few nova-network bugs with floating ips though
[13:57:00] <Krenair>	 in ocata?
[13:57:15] <Krenair>	 yeah I struggled to get an IP associated with my instance
[13:57:26] <Krenair>	 ended up going to the floating IPs panel and associating the instance there
[13:57:34] <Krenair>	 instead of finding the instance and pressing the associate floating IP button
[13:58:22] <Krenair>	 I have considered trying to use an alexmonk.uk subdomain for my hackathon project (as I can't edit wmflabs.org DNS stuff right now), but found that I can't get into that due to my 2FA device breaking
[14:00:09] <Neha16>	 bd808: Hi, Do you have a few minutes?
[14:16:35] <bd808>	 Neha16: hi! I totally have some time to chat
[14:18:16] <Neha16>	 bd808: I think I have messed up a few things. I have ssh'ed in toolsbeta and modified a few lines of code there in /usr/local/bin/webservice. Shouldn't I be doing all these things in a git repository?
[14:20:14] <Krenair>	 I've resorted to creating krenair.hopto.org
[14:20:31] <bd808>	 Neha16: it is ok to be making small hacks for testing on the test server, but yes ultimately you need to submit patches to https://gerrit.wikimedia.org/r/#/admin/projects/operations/software/tools-webservice
[14:22:29] <Neha16>	 bd808: So, I can change the code after sshing in toolsbeta, test it on various tools and submit the same code from the repository that I have cloned ?
[14:22:56] <bd808>	 Neha16: I think that would work, yes
[14:23:49] <Neha16>	 bd808: I am working on a test server right? If I mess up, that shouldn't affect the actual project.
[14:25:22] <bd808>	 Neha16: right. we can always rebuild it :)
[14:26:00] <bd808>	 sudo apt-get install toollabs-webservice will put it all back to normal
[14:26:47] <Neha16>	 bd808: Thanks for clearing my confusion. I can code in peace now :)
[14:27:35] <bd808>	 Neha16: :) good. unpeaceful coding is no fun
[14:28:28] <Neha16>	 bd808: So true :)
[14:37:13] <arturo>	 Krenair: I have some spare cycles now
[14:38:16] <Krenair>	 it's ok arturo 
[14:38:21] <Krenair>	 I have a workaround for my project for now
[14:38:36] <arturo>	 ack, sorry for the delay
[14:39:10] <arturo>	 pablohn: do you want some help?
[14:41:25] <pablohn>	 arturo, no thanks, I am reading the documentation looking for something to improve while I am learning all this stuff
[14:42:58] <arturo>	 ack
[17:03:27] <halfak>	 Hey folks.  Helping someone request a vps project
[17:03:32] <halfak>	 Where's the process docs
[17:03:33] <halfak>	 ?
[17:05:14] <halfak>	 bd808: ^ 
[17:10:37] <chicocvenancio>	 halfak: there is a template for the request 
[17:10:55] <halfak>	 Hey chicocvenancio.  Thanks.  Can you point me to it?
[17:13:23] <chicocvenancio>	 https://phabricator.wikimedia.org/project/view/2875/
[17:13:32] <chicocvenancio>	 halfak: ^
[17:14:09] <halfak>	 Thank you!
[19:00:57] <Krenair>	 When you go to https://horizon.wikimedia.org/project/floating_ips/ and click to associate an IP with an instance, why does the default option for the IP address show up as '36'?
[19:15:29] <chicocvenancio>	 !log tools.paws moving paws to mysql manually, working!
[19:15:31] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.paws/SAL
[19:16:54] <chicocvenancio>	 bd808: is there a good channel to give news to the rest of the hackathon that PAWS is in a working state?
[19:19:14] <Lucas_WMDE>	 chicocvenancio: #wmhack ?
[19:32:06] <bd808>	 chicocvenancio: yes, what Lucas_WMDE said
[19:32:25] * bd808 is in a fuge state of beer and jet lag
[19:32:35] <chicocvenancio>	 sent a message there, please spread the word if you can there
[19:33:25] <chicocvenancio>	 a lot more traffic then usual for paws, so maybe people there will figure it is not working
[20:17:21] <halfak>	 !log wikilabels staging wikilabels-wmflabs-deploy:58df4b7
[20:17:23] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikilabels/SAL
[20:18:02] <arturo>	 Krenair: in don't see '36' but another random number xD
[20:21:24] <halfak>	 Anyone got the link to the showcase etherpad?
[20:21:30] <halfak>	 I can't find it in the schedule 
[20:21:37] <halfak>	 or the "Wikimedia-Hackathon-2018" tag :| 
[20:21:40] <Reedy>	 https://etherpad.wikimedia.org/p/Wikimedia_hackathon_showcase_2018
[20:21:44] <halfak>	 <3
[20:22:27] <halfak>	 !log wikilabels deploying wikilabels-wmflabs-deploy:58df4b7
[20:22:28] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikilabels/SAL
[22:18:18] <chicocvenancio>	 !log tools.paws restart proxy pod to get to a working state
[22:18:19] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.paws/SAL
[23:59:56] <wikibugs_>	 (03PS1) 10Krinkle: Remove unused 'p[class=statistics]' [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/434117
[23:59:58] <wikibugs_>	 (03PS1) 10Krinkle: Move "Limited to 20 results per wiki" message from bottom to top [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/434118 (https://phabricator.wikimedia.org/T167524)