[07:38:49] <HakanIST>	 hello
[11:06:25] <chicocvenancio>	 hello
[13:06:18] <arturo>	 !log tools deploying fix for T186230 using clush
[13:06:24] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[13:06:24] <stashbot>	 T186230: apt-show-versions daily cron often failing with conflict - https://phabricator.wikimedia.org/T186230
[13:27:32] <arturo>	 !log tools for the record, not a single warning or error (orange/red messages) in puppet in the toolforge cluster
[13:27:38] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[14:18:54] <avgas>	 !help Hi guys, my tool irishbot is on stuck due to 503. Text error is:"WARNING: Http response status 503
[14:18:54] <wm-bot5>	 avgas: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team
[14:18:54] <avgas>	 WARNING: Non-JSON response received from server wikipedia:it; the server may be down.
[14:18:55] <avgas>	 Set gpllimit = ['2500']"
[14:19:29] <avgas>	 job is still running, "orphanize"
[14:20:02] <chicocvenancio>	 avgas: I'll check it
[14:27:34] <chicocvenancio>	 avgas: seems like a genuine quick outage or a pywikibot bug
[14:28:00] <chicocvenancio>	 If it keeps happening, raise the debug level in the script and open a task
[14:28:27] <chicocvenancio>	 Might have resolved already, however
[14:28:45] <chicocvenancio>	 You might want to rerun the script to see
[14:39:07] <avgas>	 chicocvenancio: already rerunned but same error come out...
[14:39:35] <avgas>	 chicocvenancio: ok, I'll open task. How to raise debug level?
[14:42:45] * chicocvenancio is checking 
[14:45:10] <wikibugs>	 (03CR) 10MarcoAurelio: "I wish {name} could also output if the thing is an Extension or an Skin, as extreg-wos also displays skins to be converted." [labs/tools/extreg-wos] - 10https://gerrit.wikimedia.org/r/406998 (https://phabricator.wikimedia.org/T185413) (owner: 10MarcoAurelio)
[15:09:15] <chicocvenancio>	 avgas: `-debug` or `-verbose` in the file calling the script will do
[15:09:44] <chicocvenancio>	 I'm pretty sure there is a way to set it in python, but can't quite remember/find it
[15:10:09] <zhuyifei1999_>	 possibly user-config.py
[15:11:00] <chicocvenancio>	 I think both from user-config.py and directly from the script it is possible, but I can't find the relevant docs
[15:11:26] <chicocvenancio>	 for his script the cli argument will work
[15:11:42] <Hauskatze>	 do we have someone here with access to production Logstash?
[15:12:47] <avgas>	 many thanks chicocvenancio
[16:02:44] <paladox>	 !log git set notedb to automigrate on gerrit-test.wmflabs.org (gerrit-test)
[16:02:47] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL
[16:03:57] <paladox>	 !log git upgrade to gerrit 2.15 rc2 (stable-2.15 branch) on gerrit-test.wmflabs.org (also migrate to notedb from reviewdb (not completly migrate))
[16:03:59] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL
[17:58:45] <arturo>	 !log tools publishing/unpublishing trusty-tools repo in tools-services-01 to address T186539
[17:58:51] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[17:58:51] <stashbot>	 T186539: tools-services-01: issue with aptly repo release file - https://phabricator.wikimedia.org/T186539
[20:17:28] <Niharika>	 `MediaWiki-Vagrant requires a Debian ^8 guest OS` when did that happen? :(
[20:17:51] <bd808>	 Niharika: when we updated to Debian Stretch as the base os
[20:18:11] <Niharika>	 bd808: The commtech instance runs ubuntu. Is there a way to migrate?
[20:18:14] <bd808>	 there is a branch for jessie still
[20:18:23] <bd808>	 and another for trusty
[20:18:31] <Niharika>	 https://www.irccloud.com/pastebin/kCsdsVlA/
[20:18:43] <Niharika>	 It won't let me provision.
[20:35:50] <James_F>	 BTW, is anyone else getting the notice "Ignoring nokogiri-1.7.1 because its extensions are not built.  Try: gem pristine nokogiri --version 1.7.1" from Vagrant on every action (on Mac)? Running gem pristine throws the error "Failed to find gems ["nokogiri"] = 1.7.1", unhelpfully.
[20:37:58] <bd808>	 Niharika: there is a "trusty-compat" branch that you need to be on in your /srv/mediawiki-vagrant clone to keep working with an old Trusty VM
[20:39:16] <bd808>	 James_F: ugh. I haven't seen that kind of Vagrant + nokogiri grief for a while
[20:40:10] <James_F>	 bd808: FWIW nokogiri definitely does have a release 1.7.1, so not sure what "Failed to find gems" means?
[20:40:23] <James_F>	 Is it possible to un-publish releases in gem?
[20:40:36] <James_F>	 (Can you tell I normally ignore Ruby stuff? ;-))
[20:42:36] <Niharika>	 bd808: Thanks!
[21:00:56] <bd808>	 James_F: many past battles with nokogiri are documented at https://phabricator.wikimedia.org/T71052
[21:02:31] <bd808>	 James_F: oh and https://phabricator.wikimedia.org/T70453 as well. Broken nokogiri is a fun time for everyone
[21:10:16] <robh>	 chasemp: i was actualy looking at that right now
[21:10:20] <robh>	 but its not what i thought it was
[21:10:24] <robh>	 (the labvirt installer issue)
[21:11:07] <robh>	 im really glad they are dell.
[21:11:29] <robh>	 chasemp: its cool for me to take over on labvirt1021 i assume?
[21:11:36] <robh>	 i wanna boot it into bios and check everything
[21:11:38] <chasemp>	 robh: yep definitely
[21:11:57] <robh>	 cool, doing so now
[21:12:56] <robh>	 hrmm, i sent it reboot, seems to be very slow to post
[21:13:11] <robh>	 there it goes.
[21:25:00] <robh>	 chasemp: these have 10G cards that appear not disabled
[21:25:09] <robh>	 oh wait
[21:25:12] <robh>	 nm i misparsed a line
[21:25:21] <robh>	 oh wait, i didnt... wtf
[21:25:30] <robh>	 these have 10g and 1g integrated cards annoying.
[21:25:47] <robh>	 just means extra ports dont need, maybe one got left on for dhcpyep.
[21:25:48] <robh>	 yep
[21:25:54] <robh>	 the 1g had pxe still enabled.
[21:26:24] <robh>	 Dell fucked up some of our past orders and upgraded the dual port 10G nic to quad port 2 10 and 2 1gb
[21:26:38] <robh>	 they have since been corrected, but seemst his got ordered with the slightly more expensive (a few dollars)
[21:26:39] <robh>	 card
[21:28:57] <robh>	 chasemp: so i need to sync with chris
[21:29:12] <robh>	 it appears these were put into a 1g switch
[21:29:17] <robh>	 but im not 100% sure how its wired up
[21:29:40] <chasemp>	 robh: makes sense, that's kind of where andrew landed I think in confuzlement
[21:29:57] <chasemp>	 I'll both you later in the week to bother him once he's back from plague land?
[21:30:00] <chasemp>	 bother even
[21:30:03] <robh>	 yeah, im very confused about it too, since it seems to be a quad port mixed 10/1g nic
[21:30:05] <chasemp>	 or we can bother in tandem
[21:30:08] <robh>	 oh thats right he is sick today
[21:30:10] <robh>	 =P
[21:30:16] <robh>	 lemme dig into the quote and see whats up
[21:30:22] <chasemp>	 thanks robh 
[21:30:44] <robh>	 fuck 
[21:30:44] <robh>	 Intel X520 DP 10Gb DA/SFP+, + I350 DP 1Gb Ethernet
[21:30:49] <robh>	 i dont even recognize that nic
[21:30:54] <robh>	 and i dunno how i let it on a quote?
[21:32:10] <chasemp>	 confusing and dropped ball on my end too
[21:32:19] <chasemp>	 robh: what's the move then, order some nics? idk
[21:33:04] <robh>	 likely
[21:33:15] <robh>	 just order some nics to swap them out and eat a few hundred dollar loss per system
[21:33:34] <robh>	 but i wanna check with chris on the physical layout of the nic first
[21:33:39] <chasemp>	 robh: right
[21:51:19] <James_F>	 bd808: Thanks, looking.
[22:01:20] <James_F>	 bd808: Woohoo, now I've got a Ruby segfault.
[22:01:45] <bd808>	 James_F: *sigh*
[22:01:59] <James_F>	 So very much. I think I'll stop for now
[22:45:30] <Niharika>	 I'm trying to enable centralauth role on a mwvagrant instance on labs (commtech one). I keep getting ` Error: Failed to set owner to '52755': Operation not permitted - /vagrant/mediawiki/extensions/WikiEditor`for all extensions. I'm not sure what the problem is.  
[22:45:50] <Niharika>	 It doesn't work as expected either. 
[22:56:37] <bd808>	 Niharika: that permissions error sounds like Puppet and NFS fighting over file system things
[22:57:14] <bd808>	 I'm not sure what "doesn't work as expected" means exactly as you haven't stated your expectations. :)
[22:57:33] <Niharika>	 bd808: Oh, I meant it doesn't enable centralauth properly. 
[22:57:42] <Niharika>	 It tries to create more wikis but fails to.
[22:57:58] <Niharika>	 But yet expects them to exist when I try to login but doesn't find the wiki and fails. 
[22:58:13] <Niharika>	 I guess I could revert but I want to try and fix this. Any pointers?
[22:58:15] <bd808>	 I theory adding the CA role should provision 2 new wikis I think, one for logins and one client wiki other than the base wiki
[22:58:29] <Niharika>	 Yeah, the login wiki isn't getting created?
[22:58:31] <Niharika>	 .*
[22:58:50] <bd808>	 can you see why in the Puppet output?
[22:58:59] <Niharika>	 commtech.wmflabs.org/wiki/Main_Page
[22:59:05] <Niharika>	 Let me see. 
[22:59:39] <bd808>	 enabling complex roles to an old VM is ... not a supported action by the MediaWiki-Vagrant maintainers (i.e. me)
[23:00:49] <bd808>	 Niharika: I see CA at http://commtech.wmflabs.org/wiki/Special:Version. Did you also setup the new domain proxy that you will need to get to the new wiki?
[23:01:17] <bd808>	 https://wikitech.wikimedia.org/wiki/Help:MediaWiki-Vagrant_in_Cloud_VPS#Run_a_wikifarm
[23:01:31] <Niharika>	 bd808: Ah, I didn't realize I had to set that up. Silly me. I'll do that and see if it helps. Thanks!
[23:02:54] <bd808>	 cool deal. it's not obvious really if you are used to working locally where the *.local.wmftest.net DNS record makes it all happen by magic