[02:39:14] <Cyberpower678>	 Would an admin mind killing PID 1337 on tools-login.  It's really bogging down the VM.
[02:39:27] <Cyberpower678>	 It appears to be some tool running mono
[02:39:58] <Cyberpower678>	 bd808: ^
[02:40:04] <Cyberpower678>	 andrewbogott: ^
[02:43:25] <bd808>	 !log tools.botorder Killed BotOrderOfChapters.exe running on tools-login. Please use Grid Engine
[02:43:26] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.botorder/SAL
[02:44:05] <bd808>	 !log tools.info-farmer Killed ws-ta-appendInPage.py running on tools-login. Please use Grid Engine
[02:44:06] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.info-farmer/SAL
[02:44:29] * harej eagerly awaits the day this is no longer an issue
[02:44:43] <bd808>	 Cyberpower678: what's "php ../../bin/ia-upload jobs"?
[02:44:55] <Cyberpower678>	 No idea
[02:44:57] <Cyberpower678>	 Not mine
[02:45:25] <bd808>	 ah. ia-upload is not iabot :)
[02:45:30] <Cyberpower678>	 Nope. :-)
[02:45:43] <Cyberpower678>	 IABot runs responsibly and correctly on tools
[02:46:05] <harej>	 hmmmm
[02:46:12] <harej>	 is this related to that guy who wanted that 500 GB VM?
[02:46:41] <harej>	 there's a volunteer who uploads wikimedia dumps to internet archive for, well, archiving
[02:48:40] <bd808>	 I need to figure out the bug in tools.admin that keeps the maintainers from showing up in the listings
[02:50:42] <bd808>	 samwilson: you about? IA Uplaod seems to be running a queue processing job on tools-login
[02:51:07] <bd808>	 I'm about to kill it, but thought I'd give you a chance to shut it down gracefully
[02:51:51] <bd808>	 (it either finished or somebody else killed it)
[03:06:14] <Ivy>	 chicocvenancio: Yeah, I'd like to be able to pass -N to the underlying mysql process.
[03:08:09] <samwilson>	 bd808: yes, sorry! that was me. :( i kicked off a thing that I had thought kicked off a job
[03:08:27] <samwilson>	 but didn't notice for ages that it was just sitting there running
[03:08:37] <bd808>	 samwilson: you made Cyberpower678 sad :)
[03:09:06] <samwilson>	 sorry Cyberpower678 !  :) it's all-for-the-good-of-the-country i'm sure
[03:10:05] <Cyberpower678>	 bd808: Im'm lost, why am I sad?
[03:10:17] <Cyberpower678>	 :-)
[03:10:31] <bd808>	 because tools-login was slow.
[03:10:44] <Cyberpower678>	 samwilson: oh so that was you. :p
[03:10:53] <Ivy>	 Nemo was doing a neat bash for loop using `sql`.
[03:11:11] <Ivy>	 But it includes the header, so you always get at least one silly error for the literal string `dbname`.
[03:11:21] <Cyberpower678>	 tools-login is running fast again. :D
[03:11:24] <samwilson>	 well, if someone's backup wikimedia to IA, i'm going to carry on backing up IA to Commons...
[03:20:19] <zhuyifei1999_>	 Ivy: could you explain what -N does?
[03:22:12] <zhuyifei1999_>	 --skip-column-names?
[03:24:17] * zhuyifei1999_ uses a ugly workaround in the bash completion script https://gerrit.wikimedia.org/r/plugins/gitiles/labs/toollabs/+/9ecc544a40798d83ef26812d6eb3b4703f0a3ff5%5E%21/#F1
[03:25:03] <zhuyifei1999_>	 so if that -N can be passed somehow it'd be great
[03:25:47] <Ivy>	 zhuyifei1999_: Nice. :-)
[03:29:07] <zhuyifei1999_>	 Ivy: could you upload a patch for -N?
[03:29:44] <zhuyifei1999_>	 my naive thinking would be that any args after dbname that starts with a '-' is probably not part of the sql
[03:30:12] <SQL>	 zhuyifei1999_, no -'s here!
[03:30:37] <zhuyifei1999_>	 but we might be be better off if we specify a list of parameters explicitly
[03:30:51] <zhuyifei1999_>	 SQL: ;)
[03:32:00] <Ivy>	 zhuyifei1999_: That seems more complicated than what I was thinking.
[03:32:02] <Ivy>	 SQL: Hi!
[03:32:08] <SQL>	 Ivy, hi!
[03:33:00] <zhuyifei1999_>	 so were you thinking?
[03:33:39] <Ivy>	 zhuyifei1999_: Just to add -N to sql and have it pass just that argument.
[03:35:46] <zhuyifei1999_>	 there are quite a log of other parameters for `mysql`. yeah -N is probably indeed the most-useful one, but does it make sense to ignore all the other switches and handle only -N?
[03:36:27] <Ivy>	 zhuyifei1999_: Until we find another one we want to support, probably, yeah.
[03:36:36] <zhuyifei1999_>	 k
[03:37:13] <zhuyifei1999_>	 could you submit a patch / file a ticket (whichever you are more comfortable with)?
[03:39:52] <Ivy>	 Yeah, I think so!
[03:39:57] <Ivy>	 zhuyifei1999_: You can review for me? :-)
[03:40:03] <zhuyifei1999_>	 sure
[03:40:07] <Ivy>	 Sweeeeeet.
[03:48:03] <Ivy>	 zhuyifei1999_: I submitted https://phabricator.wikimedia.org/T189430
[03:48:08] <Ivy>	 I'll do a Gerrit patch in a minute, maybe.
[03:48:14] <zhuyifei1999_>	 k thanks
[03:48:44] <Sveta>	 is the sql command a wrapper around mysql command?
[03:48:59] <Ivy>	 Yes.
[03:49:06] <Sveta>	 ok :-)
[03:49:07] <Ivy>	 You can see the command in the output on that ticket.
[03:49:16] <Ivy>	 ['mysql', '--defaults-file=/home/mzmcbride/replica.my.cnf', '-h', 's7.analytics.db.svc.eqiad.wmflabs', 'meta_p']
[03:49:21] <Ivy>	 For example.
[03:55:08] <wikibugs>	 (03PS1) 10MZMcBride: sql: Add support for -N/--skip-column-names [labs/toollabs] - 10https://gerrit.wikimedia.org/r/418840 (https://phabricator.wikimedia.org/T189430)
[03:56:19] <Ivy>	 zhuyifei1999_: ^ :-)
[03:56:27] <zhuyifei1999_>	 k
[03:56:30] <Ivy>	 I think that does it.
[03:59:42] <Ivy>	 $(/usr/bin/sql --cluster web meta_p 'SELECT dbname AS "" FROM wiki WHERE is_closed = 0;' | /bin/sed '/^$/d')
[03:59:45] <Ivy>	 That's kind of clever!
[04:00:35] <wikibugs>	 (03PS2) 10Zhuyifei1999: sql: Add support for -N/--skip-column-names [labs/toollabs] - 10https://gerrit.wikimedia.org/r/418840 (https://phabricator.wikimedia.org/T189430) (owner: 10MZMcBride)
[04:01:53] <wikibugs>	 (03PS3) 10Zhuyifei1999: sql: Add support for -N/--skip-column-names [labs/toollabs] - 10https://gerrit.wikimedia.org/r/418840 (https://phabricator.wikimedia.org/T189430) (owner: 10MZMcBride)
[04:03:09] <wikibugs>	 (03PS4) 10Zhuyifei1999: sql: Add support for -N/--skip-column-names [labs/toollabs] - 10https://gerrit.wikimedia.org/r/418840 (https://phabricator.wikimedia.org/T189430) (owner: 10MZMcBride)
[04:03:44] <zhuyifei1999_>	 (sorry for flooding patchsets)
[04:04:17] <zhuyifei1999_>	 Ivy: does my changes look good to you?
[04:10:20] <Ivy>	 zhuyifei1999_: I'm not sure about "local opts="--cluster -N --skip-column-names"  # --verbose is rarely used"
[04:10:32] <Ivy>	 -N is a synonym of --skip-column-names. Do you need both?
[04:10:38] <Ivy>	 Maybe just remove " -N"?
[04:10:50] <wikibugs>	 (03CR) 10Zhuyifei1999: [C: 031] sql: Add support for -N/--skip-column-names [labs/toollabs] - 10https://gerrit.wikimedia.org/r/418840 (https://phabricator.wikimedia.org/T189430) (owner: 10MZMcBride)
[04:10:52] <Ivy>	 Though I'm not sure what opts is actually doing.
[04:11:15] <zhuyifei1999_>	 hmm
[04:11:31] <Ivy>	 I thought opts was being passed later, but I misread.
[04:11:32] <Ivy>	 Maybe just ignore m.e
[04:11:33] <Ivy>	 me.
[04:11:36] <zhuyifei1999_>	 when someone -[tab], it would autocomplete
[04:11:51] <zhuyifei1999_>	 uh, autocomplete a lot of --<something>
[04:12:00] <Ivy>	 Oh, nice!
[04:12:02] <zhuyifei1999_>	 yeah I guess it's better to remove -N
[04:12:18] <Ivy>	 If it can tab-complete -<tab>, that'd be nice.
[04:12:23] <Ivy>	 To know which arguments are available.
[04:12:46] <wikibugs>	 (03PS5) 10Zhuyifei1999: sql: Add support for -N/--skip-column-names [labs/toollabs] - 10https://gerrit.wikimedia.org/r/418840 (https://phabricator.wikimedia.org/T189430) (owner: 10MZMcBride)
[04:13:04] <Ivy>	 zhuyifei1999_: Thanks for the patches!
[04:13:20] <zhuyifei1999_>	 right now it only has --cluster (you can try that)
[04:13:23] <zhuyifei1999_>	 np
[04:13:45] <Ivy>	 Yeah, that's super-neat.
[04:15:00] <zhuyifei1999_>	 I'm gonna +1. if someone else say it's good enough I can merge + deploy
[04:15:05] <wikibugs>	 (03CR) 10Zhuyifei1999: [C: 031] sql: Add support for -N/--skip-column-names [labs/toollabs] - 10https://gerrit.wikimedia.org/r/418840 (https://phabricator.wikimedia.org/T189430) (owner: 10MZMcBride)
[04:54:35] <wikibugs>	 (03CR) 10BryanDavis: [C: 031] "LGTM. I saw the irc discussion about adding all mysql arguments, and I think I agree that would be overkill." [labs/toollabs] - 10https://gerrit.wikimedia.org/r/418840 (https://phabricator.wikimedia.org/T189430) (owner: 10MZMcBride)
[05:30:41] <Zackary>	 I just got an email saying that my @tools.wmflabs.org email will be deactivated shortly, but its obliviously a fake email, so is there someone who I should report this to or should I just delete it?
[06:13:40] <prtksxna>	 Thanks madhuvishy! That was so quick :)
[06:14:21] <madhuvishy>	 prtksxna: yw :)
[06:14:56] <prtksxna>	 madhuvishy: So I deleted a bunch of instances, the reflex ones. Creating a new one now :)
[06:15:20] <madhuvishy>	 prtksxna: awesome! 
[06:19:07] <madhuvishy>	 Zackary: feel free to make a phab task https://phabricator.wikimedia.org/maniphest/task/edit/form/1/ and tag cloud-services-team with the content of the email + headers. It sounds like phishing and there may be nothing much to do there, but probably worth documenting on phabricator for posterity atleast!
[06:23:45] <prtksxna>	 So I have my new instance - https://horizon.wikimedia.org/project/instances/33db5950-fecd-4219-bd1d-b5f7c4dc99f5/ - and I have created a web proxy too - ve-font.wmflabs.org
[06:24:23] <prtksxna>	 What do I need to do get a running mw instance? (sorry dumb questions 😐)
[06:26:00] <madhuvishy>	 prtksxna: aah, https://wikitech.wikimedia.org/wiki/Help:MediaWiki-Vagrant_in_Cloud_VPS
[06:26:28] <prtksxna>	 Thanks! Reading now.
[06:33:59] <madhuvishy>	 prtksxna: I'm gonna go sleep now, but feel free to ask questions here/create a task if you're stuck! Good luck :)
[06:34:30] <prtksxna>	 Thanks madhuvishy! (-, – )…zzZZ
[06:39:10] <Zackary>	 madhuvishy: ah, thanks (filled as https://phabricator.wikimedia.org/T189434)
[08:06:20] <wikibugs>	 (03CR) 10jenkins-bot: Localisation updates from https://translatewiki.net. [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/418854 (owner: 10L10n-bot)
[12:34:15] <arturo>	 !log tools T188994 upgrade packages from trusty-wikimedia in all ubuntu servers
[12:34:20] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[12:34:20] <stashbot>	 T188994: toolforge: package upgrades as part of the new workflow - https://phabricator.wikimedia.org/T188994
[12:49:50] <arturo>	 !log tools T188994 upgrade packages from trusty-updates in all ubuntu servers
[12:49:52] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[12:49:52] <stashbot>	 T188994: toolforge: package upgrades as part of the new workflow - https://phabricator.wikimedia.org/T188994
[13:10:27] <chasemp>	 I think updates are causing transient puppet failures
[13:15:32] <chasemp>	 arturo: I see grub updates in the mixx there, could reboot 2 of the trusty instances to make sure they still come up ok post?
[13:19:05] <arturo>	 shit!
[13:19:22] <arturo>	 sure
[13:19:45] <arturo>	 !log tools T188994 upgrade packages from jessie-backports in all jessie servers
[13:19:47] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[13:19:47] <stashbot>	 T188994: toolforge: package upgrades as part of the new workflow - https://phabricator.wikimedia.org/T188994
[13:26:56] <arturo>	 !log tools depool tools-exec-1441 and tools-exec-1442 for reboots
[13:26:58] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[13:29:12] <arturo>	 chasemp: I can't see anything wrong with grub or puppet
[13:29:18] <chasemp>	 cool
[13:29:43] <arturo>	 which transient errors did you see?
[13:31:15] <arturo>	 !log tools tools-exec-1441 and tools-exec-1442 rebooted fine and are repooled
[13:31:16] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[13:32:01] * arturo leaving for lunch
[14:54:01] <wikibugs>	 (03CR) 10Zhuyifei1999: [C: 032] sql: Add support for -N/--skip-column-names [labs/toollabs] - 10https://gerrit.wikimedia.org/r/418840 (https://phabricator.wikimedia.org/T189430) (owner: 10MZMcBride)
[14:54:55] <wikibugs>	 (03Merged) 10jenkins-bot: sql: Add support for -N/--skip-column-names [labs/toollabs] - 10https://gerrit.wikimedia.org/r/418840 (https://phabricator.wikimedia.org/T189430) (owner: 10MZMcBride)
[14:58:50] <zhuyifei1999_>	 !log tools building, publishing, and deploying misctools 1.31 5f3561e T189430
[14:58:52] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[14:58:53] <stashbot>	 T189430: Support skipping column names when using `sql` on Tool Labs - https://phabricator.wikimedia.org/T189430
[15:21:11] <multichill>	 bd808: I see Ivan is trying to move to Toolforge
[15:28:39] <multichill>	 These reports are quite important for Wikidata. User hasn't been able to share the source code, see https://www.wikidata.org/wiki/User_talk:Ivan_A._Krestinin#Publish_the_source_of_KRBot_please 
[16:01:11] <bd808>	 multichill: from what they are saying about what it takes to actually run the bot I'm not sure if Toolforge will have room for it. 32-64G of runtime memory is a lot.
[16:33:16] <arturo>	 !log tools T188994 upgrading packages form jessie-wikimedia
[16:33:23] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[16:33:23] <stashbot>	 T188994: toolforge: package upgrades as part of the new workflow - https://phabricator.wikimedia.org/T188994
[16:43:24] <multichill>	 bd808: And without the source code it's hard to improve it. I believe user:Pasleim implemented it too and that probably runs on Toolforge already
[16:53:53] <arturo>	 !log tools T188994 upgrading packages from stretch-wikimedia
[16:53:57] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[16:53:57] <stashbot>	 T188994: toolforge: package upgrades as part of the new workflow - https://phabricator.wikimedia.org/T188994
[17:13:00] <arturo>	 !log tools T188994 upgrading packages from `stable`
[17:13:02] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[17:13:03] <stashbot>	 T188994: toolforge: package upgrades as part of the new workflow - https://phabricator.wikimedia.org/T188994
[18:58:54] <harej>	 Oh boy, KrBot.
[19:40:39] <paladox>	 !log git deploying https://gerrit.wikimedia.org/r/#/c/418966/ to gerrit-test3
[19:40:40] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL
[19:49:19] <paladox>	 !log git starting gerrit on gerrit-test3 after upgrade from 2.14.6 to 2.14.7
[19:49:20] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL
[19:52:02] <paladox>	 !log phabricator delete phabricator-stretch1 and recreate it as phabricator-stretch (broken ssh) this is to test php 7.2
[19:52:02] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Phabricator/SAL
[19:52:12] <paladox>	 mutante ^^ :)
[20:09:12] <madhuvishy>	 !log tools Run clush -w @all -b 'sudo umount /mnt/nfs/labstore1003-scratch && sudo mount -a' to remount scratch across all of tools
[20:09:14] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[20:09:29] <mutante>	 paladox: cool
[20:46:58] <paladox>	 !log phabricator cherry picking https://gerrit.wikimedia.org/r/#/c/410245/ to test php 7.2
[20:46:59] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Phabricator/SAL
[22:08:51] <mmecor>	 hi folks. i'd like to ask you a question.
[22:09:00] <mmecor>	 i'm trying to extract data directly from a mysql database into a csv
[22:09:04] <chicocvenancio>	 hello
[22:09:05] <mmecor>	 using sth like 
[22:09:14] <mmecor>	 SELECT * INTO OUTFILE 'extent.csv' FIELDS TERMINATED BY '\t' LINES TERMINATED BY '\n' FROM s53619__wcdo.ccc_cawiki_current
[22:09:22] <mmecor>	 but it doesn't seem to work because of permissions
[22:09:30] <mmecor>	 it doesn't matter if i change the path-file
[22:09:39] <mmecor>	 or i submit the query in the terminal or with python
[22:09:57] <chicocvenancio>	 well, you don't have permissions in the db host
[22:10:09] <chicocvenancio>	 you should get the results and send that to the file
[22:10:15] <mmecor>	 yup, i imagined it was that. but i tried to put the path
[22:10:21] <mmecor>	 targetting my folder
[22:10:27] <mmecor>	 but it didn't work anyway
[22:10:36] <mmecor>	 isn't there anyway i introduce the path so it may work?
[22:10:59] <mmecor>	 i can get the results and print them into a file, yup, but this just simplified a bit the process
[22:11:07] <chicocvenancio>	 https://dev.mysql.com/doc/refman/5.7/en/select-into.html
[22:11:17] <chicocvenancio>	 the filepaht will be on the db host
[22:11:22] <mmecor>	 ok :)
[22:11:30] <mmecor>	 i had to try :) no problem
[22:11:36] <mmecor>	 thanks for the info
[22:11:40] <chicocvenancio>	 I don't think users have any permission there, but I may be wrong
[22:12:55] <zhuyifei1999_>	 mmecor: the easiest way I can think of is to use quarry
[22:13:13] <mmecor>	 aha
[22:13:21] <mmecor>	 i need to integrate it into a python script
[22:13:32] <zhuyifei1999_>	 https://stackoverflow.com/questions/356578/how-to-output-mysql-query-results-in-csv-format
[22:13:37] <mmecor>	 so it's fine, i'll just get the results
[22:13:53] <zhuyifei1999_>	 python can read the database directly using appropriate libraries
[22:14:13] <mmecor>	 yup yup. i just wanted to skip one step
[22:14:20] <mmecor>	 and introduce the path-file into the query
[22:14:23] <mmecor>	 instead of fetching results
[22:14:35] <mmecor>	 but it is not a big deal :)
[22:14:52] <zhuyifei1999_>	 k
[22:14:52] <mmecor>	 so no worries. thanks for the info
[22:15:08] <mmecor>	 the important issue is the performance with the db, which is my concern
[22:15:33] <mmecor>	 that's sth we'll know soon how to address it
[22:15:57] <mmecor>	 so i keep working :)