[01:10:32] <chicocvenancio>	 !log paws changed group of all userhome folders to tools.paws
[01:10:34] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL
[06:34:59] <wikibugs>	 (03PS1) 10Legoktm: Use Gerrit/Gitiles for downloading files instead of Phabricator [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/410645 (https://phabricator.wikimedia.org/T187150)
[06:35:49] <wikibugs>	 (03CR) 10Legoktm: [C: 032] Use Gerrit/Gitiles for downloading files instead of Phabricator [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/410645 (https://phabricator.wikimedia.org/T187150) (owner: 10Legoktm)
[06:36:05] <wikibugs>	 (03Merged) 10jenkins-bot: Use Gerrit/Gitiles for downloading files instead of Phabricator [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/410645 (https://phabricator.wikimedia.org/T187150) (owner: 10Legoktm)
[06:39:14] <wikibugs>	 (03PS1) 10Legoktm: Fix Python <3.6 compatibility [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/410646
[06:39:19] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Fix Python <3.6 compatibility [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/410646 (owner: 10Legoktm)
[06:40:25] <wikibugs>	 (03PS2) 10Legoktm: Fix Python <3.6 compatibility [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/410646
[06:40:33] <wikibugs>	 (03CR) 10Legoktm: [C: 032] Fix Python <3.6 compatibility [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/410646 (owner: 10Legoktm)
[06:40:48] <wikibugs>	 (03Merged) 10jenkins-bot: Fix Python <3.6 compatibility [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/410646 (owner: 10Legoktm)
[07:44:37] <wikibugs>	 (03PS1) 10Legoktm: Bump COMPOSER_PROCESS_TIMEOUT [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/410657
[07:44:39] <wikibugs>	 (03PS1) 10Legoktm: Update cached codesniffer versions [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/410658
[07:44:56] <wikibugs>	 (03CR) 10Legoktm: [C: 032] Bump COMPOSER_PROCESS_TIMEOUT [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/410657 (owner: 10Legoktm)
[07:44:59] <wikibugs>	 (03CR) 10Legoktm: [C: 032] Update cached codesniffer versions [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/410658 (owner: 10Legoktm)
[07:45:11] <wikibugs>	 (03Merged) 10jenkins-bot: Bump COMPOSER_PROCESS_TIMEOUT [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/410657 (owner: 10Legoktm)
[07:45:21] <wikibugs>	 (03Merged) 10jenkins-bot: Update cached codesniffer versions [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/410658 (owner: 10Legoktm)
[08:37:07] <wikibugs>	 (03CR) 10Legoktm: [C: 032] Use gitiles as repository viewer [labs/codesearch] - 10https://gerrit.wikimedia.org/r/410276 (https://phabricator.wikimedia.org/T187151) (owner: 10Legoktm)
[08:39:12] <wikibugs>	 (03CR) 10Legoktm: [C: 032] "Fixed ACL so jenkins should be able to submit." [labs/codesearch] - 10https://gerrit.wikimedia.org/r/410276 (https://phabricator.wikimedia.org/T187151) (owner: 10Legoktm)
[08:39:34] <wikibugs>	 (03Merged) 10jenkins-bot: Use gitiles as repository viewer [labs/codesearch] - 10https://gerrit.wikimedia.org/r/410276 (https://phabricator.wikimedia.org/T187151) (owner: 10Legoktm)
[08:43:52] <wikibugs>	 (03PS1) 10Legoktm: Fix gitiles anchor [labs/codesearch] - 10https://gerrit.wikimedia.org/r/410703
[08:44:01] <wikibugs>	 (03CR) 10Legoktm: [C: 032] Fix gitiles anchor [labs/codesearch] - 10https://gerrit.wikimedia.org/r/410703 (owner: 10Legoktm)
[08:44:15] <wikibugs>	 (03Merged) 10jenkins-bot: Fix gitiles anchor [labs/codesearch] - 10https://gerrit.wikimedia.org/r/410703 (owner: 10Legoktm)
[12:19:33] <wikibugs>	 (03CR) 10MarcoAurelio: "recheck" [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/410674 (owner: 10Libraryupgrader)
[12:24:53] <wikibugs>	 (03CR) 10MarcoAurelio: [C: 032] build: Updating mediawiki/mediawiki-codesniffer to 16.0.0 [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/410674 (owner: 10Libraryupgrader)
[12:51:15] <arturo>	 !log tools aborrero@tools-webgrid-generic-1401:~$ sudo apt-upgrade -u upgrade trusty-wikimedia
[12:51:20] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[12:57:03] <arturo>	 !log tools aborrero@tools-webgrid-generic-1401:~$ sudo apt-upgrade -u upgrade trusty-updates
[12:57:07] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[13:06:45] <arturo>	 !log tools aborrero@tools-webgrid-generic-1401:~$ sudo apt-upgrade -u upgrade trusty-tools
[13:06:50] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[13:13:55] <arturo>	 !log tools aborrero@tools-bastion-02:~$ sudo apt-upgrade -u upgrade trusty-wikimedia
[13:14:00] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[13:16:03] <arturo>	 !log tools aborrero@tools-bastion-02:~$ sudo apt-upgrade -u upgrade trusty-updates -y
[13:16:07] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[13:28:43] <arturo>	 !log tools aborrero@tools-bastion-02:~$ sudo apt-upgrade -u upgrade trusty-tools
[13:28:47] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[13:54:35] <arturo>	 !log tools cleanup ferm (deinstall) in tools-services-01 for T187435
[13:54:41] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[13:54:41] <stashbot>	 T187435: toolforge: clush can't connect to some instances - https://phabricator.wikimedia.org/T187435
[16:20:18] <dsaez>	 hi bd808! :D
[16:21:20] <bd808>	 hey dsaez. So you are having problems logging in to Horizon?
[16:21:27] <dsaez>	 yes.
[16:21:32] <bd808>	 Can you tell me what username you are using there?
[16:21:38] <dsaez>	 diego
[16:21:46] <dsaez>	 same than wikitech
[16:22:58] <bd808>	 andrewbogott: do you remember if Horizon is picky about username capitalization?
[16:23:24] <andrewbogott>	 I don't remember
[16:23:30] <bd808>	 dsaez: if it is, you may need to use "Diego"
[16:23:40] <dsaez>	 let me try
[16:23:48] <andrewbogott>	 dsaez, your 2fa is working on wikitech as well?
[16:23:48] <arturo>	 I use 'Arturo Borrero Gonzalez' as username -_-
[16:24:46] <dsaez>	 andrewbogott, yes, I configure it
[16:24:48] <Hauskatze>	 arturo: González, rename yourself :P
[16:24:54] <dsaez>	 bd808, no luck with Diego
[16:25:13] <dsaez>	 my username on the stats machines is dsaez, i've also tried with that, but no luck
[16:25:16] <bd808>	 ok. I just got logged into the server. let me see if I can find anything useful in the logs
[16:25:33] <arturo>	 Hauskatze: yeah, simpler everywhere without that symbol @_@
[16:26:04] <bd808>	 "dsaez" is your shell account name. "Diego" is your Wikitech account name. Horizon uses the latter.
[16:26:04] <Hauskatze>	 true that
[16:26:12] * chicocvenancio is chicocvenancio in SUL and signs as Chico Venancio and am Chico Venancio in LDAP and signa as chicocvenancio 
[16:27:39] <dsaez>	 bd808, no luck, same error
[16:27:40] <bd808>	 dsaez: unhelpfully all it is logging is `Login failed for user "Diego".`
[16:28:06] <dsaez>	 password should be the same than for wikitech, true?
[16:28:14] <bd808>	 correct
[16:28:50] <paladox>	 do you have 2fa enabled?
[16:28:59] <bd808>	 your LDAP record shows "pwdFailureTime: 20180215162725.253293Z"
[16:29:18] <bd808>	 so I think you may be getting your password wrong somehow
[16:29:42] <dsaez>	 let me restart the 2fa
[16:30:13] <dsaez>	 solved!
[16:30:27] <bd808>	 \o/
[16:30:45] <dsaez>	 bd808, paladox, andrew, thanks!
[16:30:57] <paladox>	 your welcome :)
[16:31:03] <arturo>	 dsaez: are you attending hackathon BCN?
[16:31:12] <dsaez>	 yes!
[16:31:27] <arturo>	 great :-) see you there
[16:34:27] <dsaez>	 ;)
[16:35:43] <Hauskatze>	 Hackathon en Barcelona?
[16:45:52] <dsaez>	 Hauskatze, yes
[17:04:13] <arturo>	 Hauskatze: https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2018
[17:18:37] <James_F>	 Hauskatze: You should come, it'll be fun.
[17:19:24] <Hauskatze>	 James_F: things are kinda tense over there
[17:19:32] <Hauskatze>	 + I'm busy :(
[17:19:37] <James_F>	 :-(
[18:18:55] <harej>	 halfak|Lunch: not a ML question per se, but do you know of any services that you can feed a corpus of documents, then for each document it tells you what the most "unique" terms are?
[18:18:59] <harej>	 As a way of classifying pages?
[18:20:59] <harej>	 underlying goal I want to achieve: I want to create a Wikimedia-wide list of current bots, but even if I compare all the user DBs together ultimately I'll only get a list of usernames which is not that interesting. It would be nice to get some additional data with those usernames
[18:42:45] <zhuyifei1999_>	 andrewbogott / matanya: something really weird is happpening on the encoding0[1-3] instances of the video project (other instances of the same project seems fine). Reading any file (listing directories is okay) on NFS gives EPERM (Operation not permitted). ditto with root. dmesg says 'NFS: Server nfs-tools-project.svc.eqiad.wmnet reports our clientid is in use' and 'NFS: Server labstore1003.eqiad.wmnet reports our clientid
[18:42:45] <zhuyifei1999_>	 is in use'. could you take a look?
[18:43:30] <andrewbogott>	 zhuyifei1999_: I can look in a few minutes.  madhuvishy might get a faster answer
[18:43:43] <zhuyifei1999_>	 ok
[18:44:43] <madhuvishy>	 zhuyifei1999_: ah, can you may be share an example of a file you're reading for each error
[18:45:03] <zhuyifei1999_>	  /home/zhuyifei1999/.bashrc
[18:45:44] <zhuyifei1999_>	 actually, any file shoes that error, even those that do not exist
[18:45:48] <madhuvishy>	 hmmm, works fine for me
[18:46:11] <madhuvishy>	 https://www.irccloud.com/pastebin/Xp9uft8t/
[18:46:16] <zhuyifei1999_>	 uh
[18:46:25] <madhuvishy>	 oh it's only in the encoding project?
[18:46:31] <madhuvishy>	 sorry I missed that
[18:46:33] <zhuyifei1999_>	 encoding0[1-3].video.eqiad.wmflabs
[18:46:40] <madhuvishy>	 okay
[18:58:18] <madhuvishy>	 hmmm zhuyifei1999_ I was able to remount dumps and scratch and those seem to be fine now
[18:58:23] <zhuyifei1999_>	 ok
[18:58:30] <madhuvishy>	 but home and project not yet
[18:58:40] <madhuvishy>	 I'm gonna try rebooting one of these is that okay?
[18:59:09] <zhuyifei1999_>	 either 1 or 3 is okay
[18:59:25] <madhuvishy>	 okay thanks
[18:59:36] <madhuvishy>	 !log video Rebooting encoding-01
[18:59:39] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Video/SAL
[18:59:53] <zhuyifei1999_>	 2 is serving. I'll depool it when I get a fully functional instance
[19:00:05] <madhuvishy>	 no problem
[19:00:18] <madhuvishy>	 are these jessie?
[19:00:34] <zhuyifei1999_>	 yeah
[19:01:04] <madhuvishy>	 okay 01 is looking better
[19:01:08] <zhuyifei1999_>	 k
[19:01:10] <madhuvishy>	 can you check?
[19:02:00] <zhuyifei1999_>	 yeah
[19:02:02] <zhuyifei1999_>	 thanks
[19:02:23] <madhuvishy>	 cool, rebooting the other two should fix too. let me know if something else comes up
[19:02:57] <zhuyifei1999_>	 ok
[19:03:29] <zhuyifei1999_>	 !log video depool encoding02, encoding01 is pooled by reboot
[19:03:31] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Video/SAL
[19:04:01] <zhuyifei1999_>	 !log video reboot encoding03
[19:04:03] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Video/SAL
[19:08:11] <andrewbogott>	 madhuvishy: thank you for taking that on!  I figured the solution would be 'restart some things' but wasn't sure which things :)
[19:09:02] <zhuyifei1999_>	 !log video schedule reboot on encoding02 1 day later with `sudo shutdown -r +1440`, scheduled for Fri 2018-02-16 19:07:47 UTC
[19:09:04] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Video/SAL
[19:10:12] <matanya>	 zhuyifei1999_: thanks for handling it with madhuvishy
[19:10:19] <zhuyifei1999_>	 np
[19:10:38] <matanya>	 i was going to suggest and do remount and reboot, but as usual madhuvishy was quicker
[19:11:25] <madhuvishy>	 andrewbogott: matanya yw :)
[19:47:05] <harej>	 How can I see what modules are available on PAWS? Other than importing and hoping for the best?
[19:51:07] <ebernhardson>	 harej: !pip install <thing> :)
[19:52:20] <ebernhardson>	 harej: otherwise you could do something rediculous like parse sys.path and report all the available stuff, but seems easier to declare the dependencies up front with `!pip install ...`
[19:52:32] <harej>	 Oh, interesting
[19:52:44] <harej>	 You can just do that in your notebook and it installs the dependency for you if it's missing?
[19:52:50] <ebernhardson>	 harej: yup
[20:24:19] <bd808>	 harej: you can also `pip freeze` from the cli and get a dump of all the things in your venv
[20:33:09] <harej>	 https://wikitech.wikimedia.org/wiki/PAWS/Tools demonstrates a very interesting, almost discursive approach to documentation.
[20:33:17] <harej>	 It's documentation that argues and disagrees with itself.
[20:33:32] <chicocvenancio>	 You can start a terminal and have a more familiar  interface 
[20:34:53] <chicocvenancio>	 But `!command` is quicker if you have a notebook open
[20:35:30] <harej>	 So does PAWS have a terminal interface distinct from the notebook thing?
[20:36:09] <chicocvenancio>	 Yes
[20:37:18] <chicocvenancio>	 Click on the new and choose terminal 
[20:38:00] <chicocvenancio>	 https://usercontent.irccloud-cdn.com/file/JsxwsD35/Screenshot_20180215-173720.png
[20:39:03] <chicocvenancio>	 https://usercontent.irccloud-cdn.com/file/u17Mfl1d/Screenshot_20180215-173819.png
[20:39:29] <chicocvenancio>	 Maybe we should point to here in that banner btw
[20:43:15] <harej>	 PAWS takes your OAuth credentials and applies them to PyWikiBot. So clever.
[20:44:32] <chicocvenancio>	 Yes
[20:45:25] <chasemp>	 yuvi is one clever dude
[20:45:41] <chicocvenancio>	 And pywikibot won't accept password Auth once oauth is set 
[20:46:05] <chicocvenancio>	 So it actively prohibits unsafe password files
[20:46:12] <harej>	 Sounds great