[00:05:36] <wikibugs>	 (03CR) 10Legoktm: [C: 032] "Thanks" [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/411521 (owner: 10Umherirrender)
[00:05:53] <wikibugs>	 (03Merged) 10jenkins-bot: Add lucene-explain-parser and textcat to upgrade list [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/411521 (owner: 10Umherirrender)
[07:32:54] <Kotz>	 help, i get "The remote server returned an error: (503) Service Temporarily Unavailable." when accessing wikipedia - is it a known downtime or am I doing somehing wrong? Used to work until a few days ago
[07:33:08] <Kotz>	 !help, i get "The remote server returned an error: (503) Service Temporarily Unavailable." when accessing wikipedia - is it a known downtime or am I doing somehing wrong? Used to work until a few days ago
[07:33:24] <Zackary>	 could you link the exact page it happens on?
[07:35:37] <Zackary>	 Kotz ^
[07:43:07] <Kotz>	 Zackarry: This is annoying: I added some debug printing to the ocde in order to find the URL and now it works OK. 
[07:43:17] <Kotz>	 is there a URL with "current status" of the the tools?
[07:44:15] <Zackary>	 there's https://status.wikimedia.org
[07:45:04] <Kotz>	 Zackary, thanks
[07:45:13] <Zackary>	 np
[10:35:59] <mmecor>	 !help hello, i am trying to set up a virtual environment and start installing packages but it seems not to work for me. i use pip install and every package gets stuck at half installation
[10:35:59] <wm-bot5>	 mmecor: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team
[10:36:14] <mmecor>	 could anyone more expert give me some advice?
[11:25:29] <mmecor>	 doesn't anyone know about virtual environments?
[12:16:36] <chicocvenancio>	 mmecor: it's just a time without people online 
[12:17:02] <chicocvenancio>	 were are you running pip? 
[12:20:10] <mmecor>	 chicocvenancio: i'm running the pip once i activated the virtualenv
[12:20:27] <mmecor>	 i tried creating the virtualenv in the default python version (2.7) 
[12:20:32] <mmecor>	 and i also did directly with 3
[12:20:49] <mmecor>	 the result is the same, packages are not properly installed using pip
[12:21:15] <mmecor>	 i did this (virtualenv venv) and this (virtualenv -p python3 venv)
[12:21:24] <mmecor>	 i tried to install the package reverse_geocoder
[12:21:29] <mmecor>	 which requires scipy and numpy
[12:21:59] <mmecor>	 the installation takes around 15 minutes (which means sth is not going right, since in my laptop is quite fast)
[12:22:26] <mmecor>	 and then when i enter in python and i use import reverse_geocoder, it says scipy.spatial is not there
[12:22:55] <mmecor>	 when the package was actually installed by the same pip reverse_geocoder and i also did it independently
[12:23:22] <mmecor>	 but no way, it does not work... i'm quite stuck as the situation repeats no matter which python version i choose
[12:25:03] <chicocvenancio>	 Ok, let me check 
[12:27:04] <chicocvenancio>	 How are you running your tool? Grid or k8s? 
[12:27:37] <mmecor>	 until now i wasn't, i was doing it locally. one year ago i was using the grid (sending jsubs)
[12:27:47] <mmecor>	 i don't know what is k8s
[12:28:17] <chicocvenancio>	 Kubernettes 
[12:28:57] <mmecor>	 this is just for webservices, right?
[12:29:06] <mmecor>	 i plan to run a webservice at a later stage of my project
[12:29:13] <mmecor>	 but now i'm struggling with the data
[12:29:13] <chicocvenancio>	 It's a container technology, if you tool can be run on it it is better
[12:29:55] <mmecor>	 i had not heard of it. my tool will generate datasets every 15 days / months (haven't decided yet)
[12:30:05] <mmecor>	 so i plan to send a sh script with a chron
[12:30:13] <mmecor>	 using qsub
[12:30:26] <chicocvenancio>	 Well, it can run other things, but for webservices it is easier to use
[12:30:39] <chicocvenancio>	 Sounds good
[12:30:46] <chicocvenancio>	 Your grid plans
[12:31:15] <mmecor>	 later, there will be a website reading those data either from csv files or a mysql database i created yesterday
[12:31:25] <mmecor>	 perhaps the website should be using kubernetes, right?
[12:32:37] <chicocvenancio>	 If it can, it is better 
[12:32:54] <chicocvenancio>	 mmecor: what's your shell user again? 
[12:33:27] <mmecor>	 u3532
[12:34:59] <chicocvenancio>	 I see a marcmiquel
[12:35:19] <mmecor>	 yup
[12:38:03] <chicocvenancio>	 So, you are activating your venv but are getting a pip error? 
[12:39:06] <mmecor>	 yes, i can create the venv with python 2.7 or python 3 as defaults (that works, and I check the version -v inside python)
[12:39:12] <mmecor>	 then i active any of them
[12:39:26] <mmecor>	 but once i start using pip to install packages,...
[12:39:38] <mmecor>	 i'm getting errors
[12:39:45] <mmecor>	 and they are not installed
[12:40:38] <chicocvenancio>	 What is the error? 
[12:41:13] <mmecor>	 several. let me check
[12:41:47] <mmecor>	 but i think they are saved in a log
[12:42:00] <mmecor>	 Storing debug log for failure in /data/project/wcdo/.pip/pip.log
[12:42:15] <mmecor>	   File "scipy/linalg/setup.py", line 19, in configuration
[12:42:15] <mmecor>	     raise NotFoundError('no lapack/blas resources found')
[12:42:15] <mmecor>	 numpy.distutils.system_info.NotFoundError: no lapack/blas resources found
[12:42:28] <mmecor>	 these are the last lines once i tried to install 'reverse_geocoder' package
[12:43:16] <mmecor>	 neither numpy or scipy are installed (and they are required for reverse_geocoder)
[12:45:58] <chicocvenancio>	 Let me check 
[12:47:39] <chicocvenancio>	 https://wikitech.wikimedia.org/wiki/Help:Toolforge/Web#Installing_numpy_/_scipy_/_things_with_binary_dependencies
[12:47:55] <chicocvenancio>	 Those instructions are for k8s
[12:48:11] <chicocvenancio>	 But, minus the webservice shell part
[12:48:28] <chicocvenancio>	 They should work for bastion venvs
[12:48:50] <chicocvenancio>	 In a nutshell, you need to install numpy and scipy
[12:49:43] <mmecor>	 yes, i know, but it didn't work. i'm going to try to follow those instructions, one sec
[12:51:25] <mmecor>	 numpy ok
[12:51:30] <mmecor>	 scipy :S
[12:51:34] <mmecor>	 many warnings... and...
[12:52:00] <mmecor>	 https://pastebin.com/2N8Z19Q0
[12:52:37] <mmecor>	 when i 'log' in python and i try to import reverse_geocoder it tells me that no module named scipy.spatial
[12:52:50] <mmecor>	 so i assumed the scipy installation didn't work
[12:53:30] <mmecor>	 now i'm upgrading pip
[12:53:43] <mmecor>	 just in case
[12:54:21] <chicocvenancio>	 yes, I believe that is a needed step
[12:55:22] <chicocvenancio>	 huh, I see numpy and scipy in you venv
[12:55:32] <mmecor>	 yes, i just installed scipy now
[12:55:39] <mmecor>	 now trying to import it 
[12:55:43] <chicocvenancio>	 and reverse-geocoder
[12:55:57] <mmecor>	 it takes ages to import it
[12:56:19] <mmecor>	 but i'm farther than i've ever been today :)
[12:57:10] <mmecor>	 hooray, reverse geocoder works!
[12:57:13] <mmecor>	 thanks chicocvenancio
[12:57:21] <chicocvenancio>	 you're welcome
[12:57:35] <mmecor>	 i did not think about upgrading pip
[12:57:39] <mmecor>	 that was a bit silly
[12:57:53] <chicocvenancio>	 i wouldn't either if it was not on the docs
[12:58:32] <mmecor>	 btw, which python version would you recommend me to use now that i have the choice?
[12:58:38] <mmecor>	 2.7 or a 3
[12:59:08] <chicocvenancio>	 I always go for 3 unless something doesn't allow me to
[12:59:17] <chicocvenancio>	 (old library not yet ported)
[12:59:30] <mmecor>	 yes, better a newer one, i see
[12:59:35] <mmecor>	 :)
[12:59:49] <chicocvenancio>	 specially with multilanguage wikis, makes live easier
[16:21:16] <andrewbogott>	 !log wikidata-topicmaps deleting all VMs and project
[16:21:18] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikidata-topicmaps/SAL
[18:32:37] <zhuyifei1999_>	 !log tools.quarry added a simple catch-all redirect rule to lighttpd.conf and switch webservice from python2 on kubernetes to lighttpd on gridengine T175881
[18:32:40] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.quarry/SAL
[18:32:40] <stashbot>	 T175881: Redirect Toolforge Quarry page to Cloud VPS Quarry - https://phabricator.wikimedia.org/T175881
[21:08:32] <Sveta>	 Hello tech services people (I dislike the word 'cloud', it's too vague).
[21:08:32] <Sveta>	 same origin policy prevents me from reading an external page html in my script
[21:08:32] <Sveta>	 I'm considering running a proxy at toolsforge, which would allow a gadget from a wikimedia wiki to fetch an external page and analyse it to get this information
[21:08:32] <Sveta>	 that'd allow me to populate templates like {{cite web}} with a gadget, including author information
[21:08:32] <Sveta>	 would that be against the labs or toolsforge terms of use?
[21:12:44] <Sveta>	 I could also restrict the proxy to local access only, and have the tool only provide the users with the page metadata (title, author, date, etc) wihout making the proxy available to the outside world
[21:13:29] <chicocvenancio>	 There are things that concern me in that idea
[21:13:53] <Sveta>	 hi chicocvenancio! yes?
[21:14:57] <chicocvenancio>	 Why did you want/need to violate same origin policy? 
[21:15:31] <Sveta>	 I'd like to write a user script that populates templates like {{cite web}} with information on the author of the page being cited.
[21:16:13] <chicocvenancio>	 Like Zotero for the visual editor? 
[21:18:09] <Sveta>	 I am writing the script for the source editor. I'd be glad to steal some codes or APIs from zotero if they are available.
[21:18:55] <chicocvenancio>	 The new source editor has Zotero as well
[21:19:35] <chicocvenancio>	 Porting it to the old editor sounds like a worthy task
[21:20:39] <Sveta>	 Where is zotero documented?
[21:21:12] <chicocvenancio>	 But there a lot of ways to make things wrong and make users insecure 
[21:21:42] <chicocvenancio>	 Not sure, I think visual editor documentation is the best bet
[21:23:26] <Sveta>	 Zotero looks like a translator thing.
[21:28:01] <Sveta>	 I am trying it out here.
[21:28:01] <Sveta>	 https://en.wikipedia.org/api/rest_v1/#!/Citation/getCitation
[21:28:10] <Sveta>	 As a sample URL I provided http://www.latimes.com/world/la-fg-mexico-helicopter-crash-20180217-story.html
[21:28:27] <Sveta>	 This gave me the author and access date, but not the date the story was published.
[21:38:38] <Sveta>	 Ok, this is handy.
[21:38:43] <Sveta>	 Thanks chicocvenancio.
[22:46:27] <zhuyifei1999_>	 !log tools.paws `# find /data/project/paws/userhomes/ -maxdepth 1 -user root | xargs chown -v tools.paws:tools.paws`. Affected: 17295220 & 53267907 T185434
[22:46:30] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.paws/SAL
[22:46:30] <stashbot>	 T185434: PAWS fails creating a server for new user  - https://phabricator.wikimedia.org/T185434