[00:05:53] chrismcmahon, can you open up the network tab in developer tools (assuming you're using chrome) and find the exact response given when you hit https://bugzilla.wikimedia.org/show_bug.cgi?id=50623 ? [00:06:13] Krenair: looking [00:13:56] Krenair: well, it seems to work now, though I wonder why it says "100% found what they were looking for" ヾ [00:14:54] Where does it say 100% AzaToth? [00:15:16] under show all comments [00:16:48] Krenair: http://i.imgur.com/HxRc4UN.png [00:17:00] huh [00:17:03] Krenair: or is it that it rounds up ツ [00:17:22] Krenair: afaict the response is the Mediawiki API documentation page [00:56:24] I know why my key got rejected to that random instance earlier - forgot to turn on agent forwarding -.- [00:56:34] can anyone walk me through mounting /data/project on a labs instance? [04:49:11] @trusted [04:49:11] I trust: petan!.*@wikimedia/Petrb (2admin), .*@wikimedia/.* (2trusted), .*@mediawiki/.* (2trusted), .*@wikimedia/Ryan-lane (2admin), .*@wikipedia/.* (2trusted), .*@nightshade.toolserver.org (2trusted), .*@wikimedia/Krinkle (2admin), .*@[Ww]ikimedia/.* (2trusted), .*@wikipedia/Cyberpower678 (2admin), .*@wirenat2\.strw\.leidenuniv\.nl (2trusted), .*@unaffiliated/valhallasw (2trusted), [04:50:09] Cyberpower678: What's the best irc client? [06:43:45] * Hazard-SJ says hello, and asks for either Coren or petan [07:10:58] !ping [07:10:58] pong [07:10:58] pong [07:14:21] !ping is pong [07:14:22] pong [07:14:22] You are not authorized to perform this, sorry [07:14:22] Key was added [07:14:29] !ping [07:14:30] pong [07:14:30] pong [07:14:30] pong [07:19:15] hi [07:36:13] @part [07:36:13] Permission denied [07:38:41] zhuyifei1999: did you try pidgeon? :P [07:38:47] that's irc client I made [07:39:44] petan: ? [07:39:56] you asked what is a best irc client [07:40:27] @notify Hazard-SJ [07:40:27] I'll let you know when I see Hazard-SJ around here [07:41:28] petan: can't find it on wikipedia [07:41:38] http://pidgeonclient.org [07:41:44] because nobody did insert it there yet [07:42:03] wikipedia contains notable software not new projects [07:42:54] It's not notable when it's the best software? [07:44:48] yes [07:44:59] being notable != best [07:45:22] there are lot of best things, that people have no idea about [07:46:19] ok, switching. [08:01:53] petan: How to use? [08:02:13] zhuyifei1999 did you install it? :P btw you don't need to switch you can run both [08:02:22] zhuyifei1999 what's your OS [08:03:02] ubuntu [08:03:07] Ubuntu 12.04 LTS [08:03:16] install package, then run command pidgeon anywhere to start it [08:03:21] you can create a shortcut for it [08:03:33] alt + f2 -> pidgeon [08:03:41] already done, but its blank [08:03:48] how blank? o.O [08:04:01] did you download latest version? 1.2.3 [08:05:28] Its the latest version, and when I try to join, it says that I'm not connected. [08:08:19] ? [08:16:10] switching [08:16:45] OMG [08:16:52] that guy keep quitting [08:19:02] zhuyifei1999 you need to connect first to join channels :D [08:19:09] petan: finally got it working [08:19:39] well, pidgeon is designed for people who understand how irc works, for irc newbies it might not be best client :< [08:21:24] btw I am still writing documentation, having a feedback on what is hard to do, might help me to document it well [08:21:46] pidgeon can do almost anything, it's just that people might not know how to do that [08:22:04] so if you don't know how to do something just ask and I will document it :> [08:22:16] ok [08:22:33] you figured how autocompletion works? [08:22:33] petan: why does the three bots on this channel have a + before its name? [08:22:40] because they are voiced [08:22:51] they also should be displayed with different color [08:22:57] green [08:22:59] yes [08:23:04] that's in default skin [08:23:13] there are things called channel modes [08:23:22] if you right click in text are and click channel you will see the options [08:23:26] with description [08:23:54] pidgeon automatically detect which software the network you connect to run and adjust this information [08:24:10] when you hover over the network name in side list, you should see version of irc server [08:25:27] cool [08:26:11] if you press f1 it will open browser with help pages... [08:26:18] you can improve them yourself because it is a wiki :P [08:27:23] btw autocompletion works even on commands, so for example /j + tab will make it /join [08:29:36] petan: why can't whois work? [08:29:52] it surely does, but output is probably displayed in network window [08:42:56] btw zhuyifei1999 you can always request new features here: http://pidgeonclient.org/bugzilla/ [08:57:04] petan: What's the license for the wiki? [09:28:11] !ping [09:28:11] pong [09:28:11] pong [09:33:30] [bz] (8NEW - created by: 2Aude, priority: 4Unprioritized - 6normal) [Bug 50730] site_domain column contains just a dot - https://bugzilla.wikimedia.org/show_bug.cgi?id=50730 [09:51:39] !smoke [09:51:39] * Helpmebot sets {0} over hickory smoke and waits for the taste to be just right, then eats {0}. [10:37:21] zhuyifei1999 it's WTFPL [10:39:59] petan: I meant the wiki, not the software [10:41:06] Is it really Do What the Fuck You Want to Public License too? [10:53:15] petan: which module is required to do @recentchanges-on? [10:56:36] hehe, my git bot is also wtfpl :) [10:59:44] YuviPanda: what does your bot do? [10:59:57] zhuyifei1999: oh, it pulls github pull requests into gerrit [11:01:27] gerrit-wm? [11:03:43] zhuyifei1999 software is GPL, wiki is WTFPL [11:05:28] petan: ok, thanks [11:08:07] Cyberpower678: am I right now? [11:11:04] Cyberpower678: and having my nickname as advanced is dangerous. It would be better if having my username. [11:13:34] Cyberpower678: ? [11:14:31] !ping [11:14:31] pong [11:14:31] pong [11:15:30] petan: which module is required to do @recentchanges-on? [11:16:08] zhuyifei1999 I think that rc? [11:17:54] I am trying $ ssh -A fnielsen@bastion.wmflabs.org, but it seems that I lack the " Shell access" for bastion. Is is possible to get one? I am already on the toolserver as fnielsen having experimented with a network visualization service: http://toolserver.org/~fnielsen/cgi-bin/revvis [11:19:01] petan: How can I define sites? [11:19:16] there is a file sites [11:19:19] sec [11:20:39] http://bots.wmflabs.org/~wm-bot/sites [11:20:40] here [11:34:29] petan: Is it the feed file in configuration [11:34:44] this file is in root [11:34:49] not in config folder [11:36:24] than what's the feed file? [11:39:11] feed is configuration file for a channel [11:39:17] sites is global definition of wiki's [11:39:27] each channel can configure the feed for these wikis [11:54:43] petan: does it have any lag? [11:54:56] ? [11:55:00] what you mean [11:56:34] Does it update as soon as an edit happened? [11:56:55] it report to channel as soon as it read the edit from wikimedia irc [11:57:48] Any third-party wikis supported? [11:57:55] no [11:57:59] it read wikimedia irc feed [12:00:07] zhuyifei1999, sorry I was in bed. [12:00:43] Cyberpower678: It's ok [12:01:13] And my computer went to sleep as you were sending me messages so I only got have of it. [12:07:23] zhuyifei1999, what did you want? [12:09:19] he wanted to recommend some irc client :3 but I sorted it out [12:10:32] Cyberpower678: I'm thinking of having my username as advanced instead of nickname since nickname is too dangerous. [12:10:52] o.O [12:11:02] Except I can't do it until you have a cloak. [12:11:25] Any one can have it unless I use my password to kick them out. [12:11:46] anyone can have your username as well [12:12:28] zhuyifei1999, turn on enforcer. [12:12:40] petan: unless it expire or I tell him my password [12:13:04] ah you are talking about record at nickserv? [12:13:26] well, that has nothing to do with irc identity [12:14:10] ^trusted [12:14:19] your bot is gone? [12:14:50] petan: I killed it [12:14:56] poor bot [12:22:14] !trout zhuyifei1999 [12:22:15] * Helpmebot slaps zhuyifei1999 with a ten pound trout. [12:22:36] Sorry. I needed to trout someone. :p [12:22:59] get a cloak [12:23:13] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/List of Toolserver Tools was modified, changed by Nemo bis link https://www.mediawiki.org/w/index.php?diff=724923 edit summary: [+33] /* Intro */ Magnus tools, tracked at [[w:en:User:Magnus Manske/tools2port]] [12:30:59] ^trusted [12:31:02] ^trusted [12:31:17] ^trusted [12:31:29] ^trusted [12:31:34] @trusted [12:31:35] I trust: petan!.*@wikimedia/Petrb (2admin), .*@wikimedia/.* (2trusted), .*@mediawiki/.* (2trusted), .*@wikimedia/Ryan-lane (2admin), .*@wikipedia/.* (2trusted), .*@nightshade.toolserver.org (2trusted), .*@wikimedia/Krinkle (2admin), .*@[Ww]ikimedia/.* (2trusted), .*@wikipedia/Cyberpower678 (2admin), .*@wirenat2\.strw\.leidenuniv\.nl (2trusted), .*@unaffiliated/valhallasw (2trusted), [12:31:55] ^trusted [12:32:21] ^restart [12:33:30] ^trusted [12:33:48] ^whoami [12:33:48] You are root identified by name zhuyifei1999.* [12:34:19] petan: why doesn't ^trusted work? [12:35:51] using the old one [12:36:09] @trusted [12:36:09] I trust: zhuyifei1999.* (2admin), petan!.*@wikimedia/Petrb (2admin), [12:36:10] I trust: petan!.*@wikimedia/Petrb (2admin), .*@wikimedia/.* (2trusted), .*@mediawiki/.* (2trusted), .*@wikimedia/Ryan-lane (2admin), .*@wikipedia/.* (2trusted), .*@nightshade.toolserver.org (2trusted), .*@wikimedia/Krinkle (2admin), .*@[Ww]ikimedia/.* (2trusted), .*@wikipedia/Cyberpower678 (2admin), .*@wirenat2\.strw\.leidenuniv\.nl (2trusted), .*@unaffiliated/valhallasw (2trusted), [12:37:56] @trustdel zhuyifei1999.* [12:37:56] You are not authorized to perform this, sorry [12:37:56] You can't delete yourself from db [12:38:50] Permission denied [12:38:50] Channel config was reloaded [12:38:56] @trusted [12:38:56] I trust: petan!.*@wikimedia/Petrb (2admin), .*@wikimedia/.* (2trusted), .*@mediawiki/.* (2trusted), .*@wikimedia/Ryan-lane (2admin), .*@wikipedia/.* (2trusted), .*@nightshade.toolserver.org (2trusted), .*@wikimedia/Krinkle (2admin), .*@[Ww]ikimedia/.* (2trusted), .*@wikipedia/Cyberpower678 (2admin), .*@wirenat2\.strw\.leidenuniv\.nl (2trusted), .*@unaffiliated/valhallasw (2trusted), [12:38:57] I trust: zhuyifei1999.* (2admin), petan!.*@wikimedia/Petrb (2admin), [12:39:56] @trusted [12:39:56] I trust: petan!.*@wikimedia/Petrb (2admin), .*@wikimedia/.* (2trusted), .*@mediawiki/.* (2trusted), .*@wikimedia/Ryan-lane (2admin), .*@wikipedia/.* (2trusted), .*@nightshade.toolserver.org (2trusted), .*@wikimedia/Krinkle (2admin), .*@[Ww]ikimedia/.* (2trusted), .*@wikipedia/Cyberpower678 (2admin), .*@wirenat2\.strw\.leidenuniv\.nl (2trusted), .*@unaffiliated/valhallasw (2trusted), [12:39:56] I trust: zhuyifei1999.* (2admin), petan!.*@wikimedia/Petrb (2admin), [12:41:24] @trusted [12:41:24] I trust: petan!.*@wikimedia/Petrb (2admin), .*@wikimedia/.* (2trusted), .*@mediawiki/.* (2trusted), .*@wikimedia/Ryan-lane (2admin), .*@wikipedia/.* (2trusted), .*@nightshade.toolserver.org (2trusted), .*@wikimedia/Krinkle (2admin), .*@[Ww]ikimedia/.* (2trusted), .*@wikipedia/Cyberpower678 (2admin), .*@wirenat2\.strw\.leidenuniv\.nl (2trusted), .*@unaffiliated/valhallasw (2trusted), [12:41:24] I trust: zhuyifei1999.* (2admin), petan!.*@wikimedia/Petrb (2admin), [12:55:58] o.o [12:57:43] no idea [12:58:21] you are using very old version of bot core [12:58:25] it might be that [13:05:27] @part [13:05:28] Permission denied [13:06:27] I used the latest git version [13:15:34] zhuyifei1999 it was latest maybe yesterday ;) [13:57:26] Coren, petan: I'm going to fix my crontab now. [13:57:38] * petan pats Cyberpower678 [13:57:40] good dog [13:57:46] :0 [13:57:54] As in make my scripts run continuously and submit continuous jsub command. [13:58:04] very good dog [13:58:23] petan, I'm dogs can't program. :p [13:58:31] *I'm pretty sure [13:59:57] no worries: http://dashburst.com/wp-content/uploads/2013/06/on-the-internet-nobody-knows-youre-a-dog-meme.jpg [14:00:27] lol [14:02:02] petan: How did you >>>>>>petan pats Cyberpower678? [14:02:39] /me [14:03:19] * zhuyifei1999 thanks Cyberpower678 [14:03:30] There you go. [14:04:19] Yeay Cyberpower678! [14:04:29] !smoke [14:04:29] * Helpmebot sets {0} over hickory smoke and waits for the taste to be just right, then eats {0}. [14:19:52] AzaToth!! [14:19:58] your update still doesn't work [14:20:05] neither libprocps >= 3.3.6 or proc was found [14:20:11] it should look for libproc not proc [14:20:18] meh [14:28:58] Coren, when submitting the jsub command do I use -cunt or -continuous [14:28:59] ? [14:29:06] *-cont [14:29:08] :/ [14:29:18] did you try man jsub [14:29:38] petan, what? [14:29:38] it's -continuos [14:29:41] it's -continuous [14:29:43] -continuous; but you probably want to just use jstart which is much less verbose. :-) [14:29:55] Coren, no thanks. [14:29:56] (since it implies -continuous and -once) [14:30:00] I've got. [14:30:48] hey guys! What do i need to install an mediawiki+extension in wmflabs, to test [14:31:15] you typically need a wiki :-) [14:31:21] which you can install it to [14:31:24] Coren, 589640 is now running continuously. [14:31:31] Raylton you can create a wiki on tools project [14:31:50] petan, ^^ [14:31:57] Cyberpower678: good work [14:32:01] if i do 'become foo' and put stuff to public_html, how do i access it? [14:32:05] on to the next [14:32:14] gry: http://tools.wmflabs.org/foo [14:32:39] petan: hmm [14:32:40] petan,how to do it? what I need to read? [14:32:52] AzaToth: I already fixed that but now I have still /etc problem [14:32:55] petan: it looks for libproc [14:33:02] AzaToth ah hold on, I found it [14:33:03] the message I wrote manually [14:33:15] AzaToth no, it looks for procps, I fixed it [14:33:34] it looks first for procps, if not found, it looks for proc [14:33:45] https://github.com/benapetr/terminator/commit/91935531327f6739dd9fe6dcdc4f6990cb1c7d2e [14:33:49] petan, grr. I have to kill the script. [14:33:54] it should look for libproc, not proc [14:33:59] Cyberpower678 do it! [14:34:06] petan: hmm, that should not work [14:34:11] petan, I am. [14:34:14] that /works/ [14:34:24] AzaToth: I just sucessfuly built it using this patch [14:34:31] strange [14:34:35] strange, but works [14:34:53] petan: the entry there is what you usually type after -l [14:35:05] please let me know when you talk to me [14:35:13] apparently not on ubuntu version of scons [14:35:20] petan, what's the command line code to delete a file? [14:35:31] petan: offcourse it should have been "proc" not "procps"... [14:35:56] nvm [14:35:57] petan: I was testing it locally, and had to test it against procps, without using pkg-config, and forgot to change it to proc [14:36:02] Raylton I told, you: a) create a project on tools b) install mediawiki c) have a beer d) install extension e) have another beer f) go sleep [14:36:37] petan: anyway, if you accept a pull-req, I assume you accept it ツ [14:36:56] I assume you know how it works better than me thus it's correct and working :P [14:37:35] petan: change it to "proc" and try again. I assume scons just remove "lib" from it first [14:38:00] petan, you have documentation about 'tools', for beginner? [14:38:06] !tooldocs [14:38:06] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help [14:38:09] yes [14:38:27] petan: that's tool docs, not tools docs [14:38:31] ;-P [14:38:46] petan, thank you [14:39:25] !toolsdocs | AzaToth [14:39:26] AzaToth: https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help [14:39:28] :P [14:39:37] ツ [14:39:48] this bot knows what you actually meant, and fix the typo for you XD [14:39:54] ツ [14:39:57] because it knows we are all stupid [14:39:58] petan: I must say: Your commit messages are really expressive [14:40:08] yes they are :D [14:40:22] petan, I thought we were all village idiots. [14:40:33] I try to spend most of my time to do actual programming and less as possible fidling with git [14:40:46] Cyberpower678: just you :P [14:41:00] !whale petan [14:41:01] * Helpmebot slams petan with a 10-tonne whale. [14:41:29] petan, and you're now a pancake. [14:42:06] * AzaToth slams Cyberpower678 with a 10 Mg whale [14:42:14] * petan turned to ._._.. [14:42:36] * Cyberpower678 is underground. A whale can't fit. [14:42:49] it's gaseous [14:42:50] * YuviPanda slams AzaToth with a notice saying 'Anything we write needs to be built with Autotools, and autotools only. Signed, Ops' [14:42:51] ah, you village idiots, living underground [14:43:10] * AzaToth gives YuviPanda the finger [14:43:16] !electrocute everyone [14:43:16] * Helpmebot strikes everyone with lightning. [14:43:18] was that built with Autotools? [14:43:20] is there a formal place to describe what a tool does after adding it to https://wikitech.wikimedia.org/wiki/Special:NovaProject ? [14:43:23] if not, iz illegal! [14:43:30] !charge AzaToth [14:43:30] * Helpmebot shouts "DOCTOR OCTAGONAPUS!", and completely annihilates AzaToth. [14:43:45] that bot really is everything but helpful [14:43:45] gry: I think you can add a .description file to the tool home? [14:43:49] YuviPanda: if that was a rule, I would hit the door asap [14:44:04] well, if we were *really* flattening people with whales... [14:44:13] !toolsdoc [14:44:13] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help [14:44:19] YuviPanda: i'll try, 'toolname.description'? where will the description appear? [14:44:25] looking, moment [14:44:28] YuviPanda, lol [14:44:32] gry: no [14:44:42] gry: it's just .description in home [14:44:48] gry: see https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help#Tool_Labs.27s_landing_page [14:44:48] like .bashrc [14:44:50] aye, i see [14:53:20] Coren, or petan: In the event that something causes the scripts to stop, will they automatically restart? [14:53:47] I think it depend on reason [14:53:53] Cyberpower678: So log as it doesn't exit with a return status of 0 (indicating completion), or it hasn't been killed for cause of OOM [14:53:54] if it's OOM then not [14:54:04] so long* [14:54:13] What's OOM? [14:54:18] out of memory [14:54:44] Well that shouldn't happen with the scripts. It shouldn't run out of memory. [14:54:56] why not [14:55:03] scripts require interpretor to run [14:55:09] which is memory expensive in most cases [14:55:16] Cyberpower678: In which case, as long as they don't exit 0, then they'll keep running. [14:55:47] petan: Scripts can also lmit their own memories. PHP, for instance, won't OOM ever (they don't grow past their maximum( [14:55:48] Cool. They shouldn't now. It's got a while(true) { stuff } [14:56:10] Cyberpower678 I think you should change it [14:56:16] petan: Why? [14:56:26] Why? [14:56:30] like... that thing inside of while(true) { ... } [14:56:42] could be likely implemented as a one time task [14:56:49] that could be repeatedly submited as a new task [14:57:03] which is likely more resource effective [14:57:13] but it depends on what is there [14:57:14] ... petan, that's exactly what he's trying to avoid, for exactly the wrong reason. [14:57:25] ah really? [14:57:40] You don't /want/ to start a new job every minute. THAT is a horrible drain on resources. [14:57:53] petan, I've been pressured to switch to continuous functions for the tasks with * * * * * [14:58:08] for example if you were running archive bot which is supposed to archive twice a day, you should have while (true) { archive(); sleep(3600 * 12); } [14:58:12] So now I am. [14:58:19] but rather submit the task twice a day [14:58:21] petan: You're missing the point. [14:58:32] ah he's doing it every minute [14:58:37] in that case it's probably better [14:58:39] petan: Right. [14:59:27] at some point sge shouldn't drain horrible amount of resources when starting a simple process :D [15:00:04] petan: Not just SGE. Having cron fire every minute is bad as well. [15:00:25] hmm... didn't you do the same on -master [15:00:32] like resync of that file [15:00:44] Every ten minutes, IIRC [15:00:56] evil Coren! D: [15:01:16] Task 2 converted. [15:01:22] And a copy is (relatively) lightweight; there's a balance to be acheived in this case between "reasonably responsive" and "drain on resources" [15:02:02] (That said, the very vey best way of doing it would be a deamon that sleeps on an inotify, but if I had the time to write every deamon I'd want to...) :-) [15:02:14] Coren, petan: And if NFS ever fails, my bot will keep going and I can't be blamed for excessive loads. :p [15:02:33] we will find another reason to blame you [15:03:29] whatever it is... Cyberpower678 is responsible! [15:03:52] !charge petan [15:03:53] * Helpmebot shouts "I BE FIRIN MAH LAZORS!", aims and fires at petan. [15:03:58] !failure is Cyberpower678 is responsible! [15:03:58] Key was added [15:04:30] !learn failure petan is responsible. [15:04:37] !failure [15:04:37] Cyberpower678 is responsible! [15:04:37] petan is responsible. [15:04:41] :D [15:04:49] !helpmebot is liar [15:04:49] Key was added [15:05:11] !learn wm-bot liar [15:05:19] !wm-bot [15:05:19] liar [15:05:19] http://meta.wikimedia.org/wiki/WM-Bot [15:45:43] Coren: Could you make me a member of "shelladmins" on wikitech? [15:46:41] scfc_de: Sure, and good idea. [15:47:39] scfc_de: {{done}} [15:48:00] Coren: Thanks. We basically accept anyone who looks human and not evil? [15:48:21] scfc_de: Yep. The primay check I do is check contributions for presence of spambotness. [15:48:40] scfc_de: The bit exists not so much as a barrier of entry as a method to pull it back in case of trouble. [15:49:00] Coren: Okay. [15:50:39] scfc_de if you find a spambot, create a ticket on bugzilla and make it dependent on that blockuser bug [15:50:54] so that once the feature is fixed we can block them XD [15:52:57] petan: You mean https://bugzilla.wikimedia.org/show_bug.cgi?id=49811? Very confusing to read. [15:57:57] [bz] (8NEW - created by: 2Peter Bena, priority: 4High - 6critical) [Bug 49811] Block user is broken on wikitech - https://bugzilla.wikimedia.org/show_bug.cgi?id=49811 [16:00:44] scfc_de yes because I am very confusing person [16:00:50] gtg [16:15:01] scfc_de: Yes, the *bug* is confusing as well. If we block a user on wikitech, it seems that at some point in the indeterminate future that will end up blocking some other random user instead. [16:17:07] Coren: Ah, okay. Memo to self: Don't apply for blockuser right :-). [16:50:53] hi [16:53:06] I have a little problem to create a tool account. I am approved (in the shell usergroup) but the access to [[Special:NovaProject]] is denied for me [16:57:53] brb [17:00:48] Linedwell: You might need to log out and in again so that wikitech recognizes that you have that right. [17:01:26] okay, I'll try after my lunch [17:01:30] thanks scfc_de [17:39:08] great, it works. thanks :) [17:39:10] bye [18:31:03] I am having a hard time adding a user to a group in gerrit. The user claims to have a labs account, but it does not show up when querying through gerrit. [18:31:22] Is there a way to check whether or not the username exists? [18:31:33] (If one does not have direct LDAP access) [18:35:13] qchris: hacky way might be to check via https://wikitech.wikimedia.org/wiki/Shell_Request/Fuxuan [18:35:20] replace Fuxuan with the username? [18:35:24] and see if that exists? [18:35:28] since this is autocreated on account creation [18:35:32] Thanks :-) [18:35:35] * qchris tries that [18:35:35] i'm sure there are much less hacky ways [18:36:10] qchris: you could also try https://wikitech.wikimedia.org/wiki/User: [18:36:15] if that user isn't registered that is shown in red [18:37:48] That worked. Thanks YuviPanda [18:37:53] :) [18:59:36] Hi! Is there an XSLT processor on tool labs? If not, is it possible to install "php5-xsl" that is the official PHP module that provides an XSLT processor? [19:02:23] petan: ^ [19:02:27] Tpt_: should be possible! [19:02:50] YuviPanda: Good :-) [19:03:38] I'll be useful for a conversion system to import content into Wikisource. [19:05:06] Tpt_: ah, nice. petan or scfc_de should be able to install it for you. [19:05:12] i can submit a puppet patch in a while too [19:07:06] Thanks :-) It's amazing! [19:07:30] I have a CPU-bound tool-labs process I can spread accross an arbitrary number of CPUs. It'll consume around 20 CPU-hours. How many cores is it sensible to set it up for? Am I right in thinking there are 24 corel servicing the job queue ? [19:07:31] :) [19:12:22] scfc_de: petan we should try to move all the packages we have installed into puppet, I think. [19:14:24] Tpt_: https://gerrit.wikimedia.org/r/72002 will add that package when it is merged. We now have to just wait for Coren to merge that (+ dependent package) [19:15:20] tb3: It's a reasonable assumption, but are you intending to use the gridengin parallel processing system or are they mutually independent jobs? [19:15:32] YuviPanda: I go review now. [19:16:02] Coren: I'm also looking at the installed packages on an exec node, and adding to puppet any perl / php / python modules that don't exist [19:18:27] YuviPanda: It may or may not make sense to do so unless there is an explicit request for the package; many of those are autoinstalled dependencies I don't want to pull in explicitly if they are not needed. [19:18:30] okay, I'm not going to do perl, since I've no idea which ones come by default with the system and which ones don't [19:18:33] Coren: indeed [19:18:36] that's what I just found out [19:18:47] so I'm going to just find the ones that are *obviously* installed by request [19:18:56] and ignore perl altogether [19:19:16] Coren: It's an algorithm being applied to each of 4.4 million records in a user database. I run separate processes, giving each a range of records to process. Entirely independant. [19:21:31] wtf do we have python-psyocpg2 installed for? [19:21:36] are we running a hidden postgres service? [19:24:15] YuviPanda: use v5.12; [19:24:15] Tpt_: that patch was merged. that library should be installed automatically shortly now :) [19:24:20] problem solved [19:24:25] AzaToth: ? [19:24:38] YuviPanda, Coren: Thanks a lot :-) [19:24:39] if you want to make sure you are using the right version of perl [19:25:22] AzaToth: ah, no. I was trying to get the list of packages that we have installed by user request on to puppet, but dpkg doesn't tell me which were installed directly and which were pulled in as dependencies of something else [19:25:26] ah, you might know! [19:25:32] is there any way to figure such a list out? [19:25:41] 'list of packages that were installed explicitly'? [19:25:57] Coren: we might want to start having a soft-policy of 'install manually, but also do a puppet patch'? [19:25:59] manually installed packages are marked as such [19:27:10] also why do we have Tk related libraries :| [19:27:15] we also seem to have some X related ones [19:27:16] wat [19:27:52] YuviPanda: tk/s might be a dev-deps [19:27:55] x* [19:28:40] hmm, my apt foo is weak. do you know the way to find such 'marked manually' packages off the top of your head? [19:28:43] * YuviPanda reads man page [19:30:57] YuviPanda: you can use aptitude instead [19:31:15] google tells me 'aptitude search '?installed ?not(?automatic)' | less' [19:31:51] yea [19:33:59] YuviPanda: Actually, we have a policy of "don't install manually, do a puppet patch instead" :-) [19:34:11] really?! :D [19:35:50] YuviPanda: /var/lib/apt/extended_states [19:36:00] Auto-Installed: 1 [19:36:14] ah [19:36:16] nice! [19:39:16] YuviPanda: You *should* be able to gather manually installed packages from the sysadmin log. [19:39:27] scfc_de: aaah, right. that's there! [19:39:33] might be easier, since it'll also have reasons [19:39:34] !sal [19:39:34] https://wikitech.wikimedia.org/wiki/Labs_Server_Admin_Log [19:40:03] Tpt_: If you are just interested in pure XSLT, there's also xsltproc -- fast, but just XSLT. [19:40:08] grep "apt-get install" /home/*/bash_history /root/bash_history [19:41:58] AzaToth: That wouldn't work; I use aptitude as a rule. And that'll catch install-to-upgrade [19:42:10] Coren: true [19:42:19] (By default, I use 'present' in puppet to avoid surprise upgrades) [19:42:54] YuviPanda: You probably noticed, but in Puppet I try to add comments to package requests so that we have some information if in a future release of Ubuntu some of these packages are no longer available and we have to decide whether to build it ourselves or adapt the programs that require it. [19:43:15] Coren: grep -B 2 'Auto-Installed: 0' /var/lib/apt/extended_states | grep Package | cut -f 2 -d ' ' [19:43:28] is teh ugly one [19:45:21] bleh, stupid connection [19:45:30] Coren: there are lots of packages installed that aren't on puppet :) [19:45:52] I said there was a policy, not that it had ever been adhered to that well in the past. :-) [19:46:14] hopefully it is in the future [19:46:17] i'm doing python for now [19:46:18] And don't count -login and -dev; those have stuff installed on a ad-hoc basis for one-off builds. [19:46:20] looking from SAL [19:46:35] Coren: not looking at build files, but at SAL [19:46:37] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [19:46:51] still, pytohn-tk?! [20:13:53] anyone here really know python? [20:14:15] Im trying to work out an idea but Im kinda not sue how to do it [20:14:33] hey Betacommand [20:14:38] hay [20:14:39] what is up with Python? [20:14:52] Im trying to convert a web page to PDF using python [20:15:17] ah okay [20:15:20] found a library for it? [20:15:30] YuviPanda: No [20:15:39] thats why Im asking [20:15:59] googling gives me https://pypi.python.org/pypi/pisa/ [20:16:36] wow not sure why my googling didnt find that ... :( [20:17:39] Betacommand: :D [20:17:45] I just googled 'python html to pdf' [20:17:57] err [20:17:59] python html2pdf [20:18:02] is wha ti googled [20:18:10] YuviPanda: I googled something very similar to your first thing [20:18:30] that still has this in the first page [20:32:00] * Betacommand goes to force PIL to compile [20:33:41] Betacommand: want to install PIL? Can submit a puppet patch, should be easier [20:34:09] YuviPanda: I need it working on my local machine first [20:34:15] ah, okay ;) [20:34:43] However I have VS2010 installed and python uses VS2008 compiler [20:35:45] YuviPanda: python-pdftools, python-poppler, and python-pypdf [20:36:00] Betacommand: ^ [20:36:38] also python-pdfrw [20:37:55] YuviPanda: getting this to labs is at least 3 months away, and will require an email to legal [20:38:00] ah [20:38:01] :D [20:38:01] ok [20:38:12] what exactly is it? [20:38:46] YuviPanda: basically a homebrew of webcitation.org [20:38:52] aah, nice! [20:38:56] why would that need legal? [20:38:57] oh [20:39:01] copyright issues? [20:39:04] yeah [20:39:12] makes ense [20:39:13] major issues [20:39:42] take webpage convert to pdf and store for later usage [20:40:21] indeed [20:40:21] see why it might need legal? [20:40:22] Betacommand: looking at http://webcitation.org/ I notice they really like ® [20:40:56] I do :) [20:41:13] AzaToth: that might be, but you cant copyright the basic principle of archiving webpages [20:41:35] similar process new name [20:42:10] Betacommand: but you are screenscraping their homepage? [20:42:17] which is cc-by-nc-2.5 [20:43:01] AzaToth: this is going to be a general purpose web archiving tool [20:43:20] IE a webcitation replacement [20:43:26] ok [20:44:00] tell that to napster [20:44:32] AzaToth: webciation has major limits on the rate you can archive things [20:44:58] k [20:54:59] petan, Coren why did all of my continuous scripts just terminate? [20:55:31] I can think of no reason why they would offhand. Especially more than one. Have you checked their job statuses? [20:55:40] Do you know the job number of one of them so I can look? [20:55:46] No. [20:56:04] Coren, 591703 [20:57:20] Cyberpower678: no error and "exit_status 0" [20:57:32] Can you point me at the script you ran? [20:58:26] data/project/cyberbot/bots/taskchecker.php [21:03:24] writing bots in php... [21:04:58] Coren, Are you looking? [21:19:57] Coren: two patches for review ;) [21:23:56] YuviPanda: Why did you -1 71253? [21:24:09] hmm? [21:24:21] !g 71253 [21:24:21] https://gerrit.wikimedia.org/r/#q,71253,n,z [21:24:44] Coren: oh, that. the tool I'm building that uses those isn't built yet. [21:24:57] either way they need rebasing now, bleh. let me abandon that [21:27:05] Coren: one more patch sent. Final one on the way now :) [21:27:20] Coren: it helps to keep them alphabetically sorted, to make sure you don't add two accidentally [21:33:03] Coren, have you been able to identify the problem? [21:34:51] Cyberpower678: Oh, I sent my reply to the wrong channel. [21:35:27] Cyberpower678: I meant to ask you if you had your output and error files somewhere. [21:35:48] CyberbotII and CyberbotI are the output folders. [21:37:11] Cyberpower678: is the source for the edit counter someplace? [21:37:28] X!'s eit counter? [21:37:35] yeah [21:37:43] also, why is it called X!'s edit counter? [21:37:44] Just click source. [21:37:46] oh [21:37:49] damn [21:38:58] Coren, I found the problem. [21:39:33] YuviPanda: Because it was originally made and maintained by User:X! :-) [21:39:39] ah [21:39:43] who would've thought... [21:39:46] Cyberpower678: What was it? [21:40:27] When using die(), it exits the program with result 0 am I correct. If I use a stack trace error, that generates a fatal error, will that fix it? [21:41:08] * YuviPanda has a script that explicitly exits with -1 no matter what just for this issue [21:41:50] I'd have thought die() wouldn't exit with 0, but if that's the case then that's definitely what's happening. [21:44:17] Will creating code that generates a fatal error fix that Coren? [21:44:54] Well, I haven't played with PHP for non-web scripting, but I'd expect you can just exit(1); :-) [21:44:58] Coren: could you take care of https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Raylton_P._Sousa ? Raylton is needing it fot gsoc [21:45:23] Alchimista: {{done}} [21:45:32] Alchimista: not sure if tools is the best environment for mediawiki extension testing tho [21:45:32] :D [21:45:39] should probably be on labs... [21:45:46] (confusing naming, I know!) [21:46:03] YuviPanda: i've been discussing it qwith him, someone told him that it should be just fine on tools [21:46:08] Coren, thanks :) [21:46:09] YuviPanda: It suffices, for light loads, and has the advantage of being zero setup. :-) [21:46:29] true, but it's going to be fairly slow [21:47:01] YuviPanda: It's not /so/ bad. I wouldn't make a public wiki like this but for extension testing with just a few users it does the trick just fine. [21:47:33] YuviPanda: Plus we even got a memcached server available. [21:48:55] Coren: still... [21:49:11] we should have some other toolslabsish thing at some point for mw extensions [21:49:42] YuviPanda: Yes, that's on the post wikimania roadmap. [21:49:48] :D [21:50:00] what is the position of 'mod_wsgi' on your todo list now? [21:50:24] YuviPanda: Mediawiki-in-a-box; a setup analogous to labs where service groups == mediawiki setup. [21:50:27] i'm thinking of giving a talk at pycon india about tool labs, and not having to tell people 'CGI' [21:50:44] Coren: indeed. We already have pupept manifests for that from the work ori-l did with Vagrant [21:51:26] YuviPanda: It's actually not looking so hot; it'll require either (a) modifying mod_wsgi itself or (b) using an FCGI wedge. I did some research, and the default WSGI presumes too much about the environment and hardcodes too many things. [21:51:56] YuviPanda: It presumes unix sockets, for once, and doesn't let you change the way the script is invoked. [21:52:00] for one* [21:52:28] meh [21:52:31] FCGI wedge? [21:52:33] If I end up having to modify mod_wsgi, I'll have to work with upstream. [21:52:43] is upstream still actively maintained? [21:52:52] YuviPanda: I'd hope so. [21:52:59] in the python world I know that mod_wsgi is fairly out of fashion, uwsgi is the thing most people use [21:53:01] (or gunicorn) [21:53:24] Hm. I may want to look into those then, perhaps they are more amenable to our setup. [21:53:38] Coren: https://code.google.com/p/modwsgi/source/list [21:53:43] three commits in the last year [21:54:13] Yeah, that's not abandoned but hardly "active" [21:54:23] trye [21:54:24] true [21:54:37] similar to memcached - my 2 line patch is still sitting there, along with ~11 patches from the last year [21:54:53] Coren: there's uwsgi and mod_proxy_uwsgi [21:55:11] At first glance, uwsgi seems promising. [21:55:23] it's a separate deamon though, but I guess that's oka [21:55:24] y [21:55:58] It works for me; I've got a proxy sitting in front of the webservers; firing wsgi requests off elsewhere is no harder for me. [21:56:30] hmm, so it'll be webproxy to uwsgi directly, rather than webproxy to apache on webserver to uwsgi? [21:56:31] that's nice [21:56:49] YuviPanda: That seems to be the more reasonable way to do it. [21:57:51] Coren: update the bug report? :) [21:58:19] Well, I'd want to run a couple more experiments first to see what direction I'm headed towards. [22:03:51] Coren: there's also gunicorn, though generally uwsgi is faster [22:19:27] Coren: also we probably want http://uwsgi-docs.readthedocs.org/en/latest/Emperor.html [22:21:11] Coren, I've reprogrammed the function, and if the framework's autoupdater works as it should, it should be installed everywhere already.. [22:21:16] Will exit(1); [22:21:21] do the trick? [22:21:57] Coren: specifically their 'tyrant' mode [22:22:17] I got ssh an error [22:22:51] If you are having access problems, please see: https://wikitech.wikimedia.org/wiki/Access#Accessing_public_and_private_instances [22:22:52] Permission denied (publickey). [22:23:46] anyone can help me? [22:24:54] Is your SSH key correct? [22:25:20] Coren, I'm reinitializing the scripts. I'll give you the process ids in a moment. [22:29:03] Coren, rfx-tally: 592266; PCbot: 592269; taskchecker: 592272 [22:29:41] Cyberpower678, i think so [22:29:57] Did you set your SSH key? [22:30:01] i generate it, right now [22:31:22] Cyberpower678, [22:31:26] yes [22:31:41] in preferences [22:32:26] Hmm... [22:32:58] Generate a new private and public key and set that instead. [22:34:34] yep [22:40:07] Cyberpower678, [22:41:03] Now delete the old public key in preferences and load the new key exactly as you see it in the text editor into your preferences. [22:42:52] Cyberpower678, i did [22:43:11] Cyberpower678, the link in the error message appears: [22:43:18] In order to access instances (see Help:Terminology) you need to be a member of the 'bastion' project. If you specifically requested a labs account then you may already be a member; to check, on the 'bastion' project page click "Members [Expand]". If not, fill out the Shell access request form (or make an appearance on #wikimedia-labs connect IRC channel and ask someone to add you). [22:44:04] petan, ^ [22:44:12] He needs shell access. [22:44:43] Coren, ^ [22:44:51] !shell [22:44:51] http://bit.ly/10eZZoa [22:44:55] hjm?? [22:45:13] well, that's empty [22:45:14] ??? [22:45:21] !shell [22:45:21] http://bit.ly/10eZZoa [22:45:29] i've rights to grant shell access too [22:45:35] That's wierd [22:45:46] yeah, empty. [22:45:59] YuviPanda, can you grant him shell access? [22:46:21] !shell [22:46:21] http://bit.ly/10eZZoa [22:46:23] what's his username? [22:46:33] !shell [22:46:34] http://bit.ly/10eZZoa [22:46:38] Raylton: what is your wikitech username? [22:47:04] nobody by name Raylton [22:47:33] YuviPanda, Instance shell account name: raylton.sousa [22:47:55] 'There is no user by the name "raylton.sousa". Check your spelling. ' [22:48:01] YuviPanda, Username: Raylton P. Sousa [22:48:13] ah there it is [22:48:18] Cyberpower678: he already has shell [22:48:46] In order to access instances (see Help:Terminology) you need to be a member of the 'bastion' project. If you specifically requested a labs account then you may already be a member; to check, on the 'bastion' project page click "Members [Expand]". If not, fill out the Shell access request form (or make an appearance on #wikimedia-labs connect IRC channel and ask someone to add you). [22:50:29] I do not see my name on 'Members [Expand]' [22:50:51] I don't know if he needs to be on Bastion to access tool-labs. [22:50:55] since it is directly ssh'able [22:50:58] Coren: ^ [22:52:16] YuviPanda, see https://wikitech.wikimedia.org/wiki/Access#Accessing_public_and_private_instances [22:52:30] !toolsdoc [22:52:30] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help [22:52:37] !wm-bot [22:52:37] http://meta.wikimedia.org/wiki/WM-Bot [22:52:37] liar [22:53:11] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help#Getting_access_to_the_Tool_Labs doesn't mention that at all [22:53:41] YuviPanda, your name is on bastian [22:53:54] it is, but that got added a long long time ago [22:54:00] when I was accesing private instances [22:54:37] My friends who have name bastian can access and others do not [22:55:01] hmm, the latter documentation should be updated. [22:55:02] still [22:55:03] Coren! [22:55:07] :) [22:55:34] alchimista and danilo can access, but not helder.wiki [23:37:23] Browsing through my directory seems to have suddenly slowed down drastically. [23:38:53] Tools is down again and load has spiked. Coren petan [23:39:52] Cyberpower678: "3.9" is hardly down and spiked. [23:40:17] And I see no issue. [23:40:25] It's at 83.9 [23:40:41] 23:40:31 up 3 days, 5:03, 13 users, load average: 3.03, 3.78, 2.23 [23:40:58] Which universe did you mean? :-) [23:41:25] And the filesystem is okay. [23:41:59] Tools-dev: 23:41:48 up 3 days, 5:05, 5 users, load average: 0.18, 0.52, 0.31 [23:42:13] So, err, what /are/ you talking about? [23:43:26] ... nothing on the grid has load above 1.13 [23:44:15] All I see is webserver-01 having had a brief blip around 14 of load five minutes ago. [23:44:36] * Coren wonders if Cyberpower678 is stuck in a time warp. :-) [23:44:39] must be the mediawiki :P [23:45:47] YuviPanda: No, at first glance it's a brief ppeak in geohack usage. [23:45:54] ah [23:46:07] Hm, and a few dupdets in progress. [23:46:22] I.e.: nothing out of the ordinary. [23:46:38] hehe :) [23:46:46] Cyberpower678: What /are/ you talking about? Where did you see that load? [23:47:21] ganglia [23:47:41] Grid load back to 7.9 [23:48:01] Those numbers do not match observable reality. [23:48:14] Also, "tools is down again" how? [23:48:16] ganglia is wrong then? [23:48:50] That blip and the fact that labs booted me while sshed into tools gave me the indication. [23:49:27] And tools was marked red. [23:50:48] Except for the fact that I see you still have cron jobs every minute, there is no log trace of that. [23:51:15] Oh, and er, could you explain to me why you are beating up crond by replacing your crontab every minute thus forcing a reload and reparse? :-)