[04:04:49] Anyone here that knows anything about wm-bot's db? [04:05:39] I think I've tracked down a bug, but am very tired and want a secind opinion. [04:06:31] There's a channel that's getting 3 redundant rc feed posts for every change. [04:07:12] I think it has something to do with two different people trying to put bot in same channel at same time. [04:08:34] One did @add ##Foo and the other did @add ##foo and there were two bouncers in there at once 3 & 5 the op in the room kicked bothe and brought the bot back a third time. [04:09:32] Now, the db seems to be stuck thinking there are three instances and all should post rc feed [04:10:36] I've had bot join ##Foo and ##foo and dropped it and manually cleared everything I coukd find and reloaded db, but no go. [04:10:56] Anyone think a restart might fix? [04:19:59] I have my doubts, and everyone else must be asleep. [06:02:29] T13|sleeps: which channel [09:38:06] [bz] (8NEW - created by: 2Antoine "hashar" Musso, priority: 4Normal - 6major) [Bug 48501] [OPS] beta: get SSL certificates - https://bugzilla.wikimedia.org/show_bug.cgi?id=48501 [09:38:52] [bz] (8RESOLVED - created by: 2Michelle Grover, priority: 4Low - 6enhancement) [Bug 46621] SSL Support on betalabs - https://bugzilla.wikimedia.org/show_bug.cgi?id=46621 [09:56:24] petan, are you around in a bit for some impertinent personal questions? [09:56:53] ooo [10:51:49] PETAN :O [10:51:53] araound? [10:54:29] @seen petan [10:54:29] T13|needsCoffee: I have never seen petan [10:54:35] @seen petan [10:54:35] T13|needsCoffee: petan is in here, right now [10:54:52] Last post I saw of his was a couple hours ago. [10:55:33] [06:55] <+wm-bot2> T13|needsCoffee: Last time I saw petan they were talking in the channel, they are still in the channel #wm-bot at 8/21/2013 8:59:38 AM (1h55m26s ago) [11:12:47] MartijnH: hm? [11:14:00] !logs [11:14:00] http://bots.wmflabs.org/~wm-bot/logs/%23wikimedia-labs/ [11:41:51] boooyeah, http://wikistream-tools.wmflabs.org/ now actually uses websockets! [11:41:51] addshore, ping [11:41:56] pong [11:42:09] addshore, I see you are hard at work on Addwiki. [11:42:18] Do you see me working on Peachy? [11:44:08] I saw https://github.com/cyberpower678/Peachy/commit/e57c649eba5f83acd305b37339ae4829aca12dd9 :P [11:44:53] addshore, I'm almost done alpha 4 and it's slowly going into the beta stage. [12:17:00] @link [[Meep]] [12:17:00] !ping [12:17:01] !pong [12:18:05] @link [[Meep]] [12:18:06] http://enwp.org/Meep [12:21:10] @link [[meaow]] [12:21:10] http://enwp.org/meaow [12:21:12] :D [12:21:17] @link [[:de:meaow]] [12:21:17] http://enwp.org/de:meaow [12:22:00] test [[meaow]] [12:22:32] @link [12:22:33] http://enwp.org/meaow [12:22:53] @link [[de:meaow]] [12:22:53] https://de.wikipedia.org/wiki/meaow [12:23:00] Steinsplitter ^ [12:24:04] thx :D works great xD [12:24:15] without @link is not possible? [12:24:21] @linkie-on [12:24:21] Links will be automatically translated in this channel now [12:24:29] [[de:Pr0n]] [12:24:29] https://de.wikipedia.org/wiki/Pr0n [12:24:44] [[a]] [[b]] [12:24:44] http://enwp.org/a http://enwp.org/b [12:25:07] wow :):):) thx [12:25:59] petan: default language is en, or is possible to change it? :D [12:26:20] [bz] (8NEW - created by: 2Chris McMahon, priority: 4Unprioritized - 6normal) [Bug 53080] no login error messages on http://commons.wikipedia.beta.wmflabs.org/ - https://bugzilla.wikimedia.org/show_bug.cgi?id=53080 [12:26:36] but great funtion :):) awww [12:26:43] https://bugzilla.wikimedia.org/show_bug.cgi?id=53091 [12:26:48] Steinsplitter read it [12:26:52] that documents it [12:27:08] you can use @configure to change default wiki [12:27:30] awww [12:27:32] Value cs was stored into default_link_wiki to config [12:27:34] i LOVE YOU! ;:) [12:27:40] I LOVE the BOT :):) AWWWWWWW [12:27:40] @link [[bla]] [12:27:40] http://cswp.cz/bla [12:27:55] awwww [12:28:02] Value en was stored into default_link_wiki to config [13:20:22] Steinsplitter: no love for me? [13:20:40] Pfft... see if I request any more new wm-bot toys... [13:21:16] T13|needsCoffee: + love for you [13:22:49] [09:21] <@Revi> [[User:Revi]] [13:22:49] http://enwp.org/Revi [13:22:49] [09:21] <+wm-bot5> https://meta.wikimedia.org/wiki/Revi [13:23:06] petan: ^^^ bug [13:23:29] indeed [13:24:56] This value can't be stored [13:25:13] ^^ another one petan ? [13:26:07] @link [[ko:Example]] [13:26:07] https://ko.wikipedia.org/wiki/Example [13:27:25] @link [[User:Petrb]] [13:27:25] http://enwp.org/User:Petrb [13:27:42] T13|needsCoffee: is that really a bug? what happens when you do that on kowiki [13:28:07] in puppet, i get an error "Error 400 on SERVER: Could not find class ldap::role::client::labs " [13:28:07] i love this fuction, i hope a lot of channel enable it [13:28:07] anyone know why? [13:28:07] * aude thinks i've seen this before and fixed it somehow [13:28:07] but can't remember how [13:28:34] petan: the bug is being unable to store ko as default [13:29:50] Value ko was stored into default_link_wiki to config [13:29:55] [[blah]] [13:29:55] https://ko.wikipedia.org/wiki/blah [13:29:58] works to me [13:32:21] oh, I see... I was using - instead of _ [13:32:33] * T13 trouts hisself. [13:51:54] !ping [13:51:54] *�POOF�* Wadda need? *�POOF�* Wadda need? *�POOF�* Wadda need? [13:51:59] :DDD [13:52:34] petan, why has tools been so... [13:52:40] ...overloaded? [13:52:53] YuviPanda: i'm here now :) [13:53:25] YuviPanda: why are you putting it at wikistream-tools as well? [13:53:40] Cyberpower678 when [13:53:48] A lot of the time. [13:54:03] my guess is NFS, but if you don't tell me exact time I can [13:54:08] 't tell you... [13:54:48] Webserver-01 seems to be constantly running on a high load. [13:54:57] http://ganglia.wmflabs.org/latest/?c=tools&h=tools-webserver-01&m=load_one&r=hour&s=by%20name&hc=4&mc=2 [13:56:17] win 1 [13:56:26] apologies :) [14:00:10] Cyberpower678: Yeah, it's time I add a new server and spread the load. [14:00:22] Cyberpower678: I'm about to do that and two compute nodes today. [14:00:34] Coren, :-))))) [14:00:42] !b 53153 [14:00:42] https://bugzilla.wikimedia.org/53153 [14:00:52] ^ also... &(append|prepend)Text option for index.php action=edit [14:00:52] Coren, what's the status of deleted edits? [14:01:01] Cyberpower678: deleted? [14:01:14] T13, ? [14:01:26] Cyberpower678: It's in Ashar's hand. IIRC, he returns from vacation next week. [14:01:35] Asher* [14:01:41] Deleted edits are deleted, as in that is their status? [14:02:31] T13, deleted revisions? [14:02:52] edsu: heya! [14:03:07] edsu: this is running on toollabs, so you won't have to deal with adminstering your own labs instance [14:03:11] !ping del [14:03:12] Successfully removed ping [14:03:15] !ping is pong [14:03:16] Key was added [14:03:23] YuviPanda, ? [14:03:32] Cyberpower678: Deleted revisions are deleted, as in that is their status? <-- better? :p [14:03:39] !ping del [14:03:40] Successfully removed ping [14:03:47] !ping is !pong [14:03:47] Key was added [14:03:53] :p [14:04:08] edsu: plus before this, we couldn't actually do this right, since we all only did... CGI [14:04:19] :) I'm trying to change that, and this was a really good proof of concept, I guess [14:04:40] Coren: did you see http://wikistream-tools.wmflabs.org/? it is running on tools :) [14:04:57] proof of concept, don't bite my head off about giving tools their own domains yet :) [14:04:58] Neat! [14:05:03] T13, I don't get what you mean. An admin can delete an edit or a page. They are marked as deleted in the database. [14:05:15] They are stored in the archive table then. [14:05:46] Cyberpower678: Apparently over your head. :) [14:05:49] * T13 backs away. [14:06:09] Coren: I guess we'll need to replace tools-webproxy with this once it matures. [14:06:15] T13, ?????? [14:08:31] Coren: I was talking to scfe_de about it yesterday a fair bit, and am thinking of relying on identd for auth. I'll write it up a bit more later. [14:09:38] ... that'd work, but only on projects where you can generally rely on the roots (i.e.: not those where project admins are not vetted) [14:10:41] Coren: yeah, this is for the tools specific parts [14:11:05] Coren: there'll be a proxy API, and for general labs it'll be a wikitech interface, and for tools... I'm still trying to figure thatr out [14:12:42] YuviPanda: who deals with admining the labs instance? :) [14:19:35] edsu: That depends on the project; every project has its admins. [14:23:27] Coren: can you help me with puppet? [14:23:38] aude: Probably. What's up? [14:23:57] for wikidata instances (not tool labs) i am getting an error [14:23:58] Error 400 on SERVER: Could not find class ldap::role::client::labs [14:24:11] think i saw that before and fixed it somehow, but don't remember how [14:24:24] do you know about that? [14:24:47] think i'm missing a checkbox on the configuration page [14:25:18] I don't think I've seen that particular error before; I can look into it in a little bit once I'm done setting up my new instances? [14:25:23] ok [14:25:29] i think andrew helped me with it or might know [14:25:37] i can ask him when he's around [14:25:57] Coren: so who is admining this instance? YuviPanda? [14:26:09] edsu: which instance? [14:26:11] I'm probably going to be able to look into it before he gets here, but if he solves your problem before I do tell him I want to know for future reference. :-) [14:26:17] Coren: ok [14:26:42] edsu: oh, http://wikistream-tools.wmflabs.org/ [14:26:44] aude: http://wikistream-tools.wmflabs.org/ [14:26:50] interesting... not you? [14:27:08] aude: i started http://wikistream.wmflabs.org/ :) [14:27:14] yeah, i know [14:27:24] looks like YuviPanda setup the one on toollabs [14:27:37] he's doing stuff with redis there [14:28:28] oh, ok ... wikistream doesn't use redis at all anymore, but maybe he has something planned [14:28:37] oh, really? [14:28:51] aude: yeah, it just streams things and has no memory at all [14:28:56] cool :) [14:29:29] on tool labs, basically we have support from coren etc. on maintaining the overall systems [14:29:47] but then it's less flexible, sometimes or takes more time to get things done [14:29:59] i'm confused doesn't anyone maintain wmflabs.org in general? [14:30:00] it does have access to the "grid" and more resources [14:30:20] edsu: there's labs (all the instances like yours and the wikidata ones) [14:30:34] those need to be self-maintained [14:30:44] tool labs is a project within labs [14:30:57] wo tool labs will monitor services and make sure they are up, etc? [14:31:00] but is special, with staff support and shared environment [14:31:01] s/wo/so/ [14:31:09] edsu: pretty much, yes [14:31:19] so you don't have to setup stuff like redis [14:31:33] setting up redis is trivial, making sure it is still running is work :) [14:31:38] but then for some of my stuff, i want postgresql and postgis (not available yet on toollabs) [14:31:55] so i have to wait or have my own labs project or work elsewhere for that [14:31:56] i see [14:32:11] and i can also help maybe to setup some stuff on tool labs via puppet/gerriot [14:32:14] gerrit [14:32:18] honestly i like isolated environments where things can exist independent of each other [14:32:23] edsu: sure [14:32:41] as long as they aren't so independent that nobody watches them :) [14:32:46] with your own labs instances you can still add people to the project group [14:32:57] well, i think nobody watches them [14:33:06] except might notice if labs as a whole goes down [14:33:13] even the ones in tool labs too it sounds like? [14:33:27] tool labs has more support and monitoring [14:33:30] i guess that's one advantage to a shared environment, more people squawk when things go down [14:33:31] aude: That's correct; labs projects are not supported by ops unless specified (like tools) [14:33:46] mysql is a separate service (separate dedicated boxes) [14:33:50] Although labs /itself/ is considered a production system. [14:33:55] and i assume (likely) is monitored [14:34:00] Coren: yep [14:34:07] Coren: but tools is admin'd just like any other wmflabs project right? [14:34:11] aude: You mean database replication? Yes. [14:34:15] edsu: yes and no [14:34:30] Coren: yes and my project databases [14:34:33] user databases on labs [14:34:37] Coren: you just have a group of admins? [14:34:42] edsu: Not really; unless most other projects tools has staff admins and is officially supported by ops. [14:34:51] on tool labs there is access to replication [14:35:02] oh, that's a big perk [14:35:03] so full admins might have access to private data, so it's more restricted [14:35:18] for general users, they access a subset of the database sans private data [14:35:40] i see, yeah that is a big difference [14:36:06] having access to replicated databases is a big plus [14:36:14] for many tools [14:36:35] (The difference might seem subtle, but there is a big difference with staff project admins and project admins that happen to work for the WMF) [14:36:50] yep [14:36:51] s/with/between/ [14:37:24] there are other labs projects like deployment-prep (e.g. http://en.wikipedia.beta.wmflabs.org/) [14:37:30] that are special [14:37:34] most are not special like that [14:38:12] (looks like beta is testing https) [14:38:15] Right, the general rule is "you admin your project and support it"; it's just that the WMF also uses labs for some projects /it/ supports. [14:38:22] yep [14:45:37] personally I don't mind being admin on wikistream, i'll just have to automate monitoring it [14:46:02] sure, that's fine [14:46:18] it would be nice to make it less of a labs service, except for development, and have it running in "production" [14:46:23] if that concept exists [14:46:33] stream.wikipedia.org would be kinda cool :-) [14:46:46] but i have no idea how to make that happen [14:46:57] or even try to make it happen [14:47:06] if i knew, we'd have osm map tiles already [14:47:14] heh :) [14:47:27] need to find someone in ops to help and get a server or place for it to run [14:47:32] aude: so do you have an osm project in labs? [14:47:48] we have a maps project, but i've not had lots of time for it [14:47:55] and it's not powerful enough [14:47:59] aude: busy w/ wikidata i imagine? [14:48:10] aude: nice work on that btw, it's awesome :) [14:48:14] e.g. if i import all the entire osm data and make tiles, people will scream at me [14:48:17] it will break labs [14:48:31] sometimes that's a good way to move forward :) [14:48:42] i could have tiles maybe for just the united states and that would be okay for development [14:48:49] sometimes it's a good way to make enemies too i guess [14:48:53] heh [14:49:28] tool labs helps bring some dedicated systems for stuff like osm database (but it's not there yet) [14:49:47] and yes, wikidata is busy but we also need maps :) [14:55:14] Coren: so is there an issue with the /data/project space on labs? [14:59:00] * Coren catches up. [14:59:31] define "an issue"? [14:59:31] Coren: i can't cd into /data/project [14:59:37] it freezes [14:59:46] (not toollabs, just labs generally) [14:59:55] I need more info than that; what instance, etc? [15:00:17] i am on wikidata-test-multi at the moment [15:00:22] can see if it happens on others [15:00:41] aude: Looks like gluster is having "fun" again then. [15:00:48] yeah [15:00:58] on other instances, it's slow or not working either [15:01:08] wikidata-testrepo [15:01:09] aude: It's working on bastion [15:01:16] oh, interesting [15:01:22] It's project-local. Lemme go beat up gluster [15:02:57] * Coren mutters really unkind things about gluster. [15:03:03] heh [15:05:44] aude: Should be back. [15:05:48] trying [15:06:12] yes, it works [15:06:14] thanks! [15:07:14] :> [15:07:15] https://tools.wmflabs.org/oauth-hello-world/ is giving me a 500 :/ [15:07:53] legoktm: is it owned by the tool user? [15:08:20] valhallasw: i'm not sure, it's anomie's tool (i think) [15:08:24] ah, ok [15:08:49] hmm [15:09:37] anomie: i'm mainly interested in looking at the source code if that's posted somewhere, i remember there was a link on the tool but I never clicked the link [15:10:03] legoktm: /data/project/oauth-hello-world/public_html/index.php ;-) [15:10:23] heh [15:12:29] It was working yesterday, and I haven't touched it since. Nothing is showing up in the logs I have access to. Ownership on everything looks correct. Coren, petan, YuviPanda? Any of you around and able to help? [15:12:49] anomie? [15:12:54] hi [15:13:02] what exactly should I do :P [15:13:19] petan: https://tools.wmflabs.org/oauth-hello-world/ is returning 500 errors, do you have access to more logs than are in the tool directory? [15:13:33] hold on [15:15:45] tbh I have no idea, it seems that scfs did some things with apache... logs are weird [15:15:56] there are some logs with scfc in name o.O [15:16:19] !toolsadmin [15:16:20] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Documentation/Admin [15:16:50] something likely changed but I don't know what it is... [15:17:04] I can see id: local--: no such user in error.log of apache [15:17:11] but that doesn't really say much [15:18:37] people should start documenting their changes otherwise tools are never going to work... [15:18:47] @notify scfc_de [15:18:47] I'll let you know when I see scfc_de around here [15:19:12] Coren: any idea what changed in apache configuration past days? logs seem to be totally useless now [15:19:35] petan: Nothing should have. What do you mean "useless"? [15:19:54] some random errors produced by "id" command with no trace of source [15:20:06] I suppose it's produced by one of error splitters [15:20:15] There is /usr/local/bin/php-wrapper that is splitting php error logs [15:20:26] I suppose that is what produces these `id` errors [15:20:51] petan: It does, AFAIK that has almost always been there. I'll look into it in a little bit, I'm setting up the new instances atm. [15:21:20] Coren: useless as they don't contain useful information, in fact they contains almost no information, server display 500 error, error log is sent to some splitter and likely end up in /dev/null, we should have soome global error log like for access logs [15:21:27] so that I can easily grep any tool from 1 place [15:21:41] without having to search multiple filesystem for corresponding log files [15:21:58] I'll look into it in a little bit. [15:22:02] ok [15:22:04] anomie ^ [15:22:28] btw, Coren exec-01 is still down [15:22:53] petan: I am aware. Something odd with Openstack I will diagnose with Ryan later today. [15:23:00] ok [15:23:18] aude: edsu wikistream-tools.wmflabs.org is *not* another instance. It is running on toollabs, on the grid engine [15:23:27] http://tools.wmflabs.org/?status C-f 'wikistream' [15:23:45] aude: edsu I was using it as a proof of concept to show how you can run web servers on toollabs grid engine, which wasn't possible before :) [15:23:54] YuviPanda: cool [15:24:01] and this also means you can easily run websockets, etc from toollabs, which also wasn't possible before [15:24:09] Internal Server Error [15:24:12] The server encountered an internal error or misconfiguration and was unable to complete your request. [15:24:19] Please contact the server administrator, mpelletier@wikimedia.org and inform them of the time the error occurred, and anything you might have done that may have caused the error. [15:24:22] More information about this error may be available in the server error log. [15:24:23] Bleh. [15:24:24] Additionally, a 500 Internal Server Error error was encountered while trying to use an ErrorDocument to handle the request. [15:24:27] Apache/2.2.22 (Ubuntu) Server at tools.wmflabs.org Port 80 [15:24:31] oops [15:24:32] That's almost certainly something I did wrong. [15:25:17] * Coren headdesks. [15:25:21] Yep. My fault. [15:26:01] Sorry, just broke this. Should work again now? [15:26:19] Coren, thanks. [15:26:50] Coren, thanks. [15:26:51] Coren, thanks. [15:26:52] Coren, thanks. [15:26:52] Coren, thanks. [15:26:53] Coren, thanks. [15:26:54] Coren, thanks. [15:26:55] Coren, thanks. [15:26:56] Coren, thanks. [15:26:57] Coren, thanks. [15:27:01] Coren, thanks. [15:27:02] Coren, thanks. [15:27:04] Coren, thanks. [15:27:07] Coren, thanks. [15:27:08] Coren, thanks. [15:27:10] Coren, thanks. [15:27:17] Coren, thanks. [15:27:19] Coren, thanks. [15:27:20] Coren, thanks. [15:27:22] Coren, thanks. [15:27:25] Coren, thanks. [15:27:27] Coren, thanks. [15:27:31] Coren, thanks. [15:27:33] Coren, thanks. [15:27:35] Coren, thanks. [15:27:37] Coren, thanks. [15:27:39] Coren, thanks. [15:27:41] Coren, thanks. [15:27:43] * YuviPanda staples Cyberpower678 in place [15:27:47] Coren, thanks. [15:27:49] Coren, thanks. [15:27:51] Coren, thanks. [15:27:53] Coren, thanks. [15:27:55] Coren, thanks. [15:27:57] Coren, thanks. [15:28:01] Coren, thanks. [15:28:03] Coren, thanks. [15:28:04] Hm. Forgot to ask ops in this channel. [15:28:09] Cyberpower678: Stop this now, please. [15:28:34] thanks coren! [15:28:36] :) [15:28:49] Sorry [15:28:51] edsu: btw, https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help has a more detailed description on what toollabs is. You get a grid that is monitored, plus other tools that are monitored - plus access to the dbs [15:28:56] cat on keyboard [15:28:57] !searchlogs [15:29:00] yeah, thanks Coren! :) [15:29:07] !ping [15:29:07] !pong [15:29:14] !logsearch [15:29:15] http://bots.wmflabs.org/~wm-bot/searchlog [15:29:24] Cyberpower678 what the hell was that [15:29:36] petan, I'm not sure. [15:29:39] anomie: no license header on the file? [15:29:51] * YuviPanda hides his license headerless files from legoktm [15:29:54] Coren: you can always type @q Cyberpower678 [15:29:56] @q Cyberpower678 [15:29:57] isn't a LICENSE or COPYING file enough? [15:30:01] @unq Cyberpower678 [15:30:13] XChat just flooded my screen with Coren, thanks. [15:30:13] YuviPanda: there isnt one of those either. [15:30:21] Nothing responded. [15:30:25] legoktm: aaah, okay. then poke, poke! [15:30:33] legoktm: I should fix that. Hmm, which to choose? [15:30:37] @trustadd .*@wikipedia/Coren admin [15:30:37] Successfuly added .*@wikipedia/Coren [15:30:40] anomie: WTFPL! [15:30:44] anomie: PD :) [15:32:39]