[00:17:07] 3Tool-Labs: Tool Labs: Provide anonymized view of the user_properties table - https://phabricator.wikimedia.org/T60196#843147 (10coren) There are, in essence, two steps. The underlying table needs to be replicated, and a view need to be created to it. Access to the underlying table is already there (it is used... [11:43:03] YuviPanda: Hi, Special dedicated to you, first offline package created @wmflabs: WPSA http://download.kiwix.org/portable/wikipedia/kiwix-0.9+wikipedia_sa_all_2014-12.zip [11:43:15] Kelson42: \o/ YAY! :) [11:43:43] YuviPanda: whole toolchain is now ready and has started to create auto. ZIM files [11:43:53] nice! [11:44:06] Kelson42: we should set up some monitoring for it. [11:44:16] YuviPanda: what do you mean exactly? [11:44:18] at least trivial things, like free space checks [11:44:26] so if it runs out of space, for example, or the host dies [11:44:32] you’ll get an email notification [11:45:18] YuviPanda: yes, the stuff is with the sporadic die is pretty annoying... because ZIM files are created in a rail... and if it stops in the middle I have no easy way to resume (at least for now) [11:45:36] yeah [11:45:43] YuviPanda: but maybe I was only unlucky at the beginning, let's see if this happens again [11:45:46] well, *that* should be fixed next week, hopefully [11:45:53] alright, let me know if you want some monitoring :) [11:46:08] YuviPanda: yes, timing is great, so I can start with "real industrialisation" in january [11:46:14] :) cool [11:46:30] we could also puppetize the entire setup at some point if you’d like [11:46:36] that would make spinning up new instances easy [11:46:43] and also make it easy for someone else to figure out what is going on [11:52:11] andrewbogott_afk: there’s a labs puppetmaster warning, but that’s because I was stupid and forced a puppet run on *all* labs hosts at the same time. should recover [11:52:54] YuviPanda: the stuff about puppet is definitly a good idea [11:53:21] YuviPanda: let's see if this is necessary, I still hope to be able to do all the job with only 1 or 2 VMs [11:54:10] Kelson42: ok :) I’d still consider it a good idea, and offer to help if you can write down the entire process in a document :) [11:56:28] YuviPanda: thx you for your offer, I never have done this kind of job before... so help might be welcome. Someone told me to use puppet to configure the kiwix-plug... which sounds a good idea too! [11:57:15] Kelson42: what is kiwix-plug? [11:59:49] YuviPanda: this is what should be ported to the MR3020 ;) [11:59:53] YuviPanda: http://www.kiwix.org/wiki/Kiwix-plug [12:00:01] Kelson42: aaah [12:00:12] Kelson42: I’d highly reccomend against using puppet. it’s a resource hog on small machines :) [12:00:29] YuviPanda: ok, but isn't that used only during the setup? [12:00:43] YuviPanda: so one time job? [12:01:04] Kelson42: that is true. but still, for a one time job something like bash or a python script is more efficient and clearer too [12:01:51] YuviPanda: ok, currently it's in bash [12:02:04] yeah, that’s good enough, I think [12:02:08] YuviPanda: but I though puppet might be easier to improve/maintain [12:02:20] I’d reccomend python in these cases :) [13:24:28] 3Tool-Labs: Update Tcl 8.6 - https://phabricator.wikimedia.org/T78397#844216 (10Giftpflanze) 3NEW a:3coren [13:39:55] 3Tool-Labs: Update Tcl 8.6 - https://phabricator.wikimedia.org/T78397#844226 (10coren) Tcl 8.6 is already available (as the default, even) on Trusty instances. Interactively on trusty.tools.wmflabs.org, and through the gridengine with -l release=trusty [13:46:22] coren: you know that we have the tip-389-impl branch? [13:49:59] I... don't know enough about tcl to usefully answer that question. A quick google seems to indicate that's in 8.7? [13:50:30] no idea [13:51:24] Also, if I understand things correctly, a 'TIP' is a proposal for a change in the language; any code derived from that would be very experimental. [13:51:35] but you already compiled tcl 8.6 with that branch, now it has an important bugfix [13:51:51] it works fine [13:52:16] The easiest way to determine this is to run test code on the trusty bastion [13:52:41] huh? [13:54:32] The tcl available on Trusty is 8.6; if you want to check whether in includes code from a specific branch the easiest way is to just try it. :-) [13:54:44] Well, you could always check the debian source. [13:55:02] ah, well, inb4 it doesn't [13:55:29] what was the magic switch? [13:55:49] -release trusty? [13:56:00] -l release=trusty [13:56:09] ah [13:56:45] Or you can just try it interactively on trusty.tools.wmflabs.org [13:57:02] (That's a bastion, like tools-login, only it runs Trusty) [13:57:12] ah [13:57:42] does it have an internal name? [14:03:26] coren: ok, doesn't work [14:03:53] You may want to put the details to that on the task then. [14:06:08] which details? the test? [14:10:32] coren: ^? [16:50:15] seems LDAP has some issue [16:50:37] I often encountered the error: Error: /Stage[main]/Ldap::Client::Utils/File[/usr/local/sbin/manage-nfs-volumes-daemon]: Could not evaluate: getaddrinfo: Temporary failure in name resolution [16:50:51] or some other variant of getaddrinfo name resolution failure [16:50:54] s/LDAP/DNS/ [17:14:43] * Coren sighs. [17:15:47] That DNS server part of Openstack is a horrid piece of bantha poodoo. We've managed to make things better for a while, but now it's showing signs of strain again. [19:16:32] RECOVERY - Puppet failure on tools-master is OK: OK: Less than 1.00% above the threshold [0.0] [20:22:33] PROBLEM - Puppet failure on tools-master is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [20:57:33] RECOVERY - Puppet failure on tools-master is OK: OK: Less than 1.00% above the threshold [0.0] [21:32:07] I am wondering whether we got blacklist on Ubuntu apt repository :D [21:32:07] 500 http://nova.clouds.archive.ubuntu.com/ubuntu/ precise/main amd64 Packages [21:32:13] might be transient [21:32:53] it was sorry [21:46:51] Hi all, can someone please help me connect to deployment-eventlogging02.eqiad.wmflabs? I'm getting the following error: Connection closed by UNKNOWN [21:47:43] I'd like to note that I'm able to connect to stat1003.wikimedia.org using proxycommand [22:32:57] im creating a tool that is going to read RCstream, and then try and look up every diff from the revision IDs in the RCstream, i'm worried that even if i spawn enough threads the APIs will reject me for reading too quickly, will this be an issue?