[00:29:30] 3Wikimedia Labs: DNS problem with instance on Wikimedia Labs (apparently two instances with same name) - 10https://bugzilla.wikimedia.org/71595#c2 (10Matthew Flaschen) (In reply to Andrew Bogott from comment #1) > There is only one instance named mwui. I don't think that's the case. https://wikitech.wikimedi... [00:34:13] 3Wikimedia Labs: DNS problem with instance on Wikimedia Labs (apparently two instances with same name) - 10https://bugzilla.wikimedia.org/71595#c3 (10Matthew Flaschen) (In reply to Matthew Flaschen from comment #2) > Both of those errors (wrong wiki and ssh security problem) are the symptoms > that led me to f... [02:47:43] 3Wikimedia Labs / 3tools: tools-mail uses non-existing hostname in EHLO - 10https://bugzilla.wikimedia.org/71634 (10Tim Landscheidt) 5PATC>3RESO/FIX [02:50:14] 3Wikimedia Labs: Signup broken - FancyCaptcha.class.php: Ran out of captcha images - 10https://bugzilla.wikimedia.org/71587#c1 (10Matthew Flaschen) p:5High>3Normal This is just a Labs configuration issue. [08:18:44] 3Wikimedia Labs / 3Infrastructure: Jenkins can not ssh to deployment-cxserver01 (hosted by virt1005) - 10https://bugzilla.wikimedia.org/71783#c13 (10Antoine "hashar" Musso) (In reply to Yuvi Panda from comment #12) > So puppet fails on cxserver02 because it tries to create a lvm volume and > fails (/mnt, I t... [11:29:01] Hi, guys! Is here anyone able to add me to tools project? I posted a request yesterday, there is no answer yet but I hoped to play around during week-end :) https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Rubin [11:29:16] rubin16: heya! let me get to it now [11:29:49] rubin16: done [11:30:05] thanks a lot! [11:30:32] it also seems that Category:Tools Access Requests contains both completed and non-completed requests, how do ops know that there are some new requests? [11:33:57] rubin16: there's a boolean flag set in each of them that says if that request has been handled or not [11:49:51] Hi all, is there any place on wikipedia/wikitech wiki where what all sql commands are allowed is given? I am trying to get bytes added by a given user, but then, i am not allowed to query on namespace. Please help [12:37:29] 3Wikimedia Labs / 3Infrastructure: role::labs::lvm::mnt ends up with make-instance-vg: failed to create new partition - 10https://bugzilla.wikimedia.org/71873#c3 (10Marc A. Pelletier) 5NEW>3ASSI The new partitioning recipe uses all four possible primary partitions, leaving none for LVM to take. I'll fix... [12:37:45] 3Wikimedia Labs / 3Infrastructure: role::labs::lvm::mnt ends up with make-instance-vg: failed to create new partition - 10https://bugzilla.wikimedia.org/71873 (10Marc A. Pelletier) a:3Marc A. Pelletier [12:39:10] hi, I can't login wikitech [12:39:50] help! [12:40:01] what Token? [12:41:28] shizhao: Token field is optional [12:42:21] Glaisher,thx. [12:43:32] but input username and password display: Login error The two-factor authentication token provided was invalid. [12:44:27] token is blank [12:46:38] reset password, same error [12:53:44] but I login gitit ok [12:54:01] gerrit [12:54:18] shizhao: did you set up 2 factor authentication at any point in the past? [12:57:10] @YuviPanda: no [12:57:31] hmm, I'm unsure... [12:57:44] shizhao: file a bug and poke Coren? [12:58:49] Coren: thank you for looking at the LVM issue :] [13:02:22] I do not know [13:03:09] How set 2 factor authentication？ [13:04:13] https://wikitech.wikimedia.org/wiki/Help:Instances [13:04:50] If you are in the cloudadmin group on this wiki, and have two-factor authentication enabled, you can add members to any project. [13:06:56] I‘m not an cloudadmin， not a shell account [13:10:03] I hope request a Labs account, but can't login wikitech [13:28:39] I will let you know when I see andrewbogott around here [13:28:39] @notify andrewbogott [14:03:27] andrewbogott: heya! wanna merge some patches? :) [14:03:37] in a few minutes, sure [14:04:37] andrewbogott: cool! start from https://gerrit.wikimedia.org/r/#/c/165951/ and follow dependency trail, basically. some require neon checks [14:05:37] YuviPanda: I have replied to your concern on log rotating /var/log/account/pacct* files ( https://gerrit.wikimedia.org/r/#/c/164520/ ) [14:05:46] YuviPanda: I believe it is fine now :] [14:06:32] hashar: I still think it should be in files/, I don't see anything else labs specific in the base module [14:11:54] YuviPanda: I don't really want to clutter the global repos , would prefer a module [14:12:05] well, in that case we should make a labs module... [14:12:09] putting it in base seems wrong [14:13:09] yeah [14:13:18] though base has a bunch of if $::realm == 'labs' [14:14:56] hashar: true, but nothing in base refers to pacct either... [14:15:05] yup :( [14:15:06] maybe if you move the puppet code into base as well, that might make sense... [14:15:16] but putting the puppet code in manifests/ and the file in a module feels wrong [14:16:08] sure thing [14:16:18] and I prefer not to clutter the global space [14:16:23] guess we need a labs module :] [14:16:25] or labs::base [14:23:36] hashar: yeah :) [14:37:14] 3Wikimedia Labs / 3Infrastructure: role::labs::lvm::mnt ends up with make-instance-vg: failed to create new partition - 10https://bugzilla.wikimedia.org/71873#c4 (10Andrew Bogott) Dammit, that new image is giving me no end of trouble. Marc, you're going to set up the new image to use lvm for all its partiti... [14:42:17] YuviPanda: I don't follow the logic for config_source in your first patch. Is it possible you're doing the opposite of what you intended? [14:42:28] andrewbogott: let me look again [14:43:25] andrewbogott: ugh, you're write. [14:43:28] *righnt [14:44:23] andrewbogott: fixing... [14:50:16] andrewbogott: that was stupid.... I pushed another change. [14:50:22] testing on shinken... [15:15:15] 3Wikimedia Labs: DNS problem with instance on Wikimedia Labs (apparently two instances with same name) - 10https://bugzilla.wikimedia.org/71595#c4 (10Andrew Bogott) My mistake, you're right about the problem. I've emailed the creator of the new instance, suggesting that they recreate with a different name. I... [15:55:03] YuviPanda: point me at your changesets if you want me to look them over; I'm in install mode so I got idle time. [16:04:54] Coren: yuvi's patchset begins here: https://gerrit.wikimedia.org/r/#/c/165956/ [16:04:59] I merged the previous two already [16:32:06] andrewbogott: thanks [16:32:08] Coren: was eating... [16:32:13] but yeah, that's where the patches start [19:11:58] 3Wikimedia Labs / 3Infrastructure: WMFLabs: New instances with precise image are broken (puppet run fails, no ssh access possible) - 10https://bugzilla.wikimedia.org/71741#c6 (10Krinkle) 5NEW>3RESO/WOR The existing instance was never fixed, but it seems to work fine for new instances indeed (assuming it'... [19:12:28] Coren: I still can't create new Trusty instances (at least not without critical puppet failures) - https://bugzilla.wikimedia.org/show_bug.cgi?id=71873 any idea? [19:12:51] Krinkle: Known issue. Fixing the image is on my todo for this PM [19:13:11] Coren: What about existing instances, or should I re-create it? [19:14:07] Krinkle: They are fixable, but need some manual love and will always be a little different if you do. [19:14:30] they're fresh born, so I'll just nuke them [19:27:13] YuviPanda: Hm... looks like there's still a bug somewhere with data being repeated in graphite when there is no new data [19:27:20] That's not by design right/ [19:27:40] https://tools.wmflabs.org/nagf/?project=integration#h_integration-slave1010 [19:27:49] in this case the instance was deleted even [20:11:08] (03PS1) 10MaxSem: wikimedia-mobile: rm ZRMA, add WikiGrok [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/166129 [20:19:16] (03CR) 10Legoktm: [C: 032] wikimedia-mobile: rm ZRMA, add WikiGrok [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/166129 (owner: 10MaxSem) [20:19:19] (03Merged) 10jenkins-bot: wikimedia-mobile: rm ZRMA, add WikiGrok [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/166129 (owner: 10MaxSem) [20:20:42] !log tools.lolrrit-wm deploying https://gerrit.wikimedia.org/r/166129 [20:20:44] Logged the message, Master [20:29:37] thanks legoktm [20:29:44] np [20:51:13] 3Wikimedia Labs / 3Infrastructure: role::labs::lvm::mnt ends up with make-instance-vg: failed to create new partition - 10https://bugzilla.wikimedia.org/71873#c5 (10Krinkle) For the record, I initially thought this was only affecting Trusty instances, but it's affecting Precise images as well. integration-sl... [20:52:21] bd808: do yo know how/if graphite in labs is supposed to get note of deleted instances (and remove them?) [20:52:26] or did that never happen? [20:52:55] Krinkle: YuviPanda has been removing manually for now. He has some plan to fix that in the future [20:54:01] bd808: Since there's another bug that causes it to repeat/echo stale data when no new pushes come from the instance, it's affecting the sum() graphs for a cluster in a weird way [20:54:27] I'd like integration-slave1004, 1009 and 1010 to be deleted from integration for graphite/wmflabs [20:59:22] Im also happy to learn how Yuvi does that and help out in the mean time. [21:05:44] I think that stale data thing is a bug in txstatsd. :( [21:06:22] https://bugzilla.wikimedia.org/show_bug.cgi?id=62667#c11 [21:15:50] I have been hit by that as well :/ [21:16:19] was looking to get a count of jobs being triggered and since the data keep repeating that gives me crazy number of builds triggered per day [21:42:36] YuviPanda: andrewbogott: Can one of you grant one or more of hashar, bd808 or me access to project 'graphite' in labs? [21:43:03] I can add you Krinkle. I has the power [21:43:13] fancy [21:43:24] Yes please :) [21:44:02] Krinkle: {{done}} [21:44:30] !log graphite Added Krinkle as project admin [21:44:33] Logged the message, Master [21:52:31] bd808: I don't need admin per se, but you granted membership, not admin. [21:52:49] I thought I clicked both [21:52:52] * bd808 looks [21:53:05] (unless I need sudo to clean up deleted instances, in which case I do need admin) [21:53:41] Krinkle: You are listed in then projectadmin role on wikitech [21:54:05] But it looks like all project members have sudo too [21:54:54] Hm.. yeah, on https://wikitech.wikimedia.org/wiki/Special:NovaProject is says I'm projectadmin indeed [21:55:02] I was looking at https://wikitech.wikimedia.org/wiki/Nova_Resource:Graphite, which lists me in member [21:55:13] yeah. I just noticed that too [21:55:23] https://wikitech.wikimedia.org/w/index.php?title=Nova_Resource%3AGraphite&diff=130748&oldid=117663 [21:55:26] and I purged the project page and it didn't update [21:55:32] and Matanya added as admin in that same edit? [21:56:12] He was already granted in the admin ui [21:56:17] some weird cache thing? [21:56:32] bd808: maybe that field can be removed and use SMW query instead? [21:58:14] I but that granting admin isn't updating that template so when I added you as a member it updated and showed the prior add of matanya as an admin [21:58:29] It's all voodoo [21:59:25] Confirmed. I added myself as a project member and now you show as an admin [22:01:18] ah, one off [22:01:26] probably a function call in the wrong part of the code [22:08:47] YuviPanda: did you get the access you need?