[00:00:04] I just logged out and went to log back in and it is telling me that I have attempted to log in too many times in the last hour [00:00:54] AaronSchulz: well... yes :) I can certainly arrange a window if that's what you prefer, but I don't see how it's different than any other deploy that you do [00:01:42] for timeline I'll just ping you, sometime in the morning (sf) [00:02:58] sure [00:04:01] so, I'm going to use http://www.mediawiki.org/wiki/Extension:DynamicSidebar and hide sidebar actions from users who don't have rights to use them [00:05:34] I'm going to expose openstack roles via mediawiki groups. if a user is a sysadmin in any project, they'll be added to the sysadmin group in mediawiki. same with netadmin. [00:09:26] it will be a relife to have math and timeline done [00:10:33] AaronSchulz: does your change for math also take care of writes to math.tmp? [00:11:35] PROBLEM - Puppet freshness on cp1022 is CRITICAL: Puppet has not run in the last 10 hours [00:20:53] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:23:37] Should Ben H. be removed from ? [00:24:13] I guess [00:24:17] His account is disabled [00:29:54] PROBLEM - Lucene on search1001 is CRITICAL: Connection refused [00:31:50] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 6.987 seconds [00:34:32] RECOVERY - Lucene on search1001 is OK: TCP OK - 0.027 second response time on port 8123 [00:37:32] PROBLEM - Puppet freshness on ms-be1006 is CRITICAL: Puppet has not run in the last 10 hours [00:37:32] PROBLEM - Puppet freshness on ms-be1005 is CRITICAL: Puppet has not run in the last 10 hours [00:37:32] PROBLEM - Puppet freshness on ms-be1009 is CRITICAL: Puppet has not run in the last 10 hours [00:37:32] PROBLEM - Puppet freshness on ocg3 is CRITICAL: Puppet has not run in the last 10 hours [00:37:32] PROBLEM - Puppet freshness on singer is CRITICAL: Puppet has not run in the last 10 hours [00:37:33] PROBLEM - Puppet freshness on virt1001 is CRITICAL: Puppet has not run in the last 10 hours [00:37:33] PROBLEM - Puppet freshness on virt1002 is CRITICAL: Puppet has not run in the last 10 hours [00:37:34] PROBLEM - Puppet freshness on virt1004 is CRITICAL: Puppet has not run in the last 10 hours [00:37:34] PROBLEM - Puppet freshness on virt1003 is CRITICAL: Puppet has not run in the last 10 hours [00:39:20] apergos: math.tmp? [00:41:15] yeah, looks like a scratch area for the math extension [00:42:42] I don't see anything in the code about that [00:42:50] hm [00:42:56] ok, time to head out [00:43:03] /export/upload/math.tmp/ [00:45:39] New patchset: RobH; "removing ben from paging groups on nagios" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/22687 [00:46:21] last update seems to be Aug 1 [00:46:25] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/22687 [00:47:36] New patchset: RobH; "removing ben from paging groups on nagios" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/22687 [00:48:23] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/22687 [00:48:32] Change merged: RobH; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/22687 [00:59:40] Aug 19. sorry [01:00:07] with last directory mod Aug 22 [01:03:56] I would like to have a go at https://bugzilla.wikimedia.org/show_bug.cgi?id=31563 (make secure.wikimedia.org redirect to the correct place), but I'm not entirely sure what the secure.wm.o URL layout is. [01:04:56] There's the obvious /project/lang/ -> http://lang.project.org/ ones, but some special cases ruin it. [01:05:41] E.g. https://secure.wikimedia.org/wikipedia/mediawiki/wiki/MediaWiki should not redirect to https://mediawiki.wikimedia.org/wiki/MediaWiki [01:05:55] !log enabling DynamicSidebar extensions on labsconsole [01:06:04] Logged the message, Master [01:06:20] Krenair: we have two changes in for this already [01:06:28] lemme find them for you [01:06:56] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:06:57] here's one: https://gerrit.wikimedia.org/r/#/c/13429/ [01:07:16] ah [01:07:19] maybe they merged them [01:07:21] that's good [01:10:20] Oh okay, thank you Ryan_Lane [01:10:35] yw [01:13:10] Yeah, I think Roan abandoned his in favour of paravoids [01:13:29] I think I took his and fixed it up [01:13:37] I think so too [01:13:39] :P [01:13:43] Yeah that's the one [01:13:45] Much less code! ;) [01:13:47] Author: Faidon, Committer: Catrope [01:14:02] shall we deploy it? [01:14:12] Yeah how about we deploy that [01:14:13] Now? ;) [01:14:50] * apergos looks at the clock. not going to monitor that one :-D [01:16:35] who cares if we break secure.wm.o? [01:16:44] Serves them right for not having moved already [01:17:53] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.823 seconds [01:18:04] Yeah I don't think you need to worry about breaking something that's been deprecated for... [01:19:03] About 11 months now: https://blog.wikimedia.org/2011/10/03/native-https-support-enabled-for-all-wikimedia-foundation-wikis/ [01:20:14] who is using prototype again? as in ...test.prototype.wikimedia.org [01:20:35] PROBLEM - Puppet freshness on cp1028 is CRITICAL: Puppet has not run in the last 10 hours [01:20:49] My browser blocked http://blog.wikimedia.org/wp-content/uploads/2011/05/2008_fundraiser_square_button-en.png from loading on that page, it should use a protocol-relative URL :) [01:21:33] The skin is on github, I think.. [01:22:30] Krenair: log a bug and basile can fix it and get ops to deploy it [01:23:13] will do [01:26:50] https://bugzilla.wikimedia.org/show_bug.cgi?id=39986 Who is Basile? [01:28:03] Guillaume [01:28:55] Guillaume Paumier, Technical Communications Manager [01:29:02] https://wikimediafoundation.org/wiki/User:Guillom [01:30:48] If he has that irc name, he's offline [01:31:26] On which note, it's 2.30am [01:32:22] He is in this room, yeah - that's him :) [01:36:15] ok, thank you RD. wasn't aware he also used that name [01:41:11] * apergos looks at RoanKattouw [01:41:33] test.prototype.wikimedia.org? [01:41:55] ? [01:43:31] well I need to find out who is using it [01:43:58] but really I need someone to turn off "FundraisingPortal" over there [01:43:58] I don't know [01:44:10] That I can do [01:44:14] Is it causing a problem? [01:44:22] well it wants to read from ms7 and [01:44:32] it has nothing to do with the fundraiser current code any more [01:44:43] so it would be another nail in solaris's coffin [01:46:33] Wait [01:46:39] * apergos waits [01:46:45] How the hell is test.prototype reading from NFS?! [01:47:03] GET /portal/wikipedia/en/fundraiserportal.js 200 (http://test.prototype.wikimedia.org/wiki/Main_Page) [01:47:07] like that :-P [01:48:21] Ah OK [01:48:25] I'll turn it off in a minute [01:48:31] excellent [01:49:44] I am now going to bail [01:50:05] there will be more cruft squashing tomorrow. [01:50:10] have a nice evening folks [02:02:50] :O [02:02:52] Found a swap file by the name "wmf-config/.CommonSettings.php.swp" [02:02:54] owned by: pdhanda dated: Wed Jun 15 21:35:15 2011 [02:02:57] (on the prototype VM) [02:17:20] !log nagios crashed, fixing [02:17:32] Logged the message, RobH [02:20:32] New patchset: RobH; "fixing some nagios errors from my earlier commit" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/22694 [02:21:22] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/22694 [02:21:55] Change merged: RobH; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/22694 [02:29:27] hrmm, seems its been down longer than my change. [02:29:30] something else is fubar. [02:31:23] New patchset: RobH; "pager testing stanza needed for other nagios stuff" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/22696 [02:32:22] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/22696 [02:32:48] Change merged: RobH; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/22696 [02:33:53] PROBLEM - Puppet freshness on cp1023 is CRITICAL: Puppet has not run in the last 10 hours [02:33:53] PROBLEM - Puppet freshness on cp1027 is CRITICAL: Puppet has not run in the last 10 hours [02:33:53] PROBLEM - Puppet freshness on cp1026 is CRITICAL: Puppet has not run in the last 10 hours [02:33:53] PROBLEM - Puppet freshness on cp1024 is CRITICAL: Puppet has not run in the last 10 hours [02:33:53] PROBLEM - Puppet freshness on zhen is CRITICAL: Puppet has not run in the last 10 hours [02:39:08] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:40:29] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.088 seconds [02:41:23] RECOVERY - Puppet freshness on cp1027 is OK: puppet ran at Wed Sep 5 02:41:03 UTC 2012 [02:44:59] RECOVERY - Puppet freshness on cp1024 is OK: puppet ran at Wed Sep 5 02:44:35 UTC 2012 [02:46:29] RECOVERY - Varnish HTTP upload-frontend on cp1024 is OK: HTTP OK HTTP/1.1 200 OK - 641 bytes in 0.054 seconds [02:46:56] RECOVERY - Varnish traffic logger on cp1024 is OK: PROCS OK: 3 processes with command name varnishncsa [02:50:39] New patchset: Demon; "Minor typofix to Ia567fcbe: ended up renaming this to smtp_host all but here" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/22697 [02:51:30] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/22697 [02:54:27] RECOVERY - Puppet freshness on cp1026 is OK: puppet ran at Wed Sep 5 02:54:05 UTC 2012 [02:54:35] RECOVERY - Varnish traffic logger on cp1026 is OK: PROCS OK: 3 processes with command name varnishncsa [02:55:47] RECOVERY - Varnish HTTP upload-frontend on cp1026 is OK: HTTP OK HTTP/1.1 200 OK - 641 bytes in 0.053 seconds [03:06:53] RECOVERY - Puppet freshness on cp1023 is OK: puppet ran at Wed Sep 5 03:06:36 UTC 2012 [03:07:29] RECOVERY - Varnish HTTP upload-frontend on cp1023 is OK: HTTP OK HTTP/1.1 200 OK - 643 bytes in 0.054 seconds [03:07:47] RECOVERY - Varnish traffic logger on cp1023 is OK: PROCS OK: 3 processes with command name varnishncsa [03:07:57] RECOVERY - Puppet freshness on cp1028 is OK: puppet ran at Wed Sep 5 03:07:40 UTC 2012 [04:07:21] New patchset: Jeremyb; "change all $ircecho_server to use the chat CNAME" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/22698 [04:08:09] New patchset: Jeremyb; "make ircecho config sane (not just very long strings)" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/8344 [04:08:58] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/22698 [04:08:58] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/8344 [04:10:18] !log running d/d8 container consistency check fr ms7 from bast1001 in screen session as ariel [04:10:26] Logged the message, Master [04:29:06] New patchset: Jeremyb; "change all $ircecho_server to use the chat CNAME" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/22698 [04:29:55] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/22698 [04:34:25] New patchset: Jeremyb; "make ircecho config sane (not just very long strings)" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/8344 [04:35:14] New patchset: Jeremyb; "change all $ircecho_server to use the chat CNAME" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/22698 [04:36:04] wow gerrit's slow [04:36:04] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/8344 [04:36:04] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/22698 [04:37:06] * jeremyb still needs to do some work on 8120, bbl [04:38:56] PROBLEM - Puppet freshness on ms-be1007 is CRITICAL: Puppet has not run in the last 10 hours [04:38:56] PROBLEM - Puppet freshness on ms-be1011 is CRITICAL: Puppet has not run in the last 10 hours [04:38:56] PROBLEM - Puppet freshness on ms-be1010 is CRITICAL: Puppet has not run in the last 10 hours [04:44:56] PROBLEM - Puppet freshness on neon is CRITICAL: Puppet has not run in the last 10 hours [04:56:11] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:59:02] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.083 seconds [05:31:34] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:35:55] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 6.402 seconds [05:56:01] PROBLEM - Puppet freshness on cp1025 is CRITICAL: Puppet has not run in the last 10 hours [06:09:04] PROBLEM - Puppet freshness on magnesium is CRITICAL: Puppet has not run in the last 10 hours [06:09:04] PROBLEM - Puppet freshness on zinc is CRITICAL: Puppet has not run in the last 10 hours [06:11:37] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:20:37] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 1.356 seconds [06:55:11] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:07:29] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.569 seconds [07:24:17] PROBLEM - Host search32 is DOWN: PING CRITICAL - Packet loss = 100% [07:25:47] RECOVERY - Host search32 is UP: PING OK - Packet loss = 0%, RTA = 1.29 ms [07:31:34] morning [07:32:06] morning hashar [07:32:28] hey Tim!! :) [07:33:13] Jenkins is now running some extensions tests. I might setup Scribunto today :) [07:34:35] need to figure out a system to include the extensions it depends upon [07:35:17] I wrote a sampling profiler for lua [07:35:40] it seems almost too good to waste on lua, a few more lines of code and it would be a sampling profiler for PHP as well [07:35:48] is that something that will be build in a future lua version ? or dedicated to the ext you wrote? [07:36:10] it's in luasandbox, I will deploy it when I'm finished testing [07:39:07] did you get some volunteers to rewrote the heavy templates already ? ( {{cite}} comes to mind) [07:39:53] someone rewrote the citation templates, but the result was quite slow, which is why I wrote the profiler [07:40:13] it turns out to be about 70% template expansion, using frame:preprocess() [07:41:43] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:53:51] shall we deploy it? [07:54:01] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 3.061 seconds [07:54:17] (bad history recall, nevermind) [07:58:03] morning paravoid :) [07:58:34] hi [08:00:38] paravoid: I have been playing with fontconfig yesterday [08:01:08] the latex community use the Computer Modern font but Ubuntu lacks the font name they use [08:01:41] if you get any knowledge about fontconfig : https://gerrit.wikimedia.org/r/#/c/22533/ ;) [08:17:45] hashar: fc-match cmr10 matches cmr10.ttf from LyX (ttf-lyx) here [08:18:37] OHH [08:18:57] looks like that package provides all the fonts needed! [08:18:59] good find :) [08:19:01] there's also fonts-cmu (for precise) [08:19:25] that's Unicode & OT version of Computer Modern [08:20:23] OT = OpenType, a standard that (kind of) merges & supersedes TrueType and Type1 [08:21:19] fonts-cmu looks good [08:21:21] hm, how do you use cm-super with fontconfig? does that even work? [08:21:30] do you use cm-super-x11? [08:22:03] will try that one [08:22:10] fonts-cmu does not seem to provide cmr10 [08:22:58] cm-super-x11 neither [08:23:34] ttf-lyx's cmr10 is probably a raytraced version of the plain ol' CM [08:23:46] it probably doesn't have extended charsets and such [08:24:37] what do you need CM for? just math? [08:24:55] yeah for math expressions in SVG file [08:25:02] so librsvg can find them and [08:25:16] apparently the math guys uses cmr10 as a font name [08:25:35] ttf-lyx should suffice [08:27:03] trying out :) [08:27:10] will make the change very trivial [08:27:42] open("/usr/share/fonts/truetype/ttf-lyx/cmr10.ttf", O_RDONLY) = 3 [08:27:43] ;) [08:27:54] well, we knew that [08:27:58] check if the output's okay [08:28:34] particularly expressions with particularly rare characters [08:28:41] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:29:57] the bug opener created me a test file http://commons.wikimedia.org/wiki/File:Cm-super_test_font_rendering.svg :-D [08:35:24] Change abandoned: Hashar; "Apparently ttf-lyx provides the font we need :-)" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/22533 [08:35:58] :-) [08:37:47] I am not sure it supports unicode though :/ [08:38:15] New patchset: Hashar; "(bug 38299) Computer Modern fonts for SVG rendering" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/22705 [08:38:26] it probably only supports latin1 + some extra characters as the original CM did [08:38:29] but do you need it? [08:38:48] I have no idea, I am not a math guy [08:39:07] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/22705 [08:39:25] I am pretty sure we will have some hebrew / chinese math person having the issue :) [08:39:57] you don't have to go that far [08:40:04] Greek isn't in Latin1 :-) [08:40:13] PROBLEM - Puppet freshness on mw74 is CRITICAL: Puppet has not run in the last 10 hours [08:40:17] that's why I asked if it's just for math [08:40:24] if it's for math, it shouldn't be a problem [08:40:39] can't you write your math using Greek ? :-) [08:40:46] though alpha, beta etc are probably included [08:41:09] I guess that a lot of Greek characters are included, yes [08:41:11] π, μ etc. [08:42:18] There is no ツ in font cmr10! [08:42:22] no more Japanese smileys :( [08:43:34] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.026 seconds [08:44:21] paravoid: will wait for bug reporter to reply. Thanks for pointing ttf-lyx :-)) [08:45:49] fonts are a mess unfortunately [08:46:44] I'm maintaining a few myself, as part of the Debian Fonts Task Force [08:47:43] New review: Nikerabbit; "So many patchets?" [operations/puppet] (production) C: 1; - https://gerrit.wikimedia.org/r/22698 [08:53:18] PROBLEM - Puppet freshness on ms-be6 is CRITICAL: Puppet has not run in the last 10 hours [09:00:21] PROBLEM - Puppet freshness on formey is CRITICAL: Puppet has not run in the last 10 hours [09:01:24] PROBLEM - Puppet freshness on manganese is CRITICAL: Puppet has not run in the last 10 hours [09:13:51] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:23:47] ahh [09:23:58] I have discovered ant has an API and support inline javascript :-] [09:24:22] so my postpone rewriting my ant build script using ruby rake [09:28:42] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.024 seconds [10:00:17] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:12:53] PROBLEM - Puppet freshness on cp1022 is CRITICAL: Puppet has not run in the last 10 hours [10:13:56] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 1.019 seconds [10:38:50] PROBLEM - Puppet freshness on ms-be1005 is CRITICAL: Puppet has not run in the last 10 hours [10:38:50] PROBLEM - Puppet freshness on ocg3 is CRITICAL: Puppet has not run in the last 10 hours [10:38:50] PROBLEM - Puppet freshness on ms-be1006 is CRITICAL: Puppet has not run in the last 10 hours [10:38:50] PROBLEM - Puppet freshness on virt1003 is CRITICAL: Puppet has not run in the last 10 hours [10:38:50] PROBLEM - Puppet freshness on ms-be1009 is CRITICAL: Puppet has not run in the last 10 hours [10:38:51] PROBLEM - Puppet freshness on singer is CRITICAL: Puppet has not run in the last 10 hours [10:38:51] PROBLEM - Puppet freshness on virt1002 is CRITICAL: Puppet has not run in the last 10 hours [10:38:52] PROBLEM - Puppet freshness on virt1001 is CRITICAL: Puppet has not run in the last 10 hours [10:38:52] PROBLEM - Puppet freshness on virt1004 is CRITICAL: Puppet has not run in the last 10 hours [10:48:53] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:56:14] RECOVERY - check_job_queue on spence is OK: JOBQUEUE OK - all job queues below 10,000 [10:57:35] RECOVERY - check_job_queue on neon is OK: JOBQUEUE OK - all job queues below 10,000 [11:01:11] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.057 seconds [11:33:33] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:45:33] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.360 seconds [12:19:27] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:34:27] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.027 seconds [12:34:45] PROBLEM - Puppet freshness on zhen is CRITICAL: Puppet has not run in the last 10 hours [13:06:32] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:18:32] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 2.359 seconds [13:36:42] New review: Jeremyb; "yeah ;(" [operations/puppet] (production) C: 0; - https://gerrit.wikimedia.org/r/22698 [13:45:26] * jeremyb hopes cmjohnson didn't really stay the night ;P [13:46:05] ahhh [13:46:52] paravoid: easy change for ya: https://gerrit.wikimedia.org/r/#/c/22698/ irc.freenode.net -> chat.freenode.net :-) [13:47:05] jeremyb: did you get your irecho changes merged in ? [13:47:33] hashar: see the dependencies for that one you just linked ;) [13:47:51] hehe [13:48:22] TomDaley: what's with the nick? was misreading as TomDelay most of yesterday [13:48:22] hopefully Ryan will merge it today!!! [13:48:45] jeremyb: Joke from yesterday, but I'm thinking I'll stick with it for awhile. [13:49:01] TomDaley: is there a 1-line version? [13:49:29] apparently tom is DeLay (capitalization) [13:50:03] No, it's definitely not DeLay [13:50:05] It's Daley :) [13:50:54] bath ant project does not have an IRC channel :/ [13:50:56] One line: Ironholds was trying to bribe me to crash the site, so I told him he'd have to bring me Tom Daley. [13:51:45] bath? [13:51:56] TomDaley: who is that? [13:53:03] !w Tom Daley [13:53:03] http://en.wikipedia.org/wiki/Tom [13:53:04] [[w:Tom Daley (diver)]] -- I'll leave you to google images as to why :p [13:53:07] pff [13:53:08] hashar: no one's complained about them before. other people do the same thing too. I don't add them for every new patchset, I'm selective [13:53:12] !w "Tom Daley" [13:53:12] http://en.wikipedia.org/wiki/"Tom [13:53:14] .. [13:53:29] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:53:34] jeremyb: yeah feel free to ignore my comment :-) [13:53:54] Oh man, our free images for his article kind of suck. None of them do him justice at all. [13:53:56] :( [13:54:41] hashar: also, is there some way to add a comment for a push as part of the same action as the push? i haven't figured out hwo [13:54:44] TomDaley: well time to take a picture of yourself and upload to commons as {{self}} ;- [13:55:07] Hahahahahahaha [13:55:12] I don't think anyone will believe me [13:55:14] na need to push first then comment in Gerrit [13:55:41] jeremyb: You can do it from the command line, at least if you'd like. [13:56:03] once pushed though, you could use something like gerrit approve --comment "something there" [13:56:16] approve is deprecated, use review. [13:56:28] * TomDaley whacks hashar with the gerrit manual [13:56:31] TomDaley: i mean not as a separate comment. because pushing adds a comment itself, i want to put it in that comment [13:56:56] * hashar ducks by simply not opening the manual URL [13:57:28] * jeremyb gets the manual printed on a set of bricks and delivers to hashar [13:57:56] * hashar waits for delivery [13:58:34] out for a few mins [13:58:49] damn you'll miss the delivery [14:05:29] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 5.633 seconds [14:11:58] jeremyb: Is there a gerrit book yet? [14:12:02] If there is, there should be [14:12:08] no idea [14:12:20] TomDaley: is what i want possible? [14:12:37] Not as far as I know, no. [14:15:14] ;( [14:39:32] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:39:41] PROBLEM - Puppet freshness on ms-be1007 is CRITICAL: Puppet has not run in the last 10 hours [14:39:41] PROBLEM - Puppet freshness on ms-be1011 is CRITICAL: Puppet has not run in the last 10 hours [14:39:41] PROBLEM - Puppet freshness on ms-be1010 is CRITICAL: Puppet has not run in the last 10 hours [14:45:41] PROBLEM - Puppet freshness on neon is CRITICAL: Puppet has not run in the last 10 hours [14:51:41] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 9.363 seconds [14:55:00] paravoid: i am expecting a new controller card for ms-be6 today. fedex usually doesn't arrive until 2(+/-) Local. Will you be around? [14:56:17] unlikely, maybe apergos? [15:01:08] !log search32 still borked ..going down for troubleshooting [15:01:16] Logged the message, Master [15:02:29] PROBLEM - MySQL Slave Delay on db33 is CRITICAL: CRIT replication delay 187 seconds [15:03:14] PROBLEM - MySQL Replication Heartbeat on db33 is CRITICAL: CRIT replication delay 200 seconds [15:03:32] PROBLEM - Host search32 is DOWN: PING CRITICAL - Packet loss = 100% [15:06:06] hi apergos [15:06:12] hello [15:06:19] do you have a minute to make a change to something on OTRS? [15:06:27] it's changing the news item on the main login page [15:06:51] on the OTRS server (williams) in /opt/otrs/Kernel/Output/HTML/Standard/Motd.dtl. - can you change that text to replace it with: [15:06:58] September 1, 2012: There is a Request for comment (RfC) on a Wikimedia Foundation Legal Fees Assistance Program to provide assistance to Wikimedia support roles that face legal action as a result of their work. This would include OTRS agents. Please comment at https://meta.wikimedia.org/wiki/Request_for_comment/Legal_Fees_Assistance_Program. [15:08:25] do I edit that in place or is it generated by something? [15:08:33] do we have version control for any of this stuff? [15:08:41] apergos: quilt [15:09:24] ok well I have no idea how that works [15:09:32] but if you or someone can talk me through it that would be fine [15:10:29] I think you put the quilt over your head, and then scream. Loudly. [15:10:36] Reedy++ [15:10:37] ok, doing that [15:10:50] pretty sure that won't get the change applied though [15:11:04] Reedy must go though a lot of quilts [15:11:29] I expect you can reuse em [15:12:14] RECOVERY - Host search32 is UP: PING OK - Packet loss = 0%, RTA = 1.02 ms [15:14:38] RECOVERY - MySQL Slave Delay on db33 is OK: OK replication delay 2 seconds [15:15:14] RECOVERY - MySQL Replication Heartbeat on db33 is OK: OK replication delay 0 seconds [15:26:06] New review: Umherirrender; "Thanks. I hope, you are not the one person, who can do things like this." [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/21326 [15:26:23] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:27:16] * apergos looks at the scanset extension to see what would be needd for getting it into swift or if that even makes sense [15:27:32] heh [15:27:49] http://www.mediawiki.org/wiki/Extension:ScanSet [15:27:55] "this extension is undocumented." [15:28:22] at least it's less than 500 lines of code [15:28:30] yep [15:28:41] That and it was written by Tim [15:29:05] PROBLEM - check_job_queue on neon is CRITICAL: JOBQUEUE CRITICAL - the following wikis have more than 9,999 jobs: , enwiki (14903) [15:29:50] PROBLEM - check_job_queue on spence is CRITICAL: JOBQUEUE CRITICAL - the following wikis have more than 9,999 jobs: , enwiki (13885) [15:30:58] IIRC it's a pretty static dataset [15:31:51] well what I wonder is how anything gets saved into the scan directory [15:33:08] PROBLEM - ps1-b5-sdtpa-infeed-load-tower-A-phase-Z on ps1-b5-sdtpa is CRITICAL: ps1-b5-sdtpa-infeed-load-tower-A-phase-Z CRITICAL - *2563* [15:33:40] That's what I mean by static [15:33:42] Nothing is added to it [15:33:51] I think Tim just dumped all the files into a folder [15:33:57] ic [15:34:38] well that's easy to fix (and yes that's sure what it looks like from the code *and* from the date on the directory) [15:35:40] apergos, sorry I was AFK, not sure how to use quilt.. [15:35:47] ok [15:36:04] well it probably should wait for someone who's dealt with otrs updates [15:36:41] paravoid, have you used git-buildpackage to build packages before? [15:36:57] i am super close, and I thought I had it, but now that I've cloned elsewhere and am trying to build for lucid I'm having troubles [15:38:32] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 7.907 seconds [15:38:45] also Reedy can you do a rename on mediawiki.org for me please? [15:39:03] If I have to ;) [15:39:04] [[User:SPage (WMF)]] -> [[User:S Page (WMF)]] (add a space between S and P) [15:39:23] you can trust me that S requested it or if you /really/ want I'll find you a diff :P [15:40:03] done [15:40:07] Jeff_Green, do you have a minute to adjust the MOTD on OTRS (or teach apergos how to do it?) [15:40:07] thanks [15:40:29] Back in a bit [15:40:40] Thehelpfulone: ohi, I was just responding to your email about the RTF issue [15:40:55] heh [15:40:57] I have no idea how to do it, but I have a few minutes to help look for it [15:41:18] [16:06:53] on the OTRS server (williams) in /opt/otrs/Kernel/Output/HTML/Standard/Motd.dtl. - can you change that text to replace it with: [15:41:18] [16:07:00] September 1, 2012: There is a Request for comment (RfC) on a Wikimedia Foundation Legal Fees Assistance Program to provide assistance to Wikimedia support roles that face legal action as a result of their work. This would include OTRS agents. Please comment at https://meta.wikimedia.org/wiki/Request_for_comment/Legal_Fees_Assistance_Program. [15:41:20] re. RTF, my vote is that we figure out how to disable RTF and do that for now [15:41:23] Jeff_Green: The OTRS guy has given instructions [15:41:40] Jeff_Green: https://bugzilla.wikimedia.org/show_bug.cgi?id=22622#c28 [15:41:44] "Disable rich text via sysconfig" [15:41:48] Or how to fix it ;) [15:42:07] Reedy: ya I've been looking for that toggle in the code/conf tree for about 10 minutes :-) [15:42:12]