[00:28:54] can I use I'm having a stange issue on my local wiki with eaccelerator ? [00:30:22] I mean can I use $wgMainCacheType = CACHE_ACCEL; with eaccelerator [00:54:00] why are you using eaccelerator? [00:54:02] use apc [01:54:49] it's hard to find a built version for windows [02:16:29] * jeremyb has replied to OrenBochman in #-labs [03:45:16] join #wikimedia-mobile [03:45:19] oops [04:16:53] RECOVERY - Disk space on es1004 is OK: DISK OK [04:22:13] RECOVERY - MySQL disk space on es1004 is OK: DISK OK [04:42:25] PROBLEM - MySQL slave status on es1004 is CRITICAL: CRITICAL: Slave running: expected Yes, got No [08:34:25] hello [09:42:04] PROBLEM - Puppet freshness on cp1043 is CRITICAL: Puppet has not run in the last 10 hours [09:50:07] PROBLEM - Puppet freshness on cp1044 is CRITICAL: Puppet has not run in the last 10 hours [09:55:54] PROBLEM - MySQL disk space on es1004 is CRITICAL: DISK CRITICAL - free space: /a 442014 MB (3% inode=99%): [09:57:04] PROBLEM - Disk space on es1004 is CRITICAL: DISK CRITICAL - free space: /a 436879 MB (3% inode=99%): [10:06:06] PROBLEM - Puppet freshness on db22 is CRITICAL: Puppet has not run in the last 10 hours [10:14:06] RECOVERY - MySQL slave status on es1004 is OK: OK: [13:12:50] PROBLEM - Puppet freshness on lvs1005 is CRITICAL: Puppet has not run in the last 10 hours [13:22:21] New review: Rich Smith; "(no comment)" [operations/puppet] (production) C: 1; - https://gerrit.wikimedia.org/r/1726 [13:53:19] New review: Mark Bergsma; "You're installing a file in /etc/apache2/sites-enabled - that's most likely wrong. It should be in s..." [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1661 [14:02:54] New review: Mark Bergsma; "Any particular reason you're moving the monitoring out of the role class, into the node definitions?..." [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1700 [14:03:20] welcome back mark and happy new year [14:10:01] PROBLEM - Puppet freshness on ms1002 is CRITICAL: Puppet has not run in the last 10 hours [14:39:34] New review: Mark Bergsma; "What's wrong with upstart_job then?" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1753 [14:56:24] New review: Mark Bergsma; "Please get the indentation right" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1789 [14:59:54] New review: Mark Bergsma; "Please use mode 0555 where appropriate" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1797 [15:01:22] New patchset: Catrope; "Adding generic check for user's last edit time + adding 2 checks for the bots-cb server along with some package requirements." [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1811 [15:01:31] mutante: ----^^ [15:02:46] RoanKattouw: thanks! [15:04:04] RoanKattouw: but actually I'm not sure if its supposed to be there. they want to use it in Labs [15:04:22] Right [15:04:28] So you're saying they want to have it in test? [15:04:33] yea [15:04:41] I'll rebase 1712 then [15:06:27] thanks, tell me if you run into the "delete/modify" conflict with misc-servers.pp etc as well.. i fixed quite a few files manually, then always rebase --continue ..etc [15:06:40] and in the end it _looked_ ok, but wasnt [15:07:25] I didn't [15:07:35] hrm,k:) [15:07:36] Just git rebase test doesn't work [15:07:44] I had to do git rebase --onto test HEAD~1 [15:07:50] aah [15:08:02] Otherwise it's gonna try to rebase all revisions that are in prod but not in test [15:08:21] yeah, thats what i saw :p [15:08:38] gotta remember "--onto" then, cool [15:09:41] It's a bit complicated, I read the git rebase man page (git help rebase) every time I use it [15:10:31] mutante: If you're sure that 1712 should be in test and not in prod, I'll abandon 1811 [15:11:00] yay, merged.thx:) [15:11:22] lets abandon the other one [15:11:40] Done [15:11:41] Change abandoned: Catrope; "Shouldn't be in production per Daniel, see 1712" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1811 [15:12:03] :) [16:10:29] New review: Dzahn; "This has already been fixed in a later change. ".. # Placing the file in sites-available .."" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1661 [16:49:28] New patchset: Dzahn; "fix HTTP monitoring on noc.wm / fenari (RT 2218)" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1815 [16:50:51] New review: Dzahn; "(no comment)" [operations/puppet] (production); V: 1 C: 2; - https://gerrit.wikimedia.org/r/1815 [16:50:52] Change merged: Dzahn; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1815 [16:59:23] RoanKattouw: mutante: you've seen git magic, right? [16:59:47] git magic? [16:59:55] i guess that's a no... [17:00:05] http://www-cs-students.stanford.edu/~blynn/gitmagic/ [17:01:07] * jeremyb wonders where the gerrit source lives... i want to tweak something (i.e. is there a WMF clone? or WMF patches?) [17:02:31] jeremyb: See https://labsconsole.wikimedia.org/wiki/Git [17:02:41] Oh, wait, gerrit source [17:02:45] No, we don't have WMF patches for that [17:02:47] YET [17:03:18] Because it was too much of a bitch to set up on my laptop back in New Orleans [17:03:25] heh [17:03:54] So what we'll do instead is use puppet to set up a gerrit clone on a labs VM, and work on that [17:04:01] is there even a preferred place to clone from? i remmeber Ryan_Lane having trouble even getting a clone to work [17:04:04] You know, in The Future [17:04:14] Yeah I had the same problem [17:04:29] The authoritative clone URL in the README is a dead URL at kernel.org IIRC [17:04:37] I got my clone from Google code [17:05:11] well kernel.org had the server compromise so lots of stuff became unavailable. but i think it was temporary on the 3-6 month scale? [17:05:33] I didn't have a problem getting a clone going [17:05:38] I haven't tried yet [17:05:51] Ryan_Lane: months ago? [17:05:59] no [17:06:20] * jeremyb is confused... [17:06:21] haven't tried yet. it's puppetized, it should be pretty easy [17:06:38] Ryan_Lane: ok, so then how do i make a labs instance with gerrit in it? :) [17:07:41] well, I could add you to the gerrit [17:07:45] We'd need to refactor the Gerrit class in puppet a bit [17:07:45] gerrit project [17:07:49] (wouldn't we?) [17:07:51] then you could create the instance [17:08:01] and we might have to refactor gerrit puppet class some [17:08:02] (in order to support a different location for the .war file) [17:08:17] well, we'd want to use the same version for now, right? [17:08:42] I thought this clone was for development purposes? [17:09:03] well for developing hooks, it can be the same version [17:09:15] but otherwise, yeah, we'd need to have a different war location [17:09:26] Ah, yes, hooks [17:09:42] * RoanKattouw is reminded of his lint pet project [17:10:32] RoanKattouw: is for a very minor tweak [17:10:46] RoanKattouw: but maybe something to be upstreamed [17:10:54] What minor tweak exactly? [17:11:05] * RoanKattouw is interested in anything that improves gerrit's UI [17:11:16] https://gerrit.wikimedia.org/r/#change,1815 has one link that says gitweb [17:11:24] Or, I should say, changes gerrit's UI. Any change is an improvement, almost by definition [17:11:28] i want to change that to link to commitdiff instead of commit [17:11:40] hehe [17:11:55] Ah, yes [17:12:05] That partially solves my gripe about not having the full diff visible in one tab [17:12:53] If you develop it further to the point that you can click a link or button to load the full diff into the page inline using AJAX, I'll buy you a beer [17:15:02] wow you're cheap [17:15:07] only one beer?! [17:15:15] hey mark! you back? [17:15:18] yes [17:15:46] heh [17:17:07] mark: Only as cheap as you, you offered me a $beverage_of_choice which you know is cheaper than a beer in my case ;) [17:17:12] (for the same feature, actually) [17:17:22] mark: welcome back! [17:17:39] hah, for the same feature! [17:17:56] Yup [17:18:09] are beverages transferrable? [17:18:13] hah [17:18:18] It's still my pet project and I'll do it When I Have Time, whenever that is, but hey if I can delegate it ... :) [17:18:28] :) [17:19:28] !log the time is now 17:19:30 UTC [17:19:33] Logged the message, Master [17:19:57] > 17:16 jeremyb: the time is now 17:19:30 UTC [17:20:56] * jeremyb can't (last he checked) do RT tickets. can someone please fix or file? or tell me why it should be broken? (should just be `service ntp restart`? and maybe figure out why it's not running) [17:21:16] Oh, that's wikitech [17:21:18] Let me see [17:21:35] catrope@wikitech:~$ date [17:21:37] Mon Jan 9 17:18:15 UTC 2012 [17:21:42] catrope@roanLaptop:~/mediawiki/trunk$ date [17:21:44] Mon Jan 9 18:21:37 CET 2012 [17:21:48] Yeah so it's three minutes behind [17:22:02] * cmjohnson1 is now away - Reason : $will be back soon [17:22:17] ~ 3m15s [17:22:38] There was a 10-20s gap between those measurements [17:22:44] Switching windows and typing "date" takes time :D [17:23:01] just look at what mediawiki says is the edit time: http://wikitech.wikimedia.org/index.php?title=Server_admin_log&diff=prev&oldid=41827 [17:23:16] Right [17:23:22] also, you could pretype and then switch to hit enter ;-P [17:23:26] !log Installing (!) NTP on wikitech [17:23:30] Logged the message, Mr. Obvious [17:23:44] oh, i guess it must be unpuppetized [17:29:37] jeremyb: Clock is fixed now [17:30:29] !log the time is now 17:30:30 UTC [17:30:31] Logged the message, Master [17:30:46] yay! :) [17:30:49] RoanKattouw: thanks [17:51:36] RoanKattouw: I have a request/question for you [17:52:11] Sure [17:52:42] so, at some point In The Past we talked about a good way for scap to push out a couple of config files to the search boxes. is that something that you could do? [17:52:57] Hmmmm [17:53:01] Yes [17:53:11] alternative is whole mediawiki installation, which seems ridic, or nfs which is.... well, ya know [17:53:14] yay! [17:53:25] ok, this is not a rush, as the boxes I want this for aren't up yet [17:53:27] I'll put it on my list [17:53:35] should I make a bugzilla tic? [17:53:40] or give you the dataz? [17:53:47] I am traveling on Thursday, Friday and Saturday (yes, it really takes that long to go to Australia from where I live) [17:53:57] File an RT and assign to me [17:54:00] hah! that actually does sound about right [17:54:01] ok! [17:54:16] So I'll probably do it on a train, on a plane or in an airport somewhere [17:54:28] Which means the commit should appear in Gerrit some time over the weekend [17:54:33] But don't hold me to that, it might be later [17:54:56] srsly, no rush [17:55:11] if it happens sometime in the next two weeks, that'd be rad [17:55:20] OK [17:55:28] You know what, I'll do it when I'm in SF [17:55:37] But that means you will have to remind me when I get there [17:55:56] ok [17:56:02] or even, when we're both there... [17:56:05] I get in on the 25th [17:56:08] Oh, aha [17:56:12] D'oh, right [17:56:16] You live in Michigan, I forgot [17:56:30] heh, easy to forget. all the same from your perspective :) [17:56:34] Are you in the office on the 25th or is it a lost day due to flying [17:56:37] ? [17:56:59] oh, yeah, I get in that night, so the 26th, really [17:57:21] Ah, OK [17:57:25] I leave on the 28th, which is a Saturday [17:57:37] So we've got the 26th and the 27th that we're both in the office [17:58:03] You know what, send me a reminder e-mail on the 20th or 21st [17:58:07] That's when the SF hackathon is [17:58:13] oh, ok. sounds perfect [17:58:36] Then I should have it done in time for you to buy me a beer (metaphorically) when you get there ;) [18:00:54] someone's mirroring wikitech... http://wikitech.wikimedia.7val.com/ ?! [18:00:58] yes. a [18:03:20] damn why can i never remember what hetdeploy means? found https://www.mediawiki.org/wiki/Heterogeneous_deployment [18:12:01] RECOVERY - HTTP on fenari is OK: HTTP OK HTTP/1.1 200 OK - 4205 bytes in 0.002 seconds [18:22:21] PROBLEM - ps1-a5-sdtpa-infeed-load-tower-A-phase-Y on ps1-a5-sdtpa is CRITICAL: ps1-a5-sdtpa-infeed-load-tower-A-phase-Y CRITICAL - *2600* [18:42:21] PROBLEM - ps1-a5-sdtpa-infeed-load-tower-A-phase-Y on ps1-a5-sdtpa is CRITICAL: ps1-a5-sdtpa-infeed-load-tower-A-phase-Y CRITICAL - *2788* [18:42:25] RoanKattouw_away: the more I look at this, the more it looks like this code requires everything under the fucking sun. I am thinking that a full mediawiki install is the way to go [18:44:55] notpeter: search? :( [18:45:04] jeremyb: oh yeah [18:45:19] but hey, I built a java package, despite oracle and ubuntu's best efforts! [18:45:26] notpeter: i mean under the sun [18:45:47] notpeter: don't blame ubuntu. oracle should get it all [18:46:00] jeremyb: there's plenty of blame to go around :) [18:46:05] but yes, you're correct, of course [18:46:25] notpeter: does it provide the right packages for e.g. tomcat? [18:46:46] notpeter: so that tomcat doesn't try to install a different jvm [18:47:06] (pseudopackage i guess) [18:47:56] notpeter: going in svn under /debs/ ? [18:50:22] bbl [18:50:36] jeremyb: I'm sure that none of it will work properly =P [18:50:50] but srsly, the jar that search uses isn't installed via package, atm [18:50:55] so this is very search specific [19:35:06] notpeter: well teh jar could be installed by puppet? [19:35:48] LeslieCarr: so are all those fiber connections ok? [19:36:13] technically i haven't checked them out yet... [19:37:49] jeremyb: well.... it's not great to put an 80 meg (or whatever) file into the puppet repo. probably want to have ir rsynced or packaged [19:39:11] LeslieCarr: i guess you get a pass for a single day since i left that switch sitting for a couple weeks, this time.... [19:39:21] ;p [19:39:31] hehe [19:43:45] !log torrus dead, kicking [19:43:47] Logged the message, RobH [19:44:27] apergos: around? [19:44:32] no [19:44:48] they are taking a class online hexmode [19:44:50] I'm shoveling food into my mouth and then it will be time for part two of the juniper class [19:44:55] a bunch of ops folks are [19:44:59] if it's a quick "do you know about x" I can answer [19:45:26] apergos: do you know if there is a quick way to export user info apart from an sql dump? [19:45:51] I would check the api, I don't know what it provides, can't think of anything else [19:45:54] (for generic mediawiki, not wmf wikis) [19:45:56] k [19:46:00] ty, that was all [19:46:01] and careful with that, a lot of that stuff is private data [19:46:06] which we don't want to copy [19:46:13] ah ok [19:50:55] PROBLEM - Puppet freshness on cp1043 is CRITICAL: Puppet has not run in the last 10 hours [19:59:55] PROBLEM - Puppet freshness on cp1044 is CRITICAL: Puppet has not run in the last 10 hours [20:15:55] PROBLEM - Puppet freshness on db22 is CRITICAL: Puppet has not run in the last 10 hours [20:25:32] db22 was logged as back in rotation (s4?) ... (puppet alert ^^) [20:25:38] binasher [20:25:51] !log replacing the ops@ alias with the new ops list on mchenry as people keep forgetting to email the new list [20:25:53] Logged the message, Mistress of the network gear. [20:26:02] people in that statement includes myself [20:26:29] whoa, when did you get a specialized response? :) [20:26:49] ryan set it up [20:27:15] A long time ago [20:27:16] jeremyb: yes, db22 is in rotation [20:27:21] i wish it were nondeterministic [20:27:26] Not long after she joined I think [20:27:38] * jeremyb hasn't seen her log much then [20:28:12] word of warning, you can ask Ryan to put in a specific log message but he'll never put the one you asked for ;) [20:28:32] I owe mine to Domas [20:28:33] :D [20:28:40] I don't know who put in Domas's message, maybe that was Ryan as well [20:28:43] I think I owe mine to rob [20:28:44] I did [20:28:59] it was funny. domas was in the office, and I asked him to log something he was doing [20:29:05] haha [20:29:30] was ryan in the office too? [20:30:14] yeah [20:42:20] suckers [20:42:22] that bot was mine! [20:42:33] taking over and adding crap to it is rude to the author! [20:43:28] domas: right, cause you were actively maintaining it [20:43:52] domas: and I majorly changed it too ;) [20:43:59] see how it works in #wikimedia-labs ;) [20:45:03] I really need to check in those changes [20:55:48] PROBLEM - Disk space on srv288 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [20:56:10] !log updating dns with snapshot1001-1004 mgmt [20:56:12] Logged the message, RobH [21:01:38] PROBLEM - RAID on srv288 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [21:01:38] PROBLEM - Apache HTTP on srv288 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:04:18] PROBLEM - DPKG on srv288 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [21:04:38] PROBLEM - SSH on srv288 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:05:49] !log updating dns with snapshot1001-1004 primary ip info [21:05:51] Logged the message, RobH [21:11:18] RECOVERY - Apache HTTP on srv288 is OK: HTTP OK - HTTP/1.1 301 Moved Permanently - 1.292 second response time [21:13:58] RECOVERY - DPKG on srv288 is OK: All packages OK [21:14:18] RECOVERY - SSH on srv288 is OK: SSH OK - OpenSSH_5.3p1 Debian-3ubuntu7 (protocol 2.0) [21:15:18] RECOVERY - Disk space on srv288 is OK: DISK OK [21:15:28] PROBLEM - Apache HTTP on srv261 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:15:58] PROBLEM - RAID on srv261 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [21:18:48] PROBLEM - Disk space on srv261 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [21:19:01] !log snapshot1001-1004 mgmt online [21:19:03] Logged the message, RobH [21:19:39] PROBLEM - SSH on srv261 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:20:08] PROBLEM - DPKG on srv261 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [21:21:08] RECOVERY - RAID on srv288 is OK: OK: no RAID installed [21:25:08] RECOVERY - Apache HTTP on srv261 is OK: HTTP OK - HTTP/1.1 301 Moved Permanently - 0.029 second response time [21:25:38] RECOVERY - RAID on srv261 is OK: OK: no RAID installed [21:28:38] RECOVERY - Disk space on srv261 is OK: DISK OK [21:29:18] RECOVERY - SSH on srv261 is OK: SSH OK - OpenSSH_5.3p1 Debian-3ubuntu7 (protocol 2.0) [21:29:58] RECOVERY - DPKG on srv261 is OK: All packages OK [21:33:38] hey, i may break ganglia for a minute real quick - the data will still be there, just hte frontend might get funky [21:36:29] !log changing gmond source for ganglia3-tip [21:36:30] Logged the message, Mistress of the network gear. [22:22:31] New patchset: Lcarr; "Adding in all variations of ganglia server name" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1816 [22:23:21] can i get a quick peek from someone? https://gerrit.wikimedia.org/r/1816 [22:25:04] * maplebed looks [22:26:00] LeslieCarr: you're removing the second installation and telling apache to accept ganglia* names, right? [22:26:13] yep [22:26:20] +1 commit. [22:26:32] New review: Bhartshorne; "(no comment)" [operations/puppet] (production); V: 0 C: 1; - https://gerrit.wikimedia.org/r/1816 [22:26:32] New review: Lcarr; "(no comment)" [operations/puppet] (production); V: 1 C: 2; - https://gerrit.wikimedia.org/r/1816 [22:26:33] Change merged: Lcarr; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1816 [22:26:56] !log ganglia moved to new nickel server [22:26:57] Logged the message, Mistress of the network gear. [22:27:18] LeslieCarr: oooohhhh its purdy [22:27:36] and it loads... quickly... [22:27:49] ugh [22:27:51] Yay [22:27:55] and no seperate ganglia3 now [22:27:56] ugh ? [22:27:56] LeslieCarr: it rewrites the URL to nikel [22:27:59] *nickel [22:28:00] oh [22:28:03] let me fix that [22:28:07] thanks :) [22:28:13] aww, dns hasn't updated for me yet. [22:28:16] also, the virt cluster is now missing from the list [22:28:31] is gmetad handled by puppet now? [22:28:36] * Ryan_Lane crosses his fingers [22:28:38] hrmm, Utilization heatmap...? [22:29:01] it's partially puppet [22:29:03] mostly puppet [22:29:25] let me figure out why virt got no love... [22:29:34] it's just grabbing all the data from the same sources [22:30:01] New patchset: Lcarr; "fixing redirect" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1817 [22:30:03] Ryan_Lane: can you check this out ? [22:30:25] sure. gimme a sec [22:30:29] looks good [22:30:41] New review: Ryan Lane; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/1817 [22:30:49] I didn't merge that time :) [22:30:56] New review: Lcarr; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/1817 [22:30:56] Change merged: Lcarr; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1817 [22:42:53] Ryan_Lane: was the Virt cluster recently added ? [22:43:02] yep [22:43:07] after you had moved the file [22:43:17] exactly :) updating ti in puppet now [22:43:53] cool [22:43:58] ah, it's in puppet now? [22:44:03] well only for nickel [22:44:09] i didn't want to touch spence, it's scary :) [22:44:15] yeah. that's cool [22:44:22] and assuming nickel runs for another 24 hours, we can shut down all that on spence [22:45:31] free up some of spence's resources for choking solely on nagios ;) [22:46:11] New patchset: Lcarr; "Adding virt cluster" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1818 [22:47:46] New review: Lcarr; "(no comment)" [operations/puppet] (production); V: 1 C: 2; - https://gerrit.wikimedia.org/r/1818 [22:47:47] Change merged: Lcarr; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1818 [22:54:17] Ryan_Lane: virt hosts now up [22:54:27] cool. thanks [23:13:49] RECOVERY - ps1-a5-sdtpa-infeed-load-tower-A-phase-Y on ps1-a5-sdtpa is OK: ps1-a5-sdtpa-infeed-load-tower-A-phase-Y OK - 2400 [23:22:29] PROBLEM - Puppet freshness on lvs1005 is CRITICAL: Puppet has not run in the last 10 hours [23:30:29] RECOVERY - Puppet freshness on lvs1005 is OK: puppet ran at Mon Jan 9 23:30:05 UTC 2012 [23:36:48] New patchset: Asher; "testing new varnish on cp1043" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1819 [23:37:20] New review: Asher; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/1819 [23:37:20] Change merged: Asher; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1819 [23:39:59] RECOVERY - Puppet freshness on cp1044 is OK: puppet ran at Mon Jan 9 23:39:29 UTC 2012 [23:42:13] !log adding two new mobile cache servers running varnish 3.0.2 (cp104[12]) to the m.wiki eqiad vip [23:42:15] Logged the message, Master [23:44:59] RECOVERY - Puppet freshness on cp1043 is OK: puppet ran at Mon Jan 9 23:44:36 UTC 2012 [23:57:17] !log testing varnish 3.0.2 upgrade on cp3001 (bits) [23:57:19] Logged the message, Master [23:57:28] New patchset: Asher; "testing varnish 3.0.2 on cp3001 (esams bits)" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1820 [23:57:49] New review: Asher; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/1820 [23:57:50] Change merged: Asher; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1820