[00:07:04] !log aaron started scap [00:07:21] Logged the message, Master [00:14:19] !log aaron finished scap [00:14:36] Logged the message, Master [00:15:21] that was... fast [00:22:35] LeslieCarr, you still fussing with virt1006 or are you on to other things? [00:23:36] sorry, i got distracte [00:23:37] d [00:24:05] np, just don't want to abandon you if you're still working on my problem :) [00:25:02] (03PS1) 10Aaron Schulz: chmod the renamed JSON as needed [operations/puppet] - 10https://gerrit.wikimedia.org/r/103622 [00:25:12] ori-l: & [00:26:19] though 644 would have worked fine [00:28:39] trying agin but i think this may have to be asked to chris/rob who know wtf about the cisco [00:32:36] (03PS2) 10Ori.livneh: scap / refreshCdbJsonFiles: chmod the renamed JSON as needed [operations/puppet] - 10https://gerrit.wikimedia.org/r/103622 (owner: 10Aaron Schulz) [00:33:11] (03CR) 10Ori.livneh: [C: 032 V: 032] scap / refreshCdbJsonFiles: chmod the renamed JSON as needed [operations/puppet] - 10https://gerrit.wikimedia.org/r/103622 (owner: 10Aaron Schulz) [00:34:08] i got it offerend a dhcp lease but no tftp again [00:34:11] so .... yeah [00:34:15] i have no idea [00:37:29] LeslieCarr: OK, fair enough. Thanks for your help! [00:40:05] !log aaron started scap [00:40:23] Logged the message, Master [00:40:55] andrewbogott: btw, the apache module in mediawiki-vagrant is okayish [00:41:19] it was one of my first so it has a blemish or two, but it's mostly pretty good [00:41:39] Ok, I'll look before I start tearing things apart :) [00:43:38] !log aaron started scap [00:43:53] Logged the message, Master [00:43:58] andrewbogott: cool. happy holidays! [00:45:05] !log aaron started scap [00:45:20] Logged the message, Master [00:51:41] !log aaron started scap [00:51:59] Logged the message, Master [00:57:03] !log aaron started scap [00:57:21] Logged the message, Master [01:00:10] !log aaron finished scap [01:00:27] Logged the message, Master [01:01:57] !log ori started scap [01:02:12] Logged the message, Master [01:06:10] so who is on call https://gist.github.com/anonymous/8109885 >.> [01:06:34] !log ori finished scap [01:06:55] Logged the message, Master [01:31:32] PROBLEM - Puppet freshness on virt1007 is CRITICAL: Last successful Puppet run was Tue 24 Dec 2013 07:29:50 PM UTC [01:32:38] !log aaron started scap [01:32:55] Logged the message, Master [01:42:05] (03PS1) 10Aaron Schulz: Fixed confusing output message [operations/puppet] - 10https://gerrit.wikimedia.org/r/103625 [01:53:12] !log aaron finished scap [01:53:29] Logged the message, Master [01:53:46] !log aaron started scap [01:54:01] Logged the message, Master [01:54:06] Reedy: ssh key expiry really does not get along well with scap :) [01:54:27] * AaronSchulz mumbles about git-deploy [02:00:54] !log aaron finished scap [02:01:10] Logged the message, Master [02:14:06] !log LocalisationUpdate completed (1.23wmf7) at Wed Dec 25 02:14:05 UTC 2013 [02:14:24] Logged the message, Master [02:14:49] !log LocalisationUpdate completed (1.23wmf8) at Wed Dec 25 02:14:49 UTC 2013 [02:15:07] Logged the message, Master [02:40:35] !log LocalisationUpdate ResourceLoader cache refresh completed at Wed Dec 25 02:40:35 UTC 2013 [02:40:52] Logged the message, Master [02:42:52] (03CR) 10Ori.livneh: [C: 032] Fixed confusing output message [operations/puppet] - 10https://gerrit.wikimedia.org/r/103625 (owner: 10Aaron Schulz) [03:33:54] (03PS1) 10Aaron Schulz: Added another required chmod for apache read access [operations/puppet] - 10https://gerrit.wikimedia.org/r/103633 [03:34:57] ori-l: ^ [03:48:53] (03CR) 10Ori.livneh: [C: 032] Added another required chmod for apache read access [operations/puppet] - 10https://gerrit.wikimedia.org/r/103633 (owner: 10Aaron Schulz) [04:04:32] (03PS1) 10Aaron Schulz: Revert "[TEST] Disable the mergeCdbFileUpdates step for testing" [operations/puppet] - 10https://gerrit.wikimedia.org/r/103634 [04:05:25] (03PS2) 10Ori.livneh: Revert "[TEST] Disable the mergeCdbFileUpdates step for testing" [operations/puppet] - 10https://gerrit.wikimedia.org/r/103634 (owner: 10Aaron Schulz) [04:05:33] (03CR) 10Ori.livneh: [C: 032] Revert "[TEST] Disable the mergeCdbFileUpdates step for testing" [operations/puppet] - 10https://gerrit.wikimedia.org/r/103634 (owner: 10Aaron Schulz) [04:32:31] PROBLEM - Puppet freshness on virt1007 is CRITICAL: Last successful Puppet run was Tue 24 Dec 2013 07:29:50 PM UTC [04:53:56] (03PS1) 10Aaron Schulz: Fixed undefined mwVerNum variable [operations/puppet] - 10https://gerrit.wikimedia.org/r/103636 [04:54:18] ori-l: that should fix that [04:55:46] (03PS2) 10Aaron Schulz: Fixed undefined mwVerNum variable [operations/puppet] - 10https://gerrit.wikimedia.org/r/103636 [07:33:31] PROBLEM - Puppet freshness on virt1007 is CRITICAL: Last successful Puppet run was Tue 24 Dec 2013 07:29:50 PM UTC [08:40:42] PROBLEM - Host tungsten is DOWN: PING CRITICAL - Packet loss = 100% [08:42:55] that's me, sorry. [08:43:11] RECOVERY - Host tungsten is UP: PING OK - Packet loss = 0%, RTA = 0.24 ms [08:58:10] ori-l: did you see https://gerrit.wikimedia.org/r/#/c/103636/ ? [08:58:34] Aaron|home: ah, no, i missed it. reviewing. [08:59:09] (03CR) 10Ori.livneh: [C: 032] Fixed undefined mwVerNum variable [operations/puppet] - 10https://gerrit.wikimedia.org/r/103636 (owner: 10Aaron Schulz) [08:59:10] looks like the last thing [09:00:12] ori-l: do we keep those older versions around for stylesheet reasons? Maybe they can just be "skeletonized" for that [09:00:33] not sure what you mean by "stylesheet reasons" [09:00:42] i don't know why they're kept around, tbh [09:00:49] like static assets referenced by URLs [09:00:59] if the MW version is in the url [09:01:26] no, it's only useful if the php code that constructs urls to those static assets is still in use [09:02:09] if i had to guess, it's that we don't have a formal mechanism for pruning old branches [09:02:25] probably it gets a bit much every once in a while and Reedy feels inspired to delete a few [09:03:08] but i could be wrong, maybe there's a principled reason. i don't think so, but who knows [10:05:11] PROBLEM - RAID on searchidx1001 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [10:06:11] RECOVERY - RAID on searchidx1001 is OK: OK: optimal, 1 logical, 4 physical [10:34:31] PROBLEM - Puppet freshness on virt1007 is CRITICAL: Last successful Puppet run was Tue 24 Dec 2013 07:29:50 PM UTC [11:24:56] (03PS1) 10TTO: Disable interwiki magic for wikimedia (chapter) sites [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/103649 [12:52:02] (03PS1) 10Odder: Add massmessage-sender user group to enwiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/103652 [13:35:31] PROBLEM - Puppet freshness on virt1007 is CRITICAL: Last successful Puppet run was Tue 24 Dec 2013 07:29:50 PM UTC [16:36:31] PROBLEM - Puppet freshness on virt1007 is CRITICAL: Last successful Puppet run was Tue 24 Dec 2013 07:29:50 PM UTC [19:37:31] PROBLEM - Puppet freshness on virt1007 is CRITICAL: Last successful Puppet run was Tue 24 Dec 2013 07:29:50 PM UTC [20:15:31] PROBLEM - Puppet freshness on db9 is CRITICAL: Last successful Puppet run was Wed 25 Dec 2013 05:14:45 PM UTC [22:38:32] PROBLEM - Puppet freshness on virt1007 is CRITICAL: Last successful Puppet run was Tue 24 Dec 2013 07:29:50 PM UTC [22:39:33] (03CR) 10Odder: [C: 031] Update favicon spcom.ico [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/103203 (owner: 10Murfel) [22:40:55] (03CR) 10Odder: [C: 031] Fix en.wiktionary favicon [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/103183 (owner: 10Sn1per) [23:16:31] PROBLEM - Puppet freshness on db9 is CRITICAL: Last successful Puppet run was Wed 25 Dec 2013 05:14:45 PM UTC