[19:13:11] RECOVERY - Puppet freshness on mw1062 is OK: puppet ran at Thu Dec 15 19:12:20 UTC 2011 [19:14:11] RECOVERY - Puppet freshness on mw1063 is OK: puppet ran at Thu Dec 15 19:13:14 UTC 2011 [19:16:11] RECOVERY - Puppet freshness on mw1122 is OK: puppet ran at Thu Dec 15 19:15:15 UTC 2011 [19:16:11] RECOVERY - Puppet freshness on mw1083 is OK: puppet ran at Thu Dec 15 19:15:20 UTC 2011 [19:19:11] RECOVERY - Puppet freshness on virt1 is OK: puppet ran at Thu Dec 15 19:19:02 UTC 2011 [19:19:11] RECOVERY - Puppet freshness on virt2 is OK: puppet ran at Thu Dec 15 19:19:04 UTC 2011 [19:20:11] RECOVERY - Puppet freshness on mw1140 is OK: puppet ran at Thu Dec 15 19:20:06 UTC 2011 [19:24:11] RECOVERY - Puppet freshness on mw1049 is OK: puppet ran at Thu Dec 15 19:23:10 UTC 2011 [19:26:11] RECOVERY - Puppet freshness on mw1121 is OK: puppet ran at Thu Dec 15 19:25:12 UTC 2011 [19:57:6] New patchset: Jgreen; "fix typo in exim-ganglia collector, open throttles more on exim config" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1566 [19:57:18] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/1566 [19:59:31] PROBLEM - Puppet freshness on ssl3004 is CRITICAL: Puppet has not run in the last 10 hours [19:59:31] PROBLEM - Puppet freshness on ssl3002 is CRITICAL: Puppet has not run in the last 10 hours [19:59:31] PROBLEM - Puppet freshness on ssl2 is CRITICAL: Puppet has not run in the last 10 hours [20:0:8] New review: Jgreen; "(no comment)" [operations/puppet] (production); V: 1 C: 2; - https://gerrit.wikimedia.org/r/1566 [20:0:9] Change merged: Jgreen; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1566 [20:11:51] New patchset: Mark Bergsma; "Correct class inheritance syntax" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1568 [20:12:1] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/1568 [20:12:36] New review: Mark Bergsma; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/1568 [20:12:36] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1568 [20:17:47] SVN commit seems broken [20:18:2] Commit failed (details follow): [20:18:4] Commit blocked by pre-commit hook (exit code 1) with output: [20:18:5] PHP Warning: PHP Startup: Unable to load dynamic library [20:18:7] '/usr/lib/php5/20090626/curl.so' - /usr/lib/php5/20090626/curl.so: cannot open [20:18:8] shared object file: No such file or directory in Unknown on line 0 [20:18:11] PHP Warning: PHP Startup: Unable to load dynamic library [20:18:12] ... [20:19:33] nvm [20:19:34] New patchset: Mark Bergsma; "Get rid of the noop hack by using virtual resources in swift::proxy::config" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1569 [20:19:47] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/1569 [20:20:41] it was my fault. pre commit hook fired for empty commit message [20:21:25] New review: Mark Bergsma; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/1569 [20:21:26] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1569 [20:24:08] !log synchronized payments cluster to r106360 [20:24:16] Logged the message, Master [20:28:27] New patchset: Mark Bergsma; "Fix requirements, Definition[] does not work" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1570 [20:28:38] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/1570 [20:28:56] New review: Mark Bergsma; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/1570 [20:28:56] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1570 [20:30:52] !nagios is http://nagios.wikimedia.org/ [20:35:52] New patchset: Platonides; "Remove unneeded global" [test/mediawiki/core] (master) - https://gerrit.wikimedia.org/r/1571 [20:40:42] New review: Platonides; "(no comment)" [test/mediawiki/core] (master); V: 0 C: 2; - https://gerrit.wikimedia.org/r/1571 [20:41:50] New review: Platonides; "(no comment)" [test/mediawiki/core] (master); V: 1 C: 2; - https://gerrit.wikimedia.org/r/1571 [20:41:51] Change merged: Platonides; [test/mediawiki/core] (master) - https://gerrit.wikimedia.org/r/1571 [21:19:01] New patchset: Mark Bergsma; "Remove useless $roles variable" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1573 [21:19:15] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/1573 [21:19:21] New review: Mark Bergsma; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/1573 [21:19:21] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1573 [21:23:17] New review: Mark Bergsma; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/1319 [21:23:17] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1319 [21:23:47] PROBLEM - Puppet freshness on ssl3003 is CRITICAL: Puppet has not run in the last 10 hours [21:26:24] New review: Mark Bergsma; "I don't like these all-encompassing "cleanup" commits. It's a recipe for conflicts, breaks blame." [operations/puppet] (production); V: 0 C: -2; - https://gerrit.wikimedia.org/r/1494 [21:28:25] New review: Mark Bergsma; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/1497 [21:28:25] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1497 [21:36:54] !log awjrichards synchronized php/extensions/ContributionTracking/ContributionTracking.php 'r106375' [21:37:02] Logged the message, Master [21:37:22] !log awjrichards synchronized php/extensions/ContributionTracking/ContributionTracking.processor.php 'r106375' [21:37:30] Logged the message, Master [21:37:40] !log awjrichards synchronized php/extensions/ContributionTracking/ContributionTracking_body.php 'r106375' [21:37:48] Logged the message, Master [21:42:50] New patchset: Platonides; "Revert "Remove unneeded global"" [test/mediawiki/core] (master) - https://gerrit.wikimedia.org/r/1574 [21:44:37] New review: Platonides; "Partial review" [test/mediawiki/core] (master); V: 1 C: 1; - https://gerrit.wikimedia.org/r/1574 [21:44:47] New review: Platonides; "Partial review" [test/mediawiki/core] (master); V: 1 C: 1; - https://gerrit.wikimedia.org/r/1574 [21:45:58] !log awjrichards synchronized php/extensions/LandingCheck/LandingCheck.php 'r106377' [21:46:06] Logged the message, Master [21:46:36] !log awjrichards synchronized php/extensions/LandingCheck/SpecialLandingCheck.php 'r106377' [21:46:45] Logged the message, Master [22:26:59] New patchset: Lcarr; "Rewriting planet ssl to go to http planet" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1575 [22:27:12] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/1575 [22:41:06] New patchset: Lcarr; "Rewriting planet ssl to go to http planet" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1575 [22:42:38] New review: Bhartshorne; "(no comment)" [operations/puppet] (production); V: 0 C: 1; - https://gerrit.wikimedia.org/r/1575 [22:44:58] New review: Lcarr; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/1575 [22:44:58] Change merged: Lcarr; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1575 [22:51:57] tstarling cleared profiling data [22:56:53] New patchset: Lcarr; "Making planet.wikimedia.org owned by puppet" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1576 [22:57:04] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/1576 [23:00:22] New review: Bhartshorne; "(no comment)" [operations/puppet] (production); V: 0 C: 1; - https://gerrit.wikimedia.org/r/1576 [23:01:35] New review: Lcarr; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/1576 [23:01:36] Change merged: Lcarr; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1576 [23:06:28] New patchset: Lcarr; "Closed VirtualHost" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1577 [23:06:46] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/1577 [23:07:04] New review: Lcarr; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/1577 [23:07:05] Change merged: Lcarr; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1577 [23:13:33] New patchset: Sara; "Testing lvs for labs." [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1579 [23:13:48] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/1579 [23:15:22] New review: Ryan Lane; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/1579 [23:15:23] Change merged: Ryan Lane; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1579 [23:20:27] New patchset: Lcarr; "Redirect all https requests for planet to http" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1581 [23:20:38] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/1581 [23:22:15] New review: Bhartshorne; "(no comment)" [operations/puppet] (production); V: 0 C: 1; - https://gerrit.wikimedia.org/r/1581 [23:22:52] New review: Lcarr; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/1581 [23:22:52] Change merged: Lcarr; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1581 [23:44:02] gn8 folks