[00:04:03] mutante: I'm getting apache errors on gallium [00:04:10] /usr/sbin/apache2ctl: 87: ulimit: error setting limit (Operation not permitted) [00:04:10] Syntax error on line 26 of /etc/apache2/sites-enabled/doc.wikimedia.org: [00:04:10] SSLCertificateKeyFile: file '/etc/ssl/private/star.mediawiki.org.key' does not exist or is empty [00:04:12] Action 'configtest' failed. [00:04:31] oh mutante is idle 22 hours. [00:05:03] sounds like you're trying to restart it without being root? [00:05:04] This is affecting other domains on gallium (notably integration.wikimedia.org and jenkins testing) currently [00:05:33] Yeah you'll need to sudo the restart [00:05:33] I did sudo -su jenkins but I suppose jenkins isn't allowed to restart apache [00:05:38] I'll restart it [00:05:49] regular sudo prompts me for pwd, it isn't a whitelisted command for me [00:05:53] no, apache needs root [00:05:57] Done [00:06:01] it binds on 80, so... [00:06:11] I know, but I figured it was perhaps a whitelisted command [00:06:22] since there are like 4 or 5 sudo commands whitelisted for the integration team [00:06:28] regular sudo didn't work either for me [00:07:10] ,'ALL = NOPASSWD: /etc/init.d/jenkins' [00:07:14] right [00:07:17] not apache [00:07:18] maybe add /etc/init.d/apache? [00:07:23] I'd prefer not [00:07:26] apache2ctl surely [00:07:35] not as long as we have the star certificate on that box [00:07:38] But it's a bad idea [00:07:40] RECOVERY - Puppet freshness on mw1131 is OK: puppet ran at Fri Jun 7 00:07:38 UTC 2013 [00:07:50] RECOVERY - Puppet freshness on mw1208 is OK: puppet ran at Fri Jun 7 00:07:39 UTC 2013 [00:07:50] RECOVERY - Puppet freshness on mw1154 is OK: puppet ran at Fri Jun 7 00:07:41 UTC 2013 [00:07:50] RECOVERY - Puppet freshness on mw1021 is OK: puppet ran at Fri Jun 7 00:07:43 UTC 2013 [00:07:50] RECOVERY - Puppet freshness on mw1104 is OK: puppet ran at Fri Jun 7 00:07:46 UTC 2013 [00:07:59] I don't think paravoid was around back then but a couple years ago someone pointed out how sudo apache2ctl can be escalated to root [00:08:00] RECOVERY - Puppet freshness on mw1155 is OK: puppet ran at Fri Jun 7 00:07:49 UTC 2013 [00:08:00] RECOVERY - Puppet freshness on sq84 is OK: puppet ran at Fri Jun 7 00:07:50 UTC 2013 [00:08:00] RECOVERY - Puppet freshness on mc14 is OK: puppet ran at Fri Jun 7 00:07:51 UTC 2013 [00:08:00] RECOVERY - Puppet freshness on amssq56 is OK: puppet ran at Fri Jun 7 00:07:53 UTC 2013 [00:08:00] RECOVERY - Puppet freshness on lvs1002 is OK: puppet ran at Fri Jun 7 00:07:54 UTC 2013 [00:08:00] RECOVERY - Puppet freshness on sodium is OK: puppet ran at Fri Jun 7 00:07:56 UTC 2013 [00:08:02] What do you mean, does init.d/apache grant access to the cert? It doesn't grant access to apache or sudo in general, just the init.d [00:08:10] RECOVERY - Puppet freshness on bast1001 is OK: puppet ran at Fri Jun 7 00:08:00 UTC 2013 [00:08:10] RECOVERY - Puppet freshness on ms-be5 is OK: puppet ran at Fri Jun 7 00:08:01 UTC 2013 [00:08:10] RECOVERY - Puppet freshness on amssq51 is OK: puppet ran at Fri Jun 7 00:08:02 UTC 2013 [00:08:10] RECOVERY - Puppet freshness on mw23 is OK: puppet ran at Fri Jun 7 00:08:04 UTC 2013 [00:08:10] RECOVERY - Puppet freshness on ssl4 is OK: puppet ran at Fri Jun 7 00:08:05 UTC 2013 [00:08:10] RECOVERY - Puppet freshness on es1004 is OK: puppet ran at Fri Jun 7 00:08:07 UTC 2013 [00:08:11] RECOVERY - Puppet freshness on mw93 is OK: puppet ran at Fri Jun 7 00:08:08 UTC 2013 [00:08:11] aha, nasty [00:08:13] I wasn't [00:08:20] RECOVERY - Puppet freshness on mw1143 is OK: puppet ran at Fri Jun 7 00:08:09 UTC 2013 [00:08:20] RECOVERY - Puppet freshness on snapshot1002 is OK: puppet ran at Fri Jun 7 00:08:11 UTC 2013 [00:08:20] RECOVERY - Puppet freshness on cp1017 is OK: puppet ran at Fri Jun 7 00:08:12 UTC 2013 [00:08:20] RECOVERY - Puppet freshness on srv261 is OK: puppet ran at Fri Jun 7 00:08:14 UTC 2013 [00:08:20] RECOVERY - Puppet freshness on cp1018 is OK: puppet ran at Fri Jun 7 00:08:16 UTC 2013 [00:08:21] RECOVERY - Puppet freshness on analytics1009 is OK: puppet ran at Fri Jun 7 00:08:16 UTC 2013 [00:08:30] RECOVERY - Puppet freshness on mw13 is OK: puppet ran at Fri Jun 7 00:08:21 UTC 2013 [00:08:30] RECOVERY - Puppet freshness on mw74 is OK: puppet ran at Fri Jun 7 00:08:23 UTC 2013 [00:08:31] RECOVERY - Puppet freshness on mw1194 is OK: puppet ran at Fri Jun 7 00:08:26 UTC 2013 [00:08:31] RECOVERY - Puppet freshness on analytics1002 is OK: puppet ran at Fri Jun 7 00:08:27 UTC 2013 [00:08:41] RECOVERY - Puppet freshness on analytics1022 is OK: puppet ran at Fri Jun 7 00:08:30 UTC 2013 [00:08:41] RECOVERY - Puppet freshness on mw1180 is OK: puppet ran at Fri Jun 7 00:08:32 UTC 2013 [00:08:41] RECOVERY - Puppet freshness on search1003 is OK: puppet ran at Fri Jun 7 00:08:36 UTC 2013 [00:08:42] RECOVERY - Puppet freshness on mw1047 is OK: puppet ran at Fri Jun 7 00:08:38 UTC 2013 [00:08:47] but because of things like that [00:08:50] RECOVERY - Puppet freshness on mw1049 is OK: puppet ran at Fri Jun 7 00:08:41 UTC 2013 [00:08:50] RECOVERY - Puppet freshness on db9 is OK: puppet ran at Fri Jun 7 00:08:42 UTC 2013 [00:08:50] RECOVERY - Puppet freshness on ssl1003 is OK: puppet ran at Fri Jun 7 00:08:44 UTC 2013 [00:08:50] RECOVERY - Puppet freshness on mw1137 is OK: puppet ran at Fri Jun 7 00:08:45 UTC 2013 [00:08:50] RECOVERY - Puppet freshness on hume is OK: puppet ran at Fri Jun 7 00:08:47 UTC 2013 [00:08:50] RECOVERY - Puppet freshness on mw1128 is OK: puppet ran at Fri Jun 7 00:08:48 UTC 2013 [00:09:00] RECOVERY - Puppet freshness on ms6 is OK: puppet ran at Fri Jun 7 00:08:49 UTC 2013 [00:09:00] RECOVERY - Puppet freshness on capella is OK: puppet ran at Fri Jun 7 00:08:50 UTC 2013 [00:09:00] RECOVERY - Puppet freshness on palladium is OK: puppet ran at Fri Jun 7 00:08:51 UTC 2013 [00:09:00] RECOVERY - Puppet freshness on db1026 is OK: puppet ran at Fri Jun 7 00:08:52 UTC 2013 [00:09:00] RECOVERY - Puppet freshness on srv283 is OK: puppet ran at Fri Jun 7 00:08:56 UTC 2013 [00:09:00] RECOVERY - Puppet freshness on srv299 is OK: puppet ran at Fri Jun 7 00:08:57 UTC 2013 [00:09:01] RECOVERY - Puppet freshness on db1027 is OK: puppet ran at Fri Jun 7 00:08:59 UTC 2013 [00:09:10] RECOVERY - Puppet freshness on mw1084 is OK: puppet ran at Fri Jun 7 00:09:00 UTC 2013 [00:09:10] RECOVERY - Puppet freshness on sq62 is OK: puppet ran at Fri Jun 7 00:09:01 UTC 2013 [00:09:10] RECOVERY - Puppet freshness on mw1105 is OK: puppet ran at Fri Jun 7 00:09:02 UTC 2013 [00:09:10] RECOVERY - Puppet freshness on tmh1001 is OK: puppet ran at Fri Jun 7 00:09:05 UTC 2013 [00:09:10] RECOVERY - Puppet freshness on amslvs2 is OK: puppet ran at Fri Jun 7 00:09:06 UTC 2013 [00:09:11] RECOVERY - Puppet freshness on cp1034 is OK: puppet ran at Fri Jun 7 00:09:07 UTC 2013 [00:09:21] RECOVERY - Puppet freshness on cp1016 is OK: puppet ran at Fri Jun 7 00:09:10 UTC 2013 [00:09:21] RECOVERY - Puppet freshness on sanger is OK: puppet ran at Fri Jun 7 00:09:12 UTC 2013 [00:09:21] RECOVERY - Puppet freshness on mc11 is OK: puppet ran at Fri Jun 7 00:09:13 UTC 2013 [00:09:22] RECOVERY - Puppet freshness on mc12 is OK: puppet ran at Fri Jun 7 00:09:17 UTC 2013 [00:09:22] RECOVERY - Puppet freshness on mw61 is OK: puppet ran at Fri Jun 7 00:09:18 UTC 2013 [00:09:31] RECOVERY - Puppet freshness on db69 is OK: puppet ran at Fri Jun 7 00:09:22 UTC 2013 [00:09:31] RECOVERY - Puppet freshness on labstore2 is OK: puppet ran at Fri Jun 7 00:09:23 UTC 2013 [00:09:31] RECOVERY - Puppet freshness on solr1001 is OK: puppet ran at Fri Jun 7 00:09:25 UTC 2013 [00:09:32] RECOVERY - Puppet freshness on db67 is OK: puppet ran at Fri Jun 7 00:09:26 UTC 2013 [00:09:32] RECOVERY - Puppet freshness on es9 is OK: puppet ran at Fri Jun 7 00:09:27 UTC 2013 [00:09:32] RECOVERY - Puppet freshness on db32 is OK: puppet ran at Fri Jun 7 00:09:29 UTC 2013 [00:09:32] escalating from integration -> root might not be a huge deal, if we don't have the star cert there [00:09:40] RECOVERY - Puppet freshness on db1009 is OK: puppet ran at Fri Jun 7 00:09:32 UTC 2013 [00:09:40] RECOVERY - Puppet freshness on db1005 is OK: puppet ran at Fri Jun 7 00:09:33 UTC 2013 [00:09:40] RECOVERY - Puppet freshness on niobium is OK: puppet ran at Fri Jun 7 00:09:35 UTC 2013 [00:09:41] RECOVERY - Puppet freshness on search1005 is OK: puppet ran at Fri Jun 7 00:09:36 UTC 2013 [00:09:41] RECOVERY - Puppet freshness on search31 is OK: puppet ran at Fri Jun 7 00:09:38 UTC 2013 [00:09:52] RECOVERY - Puppet freshness on mw1179 is OK: puppet ran at Fri Jun 7 00:09:39 UTC 2013 [00:09:52] RECOVERY - Puppet freshness on srv291 is OK: puppet ran at Fri Jun 7 00:09:40 UTC 2013 [00:09:52] RECOVERY - Puppet freshness on mw1181 is OK: puppet ran at Fri Jun 7 00:09:41 UTC 2013 [00:09:52] RECOVERY - Puppet freshness on search1015 is OK: puppet ran at Fri Jun 7 00:09:43 UTC 2013 [00:09:52] RECOVERY - Puppet freshness on mw1020 is OK: puppet ran at Fri Jun 7 00:09:45 UTC 2013 [00:09:52] RECOVERY - Puppet freshness on mw1030 is OK: puppet ran at Fri Jun 7 00:09:46 UTC 2013 [00:09:53] RECOVERY - Puppet freshness on mw1078 is OK: puppet ran at Fri Jun 7 00:09:47 UTC 2013 [00:09:53] RECOVERY - Puppet freshness on mw1075 is OK: puppet ran at Fri Jun 7 00:09:49 UTC 2013 [00:10:01] RECOVERY - Puppet freshness on mw45 is OK: puppet ran at Fri Jun 7 00:09:52 UTC 2013 [00:10:01] RECOVERY - Puppet freshness on nickel is OK: puppet ran at Fri Jun 7 00:09:53 UTC 2013 [00:10:01] RECOVERY - Puppet freshness on amssq31 is OK: puppet ran at Fri Jun 7 00:09:56 UTC 2013 [00:10:01] RECOVERY - Puppet freshness on amssq37 is OK: puppet ran at Fri Jun 7 00:09:57 UTC 2013 [00:10:01] RECOVERY - Puppet freshness on amssq35 is OK: puppet ran at Fri Jun 7 00:09:59 UTC 2013 [00:10:10] RECOVERY - Puppet freshness on db77 is OK: puppet ran at Fri Jun 7 00:10:00 UTC 2013 [00:10:10] RECOVERY - Puppet freshness on mc4 is OK: puppet ran at Fri Jun 7 00:10:01 UTC 2013 [00:10:10] RECOVERY - Puppet freshness on ms-fe2 is OK: puppet ran at Fri Jun 7 00:10:03 UTC 2013 [00:10:10] RECOVERY - Puppet freshness on db1058 is OK: puppet ran at Fri Jun 7 00:10:04 UTC 2013 [00:10:10] RECOVERY - Puppet freshness on db65 is OK: puppet ran at Fri Jun 7 00:10:06 UTC 2013 [00:10:10] RECOVERY - Puppet freshness on wtp1002 is OK: puppet ran at Fri Jun 7 00:10:07 UTC 2013 [00:10:10] RECOVERY - Puppet freshness on cp1038 is OK: puppet ran at Fri Jun 7 00:10:08 UTC 2013 [00:10:35] RECOVERY - Puppet freshness on mw95 is OK: puppet ran at Fri Jun 7 00:10:10 UTC 2013 [00:10:36] RECOVERY - Puppet freshness on srv264 is OK: puppet ran at Fri Jun 7 00:10:11 UTC 2013 [00:10:36] RECOVERY - Puppet freshness on srv272 is OK: puppet ran at Fri Jun 7 00:10:12 UTC 2013 [00:10:36] RECOVERY - Puppet freshness on mw99 is OK: puppet ran at Fri Jun 7 00:10:13 UTC 2013 [00:10:37] RECOVERY - Puppet freshness on mw39 is OK: puppet ran at Fri Jun 7 00:10:16 UTC 2013 [00:27:26] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:28:15] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK: Status line output matched 400 - 336 bytes in 0.133 second response time [00:29:41] TimStarling: no I didn't [00:29:48] * Aaron|home read the backstroll [00:33:13] TimStarling: why was it hitting the master though? [00:33:20] * Aaron|home just sees a parse() call [00:34:26] you can read it in gerrit in a minute, I just have to do a little more testing [00:38:12] I see it under [00:38:18] * Aaron|home does trace profiling in eval.php [00:38:30] Parser::braceSubstitution-title-Guidedtour-help-url [00:38:46] only a few seconds now, you'd better be quick [00:38:56] oh, there we go, spoiler alert [00:39:08] > Parser::braceSubstitution-loadtpl [00:40:27] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:41:18] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK: Status line output matched 400 - 336 bytes in 0.125 second response time [00:41:51] I need to make those profile calls use prefixedDBKey [00:43:19] have you read the patch now? the issue was that GuidedTour was using {{MediaWiki:Guidedtour-help-url}} as a way to get a message in the content language [00:43:36] that page doesn't exist anywhere, it's just a default message [00:43:58] so Revision::loadFromConds() was hitting the missing revision case and falling back to the master [00:44:24] I figured that loadFromConds was hitting the "not in slave" case, yes [00:44:36] after that fails, it does the message fetch: [00:44:45] } elseif ( $title->getNamespace() == NS_MEDIAWIKI ) { [00:44:45] global $wgContLang; [00:44:46] $message = wfMessage( $wgContLang->lcfirst( $title->getText() ) )->inContentLanguage(); [00:44:54] which is the behaviour GuidedTour actually wanted [00:44:59] yep [00:45:23] heh [00:46:07] I guess it would be more efficient to go to the message cache first, since it has a complete cache of the MediaWiki namespace in it [00:46:53] then {{MediaWiki:blah}} would be a proper substitute for the relevant missing feature e.g. {{int:blah|lang=content}} [00:47:24] !log catrope synchronized php-1.22wmf6/extensions/VisualEditor 'Updating VisualEditor to master' [00:47:32] Logged the message, Master [01:01:49] RECOVERY - NTP on ssl3003 is OK: NTP OK: Offset 0.003083944321 secs [01:02:53] RECOVERY - NTP on ssl3002 is OK: NTP OK: Offset 0.005040168762 secs [01:06:27] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:07:17] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK: Status line output matched 400 - 336 bytes in 0.124 second response time [01:09:50] Hey TimStarling Aaron|home, have time to join us in #mediawiki-oauth to talk with brad about permissions? [01:16:37] PROBLEM - Packetloss_Average on analytics1005 is CRITICAL: STALE [01:16:38] PROBLEM - Packetloss_Average on analytics1008 is CRITICAL: STALE [01:16:39] PROBLEM - Packetloss_Average on analytics1009 is CRITICAL: STALE [01:16:42] PROBLEM - Packetloss_Average on analytics1004 is CRITICAL: STALE [01:19:12] New patchset: Hazard-SJ; "(bug 29902) Tidied up CommonSettings and InitialiseSettings" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/65860 [01:23:55] New patchset: Hazard-SJ; "(bug 29902) Tidied up CommonSettings and InitialiseSettings" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/65860 [01:23:59] PROBLEM - Packetloss_Average on analytics1006 is CRITICAL: STALE [01:31:15] New patchset: Hazard-SJ; "(bug 29902) Tidied up CommonSettings and InitialiseSettings" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/65860 [01:32:04] New review: Hazard-SJ; "I re-fixed the spacing now, it it okay?" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/65860 [01:45:02] New patchset: Yurik; "Rename all ACLs to match X-CS IDs" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67395 [02:05:54] !log LocalisationUpdate completed (1.22wmf5) at Fri Jun 7 02:05:54 UTC 2013 [02:06:04] Logged the message, Master [02:16:11] !log LocalisationUpdate completed (1.22wmf6) at Fri Jun 7 02:16:10 UTC 2013 [02:16:19] Logged the message, Master [02:27:05] !log LocalisationUpdate ResourceLoader cache refresh completed at Fri Jun 7 02:27:05 UTC 2013 [02:27:13] Logged the message, Master [06:40:19] hi, do we use 10.234.0.0/16 range anywhere? [10:33:22] New review: Odder; "Please rebase the change—there have been updates to the file in the meantime, so your version is n..." [operations/mediawiki-config] (master) C: -1; - https://gerrit.wikimedia.org/r/65860 [11:18:53] New patchset: Mark Bergsma; "Remove RFC1918 range from carrier ACL" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67405 [11:19:58] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67405 [11:20:24] New patchset: Aude; "Set $wgServer only if $_SERVER['SERVER_NAME'] is available" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67406 [11:22:15] Change abandoned: Aude; "okay, we already have https://gerrit.wikimedia.org/r/#/c/67311/ :)" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67406 [11:23:10] New review: Aude; "(1 comment)" [operations/puppet] (production) C: 1; - https://gerrit.wikimedia.org/r/67311 [11:30:01] New review: Mark Bergsma; "I like this in principle, but would it be possible to have comments with the carrier name added just..." [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67395 [11:31:25] New patchset: ArielGlenn; "instantcommons for en wp in beta labs to make wikilove happy" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/67407 [11:31:35] New patchset: Mark Bergsma; "Updated Orange Tunisia IPs per carrier request" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67360 [11:32:28] New patchset: Aude; "Include Wikibase query config only if those components are enabled" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67408 [11:33:18] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67360 [11:34:57] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67328 [11:37:19] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/66991 [11:45:50] New patchset: Mark Bergsma; "Update mobile device detection" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/66874 [11:45:55] mmm, no jenkins today [11:48:29] New patchset: Mark Bergsma; "Update mobile device detection" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/66874 [11:58:02] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/60302 [12:01:16] Change abandoned: Mark Bergsma; "This has been fixed in the error pages for the (upcoming) Varnish deployment for text (and other clu..." [operations/debs/squid] (master) - https://gerrit.wikimedia.org/r/61950 [12:02:22] New review: Aude; "(1 comment)" [operations/puppet] (production) C: -1; - https://gerrit.wikimedia.org/r/67311 [12:02:24] New review: Mark Bergsma; "As Asher said" [operations/puppet] (production) C: -2; - https://gerrit.wikimedia.org/r/57419 [12:03:23] New review: Mark Bergsma; "I believe this is no longer needed since I made similar changes recently..." [operations/puppet] (production) - https://gerrit.wikimedia.org/r/54863 [12:04:35] Change abandoned: Mark Bergsma; "One year old change without activity" [operations/debs/ircd-ratbox] (master) - https://gerrit.wikimedia.org/r/12425 [12:24:40] New review: Aude; "(1 comment)" [operations/puppet] (production) C: -1; - https://gerrit.wikimedia.org/r/67144 [12:32:27] New review: Aude; "(1 comment)" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67144 [12:44:28] !log reedy synchronized php-1.22wmf5/extensions/Parsoid/ [12:44:36] Logged the message, Master [12:45:09] !log reedy synchronized php-1.22wmf6/extensions/Parsoid/ [12:45:17] Logged the message, Master [12:50:26] New patchset: Aude; "Fix wikidata singlenode manifest" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67144 [12:50:54] New review: Aude; "fixed both issues" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67144 [12:52:34] New review: Zfilipin; "Is there a reason what this is neither merged nor abandoned?" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/54692 [12:59:24] New patchset: Andrew Bogott; "Don't override $wgServer if $_SERVER["SERVER_NAME"] is undefined." [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67311 [13:32:45] New patchset: Mark Bergsma; "Double the backend weight from 20 to 40" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67415 [13:43:28] <^demon> !log restarting zuul per https://bugzilla.wikimedia.org/show_bug.cgi?id=49294#c4 [13:43:36] Logged the message, Master [13:45:21] i think your systemuser change that I merged is causing problems [13:45:27] but i'm not yet sure why [13:45:52] <^demon> :( [13:46:01] Change abandoned: Faidon; "Empty commit" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/44715 [13:47:56] New patchset: Mark Bergsma; "Revert "Deprecate $name param to systemuser in favor of $title"" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67417 [13:48:08] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67417 [13:48:13] New review: Demon; "recheck" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67120 [13:49:28] New review: Faidon; "Let's not include an eventlogging subclass directly into site.pp..." [operations/puppet] (production) C: -1; - https://gerrit.wikimedia.org/r/63558 [13:49:58] New review: Demon; "Testing?" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67120 [13:53:28] New review: Faidon; "Including & parameterizing eventlogging::mongo belongs in the role class, not site.pp." [operations/puppet] (production) C: -1; - https://gerrit.wikimedia.org/r/63566 [13:54:26] <^demon> !log restarting gerrit, queue is overloaded and it's killing the bridge to jenkins [13:54:34] Logged the message, Master [14:02:38] New patchset: Ottomata; "Adding support for ganglia metrics in hadoop-metrics2.properties" [operations/puppet/cdh4] (master) - https://gerrit.wikimedia.org/r/67419 [14:03:19] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67415 [14:03:21] Change merged: Ottomata; [operations/puppet/cdh4] (master) - https://gerrit.wikimedia.org/r/67419 [14:16:30] New patchset: Ottomata; "Updating CDH4 module, configuring hadoop-metrics2.properties with ganglia aggreagtor hosts" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67424 [14:16:55] !log Zuul was no more triggering Jenkins jobs {{bug|49294}} . Fixed by Chad who restarted Gerrit. [14:17:04] Logged the message, Master [14:17:14] Change merged: Ottomata; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67424 [14:18:53] New patchset: Mark Bergsma; "Revert "Double the backend weight from 20 to 40"" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67425 [14:19:05] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67425 [14:20:28] I guess I'll go at that differently ;) [14:41:43] New patchset: Mark Bergsma; "Increase the chash weight to the final value on one frontend only" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67428 [14:44:06] New patchset: Mark Bergsma; "Increase the chash weight to the final value on one frontend only" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67428 [14:45:19] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67428 [15:02:11] New patchset: Mark Bergsma; "Revert "Increase the chash weight to the final value on one frontend only"" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67430 [15:02:20] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67430 [15:02:41] ok fuck it, i'll do it on the new boxes only when those arrive [15:05:45] New patchset: Yurik; "Rename all ACLs to match X-CS IDs" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67395 [15:06:20] Is Jenkins still broken, or should I 'recheck' my patches? [15:06:28] hi mark, thanks for fixing the 10. [15:06:35] could you review https://gerrit.wikimedia.org/r/#/c/67395 [15:06:42] that's how i found that problem [15:06:45] andrewbogott: It should be fixed, so recheck them for starters [15:06:47] i already did [15:07:08] mark - i just rebased it two seconds ago [15:07:09] New review: Andrew Bogott; "recheck" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67311 [15:07:12] it wasn't merged [15:07:38] i reviewed it, I didn't say I merged it [15:08:08] mark, sorry, didn't see your comment :) [15:08:18] so used to checking for -1 first :) [15:09:02] mark, could you merge it and in the next patch my script will add them? [15:09:11] i want to separate manual from automated patches [15:09:26] New patchset: Petrb; "created a manifest for syslog" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67434 [15:09:29] Coren ^ [15:09:57] the name in it would be comming from the zero config's "comment" field, and not all of them have been populated yet [15:10:12] New review: coren; "Simple placeholder, no issues" [operations/puppet] (production) C: 2; - https://gerrit.wikimedia.org/r/67434 [15:10:12] New review: Andrew Bogott; "recheck" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67144 [15:10:13] Change merged: coren; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67434 [15:10:29] New review: Andrew Bogott; "recheck" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67408 [15:11:14] why don't you just add it in this patch? [15:12:56] New review: Reedy; "git review -d 65860" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/65860 [15:13:23] New patchset: Mark Bergsma; "Argh, a wrong rebase set weight back to 40..." [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67436 [15:13:24] New patchset: Reedy; "(bug 48308) Change namespace settings for ukwikisource" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/66090 [15:13:30] Change merged: Reedy; [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/66090 [15:14:39] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67436 [15:22:59] Change merged: Andrew Bogott; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67311 [15:23:35] Change merged: Andrew Bogott; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67144 [15:23:54] Change merged: Andrew Bogott; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67408 [15:24:34] New patchset: Akosiaris; "Update to 3b470f56b479f618b7e90577f9857b4e25b38c1a" [operations/debs/kafka] (master) - https://gerrit.wikimedia.org/r/67439 [15:24:56] New patchset: Petrb; "inserted syslog to manifest" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67440 [15:25:21] Change merged: Akosiaris; [operations/debs/kafka] (master) - https://gerrit.wikimedia.org/r/67439 [15:25:35] New review: coren; "Yeah, that's basically it. :-)" [operations/puppet] (production) C: 2; - https://gerrit.wikimedia.org/r/67440 [15:25:35] Change merged: coren; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67440 [15:27:47] Reedy: Jenkins looks better! [15:28:32] New patchset: Akosiaris; "First version debian kafka package" [operations/debs/kafka] (master) - https://gerrit.wikimedia.org/r/67442 [15:30:22] nothing saying "it's time for weekend" as breaking the site twice in the same way on friday afternoon :P [15:31:32] andrewbogott: Well, it's been +2ing puppet changes in <1min, which is quite the improvement. :-) [15:32:38] ottomata: done. https://gerrit.wikimedia.org/r/67442. Whatevah improvements... you know the drill. [15:33:22] and thanks for the delete-project command :-) [15:36:09] woo woo, danke [15:50:38] Change merged: Andrew Bogott; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67008 [15:52:24] New patchset: Yurik; "Rename all ACLs to match X-CS IDs" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67395 [15:53:38] mark fixed https://gerrit.wikimedia.org/r/#/c/67395 [15:55:02] mark, i had to comment on the same line as ACL declaration because it makes it much easier for the script [15:55:14] !log Creating wikilove tables on viwiki [15:55:22] Logged the message, Master [15:57:15] !log Created EducationProgram tables on sewiki [15:57:23] Logged the message, Master [15:58:26] !log Created EducationProgram tables on hewiki [15:58:34] Logged the message, Master [16:00:01] New patchset: Reedy; "Enable EducationProgram on sewiki and hewiki" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/67447 [16:00:12] New patchset: Reedy; "Enable EducationProgram on sewiki and hewiki" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/67447 [16:00:33] Change merged: jenkins-bot; [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/67447 [16:01:40] New patchset: Reedy; "Enable WikiLove on viwiki" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/67448 [16:02:04] Change merged: jenkins-bot; [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/67448 [16:03:27] !log reedy synchronized wmf-config/ [16:03:36] Logged the message, Master [16:05:48] New patchset: Andrew Bogott; "Pep8 cleanup for modules/deployment" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67124 [16:06:10] Ryan_Lane: ^ SVP [16:07:16] Change merged: Andrew Bogott; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67126 [16:07:29] New patchset: Reedy; "Enable Guided Tour in pt.wikibooks" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/67452 [16:08:02] Change merged: jenkins-bot; [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/67452 [16:11:05] New patchset: Reedy; "Enable FooterCleanup on fr.wikipedia.org" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/67454 [16:11:58] Change merged: jenkins-bot; [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/67454 [16:12:21] Change merged: Ryan Lane; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67124 [16:12:25] andre__: thanks :) [16:12:29] werrr [16:12:30] err [16:12:34] andrewbogott: thanks :) [16:16:38] New patchset: Reedy; "reset $wgRestrictDisplayTitle to false and $wgAllowDisplayTitle to true for all wikivoyages" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/67455 [16:17:09] Change merged: jenkins-bot; [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/67455 [16:18:18] New patchset: Andrew Bogott; "Pep8 cleanup for gerrit hookhelper" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67456 [16:18:18] New patchset: Reedy; "Revert "reset $wgRestrictDisplayTitle to false and $wgAllowDisplayTitle to true for all wikivoyages"" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/67457 [16:18:26] Change merged: Reedy; [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/67457 [16:21:33] New patchset: Andrew Bogott; "Pep8 cleanups for mm_cfg: strictly whitespace" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67458 [16:21:42] !log reedy synchronized wmf-config/ [16:21:49] Logged the message, Master [16:25:06] New patchset: Reedy; "Expose visualeditor dblist" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/67459 [16:25:24] Change merged: Reedy; [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/67459 [16:26:14] New patchset: Reedy; "(bug 49125) Add localised/v2 logos for Wikipedias without one IV" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/66972 [16:26:59] New patchset: Reedy; "(bug 49125) Add localised/v2 logos for Wikipedias without one IV" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/66972 [16:27:16] Change merged: jenkins-bot; [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/66972 [16:28:04] whazzup with the Bugzilla bot? [16:28:19] New review: Cmcmahon; "as the author of https://bugzilla.wikimedia.org/show_bug.cgi?id=47893 I'd like to see this in place ..." [operations/mediawiki-config] (master) C: 1; - https://gerrit.wikimedia.org/r/67407 [16:28:19] !log reedy synchronized wmf-config/ [16:28:28] Logged the message, Master [16:31:14] New patchset: Andrew Bogott; "pep8 cleanups for selective-answer.py" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67460 [16:33:53] Change merged: Andrew Bogott; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67458 [16:34:53] Change merged: Andrew Bogott; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67456 [16:35:27] New review: Andrew Bogott; "recheck" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67460 [16:36:40] New patchset: Ryan Lane; "Suppress salt logging in cli operations" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67362 [16:42:05] New patchset: Ryan Lane; "Suppress salt logging in cli operations" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67362 [16:43:48] Change merged: Ryan Lane; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67362 [16:46:19] ottomata: do you mind if I have a look first thing Monday when Alex's around too? [16:48:16] yeah no prob, i think we need to do a few more things [16:48:50] i'm not really sure what he pushed his changes on top of, we need him to take his whole repo and push it anew I thin [16:48:56] but [16:48:59] i think its ready for review [16:49:04] so anytime the 2 of you are on i'd say go for it [16:49:12] the changes we need are very small [16:49:18] mostly the addition of the kafka shell wrapper script [16:49:21] which you already reviewed [16:52:37] not sure there's any point in me reviewing that [16:52:40] two people are enough :) [16:52:52] the debian stuff I have more expertise with, so I could lend a hand [16:53:06] but let's not make everything dependent on three people as we'll never finish this [16:53:20] bah! ^demon, little regex help? https://gerrit.wikimedia.org/r/#/c/67462/3/layout.yaml [16:54:47] What are you trying to do? [16:55:00] <^demon> I think he's trying to not match operations-puppet. [16:55:20] (?!operations-puppet) [16:55:40] <^demon> Yeah, that's what you want. [16:55:44] Yeah, otherwise I have conflicting rules. [16:55:58] In this context what's the difference between * and ? [16:56:31] * is 0 to unlimited [16:56:39] ? is 0 or 1 [16:56:41] !? is not [16:56:41] Key was added [16:56:45] lol [16:56:49] hah [16:56:55] Oh, !? is a specific thing, not a ! applied to a ? [16:57:01] !? [16:57:01] not [16:57:05] :) [16:57:19] hahaha [16:57:30] that's awesome! [16:57:33] You might want * before the brackets though otherwise it's just one character [16:58:07] New patchset: Yurik; "Rename all ACLs to match X-CS IDs" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/67395 [16:59:13] The exclusion still isn't working… operations-puppet-pep8 is matching both rules [16:59:16] https://integration.wikimedia.org/ci/job/integration-zuul-layoutdiff/131/console [17:01:11] ^.*(?!operations-puppet)-pep8$ [17:04:57] ^(?!operations-puppet).*-pep8$ [17:05:16] though, that won't match operations-puppet-lol-pep8 [17:06:30] * andrewbogott tries it [17:07:11] hm… nope, same problem [17:14:57] Reedy, ^demon, I'm stumped :( [17:22:06] New patchset: Odder; "(bug 29902) Tidied up CommonSettings and InitialiseSettings" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/65860 [17:36:56] mark, thanks for merging the redirection update - is there a timeline for squid reload for this chage to take effect? [17:37:15] New review: Faidon; "The -1 is for the unrelated change you put there to the carrier_testing ACL (which is a -2 by itself..." [operations/puppet] (production) C: -1; - https://gerrit.wikimedia.org/r/67395 [17:37:30] he's off for the weekend [17:39:02] New patchset: Odder; "(bug 29902) Tidied up CommonSettings and InitialiseSettings" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/65860 [17:39:40] oh [17:39:51] okay, no hurry there:) [17:42:37] New review: Odder; "Rebased against the current state of the repo and resolved all conflicts manually, should be OK." [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/65860 [17:43:01] does this need a squid restart? [17:44:23] !log aaron synchronized php-1.22wmf5/maintenance/eraseArchivedFile.php '2aa62f6afbd48a3362b78788b81aed847e6e805f' [17:44:31] Logged the message, Master [17:44:53] jeff_green: busy? [17:48:23] apergos: around? [17:48:34] cmjohnson1: nope [17:49:11] wanna move db1013 [17:49:20] sure [17:49:45] cool [17:51:15] !log shutting down db1013 to move to frack and rename [17:51:23] Logged the message, Master [17:52:05] paravoid, yes it does [17:52:38] New patchset: MaxSem; "Cleanup wgMFCustomLogos" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/67300 [18:06:31] paravoid, mark has asked me to add names to that patch, and the names are the result of running my script. The script also sorts IPs, otherwise they are much harder to compare. I wanted to do this as a two patch process. [18:07:17] I want to have this patch in as to make my life much easier to compare varnish with zero config until the new code (whenever that will happen) goes live [18:07:17] yurik: the question was about changing the acl names [18:07:23] okay [18:07:26] paravoid, ^ [18:07:27] no objection from me [18:07:36] it's just weird to see effort in this area [18:07:40] considering that it's about to be replaced [18:07:45] but I don't mind either. [18:07:48] it didn't take that long to write a script [18:08:01]