[00:15:40] PROBLEM - Puppet freshness on labstore1001 is CRITICAL: Last successful Puppet run was Tue 11 Mar 2014 08:47:37 PM UTC [00:39:17] Hello I can't search for articles containing the ++ C familly language operator in all language: https://en.wikipedia.org/w/index.php?title=Sp%C3%A9cial%3ARecherche&profile=default&search=%2B%2B&fulltext=Search&searchengineselect=mediawiki [00:39:20] s [00:40:03] Does someone may solve this configuration problem? [00:45:24] ytrezq: + is a often ignored by software [00:47:00] In google search engine, ++ don't have special meaning, but for characters like the - sign It work with "-parameter" [00:48:09] anyway, How I may look for articles using the ++ operator? [01:05:00] (03PS1) 10coren: Tool Labs: tweak mail relay settings [operations/puppet] - 10https://gerrit.wikimedia.org/r/118941 [01:08:07] (03CR) 10coren: [C: 032] "Tiny tweak" [operations/puppet] - 10https://gerrit.wikimedia.org/r/118941 (owner: 10coren) [01:08:33] ori: Okay to merge your change? [01:08:39] Ori.livneh: Add scap-purge-l10n-cache to /usr/local/bin (ecd64ee) [01:35:20] (03PS6) 10Physikerwelt: Change home directory of vagrant user [operations/puppet] - 10https://gerrit.wikimedia.org/r/118053 [01:54:15] (03PS7) 10Physikerwelt: Change home directory of vagrant user [operations/puppet] - 10https://gerrit.wikimedia.org/r/118053 [01:55:05] (03CR) 10jenkins-bot: [V: 04-1] Change home directory of vagrant user [operations/puppet] - 10https://gerrit.wikimedia.org/r/118053 (owner: 10Physikerwelt) [02:02:55] "An error has occurred while searching: The search backend returned an error:" [02:02:57] :P [02:03:25] I heard you like errors, So I put a error in your error [02:04:25] !log LocalisationUpdate failed: mwversionsinuse returned empty list [02:04:36] Logged the message, Master [02:26:32] hackhackhackhackhackhack [02:28:01] !log Running l10nupdate (slightly hacked version) manually [02:28:08] Logged the message, Master [02:28:53] (03PS8) 10Physikerwelt: Change home directory of vagrant user [operations/puppet] - 10https://gerrit.wikimedia.org/r/118053 [02:35:05] !log LocalisationUpdate completed (1.23wmf17) at 2014-03-16 02:35:04+00:00 [02:35:13] Logged the message, Master [02:44:36] !log LocalisationUpdate completed (1.23wmf18) at 2014-03-16 02:44:36+00:00 [02:44:45] Logged the message, Master [03:16:40] PROBLEM - Puppet freshness on labstore1001 is CRITICAL: Last successful Puppet run was Tue 11 Mar 2014 08:47:37 PM UTC [03:18:57] !log LocalisationUpdate ResourceLoader cache refresh completed at Sun Mar 16 03:18:53 UTC 2014 (duration 53m 29s) [03:19:06] Logged the message, Master [03:38:55] !log Archived 2013 SAL [03:38:59] Logged the message, Master [03:43:30] Reedy: what was the l10n issue? [03:43:49] (03PS1) 10Reedy: Fix l10nupdate-1 [operations/puppet] - 10https://gerrit.wikimedia.org/r/118946 [03:43:54] greg-g: ^ [03:43:58] :) [03:43:59] I'm not sure why the hell that fixes it [03:45:01] (03CR) 10Reedy: "l10nupdate@tin:~$ ls -al /usr/local/bin/mwversionsinuse" [operations/puppet] - 10https://gerrit.wikimedia.org/r/118946 (owner: 10Reedy) [03:45:11] But that was essentially the "hack" i did in /tmp to run it manually [03:46:00] screwy permissions of some such [03:46:21] weird [03:59:17] (03PS1) 10Reedy: Read local ganglia.xml if exists (useful for debugging) [operations/software] - 10https://gerrit.wikimedia.org/r/118947 [04:08:48] (03PS2) 10Reedy: Read local ganglia.xml if exists (useful for debugging) [operations/software] - 10https://gerrit.wikimedia.org/r/118947 [04:10:12] (03PS3) 10Reedy: Read local ganglia.xml if exists (useful for debugging) [operations/software] - 10https://gerrit.wikimedia.org/r/118947 [04:11:52] (03PS4) 10Reedy: Read local ganglia.xml if exists (useful for debugging) [operations/software] - 10https://gerrit.wikimedia.org/r/118947 [04:16:25] (03PS5) 10Reedy: Read local ganglia.xml if exists (useful for debugging) [operations/software] - 10https://gerrit.wikimedia.org/r/118947 [04:25:14] (03PS1) 10Reedy: Define $errstr [operations/software] - 10https://gerrit.wikimedia.org/r/118949 [04:36:10] PROBLEM - HTTP 5xx req/min on tungsten is CRITICAL: CRITICAL: reqstats.5xx [crit=500.000000 [04:38:03] (03PS1) 10Reedy: Fix invalid css [operations/software] - 10https://gerrit.wikimedia.org/r/118950 [04:43:04] (03PS2) 10Reedy: Fix invalid css [operations/software] - 10https://gerrit.wikimedia.org/r/118950 [04:51:09] (03PS3) 10Reedy: Fix invalid css [operations/software] - 10https://gerrit.wikimedia.org/r/118950 [05:02:05] (03PS1) 10Reedy: Use minified CSS files [operations/software] - 10https://gerrit.wikimedia.org/r/118951 [05:03:53] (03PS1) 10Reedy: Remove prettify, seems to be unused [operations/software] - 10https://gerrit.wikimedia.org/r/118952 [05:13:48] (03PS1) 10Reedy: Fixup whitespace of jOrgChart.js [operations/software] - 10https://gerrit.wikimedia.org/r/118953 [05:31:49] (03PS1) 10Reedy: Fixup a few syntax and validator errors [operations/software] - 10https://gerrit.wikimedia.org/r/118954 [05:37:10] RECOVERY - HTTP 5xx req/min on tungsten is OK: OK: reqstats.5xx [warn=250.000 [06:15:20] (03PS1) 1001tonythomas: Adjust RSS whitelist to allow mediawiki blog feeds [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/118956 [06:17:40] PROBLEM - Puppet freshness on labstore1001 is CRITICAL: Last successful Puppet run was Tue 11 Mar 2014 08:47:37 PM UTC [06:29:31] (03PS2) 10TTO: Enable Translate and EducationProgram extensions on legalteamwiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/118581 (owner: 10Jalexander) [07:18:24] !log isabled puppet on dataset2 for testing [07:18:28] Logged the message, Master [09:18:40] PROBLEM - Puppet freshness on labstore1001 is CRITICAL: Last successful Puppet run was Tue 11 Mar 2014 08:47:37 PM UTC [09:58:40] PROBLEM - Puppet freshness on dataset2 is CRITICAL: Last successful Puppet run was Sun 16 Mar 2014 06:58:11 AM UTC [10:01:07] (03PS1) 1001tonythomas: Kill tabs in operations/puppets manifests/admins.pp [operations/puppet] - 10https://gerrit.wikimedia.org/r/118961 [10:04:25] (03CR) 10Matanya: "this is a duplicate of https://gerrit.wikimedia.org/r/#/c/118794/" [operations/puppet] - 10https://gerrit.wikimedia.org/r/118961 (owner: 1001tonythomas) [10:04:32] tonythomas: ^ [10:05:50] matanya: oh. sorry. didn't knew that [10:05:57] it is ok [10:06:42] matanya: I think Dzhan forgot the bug no in the commit. No wonder it was not shown in BZ [10:06:49] !log re-enabled puppet on dataset2, testing concluded [10:06:53] Logged the message, Master [10:08:09] i'll amend it tonythomas [10:08:15] (03Abandoned) 1001tonythomas: Kill tabs in operations/puppets manifests/admins.pp [operations/puppet] - 10https://gerrit.wikimedia.org/r/118961 (owner: 1001tonythomas) [10:08:24] matanya: ok :) [10:08:52] (03PS2) 10Matanya: lint admins.pp-pt01-replace tabs and nothing else [operations/puppet] - 10https://gerrit.wikimedia.org/r/118794 (owner: 10Dzahn) [10:09:04] done [10:09:27] tonythomas: you should abandon your change now [10:09:38] matanya: done [10:09:51] ah, i see above [10:09:52] thanks [10:10:44] (03PS3) 1001tonythomas: lint admins.pp-pt01-replace tabs and nothing else [operations/puppet] - 10https://gerrit.wikimedia.org/r/118794 (owner: 10Dzahn) [10:11:36] matanya: just changed the last line to Bug: 60277 [10:11:47] yes [10:11:52] so that it will automatically come up in bz [10:11:58] yes [10:12:07] actually bug #60277 [10:12:58] matanya: don't know why, but it never came up in BZ when bug #60277 was given [10:13:21] I think the convention is Bug: 60277, ah! never mind [10:14:04] let gerrit comment :) [10:14:11] it takes some time [10:14:45] matanya: yeah :) [10:15:03] matanya: and regarding the VERP project, I have submitted my proposal in melange [10:15:13] https://www.mediawiki.org/wiki/VERP [10:15:13] nice [10:15:47] matanya: it would be great if you can take a look through [10:16:12] i can glance at it, but not atm [10:16:50] matanya: thanks [10:17:02] apergos: shop is down [10:17:17] 503 [10:19:00] RECOVERY - Puppet freshness on dataset2 is OK: puppet ran at Sun Mar 16 10:18:59 UTC 2014 [10:19:19] !log shop.wikimeida.org is down - serves 503 [10:19:23] Logged the message, Master [10:32:05] t-shirt crisis in effect [10:35:23] :) [10:35:42] ori: the foundation losses millions of dollars now [10:36:05] i actually think we should probably not log it [10:36:16] ok. when btw ? [10:36:17] it's hosted and administered by a third-party [10:36:23] *why [10:36:27] i see [10:36:32] ok. good to know [10:36:42] so i'm not sure there's anything the ops team could/would do in response [10:37:04] unless there was some indication that the coupling of the shop to our infrastructure was threatening to cause spillover damage [10:39:23] ori: if you are already around, i need some advice. [10:39:43] while fixing puppet3 issues oi found Dynamic lookup of $enable_ipv6_proxy at /etc/puppet/modules/protoproxy/templates/proxy.erb:34 is deprecated. Support will be removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or parameterized classes. [10:40:23] but looking at the code the this erb is called from modules/protoproxy/manifests/init.pp and this variable is declared there [10:40:37] so i don't understand the problem puppet is whining about [10:41:03] should be @, no? [10:41:53] i'd have to look to refresh my memory, but ruby '$' indicates a global and is thus different from the generic puppet '$'. so maybe the '$' in the erb is causing the variable to be looked up in global scope [10:42:27] i thought so at first, but the line in question is : if proxy_address[0,1] == "[" and !(has_variable?("enable_ipv6_proxy") and ipv6_enabled == true) then [10:43:05] this line hurts my head, let me look at the file for a sec [10:43:21] fair, it does look ouchy [10:44:42] "The has_variable? helper function is useless, because it can’t tell the difference between never set and undef." [10:44:47] http://docs.puppetlabs.com/guides/templating.html [10:44:59] puppetlab's honesty is to be commended (i mean that unsarcastically) [10:47:19] so @enable_ipv6_proxy.nill? looks like the way to go [10:47:40] hmm [10:47:46] way better for sure [10:48:18] thank you [10:48:42] np [10:52:08] (03PS1) 10Matanya: protoproxy: call enable_ipv6_proxy in a sane way [operations/puppet] - 10https://gerrit.wikimedia.org/r/118966 [10:53:22] (03CR) 10jenkins-bot: [V: 04-1] protoproxy: call enable_ipv6_proxy in a sane way [operations/puppet] - 10https://gerrit.wikimedia.org/r/118966 (owner: 10Matanya) [10:57:13] (03CR) 10Ori.livneh: protoproxy: call enable_ipv6_proxy in a sane way (031 comment) [operations/puppet] - 10https://gerrit.wikimedia.org/r/118966 (owner: 10Matanya) [10:58:52] (03PS2) 10Matanya: protoproxy: call enable_ipv6_proxy in a sane way [operations/puppet] - 10https://gerrit.wikimedia.org/r/118966 [11:00:06] (03CR) 10jenkins-bot: [V: 04-1] protoproxy: call enable_ipv6_proxy in a sane way [operations/puppet] - 10https://gerrit.wikimedia.org/r/118966 (owner: 10Matanya) [11:01:05] (03PS3) 10Matanya: protoproxy: call enable_ipv6_proxy in a sane way [operations/puppet] - 10https://gerrit.wikimedia.org/r/118966 [11:01:12] * matanya should sleep [11:02:19] (03CR) 10jenkins-bot: [V: 04-1] protoproxy: call enable_ipv6_proxy in a sane way [operations/puppet] - 10https://gerrit.wikimedia.org/r/118966 (owner: 10Matanya) [11:03:31] i'm having a hard time with this one [11:15:18] * ori looks [11:20:56] (03PS4) 10Ori.livneh: protoproxy: call enable_ipv6_proxy in a sane way [operations/puppet] - 10https://gerrit.wikimedia.org/r/118966 (owner: 10Matanya) [11:24:37] (03CR) 10Ori.livneh: [C: 031] protoproxy: call enable_ipv6_proxy in a sane way [operations/puppet] - 10https://gerrit.wikimedia.org/r/118966 (owner: 10Matanya) [11:36:51] (03PS1) 10Ori.livneh: Initial commit [operations/software/mwprof/reporter] - 10https://gerrit.wikimedia.org/r/118970 [11:38:01] thank you ori [11:38:10] my pleasure [11:38:35] (03PS1) 10ArielGlenn: convert adds-changes dumps to single pass, pep8 and cleanup [operations/dumps] (ariel) - 10https://gerrit.wikimedia.org/r/118971 [11:41:58] (03CR) 10Ori.livneh: [C: 032 V: 032] Initial commit [operations/software/mwprof/reporter] - 10https://gerrit.wikimedia.org/r/118970 (owner: 10Ori.livneh) [11:48:33] (03PS1) 10Ori.livneh: Initial commit of mwprof::reporter [operations/puppet] - 10https://gerrit.wikimedia.org/r/118972 [11:50:17] (03CR) 10Ori.livneh: [C: 032] Initial commit of mwprof::reporter [operations/puppet] - 10https://gerrit.wikimedia.org/r/118972 (owner: 10Ori.livneh) [12:17:55] (03CR) 10ArielGlenn: [C: 032] convert adds-changes dumps to single pass, pep8 and cleanup [operations/dumps] (ariel) - 10https://gerrit.wikimedia.org/r/118971 (owner: 10ArielGlenn) [12:19:51] PROBLEM - Puppet freshness on labstore1001 is CRITICAL: Last successful Puppet run was Tue 11 Mar 2014 08:47:37 PM UTC [13:33:10] PROBLEM - RAID on searchidx1001 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [13:34:00] RECOVERY - RAID on searchidx1001 is OK: OK: optimal, 1 logical, 4 physical [13:46:10] PROBLEM - HTTP 5xx req/min on tungsten is CRITICAL: CRITICAL: reqstats.5xx [crit=500.000000 [14:16:48] (03CR) 10Hoo man: [C: 031] lint admins.pp-pt01-replace tabs and nothing else [operations/puppet] - 10https://gerrit.wikimedia.org/r/118794 (owner: 10Dzahn) [14:45:10] RECOVERY - HTTP 5xx req/min on tungsten is OK: OK: reqstats.5xx [warn=250.000 [15:19:40] PROBLEM - Puppet freshness on tungsten is CRITICAL: Last successful Puppet run was Sun 16 Mar 2014 12:19:26 PM UTC [15:20:40] PROBLEM - Puppet freshness on labstore1001 is CRITICAL: Last successful Puppet run was Tue 11 Mar 2014 08:47:37 PM UTC [17:27:50] !log ran rebuildEntityPerPage.php on wikidata to rebuild the epp table for 466 items [17:27:54] Logged the message, Master [18:20:40] PROBLEM - Puppet freshness on tungsten is CRITICAL: Last successful Puppet run was Sun 16 Mar 2014 12:19:26 PM UTC [18:21:03] (03PS9) 10BryanDavis: Change home directory of vagrant user [operations/puppet] - 10https://gerrit.wikimedia.org/r/118053 (owner: 10Physikerwelt) [18:21:24] yay http://www.ssl-zertifikat.com/wiki/Wikipedia:Impressum [18:21:34] one can even use that mirror to edit pages :P [18:21:40] PROBLEM - Puppet freshness on labstore1001 is CRITICAL: Last successful Puppet run was Tue 11 Mar 2014 08:47:37 PM UTC [18:22:15] (03CR) 10BryanDavis: [C: 031] Change home directory of vagrant user [operations/puppet] - 10https://gerrit.wikimedia.org/r/118053 (owner: 10Physikerwelt) [19:22:02] anyone around who can deal with a legal rtTicket for me? [19:24:44] no more mailing lists disruption I hope [19:25:31] * YuviPanda rewrites all mailman URLs for Nemo_bis [19:41:29] Nemo_bis, looking at #wikimedia-stewards I would suspect it's more likely to do with deletion of wiki files/content [19:42:54] * Nemo_bis didn't bother to look that user [19:45:20] Nemo_bis: I strongly fight against anyone who tries to adjust the mailing lists. The lawyer who approved that last one got a talking to and promises not to approve future ones (tldr but that's basically what happened) [19:45:43] they, obviously, didn't realize what it did. [19:45:57] oic [19:46:04] Jamesofur: THANK YOU [19:46:05] It happens to the best too ;) [19:47:51] I was more surprised that those get done at all by technical staff, not the fact that a lawyer has approved them [19:50:06] It's so rare that it's common for someone not to know from the past I think [20:11:52] ^d: Around? [21:21:40] PROBLEM - Puppet freshness on tungsten is CRITICAL: Last successful Puppet run was Sun 16 Mar 2014 12:19:26 PM UTC [21:22:40] PROBLEM - Puppet freshness on labstore1001 is CRITICAL: Last successful Puppet run was Tue 11 Mar 2014 08:47:37 PM UTC [21:25:01] Nemo_bis: https://bugzilla.wikimedia.org/show_bug.cgi?id=26115 [21:26:25] Yep. I thought I had reopened it but what's important is that someone did [21:26:49] We can't make Erik ping Google every time though :) [22:55:32] (03PS1) 10Andrew Bogott: Fix a dependency foul-up on labs. [operations/puppet] - 10https://gerrit.wikimedia.org/r/118994 [22:57:23] (03CR) 10Andrew Bogott: [C: 032] Fix a dependency foul-up on labs. [operations/puppet] - 10https://gerrit.wikimedia.org/r/118994 (owner: 10Andrew Bogott) [23:30:14] (03PS1) 10Andrew Bogott: Add redis config for keystone in labs [operations/puppet] - 10https://gerrit.wikimedia.org/r/118999 [23:31:43] (03CR) 10Andrew Bogott: [C: 032] Add redis config for keystone in labs [operations/puppet] - 10https://gerrit.wikimedia.org/r/118999 (owner: 10Andrew Bogott) [23:38:31] ori: hmm, no pool counter on labs [23:38:42] * AaronSchulz looks at https://bugzilla.wikimedia.org/show_bug.cgi?id=36891 [23:43:10] PROBLEM - HTTP 5xx req/min on tungsten is CRITICAL: CRITICAL: reqstats.5xx [crit=500.000000