[02:09:06] http://thenextweb.com/insider/2014/03/05/mozilla-launches-jpeg-encoder-mozjpeg-improve-compression-rates-reduce-network-traffic-page-loads/#!y2su4 [02:09:16] "Results for mozjpeg range from 2-6 percent for PNGs encoded to JPEG by libjpeg-turbo and 10 percent on average for a sample of 1,500 JPEG files from Wikimedia" [02:09:59] mh [02:10:20] http://phys.org/news/2014-03-mozilla-jpeg-compression-mozjpeg-tool.html [02:10:25] Credit: Wikipeida [02:10:52] Either way it's good to see it so well documented... [02:52:01] (03PS1) 10Reedy: Remove remnants of old CA RC2UDP config [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/117667 [03:07:11] (03PS2) 10Hashar: beta: memcached multiwrite to pmtpa and eqiad [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/115623 [03:09:45] (03Abandoned) 10Ori.livneh: Tee sampled Special:BannerImpression stream to Hafnium for StatsD-ification [operations/puppet] - 10https://gerrit.wikimedia.org/r/88902 (owner: 10Ori.livneh) [03:10:11] (03CR) 10Ori.livneh: [C: 032] Make local- part of project name optional [operations/debs/adminbot] - 10https://gerrit.wikimedia.org/r/114350 (owner: 10Merlijn van Deen) [03:10:13] (03Merged) 10jenkins-bot: Make local- part of project name optional [operations/debs/adminbot] - 10https://gerrit.wikimedia.org/r/114350 (owner: 10Merlijn van Deen) [03:13:25] (03PS2) 10Merlijn van Deen: Follow redirects when saving the page [operations/debs/adminbot] - 10https://gerrit.wikimedia.org/r/114351 [03:13:36] (03CR) 10Ori.livneh: [C: 032] "I think it's OK." [operations/debs/adminbot] - 10https://gerrit.wikimedia.org/r/114351 (owner: 10Merlijn van Deen) [03:13:38] (03Merged) 10jenkins-bot: Follow redirects when saving the page [operations/debs/adminbot] - 10https://gerrit.wikimedia.org/r/114351 (owner: 10Merlijn van Deen) [03:16:19] (03CR) 10Ori.livneh: [C: 04-1] "I don't really mean to ding this change with a -1 before I understand the rationale, but 0-score reviews are sometimes easy to miss. So pl" [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/115153 (owner: 10Odder) [03:17:41] (03PS5) 10Ori.livneh: Gzip SVGs on front & back upload varnishes [operations/puppet] - 10https://gerrit.wikimedia.org/r/108484 [03:24:07] (03CR) 10Ori.livneh: [C: 031] "> Will the network latency coming from the writes to the other DC slow down beta (significantly)?" [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/115623 (owner: 10Hashar) [03:27:44] (03CR) 10MZMcBride: "This change is pretty strange. I'm not sure why it was merged as-is." [operations/debs/adminbot] - 10https://gerrit.wikimedia.org/r/114351 (owner: 10Merlijn van Deen) [08:00:42] (03PS2) 10Matanya: ganglia_new: remove lookupvar and replace with top scope @ var and fix scoping [operations/puppet] - 10https://gerrit.wikimedia.org/r/112889 [08:08:15] any apergos around? [09:06:36] (03PS1) 10Matanya: bugzilla: remove the new from motd, old is dead [operations/puppet] - 10https://gerrit.wikimedia.org/r/117669 [09:51:23] (03PS1) 10Matanya: statistics: converted iptables to ferm rule [operations/puppet] - 10https://gerrit.wikimedia.org/r/117670 [10:29:27] (03PS1) 10Matanya: mobile: replace iptables with ferm rule [operations/puppet] - 10https://gerrit.wikimedia.org/r/117673 [10:58:37] (03Abandoned) 10Matanya: statistics: convert into a module [operations/puppet] - 10https://gerrit.wikimedia.org/r/113966 (owner: 10Matanya) [11:09:26] (03CR) 10Matanya: WIP - turn RT from misc/* into puppet module (032 comments) [operations/puppet] - 10https://gerrit.wikimedia.org/r/116064 (owner: 10Dzahn) [11:46:00] (03CR) 10Odder: "Using a -1 as a means to distinguish patch sets is, I believe, quite ridiculous." [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/115153 (owner: 10Odder) [12:31:52] PROBLEM - RAID on searchidx1001 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [12:32:32] PROBLEM - DPKG on searchidx1001 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [12:32:42] RECOVERY - RAID on searchidx1001 is OK: OK: optimal, 1 logical, 4 physical [12:33:22] RECOVERY - DPKG on searchidx1001 is OK: All packages OK [13:14:50] (03PS1) 10Matanya: icinga: replace iptable with ferm rules [operations/puppet] - 10https://gerrit.wikimedia.org/r/117674 [13:15:30] (03CR) 10jenkins-bot: [V: 04-1] icinga: replace iptable with ferm rules [operations/puppet] - 10https://gerrit.wikimedia.org/r/117674 (owner: 10Matanya) [13:26:57] (03PS1) 10ArielGlenn: slim down download::common in prep for refactor [operations/puppet] - 10https://gerrit.wikimedia.org/r/117675 [13:29:51] (03PS2) 10Matanya: icinga: replace iptable with ferm rules [operations/puppet] - 10https://gerrit.wikimedia.org/r/117674 [13:29:54] (03CR) 10ArielGlenn: [C: 032] slim down download::common in prep for refactor [operations/puppet] - 10https://gerrit.wikimedia.org/r/117675 (owner: 10ArielGlenn) [13:30:30] (03CR) 10jenkins-bot: [V: 04-1] icinga: replace iptable with ferm rules [operations/puppet] - 10https://gerrit.wikimedia.org/r/117674 (owner: 10Matanya) [13:32:21] what am i missing here? [13:43:37] matanya: you want class blahblah ( param1 = defaultvalue, ... ) { stuff here } [13:44:48] apergos: those are not defines by the class, but just static defines [13:47:29] (03PS3) 10Matanya: icinga: replace iptable with ferm rules [operations/puppet] - 10https://gerrit.wikimedia.org/r/117674 [13:48:55] apergos: may i pm ? [13:49:40] sure [13:50:23] then I would drop the comma off the ends [13:50:31] they are just assignments [13:50:36] yes [13:50:48] i did it nicer anyway now :) [14:16:34] (03PS1) 10ArielGlenn: pull rsync and cron jobs out of 'download' into new dataset module [operations/puppet] - 10https://gerrit.wikimedia.org/r/117676 [14:22:00] apergos: tabs and trailing white spaces here ^ [14:27:43] (03PS2) 10ArielGlenn: pull rsync and cron jobs out of 'download' into new dataset module [operations/puppet] - 10https://gerrit.wikimedia.org/r/117676 [14:27:54] I only saw the two lines, did you see any others? [14:28:22] man [14:28:24] erp [14:28:26] matanya: [14:28:57] apergos: https://gerrit.wikimedia.org/r/#/c/117676/2/modules/dataset/files/rsync-dumps.sh [14:29:05] half tabed [14:29:10] oh. that's a straight copy of a shell script [14:29:14] it will stay that way for ow [14:29:17] now [14:29:37] I'm not doing a move because I want to do this in steps to avoid breaking anything [14:30:06] https://gerrit.wikimedia.org/r/#/c/117676/2/modules/dataset/files/rsync/rsyncd.conf.dumps_to_public <-- white space in comment [14:30:17] same here : https://gerrit.wikimedia.org/r/#/c/117676/2/modules/dataset/files/rsync/rsyncd.conf.globalopts [14:30:54] apergos: ^ and moving tabs to spaces shouldn't break anything in bash [14:32:05] I'm not going to touch the script except to toss it in a little while; if I could have git mv I would have [14:34:18] (03PS3) 10ArielGlenn: pull rsync and cron jobs out of 'download' into new dataset module [operations/puppet] - 10https://gerrit.wikimedia.org/r/117676 [14:39:54] matanya: if you see nnothing else glaring in there I am going to get this show on the road, I've been dreading it for days and now the deadline is upon me so... [14:40:06] * apergos <-- fear of commitment :-P [14:40:49] i can glash at the patch, i just did a quick puppet-lint on the patch, didn't really looked at your changes [14:40:53] but i will do know [14:41:20] i did the last iteration of modularize download, so i remember quite most of it [14:42:31] heh, that was you, right [14:46:34] apergos: ok, i'll add some comments, forgive me for annoying lint comments :) [14:46:47] I thought I got all the lint stuf except a few line too long [14:46:57] which are comand = blah where it's a very long command [14:47:20] anyways feel free, if they are files stright copied form the old module I won't do those changes this round [14:47:24] I will do them in a separate commit [15:00:47] (03CR) 10Matanya: pull rsync and cron jobs out of 'download' into new dataset module (0321 comments) [operations/puppet] - 10https://gerrit.wikimedia.org/r/117676 (owner: 10ArielGlenn) [15:00:55] and there it is, good [15:01:37] comma at the end is going to kill me isn't it? :-D [15:01:39] thanks for this [15:02:57] yeah, i'm a lint-nazi :P [15:03:24] matanya: Y u no review the admins.pp rewrite? [15:03:43] i spoke to paravoid about this [15:03:47] I wish I had more time atm to also work on WMFs puppet (especially with security stuffs) [15:04:07] i'll wait until it is done to add my useless comments :) [15:07:53] matanya: the system roles all go in the module classes because they describe what a server with that class does (not really meant for a role manifest) [15:18:43] i see [15:19:01] (03PS4) 10ArielGlenn: pull rsync and cron jobs out of 'download' into new dataset module [operations/puppet] - 10https://gerrit.wikimedia.org/r/117676 [15:19:08] and the rest are done [15:21:45] thanks apergos [15:21:52] thank you [15:28:04] (03CR) 10ArielGlenn: [C: 032] "note that the following are copied unaltered from the old download module (since we are doing the switchover in steps I can't just git mv " [operations/puppet] - 10https://gerrit.wikimedia.org/r/117676 (owner: 10ArielGlenn) [15:48:42] (03PS1) 10ArielGlenn: datasets: rsyncd conf file pieces must end in .conf for the concat [operations/puppet] - 10https://gerrit.wikimedia.org/r/117682 [15:50:34] (03CR) 10ArielGlenn: [C: 032] datasets: rsyncd conf file pieces must end in .conf for the concat [operations/puppet] - 10https://gerrit.wikimedia.org/r/117682 (owner: 10ArielGlenn) [15:56:35] (03PS1) 10ArielGlenn: dataset1001 to use new dataset role [operations/puppet] - 10https://gerrit.wikimedia.org/r/117683 [15:59:26] (03CR) 10ArielGlenn: [C: 032] dataset1001 to use new dataset role [operations/puppet] - 10https://gerrit.wikimedia.org/r/117683 (owner: 10ArielGlenn) [16:02:10] (03PS1) 10ArielGlenn: remove nfs stuff from download web server manifest [operations/puppet] - 10https://gerrit.wikimedia.org/r/117684 [16:03:51] (03CR) 10ArielGlenn: [C: 032] remove nfs stuff from download web server manifest [operations/puppet] - 10https://gerrit.wikimedia.org/r/117684 (owner: 10ArielGlenn) [16:06:11] (03PS1) 10ArielGlenn: one more nfs remnant to toss from download web server manifest [operations/puppet] - 10https://gerrit.wikimedia.org/r/117685 [16:06:41] tested fine but of course didn't remember to make thse changes to download module in the commit... grrr [16:07:46] (03CR) 10ArielGlenn: [C: 032] one more nfs remnant to toss from download web server manifest [operations/puppet] - 10https://gerrit.wikimedia.org/r/117685 (owner: 10ArielGlenn) [16:16:29] (03PS1) 10ArielGlenn: dataset: rsync nice and ionice only for nonpublic rsyncs [operations/puppet] - 10https://gerrit.wikimedia.org/r/117686 [16:18:06] (03CR) 10ArielGlenn: [C: 032] dataset: rsync nice and ionice only for nonpublic rsyncs [operations/puppet] - 10https://gerrit.wikimedia.org/r/117686 (owner: 10ArielGlenn) [16:23:16] (03PS1) 10ArielGlenn: dataset2 to use new dataset module [operations/puppet] - 10https://gerrit.wikimedia.org/r/117687 [16:24:56] (03CR) 10ArielGlenn: [C: 032] dataset2 to use new dataset module [operations/puppet] - 10https://gerrit.wikimedia.org/r/117687 (owner: 10ArielGlenn) [16:43:25] (03PS1) 10ArielGlenn: remove rsync/cron/nfs stuff from download module, cleanup roles [operations/puppet] - 10https://gerrit.wikimedia.org/r/117688 [16:47:13] (03CR) 10ArielGlenn: [C: 032] remove rsync/cron/nfs stuff from download module, cleanup roles [operations/puppet] - 10https://gerrit.wikimedia.org/r/117688 (owner: 10ArielGlenn) [17:05:16] (03CR) 10Merlijn van Deen: "You're right about the tabs/spaces -- sorry about that. It's a python script, so my editor expected spaces." [operations/debs/adminbot] - 10https://gerrit.wikimedia.org/r/114351 (owner: 10Merlijn van Deen) [17:08:46] (03CR) 10Merlijn van Deen: "Oh, and I'm not sure why I called it wm-bot. That should have been 'labslogbot' or 'labs-morebots'." [operations/debs/adminbot] - 10https://gerrit.wikimedia.org/r/114351 (owner: 10Merlijn van Deen) [17:18:37] (03PS1) 10Merlijn van Deen: pep8 fixes [operations/debs/adminbot] - 10https://gerrit.wikimedia.org/r/117691 [17:26:55] (03PS1) 10ArielGlenn: datasets: replace bash rsync script with python [operations/puppet] - 10https://gerrit.wikimedia.org/r/117692 [17:51:38] (03CR) 10ArielGlenn: [C: 032] datasets: replace bash rsync script with python [operations/puppet] - 10https://gerrit.wikimedia.org/r/117692 (owner: 10ArielGlenn) [18:27:53] (03CR) 10ArielGlenn: [C: 032] datasets: enable the python rsync script in cron [operations/puppet] - 10https://gerrit.wikimedia.org/r/117696 (owner: 10ArielGlenn) [18:42:13] (03PS1) 10Matanya: ldap: replace iptables with ferm rule [operations/puppet] - 10https://gerrit.wikimedia.org/r/117698 [18:45:53] Any update on the toolserver? [18:46:11] sjoerddebruin: #wikimedia-toolserver is the channel dedicated to it [18:46:25] this one's about WMFs infrastructure operations [18:46:37] Aha. [19:01:32] apergos: what port is udp2log using? [19:01:46] dunno off hand [19:01:51] thanks [19:03:18] sorry.. just the combination of bad memory and it's been a while since I looked at it [19:03:28] no proble, really [20:07:05] (03PS1) 10ArielGlenn: python cron script needs python [operations/puppet] - 10https://gerrit.wikimedia.org/r/117702 [20:08:59] (03CR) 10ArielGlenn: [C: 032] python cron script needs python [operations/puppet] - 10https://gerrit.wikimedia.org/r/117702 (owner: 10ArielGlenn) [20:23:32] PROBLEM - Varnishkafka Delivery Errors on cp3022 is CRITICAL: kafka.varnishkafka.kafka_drerr.per_second CRITICAL: 761.06665 [20:27:32] RECOVERY - Varnishkafka Delivery Errors on cp3022 is OK: kafka.varnishkafka.kafka_drerr.per_second OKAY: 0.0 [20:39:32] PROBLEM - Varnishkafka Delivery Errors on cp3022 is CRITICAL: kafka.varnishkafka.kafka_drerr.per_second CRITICAL: 2735.06665 [20:43:32] RECOVERY - Varnishkafka Delivery Errors on cp3022 is OK: kafka.varnishkafka.kafka_drerr.per_second OKAY: 0.0 [20:43:46] spamming again? [20:56:32] PROBLEM - Varnishkafka Delivery Errors on cp3022 is CRITICAL: kafka.varnishkafka.kafka_drerr.per_second CRITICAL: 2405.733398 [20:57:32] RECOVERY - Varnishkafka Delivery Errors on cp3022 is OK: kafka.varnishkafka.kafka_drerr.per_second OKAY: 0.0 [22:19:20] (03PS1) 10Odder: 'Markbotedits' user right for rollbackers on shwiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/117807 [23:44:21] (03PS5) 10Reedy: Disable and remove ContactPageFundraiser [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/110292 [23:54:27] (03PS1) 10Reedy: Use Vips for images over 20MP [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/117809 [23:57:02] (03PS2) 10Reedy: Use Vips for images over 20MP [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/117809