[00:23:33] PROBLEM - RAID on searchidx1001 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [00:24:32] RECOVERY - RAID on searchidx1001 is OK: OK: State is Optimal, checked 4 logical device(s) [00:26:02] PROBLEM - Puppet freshness on sq41 is CRITICAL: No successful Puppet run in the last 10 hours [00:43:18] (03PS1) 10Bsitu: Update the address in email footer [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76668 [01:01:22] @replag s3 [01:01:22] Krinkle: [s3 (DEFAULT)] db1019: 0s, db1003: 0s, db1010: 0s, db1035: 0s [01:01:32] @replage centralauth [01:01:32] Krinkle: [centralauth: s7] db1041: 0s, db1007: 0s, db1024: 0s, db1028: 0s [01:24:54] (03CR) 10Hashar: [C: 031] Disable UploadBlacklist [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76229 (owner: 10Reedy) [01:25:33] (03CR) 10Ottomata: "(1 comment)" [operations/puppet/cdh4] - 10https://gerrit.wikimedia.org/r/76018 (owner: 10Ottomata) [01:36:14] TimStarling: I went to go amend the ptwiki CAPTCHA changeset to include a hard expiry and you'd already merged it. :-) [01:36:20] I think that was a good call. [01:44:47] Replied to you on your "break the internet" bug as well. :-) [01:44:53] (03PS1) 10Dzahn: rename wikivoyages to wikivoyage, fix timestamps on index page [operations/debs/wikistats] - 10https://gerrit.wikimedia.org/r/76673 [01:53:41] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:54:31] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK: Status line output matched 400 - 336 bytes in 0.133 second response time [01:58:17] (03PS1) 10Dzahn: renable updates via file_get_contents() [operations/debs/wikistats] - 10https://gerrit.wikimedia.org/r/76674 [02:17:40] (03PS1) 10Dzahn: add 1.22wmf12 to good versions [operations/debs/wikistats] - 10https://gerrit.wikimedia.org/r/76675 [02:17:55] !log LocalisationUpdate completed (1.22wmf12) at Tue Jul 30 02:17:54 UTC 2013 [02:18:06] Logged the message, Master [02:33:31] !log LocalisationUpdate completed (1.22wmf11) at Tue Jul 30 02:33:27 UTC 2013 [02:33:41] Logged the message, Master [02:43:53] (03PS1) 10Tim Starling: Add accounts::tstarling to Locke [operations/puppet] - 10https://gerrit.wikimedia.org/r/76677 [02:45:42] (03CR) 10Tim Starling: [C: 032 V: 032] Add accounts::tstarling to Locke [operations/puppet] - 10https://gerrit.wikimedia.org/r/76677 (owner: 10Tim Starling) [02:52:52] !log LocalisationUpdate ResourceLoader cache refresh completed at Tue Jul 30 02:52:51 UTC 2013 [02:53:02] Logged the message, Master [02:57:09] !log racked and plugged back pappas [02:57:10] RECOVERY - Host pappas is UP: PING OK - Packet loss = 0%, RTA = 26.70 ms [02:57:19] Logged the message, Master [02:57:51] mutante: What's $goodversions used for in wikistats? [02:58:21] https://github.com/wikimedia/operations-debs-wikistats/search?q=goodversions [02:58:22] https://github.com/wikimedia/operations-debs-wikistats/search?q=version_color [02:58:25] can't find anything [02:59:10] <^demon> Yo Krinkle [02:59:27] hi [02:59:53] <^demon> Any chance you remember that site that tries to keep track of installed MW extensions? I know I saw it recently-ish but I can't find it in my history or anywhere else. [03:00:22] I know which you mean [03:00:26] with the bees around the mediawiki logo [03:00:53] <^demon> I can't find the dang url anywhere. [03:02:36] ^demon: http://wikiapiary.com/ [03:02:52] ^demon: found in gmail by looking for Special:ConfirmEmail, I knew I created an account htere [03:03:02] <^demon> Yes! That's it! [03:03:04] they got a new skin since I last visited [03:03:04] <^demon> Thank youuuuuu [03:03:06] yw [03:07:23] <^demon> Hahah, this site totally proved my point. [03:07:58] ^demon: context? [03:08:01] <^demon> Earlier today I heard claim about 3rd parties possibly using CodeReview. http://wikiapiary.com/wiki/Extension:CodeReview - would claim otherwise. [03:13:40] indeed, the one use of it isn't active: http://marknet.myhome.cx/science-wiki/index.php/%E7%89%B9%E5%88%A5:%E3%82%B3%E3%83%BC%E3%83%89 [03:13:43] no repos set up [03:15:13] <^demon> :) [03:32:04] (03PS1) 10Tim Starling: Puppetize /home/tstarling/.bashrc [operations/puppet] - 10https://gerrit.wikimedia.org/r/76678 [03:34:10] (03CR) 10Tim Starling: "Please review." [operations/puppet] - 10https://gerrit.wikimedia.org/r/76678 (owner: 10Tim Starling) [03:38:45] (03CR) 10MZMcBride: "(1 comment)" [operations/puppet] - 10https://gerrit.wikimedia.org/r/76678 (owner: 10Tim Starling) [03:43:18] (03CR) 10Demon: "(2 comments)" [operations/puppet] - 10https://gerrit.wikimedia.org/r/76678 (owner: 10Tim Starling) [03:48:18] (03PS1) 10Ryan Lane: Remediate BEAST on apache services [operations/puppet] - 10https://gerrit.wikimedia.org/r/76679 [03:49:18] (03CR) 10Ryan Lane: [C: 032] Remediate BEAST on apache services [operations/puppet] - 10https://gerrit.wikimedia.org/r/76679 (owner: 10Ryan Lane) [03:54:02] PROBLEM - Puppet freshness on lvs1005 is CRITICAL: No successful Puppet run in the last 10 hours [03:54:02] PROBLEM - Puppet freshness on lvs1004 is CRITICAL: No successful Puppet run in the last 10 hours [03:54:02] PROBLEM - Puppet freshness on lvs1006 is CRITICAL: No successful Puppet run in the last 10 hours [03:54:02] PROBLEM - Puppet freshness on virt3 is CRITICAL: No successful Puppet run in the last 10 hours [03:54:02] PROBLEM - Puppet freshness on virt1 is CRITICAL: No successful Puppet run in the last 10 hours [03:54:03] PROBLEM - Puppet freshness on virt4 is CRITICAL: No successful Puppet run in the last 10 hours [03:54:06] (03CR) 10Tim Starling: "(2 comments)" [operations/puppet] - 10https://gerrit.wikimedia.org/r/76678 (owner: 10Tim Starling) [03:56:59] CVS! so retro. [03:57:26] Just in case it makes a comeback. [03:58:13] Heh, Tim is attempting to use Cunningham's Law. [04:03:14] (03PS1) 10Demon: More BEAST remediation [operations/puppet] - 10https://gerrit.wikimedia.org/r/76680 [04:07:20] (03CR) 10Ryan Lane: [C: 032] More BEAST remediation [operations/puppet] - 10https://gerrit.wikimedia.org/r/76680 (owner: 10Demon) [04:36:55] (03PS1) 10Demon: Further BEAST remediation [operations/puppet] - 10https://gerrit.wikimedia.org/r/76681 [04:56:25] PROBLEM - Puppet freshness on ssl1004 is CRITICAL: No successful Puppet run in the last 10 hours [05:09:09] (03CR) 10Ryan Lane: [C: 032] Further BEAST remediation [operations/puppet] - 10https://gerrit.wikimedia.org/r/76681 (owner: 10Demon) [05:21:43] PROBLEM - RAID on searchidx1001 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [05:26:43] RECOVERY - RAID on searchidx1001 is OK: OK: State is Optimal, checked 4 logical device(s) [05:51:48] PROBLEM - Puppet freshness on mchenry is CRITICAL: No successful Puppet run in the last 10 hours [05:53:48] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:55:38] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK: Status line output matched 400 - 336 bytes in 0.129 second response time [06:23:47] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:24:37] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK: Status line output matched 400 - 336 bytes in 1.393 second response time [06:33:50] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:34:37] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK: Status line output matched 400 - 336 bytes in 0.134 second response time [07:03:09] PROBLEM - Puppet freshness on holmium is CRITICAL: No successful Puppet run in the last 10 hours [07:25:30] PROBLEM - SSH on lvs6 is CRITICAL: Server answer: [07:26:30] RECOVERY - SSH on lvs6 is OK: SSH OK - OpenSSH_5.9p1 Debian-5ubuntu1.1 (protocol 2.0) [08:06:31] (03PS1) 10Nikerabbit: Switch translation memory from vanadium to zinc [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76690 [08:07:17] (03CR) 10Nikerabbit: [C: 032] Switch translation memory from vanadium to zinc [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76690 (owner: 10Nikerabbit) [08:07:25] (03Merged) 10jenkins-bot: Switch translation memory from vanadium to zinc [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76690 (owner: 10Nikerabbit) [08:11:38] !log nikerabbit synchronized wmf-config/CommonSettings.php 'Translation memory to zinc from vanadium' [08:11:48] Logged the message, Master [08:12:03] PROBLEM - Puppet freshness on erzurumi is CRITICAL: No successful Puppet run in the last 10 hours [08:29:11] why do I get errors when running maintenance script on terbium: DB connection error: No working slave server: Unknown error (10.64.32.18) ? [08:51:02] PROBLEM - Puppet freshness on manutius is CRITICAL: No successful Puppet run in the last 10 hours [08:55:26] !log Translation memory migrated from vanadium to zinc and repopulated [08:55:36] Logged the message, Master [09:21:26] (03Abandoned) 10Hashar: ** WIP ** role class for puppet agents ** WIP ** [operations/puppet] - 10https://gerrit.wikimedia.org/r/64031 (owner: 10Hashar) [09:29:21] (03PS1) 10Nikerabbit: Use application/font-woff for woff files [operations/puppet] - 10https://gerrit.wikimedia.org/r/76698 [09:29:22] (03PS6) 10Akosiaris: Introducing bacula module [operations/puppet] - 10https://gerrit.wikimedia.org/r/70840 [09:38:34] (03CR) 10KartikMistry: [C: 031] "LGTM!" [operations/puppet] - 10https://gerrit.wikimedia.org/r/76698 (owner: 10Nikerabbit) [09:39:49] heh, debian people everywhere [09:41:08] hey paravoid :-] [09:41:15] I packaged a bunch of python modules last week [09:41:39] and I was wondering how to get them inside apt or if it worth writing a small doc to get packages in apt.wm.o [09:42:02] my concern is that if I provide you the .deb package, there is nothing preventing me from sneaking in a root kit or some nasty code :D [09:42:17] so I guess you rebuild the package and would like to document the process [09:42:32] yes, I rebuild debs before putting them into apt [09:42:45] well not always [09:43:28] ceph and cloudera's debs we don't. But as a general rule we should. It also helps spot any missing bugs... [09:43:42] missed* [09:52:55] we have some trust anchors, yes [09:53:09] at least ubuntu, debian, ceph, cloudera, jenkins [09:56:11] great [09:56:34] and yesterday I fought with cowbuilder to provide it additional dependencies [09:56:53] turns out you can pass an additional source.lists deb line when building with cowbuilder [09:57:01] it is only available when refreshing the image :-D [10:00:32] PROBLEM - SSH on pdf3 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:01:42] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:03:32] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK: Status line output matched 400 - 336 bytes in 0.130 second response time [10:04:12] (03PS1) 10Mark Bergsma: Don't use pass for all requests with a session cookie [operations/puppet] - 10https://gerrit.wikimedia.org/r/76700 [10:04:22] RECOVERY - SSH on pdf3 is OK: SSH OK - OpenSSH_4.7p1 Debian-8ubuntu3 (protocol 2.0) [10:05:55] (03PS2) 10Mark Bergsma: Don't use pass for all requests with a session cookie [operations/puppet] - 10https://gerrit.wikimedia.org/r/76700 [10:12:38] (03CR) 10Mark Bergsma: [C: 032] Don't use pass for all requests with a session cookie [operations/puppet] - 10https://gerrit.wikimedia.org/r/76700 (owner: 10Mark Bergsma) [10:26:21] PROBLEM - Puppet freshness on sq41 is CRITICAL: No successful Puppet run in the last 10 hours [10:32:11] ah I got a first pass of Debian packages :-D all python related! [10:32:27] akosiaris: paravoid: if one of you has anytime to get a look at my python backports http://noc.wikimedia.org/~hashar/debs/ :-] [10:32:49] (03PS1) 10Mark Bergsma: Ignore busy objects on requests with session cookies [operations/puppet] - 10https://gerrit.wikimedia.org/r/76702 [10:33:41] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:33:50] (03CR) 10Mark Bergsma: [C: 032] Ignore busy objects on requests with session cookies [operations/puppet] - 10https://gerrit.wikimedia.org/r/76702 (owner: 10Mark Bergsma) [10:34:13] why do we need those? [10:34:23] ? [10:34:27] sorry [10:34:30] hashar: why do we need those? [10:35:23] that is a good question :-] [10:35:31] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK: Status line output matched 400 - 336 bytes in 0.128 second response time [10:35:37] d2to1 and python-setuptools-git are used by openstack python modules [10:35:45] they end up being build dependencies for some other packages [10:35:59] for example, to have Zuul packaged [10:36:58] the pep8 one is a python linting tool. We currently have 1.3.3 which is lagging behind, fails to detects some style errors or report wrong one and is lacking some feature that would improve our python lint jobs [10:37:09] sorry should have give context first or provided a read me maybe :D [10:44:15] meh [10:44:21] now I need to figure out how debian packaging works [10:47:58] (03PS3) 10Hashar: set some paths to use $wmfHostnames 'bits' and 'test' [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/71774 [10:49:02] (03CR) 10Hashar: "Finally came back to this change. I have added a new 'test' entry in $wmfHostnames, that makes the resulting code even simpler :-]" [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/71774 (owner: 10Hashar) [10:49:16] mark: read the docs? :D https://wikitech.wikimedia.org/wiki/Category:Package_management [10:49:48] i wrote most those docs [10:58:58] [11:27:43] Nikerabbit> why do I get errors when running maintenance script on terbium: DB connection error: No working slave server: Unknown error (10.64.32.18) ? [11:01:39] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:02:29] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK: Status line output matched 400 - 336 bytes in 0.124 second response time [11:04:39] (03PS6) 10Mark Bergsma: Mobile Cookie Vary caching optimizations [operations/puppet] - 10https://gerrit.wikimedia.org/r/75316 [11:15:05] (03CR) 10MaxSem: "(1 comment)" [operations/puppet] - 10https://gerrit.wikimedia.org/r/75316 (owner: 10Mark Bergsma) [11:15:41] MaxSem: thanks [11:20:34] !log Pooled cp1052 as text varnish box in PyBal group 'text-varnish' with weight 1, to serve a tiny fraction of wikidata traffic [11:20:45] Logged the message, Master [11:20:56] wee [11:24:00] wee indeed [11:24:30] (03CR) 10Nemo bis: "MZ, of course I don't like it: nobody does as far as I know, at best it's considered a necessary evil (by those who voted for it)." [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/69982 (owner: 10Alex Monk) [11:24:34] so when that api bot hits the varnish box there's lots of requests in that one session [11:24:37] and then it goes quiet again [11:26:39] (03CR) 10Nikerabbit: "(1 comment)" [operations/puppet] - 10https://gerrit.wikimedia.org/r/76556 (owner: 10Ryan Lane) [11:40:29] (03CR) 10Nikerabbit: "(2 comments)" [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/75507 (owner: 10Manybubbles) [11:53:42] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:54:33] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK: Status line output matched 400 - 336 bytes in 0.125 second response time [12:00:40] aude: so I have a tiny bit of wikidata traffic (in the US) handled by Varnish now [12:00:51] mark: nice :) [12:01:03] of course it's all bots and such [12:01:16] heh [12:03:29] Hi, who is on RT duty now? [12:04:07] I know it's not Ryan since that was last week, but https://wikitech.wikimedia.org/wiki/Interrupts_Rotation doesn't mention this week's person and the topic hasn't been updated [12:08:09] Week of July 22 - Ryan [12:08:10] Week of Aug 5 (Wikimania) - Rob [12:08:11] hah [12:08:15] looks like we missed a week [12:08:16] how nice [12:09:12] what do you need sumanah? [12:10:01] someone on RT duty, clearly [12:10:07] paravoid: http://lists.wikimedia.org/pipermail/wikitech-l/2013-July/070946.html Silke has a db replication issue; The db replication of s5 and s6 stopped on the toolserver. She's in #wikimedia-tech [12:10:51] but yeah, mark is right, I'd also like to know who's on duty so I don't interrupt random people :) [12:11:18] springle/notpeter/binasher would be the people to ask for that [12:11:52] so an RT ticket that would be assigned on one of those three :) [12:12:04] let me file one for you [12:12:15] * sumanah curtsies with thanks :) [12:12:28] PROBLEM - SSH on pdf3 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:12:30] * mark offers a brownie [12:14:18] RECOVERY - SSH on pdf3 is OK: SSH OK - OpenSSH_4.7p1 Debian-8ubuntu3 (protocol 2.0) [12:20:33] !log Put all non-European wikidata traffic on cp1052 and cp1065 [12:20:45] Logged the message, Master [12:44:49] (03PS7) 10Mark Bergsma: Mobile Cookie Vary caching optimizations [operations/puppet] - 10https://gerrit.wikimedia.org/r/75316 [12:55:38] (03CR) 10MaxSem: [C: 031] Mobile Cookie Vary caching optimizations [operations/puppet] - 10https://gerrit.wikimedia.org/r/75316 (owner: 10Mark Bergsma) [13:01:42] (03PS8) 10Mark Bergsma: Mobile Cookie Vary caching optimizations [operations/puppet] - 10https://gerrit.wikimedia.org/r/75316 [13:28:08] (03CR) 10Santhosh: [C: 031] Use application/font-woff for woff files [operations/puppet] - 10https://gerrit.wikimedia.org/r/76698 (owner: 10Nikerabbit) [13:43:49] (03CR) 10MaxSem: [C: 031] Mobile Cookie Vary caching optimizations [operations/puppet] - 10https://gerrit.wikimedia.org/r/75316 (owner: 10Mark Bergsma) [13:54:13] PROBLEM - Puppet freshness on lvs1004 is CRITICAL: No successful Puppet run in the last 10 hours [13:54:13] PROBLEM - Puppet freshness on lvs1005 is CRITICAL: No successful Puppet run in the last 10 hours [13:54:13] PROBLEM - Puppet freshness on lvs1006 is CRITICAL: No successful Puppet run in the last 10 hours [13:54:13] PROBLEM - Puppet freshness on virt1 is CRITICAL: No successful Puppet run in the last 10 hours [13:54:13] PROBLEM - Puppet freshness on virt3 is CRITICAL: No successful Puppet run in the last 10 hours [13:54:14] PROBLEM - Puppet freshness on virt4 is CRITICAL: No successful Puppet run in the last 10 hours [14:04:44] (03PS8) 10Hashar: adapt `foreachwiki` for labs [operations/puppet] - 10https://gerrit.wikimedia.org/r/55059 [14:07:28] (03PS4) 10Hashar: beta: symlink /a/common [operations/puppet] - 10https://gerrit.wikimedia.org/r/65254 [14:07:52] (03PS10) 10Ottomata: Puppetizing HA NameNode via Quorum Based JournalNode. [operations/puppet/cdh4] - 10https://gerrit.wikimedia.org/r/76018 [14:08:14] (03CR) 10Andrew Bogott: "I have the feeling this should have a more specific name than 'git'. Can you give an example of where this will be used?" [operations/puppet] - 10https://gerrit.wikimedia.org/r/75855 (owner: 10Hashar) [14:09:38] (03Abandoned) 10Hashar: mobile $wgLoadScript now uses $wmfHostnames['bits'] [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/71779 (owner: 10Hashar) [14:10:12] andrewbogott: my first ever working rspec test in puppet! [14:11:04] hashar: That's more than I've written :) [14:11:40] I need to find out why the "git" modules specs are not invoked by the rake file :/ [14:12:03] ahh oh [14:12:56] [11:27:43] Nikerabbit> why do I get errors when running maintenance script on terbium: DB connection error: No working slave server: Unknown error (10.64.32.18) ? [14:14:39] (03PS2) 10Hashar: git::userconfig to easily craft .gitconfig files [operations/puppet] - 10https://gerrit.wikimedia.org/r/75855 [14:17:49] (03CR) 10Hashar: "I used `puppet-rspec init` to create the basic spec structure. The Rakefile generated did not rely on puppetlabs_spec_helper/rake_tasks. " [operations/puppet] - 10https://gerrit.wikimedia.org/r/75855 (owner: 10Hashar) [14:18:16] andrewbogott: good catch on the rspec not being run :-] [14:18:42] andrewbogott: I used puppet-rspec init which does not provide all the target we need and does not rely on the puppet labs spec helper hehe [14:19:18] (03CR) 10Hashar: "And I missed commenting about using the 'git' name. I simply could not find a better idea." [operations/puppet] - 10https://gerrit.wikimedia.org/r/75855 (owner: 10Hashar) [14:20:36] hashar: wouldn't it look better to split that commit in two? [14:20:55] one generic to setup the spec framework, and one specific for the current patch? [14:21:33] (03PS2) 10Hashar: deployment: abstract out MW_RSYNC_HOST [operations/puppet] - 10https://gerrit.wikimedia.org/r/72491 [14:21:37] code + test, that is an atomic change imho [14:22:19] modules/git/spec/spec_helper.rb doesn't seems to be atomic to .gitconfig [14:22:32] (03PS1) 10Ottomata: Puppetizing Hadoop JournalNode. [operations/puppet] - 10https://gerrit.wikimedia.org/r/76722 [14:24:16] !g b4b96fe [14:24:16] https://gerrit.wikimedia.org/r/#q,b4b96fe,n,z [14:24:17] !g cb3baa9 [14:24:18] https://gerrit.wikimedia.org/r/#q,cb3baa9,n,z [14:24:20] !g 22db649 [14:24:20] https://gerrit.wikimedia.org/r/#q,22db649,n,z [14:24:45] (03CR) 10Hashar: "See also bug 34552 and RT 2517" [operations/puppet] - 10https://gerrit.wikimedia.org/r/76679 (owner: 10Ryan Lane) [14:24:49] (03CR) 10Hashar: "See also bug 34552 and RT 2517" [operations/puppet] - 10https://gerrit.wikimedia.org/r/76680 (owner: 10Demon) [14:24:54] (03CR) 10Hashar: "See also bug 34552 and RT 2517" [operations/puppet] - 10https://gerrit.wikimedia.org/r/76681 (owner: 10Demon) [14:25:39] wtf? [14:25:42] "You are not authorized to access bug #34552." [14:26:20] what's so secret with that bug? [14:27:02] something to do with ssl I assume [14:27:12] security hole? [14:27:40] that is related to the Gerrit changes above [14:27:44] and yes that is an internal bug. [14:27:55] Nikerabbit: how about !log ging that? [14:28:46] hashar: internal as in "only need to know"? [14:30:05] Nemo_bis: that's not a place to get help [14:30:08] I assume it's related to CVE-2011-3389 [14:31:08] which is pretty old [14:31:23] don't know why it would need to be secret on bugzilla [14:31:34] Nikerabbit: apparently this channel isn't useful for that either :) at least today [14:33:05] hashar: has there been an recently undisclosed update on BEAST? [14:33:20] * AzaToth is clueless [14:37:04] can't comment there sorry. [14:39:28] hashar, that module just creates .gitconfig right? So maybe name it gitconfig? [14:39:35] or gituser [14:55:09] andrewbogott: yup could do that [14:55:25] I thought we might want to reuse the 'git' module base to add more commands later on [14:55:32] like the evil git::clone() we have in generic-definitions [14:56:13] hashar, that might get done with https://gerrit.wikimedia.org/r/#/c/74099/ [14:57:06] PROBLEM - Puppet freshness on ssl1004 is CRITICAL: No successful Puppet run in the last 10 hours [14:58:10] andrewbogott: :]] [14:58:42] so git to gitconfig ? [14:58:42] then I would stick the define in init.pp and name it define gitconfig() [14:59:12] if you think you'll put other config things in there, then gitconfig. If you think you'll put other generic git stuff in there, maybe gitutils? [14:59:40] * andrewbogott is not helpful [15:01:19] hashar, https://plus.google.com/hangouts/_/32bd58dfec1f8fbc583410aebb70559fa9e47c10 [15:02:51] <^demon|zzz> hashar: Hi. I didn't know about RT 2517, so I had filed 5541 last night for the issue. [15:10:59] akosiaris1: andrewbogott : quick meetings are the best ones :] [15:11:04] yep! [15:11:29] :-) [15:12:00] I'm cleaning up the calendar for the next few weeks [15:12:11] cool. I was about to do it [15:12:26] Oh wait, I can't, you'll have to [15:12:29] I guess you own the entries [15:12:39] I'm out until 8/26 same as hashar [15:12:45] \O/ [15:13:15] ok ... I will schedule next on 3/9 (or 9/3 depending on where you live) [15:13:40] and will try to give you full access on that google cal entry [15:13:57] paravoid: off-topic: I had to unwatch lumail's bug mail, got really busy/lots of churn this week. Looks like a good amount of infra is setup for things like gpg and addressbooks now [15:14:46] ^demon|zzz: the more ticket we have the best it is :-] [15:14:58] ^demon|zzz: mine went unnoticed for the last 18 months or so hehe [15:15:16] andrewbogott: it does say that guests can modify event. You are sure you can not edit it ? [15:15:45] Ah, I can, just the interface is different from events that I own [15:16:10] cool [15:16:30] andrewbogott: regarding the git module, how should I rename it ? gitconfig ? [15:16:39] yeah, let's go gitconfig for now [15:20:06] <^demon|zzz> hashar: Well, Ryan and I should've taken care of almost everything last night. [15:20:38] <^demon|zzz> :) [15:21:13] :D [15:21:19] !log Purging old SecurePoll private data from all wikis [15:21:34] Logged the message, Master [15:22:27] greg-g: yep, I'm waiting for the vmime switch :) [15:22:47] ah puppet I hate you :D [15:23:00] <^demon|zzz> We should put that on a t-shirt or something. [15:23:09] given a module named 'gitconfig', how could I have it create a define named 'gitconfig' ? :-D [15:23:22] I thought about sticking it in init.pp but that does not seem to work [15:25:57] (03CR) 10Reedy: "http://docs.puppetlabs.com/references/latest/type.html" [operations/puppet] - 10https://gerrit.wikimedia.org/r/74592 (owner: 10Reedy) [15:28:20] hashar: file named gitconfig.pp with a define gitconfig::gitconfig (params) {} [15:28:45] which looks ugly btw :P [15:28:49] ahhh [15:29:02] and how one would invoke that define? gitconfig::gitconfig ? [15:29:10] exactly [15:31:19] yeah that is ugly [15:31:31] I have renamed it gitconfig::user :-∆ [15:32:16] (03PS3) 10Hashar: gitconfig::user to easily craft .gitconfig user files [operations/puppet] - 10https://gerrit.wikimedia.org/r/75855 [15:33:38] (03CR) 10Hashar: "renamed module from 'git' to 'gitconfig'" [operations/puppet] - 10https://gerrit.wikimedia.org/r/75855 (owner: 10Hashar) [15:36:46] I am out, got to catch might daughter :-} [15:36:59] (03CR) 10Andrew Bogott: [C: 04-1] "(5 comments)" [operations/puppet] - 10https://gerrit.wikimedia.org/r/75087 (owner: 10Ori.livneh) [15:50:30] (03PS1) 10Petr Onderka: writing different kinds of dumps (stub/pages, current/history) [operations/dumps/incremental] (gsoc) - 10https://gerrit.wikimedia.org/r/76736 [15:52:47] PROBLEM - Puppet freshness on mchenry is CRITICAL: No successful Puppet run in the last 10 hours [16:11:57] (03CR) 10Faidon: [C: 04-1] "(7 comments)" [operations/puppet] - 10https://gerrit.wikimedia.org/r/75087 (owner: 10Ori.livneh) [16:14:04] (03CR) 10Andrew Bogott: [C: 032] gitconfig::user to easily craft .gitconfig user files [operations/puppet] - 10https://gerrit.wikimedia.org/r/75855 (owner: 10Hashar) [16:14:34] module gitconfig? ew :) [16:14:38] I guess I'm too late though [16:15:33] (03CR) 10Andrew Bogott: [C: 032] style for beta.pp role [operations/puppet] - 10https://gerrit.wikimedia.org/r/76283 (owner: 10Hashar) [16:16:13] andrewbogott: I'm wondering if ori-l is right and we should just make a git module, move git::clone and gitconfig under it and be done with it [16:16:58] sure, vcsrepo compatibility is nice, but if we need to have our own gitconfig module, things are starting to get a bit hairy [16:17:12] (03CR) 10Andrew Bogott: "Could we get some class headers while you're at it?" [operations/puppet] - 10https://gerrit.wikimedia.org/r/76284 (owner: 10Hashar) [16:17:45] paravoid: maybe hashar can explain about that module… it seems sort of orthogonal to vcsrepo. [16:18:02] I think he just wants it as a convenience to tune user settings. [16:18:27] (03CR) 10Faidon: [C: 04-1] "Also, if we're going style guide on this, ditch the nested subclasses." [operations/puppet] - 10https://gerrit.wikimedia.org/r/76284 (owner: 10Hashar) [16:20:08] (03PS2) 10Petr Onderka: writing different kinds of dumps (stub/pages, current/history) [operations/dumps/incremental] (gsoc) - 10https://gerrit.wikimedia.org/r/76736 [16:53:52] (03PS4) 10Reedy: (bug 49001) Restrict editing the Query namespace on Wikidata [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/66192 (owner: 10Hazard-SJ) [16:53:59] (03CR) 10Reedy: [C: 032] (bug 49001) Restrict editing the Query namespace on Wikidata [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/66192 (owner: 10Hazard-SJ) [16:54:19] (03Merged) 10jenkins-bot: (bug 49001) Restrict editing the Query namespace on Wikidata [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/66192 (owner: 10Hazard-SJ) [16:55:03] (03PS2) 10Reedy: Make FlaggedRev rights available to global groups [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/75070 (owner: 10Jalexander) [16:55:16] (03CR) 10Reedy: [C: 032] Make FlaggedRev rights available to global groups [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/75070 (owner: 10Jalexander) [16:55:37] (03Merged) 10jenkins-bot: Make FlaggedRev rights available to global groups [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/75070 (owner: 10Jalexander) [16:56:31] (03PS2) 10Reedy: Exclude *.wmflabs.org from the need to enter captchas [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/67953 (owner: 10Raimond Spekking) [16:56:37] (03CR) 10Reedy: [C: 032] Exclude *.wmflabs.org from the need to enter captchas [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/67953 (owner: 10Raimond Spekking) [16:59:34] (03CR) 10Anomie: [C: 031] set some paths to use $wmfHostnames 'bits' and 'test' [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/71774 (owner: 10Hashar) [16:59:35] (03Merged) 10jenkins-bot: Exclude *.wmflabs.org from the need to enter captchas [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/67953 (owner: 10Raimond Spekking) [16:59:36] (03PS2) 10Reedy: Enable Secure Login everywhere [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/74268 (owner: 10Ryan Lane) [16:59:37] (03CR) 10Reedy: [C: 032] Enable Secure Login everywhere [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/74268 (owner: 10Ryan Lane) [16:59:38] (03PS2) 10Ottomata: Puppetizing Hadoop JournalNode and Standby HA NameNode [operations/puppet] - 10https://gerrit.wikimedia.org/r/76722 [16:59:39] (03Merged) 10jenkins-bot: Enable Secure Login everywhere [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/74268 (owner: 10Ryan Lane) [16:59:40] (03PS2) 10Reedy: EventLogging: Add schema for mobile watchlist interactions [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76026 (owner: 10Jdlrobson) [16:59:41] (03PS4) 10Reedy: Update protection configs for core change I6bf650a3 [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/71538 (owner: 10Anomie) [16:59:42] (03CR) 10Reedy: [C: 032] Update protection configs for core change I6bf650a3 [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/71538 (owner: 10Anomie) [16:59:43] (03Merged) 10jenkins-bot: Update protection configs for core change I6bf650a3 [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/71538 (owner: 10Anomie) [16:59:47] (03PS2) 10Reedy: (bug 52076) set wgUploadNavigationUrl to a local page for kowiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76235 (owner: 10TTO) [16:59:54] (03CR) 10Reedy: [C: 032] (bug 52076) set wgUploadNavigationUrl to a local page for kowiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76235 (owner: 10TTO) [17:00:10] (03Merged) 10jenkins-bot: (bug 52076) set wgUploadNavigationUrl to a local page for kowiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76235 (owner: 10TTO) [17:00:32] (03PS2) 10Reedy: (bug 52101) add Index and Page namespaces to FlaggedRevs for ruwikisource [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76240 (owner: 10TTO) [17:00:36] secure login? secure login?! /me grabs popcorn [17:00:38] (03CR) 10Reedy: [C: 032] (bug 52101) add Index and Page namespaces to FlaggedRevs for ruwikisource [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76240 (owner: 10TTO) [17:00:58] (03Merged) 10jenkins-bot: (bug 52101) add Index and Page namespaces to FlaggedRevs for ruwikisource [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76240 (owner: 10TTO) [17:01:06] (03PS3) 10Reedy: (bug 52149) Correct AFTv5 e-mail for fr.wp oversighters [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76311 (owner: 10Odder) [17:01:13] (03CR) 10Reedy: [C: 032] (bug 52149) Correct AFTv5 e-mail for fr.wp oversighters [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76311 (owner: 10Odder) [17:01:39] (03Merged) 10jenkins-bot: (bug 52149) Correct AFTv5 e-mail for fr.wp oversighters [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76311 (owner: 10Odder) [17:02:18] (03PS3) 10Reedy: Set wgUploadNavigationUrl to Commons for ckbwiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76237 (owner: 10TTO) [17:02:30] (03CR) 10Reedy: [C: 032] Set wgUploadNavigationUrl to Commons for ckbwiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76237 (owner: 10TTO) [17:02:40] (03Merged) 10jenkins-bot: Set wgUploadNavigationUrl to Commons for ckbwiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76237 (owner: 10TTO) [17:03:28] (03PS2) 10Reedy: (bug 52145) Set wmgBabelCategoryNames for wikidatawiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76309 (owner: 10Odder) [17:03:46] (03CR) 10Reedy: [C: 032] (bug 52145) Set wmgBabelCategoryNames for wikidatawiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76309 (owner: 10Odder) [17:03:56] (03Merged) 10jenkins-bot: (bug 52145) Set wmgBabelCategoryNames for wikidatawiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76309 (owner: 10Odder) [17:04:01] PROBLEM - Puppet freshness on holmium is CRITICAL: No successful Puppet run in the last 10 hours [17:05:23] <^d> manybubbles: What e-mail address you using for BZ? [17:05:28] (03PS2) 10Reedy: Update the address in email footer [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76668 (owner: 10Bsitu) [17:05:39] <^d> Creating a new component for Cirrus and was gonna put you on default cc list. [17:05:43] (03CR) 10Reedy: [C: 032] Update the address in email footer [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76668 (owner: 10Bsitu) [17:05:52] (03Merged) 10jenkins-bot: Update the address in email footer [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76668 (owner: 10Bsitu) [17:06:06] ^d: [17:06:08] neverett+bugzilla@wikimedia.org [17:06:18] <^d> Ah, found it. Missing the +bugzilla :) [17:06:35] <^d> Ok, MediaWiki extensions -> CirrusSearch now exists. [17:08:08] !log reedy synchronized wmf-config/ [17:08:08] <^d> manybubbles: So yeah, if we want to toss bugs in there ourselves (or that other people find as they play with beta), we can now :) [17:08:21] Logged the message, Master [17:08:58] ^d: thanks! I've been getting the regression tests working against beta this morning. it is almost done but they beta seemed to start flaking out about an hour ago [17:09:39] !log reedy synchronized wmf-config/InitialiseSettings.php [17:09:54] Logged the message, Master [17:10:38] (03PS2) 10Reedy: (bug 52015) set uca-fa category collation for ckbwiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76242 (owner: 10TTO) [17:10:39] (03CR) 10Reedy: [C: 032] (bug 52015) set uca-fa category collation for ckbwiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76242 (owner: 10TTO) [17:10:41] (03Merged) 10jenkins-bot: (bug 52015) set uca-fa category collation for ckbwiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76242 (owner: 10TTO) [17:12:29] (03PS5) 10Reedy: Disable UploadBlacklist [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76229 [17:12:34] (03CR) 10Reedy: [C: 032] Disable UploadBlacklist [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76229 (owner: 10Reedy) [17:12:46] (03Merged) 10jenkins-bot: Disable UploadBlacklist [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76229 (owner: 10Reedy) [17:13:39] !log reedy synchronized wmf-config/ 'Disable UploadBlacklist' [17:13:54] Logged the message, Master [17:16:06] (03CR) 10Andrew Bogott: "I'm generally pro-upstream-module... is fixing the upstream version and getting that change merged upstream an option?" [operations/puppet] - 10https://gerrit.wikimedia.org/r/76059 (owner: 10Ori.livneh) [17:16:26] (03PS2) 10Reedy: Add DataTypes extension [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76481 (owner: 10Aude) [17:27:11] (03PS6) 10Andrew Bogott: Fixed the path to icinga cmd file all around +file [operations/puppet] - 10https://gerrit.wikimedia.org/r/52726 (owner: 10Matanya) [17:27:56] (03CR) 10Andrew Bogott: "rebased and resolved a conflict" [operations/puppet] - 10https://gerrit.wikimedia.org/r/52726 (owner: 10Matanya) [17:28:18] LeslieCarr, 10-second review: https://gerrit.wikimedia.org/r/#/c/52726/ [17:28:47] 10…. 9….. 8..... [17:29:25] (03PS1) 10Jalexander: enable translate extension on collabwiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76746 [17:33:00] (03PS7) 10Lcarr: Fixed the path to icinga cmd file all around +file [operations/puppet] - 10https://gerrit.wikimedia.org/r/52726 (owner: 10Matanya) [17:33:26] andrewbogott: can you counter review? ;) [17:34:23] (03CR) 10Andrew Bogott: [C: 032] Fixed the path to icinga cmd file all around +file [operations/puppet] - 10https://gerrit.wikimedia.org/r/52726 (owner: 10Matanya) [17:36:05] !log Created Translate tables on collabwiki [17:36:18] * Reedy pokes morebots [17:36:19] Logged the message, Master [17:36:32] (03PS11) 10Ottomata: Puppetizing HA NameNode via Quorum Based JournalNode. [operations/puppet/cdh4] - 10https://gerrit.wikimedia.org/r/76018 [17:37:14] (03CR) 10Andrew Bogott: "This one could use a class header as well." [operations/puppet] - 10https://gerrit.wikimedia.org/r/76285 (owner: 10Hashar) [17:39:07] (03PS2) 10Reedy: enable translate extension on collabwiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76746 (owner: 10Jalexander) [17:40:04] (03CR) 10Reedy: [C: 032] enable translate extension on collabwiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76746 (owner: 10Jalexander) [17:40:16] (03Merged) 10jenkins-bot: enable translate extension on collabwiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/76746 (owner: 10Jalexander) [17:40:31] (03CR) 10Ryan Lane: "(1 comment)" [operations/puppet] - 10https://gerrit.wikimedia.org/r/76556 (owner: 10Ryan Lane) [17:40:31] LeslieCarr, thanks [17:42:10] !log reedy synchronized wmf-config/InitialiseSettings.php 'Enable Translate on collabwiki' [17:42:24] Logged the message, Master [17:43:58] PROBLEM - RAID on virt6 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [17:44:58] RECOVERY - RAID on virt6 is OK: OK: Active: 16, Working: 16, Failed: 0, Spare: 0 [17:46:57] (03PS1) 10Cmjohnson: rt5527 remove everything with $svnkey [operations/puppet] - 10https://gerrit.wikimedia.org/r/76750 [17:47:13] (03CR) 10jenkins-bot: [V: 04-1] rt5527 remove everything with $svnkey [operations/puppet] - 10https://gerrit.wikimedia.org/r/76750 (owner: 10Cmjohnson) [17:50:14] [11:27:43] Nikerabbit> why do I get errors when running a maintenance script on terbium: DB connection error: No working slave server: Unknown error (10.64.32.18) ? [17:54:48] (03PS12) 10Ottomata: Puppetizing HA NameNode via Quorum Based JournalNode. [operations/puppet/cdh4] - 10https://gerrit.wikimedia.org/r/76018 [17:57:24] It's external storage [17:59:08] (03Abandoned) 10Cmjohnson: rt5527 remove everything with $svnkey [operations/puppet] - 10https://gerrit.wikimedia.org/r/76750 (owner: 10Cmjohnson) [18:00:24] Reedy: hmm? I don't quite understand... why are we encouraged to run maintenance scripts on terbium if they don't work there? [18:01:01] Ryan_Lane: topic says you're on RT duty, could you look into why we're getting raw HTML pages on beta labs as of a few minutes ago? [18:01:33] Jul 22-26 [18:02:06] <^d> chrismcmahon: I was getting that off and on yesterday. I think the bits setup in beta is flakey. [18:02:58] Nikerabbit: Do they work elsewhere? [18:03:17] Reedy: yeah it worked on tin (ttmserver-export) [18:03:34] chrismcmahon: http://en.wikipedia.beta.wmflabs.org/wiki/Main_Page <-- I'm getting CSS [18:03:46] ^d: I think it was OK until about 40 minutes ago when I saw beta labs 503 for a few minutes. when it came back, it was pure HTML [18:03:52] Ryan_Lane: try to login [18:03:55] I'm also not getting pure HTML [18:04:00] Ryan_Lane: when you hit a random page or login? [18:04:18] ah. I see [18:04:35] <^d> Ah yes, on SSL. [18:04:45] <^d> Forcing secure login for beta broke something ;-) [18:05:00] I see [18:05:04] it's because of the ssl cert [18:05:05] Yeah, that will break beta tests [18:05:17] CSS comes from bits [18:05:20] and will throw an error [18:05:23] <^d> We could set secure login to false for beta. [18:05:27] but won't present the error [18:05:37] Ryan_Lane: you suck [18:05:46] greg-g: oh? in what way? :) [18:05:49] * greg-g approves all requests [18:06:14] *confetti* [18:06:21] war is over! [18:06:21] I'm more than happy to have a real cert for beta, assuming every project admin has an NDA [18:06:23]