[00:00:10] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:00:29] New patchset: Ryan Lane; "Ensure default site is gone." [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2872 [00:01:02] New review: Ryan Lane; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/2872 [00:01:03] Change merged: Ryan Lane; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2872 [00:01:13] binasher: Yes, if they do that it means the ilom is in a bad state [00:01:30] you can try resetting the bmc with reset /SP [00:01:44] if that doesnt fix it, the only solution is full power removal via pulling the cords [00:02:07] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:02:25] RECOVERY - Puppet freshness on db1040 is OK: puppet ran at Wed Feb 29 00:02:15 UTC 2012 [00:04:04] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:06:11] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:08:07] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:08:16] RECOVERY - RAID on db40 is OK: OK: 1 logical device(s) checked [00:09:38] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:11:25] New patchset: Ryan Lane; "Add manganese to ldap firewall rules on virt0" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2874 [00:11:35] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:13:32] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:13:48] New review: Ryan Lane; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/2874 [00:13:48] Change merged: Ryan Lane; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2874 [00:14:37] gn8 folks [00:15:29] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:17:26] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:19:23] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:20:30] !log reimported schema files on db40 and re-enabled mysql parser cache [00:20:33] Logged the message, Master [00:20:51] !log tstarling synchronized wmf-config/InitialiseSettings.php 'mysql parser cache' [00:20:54] Logged the message, Master [00:21:20] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:23:13] !log restarting gerrit on formey [00:23:15] Logged the message, Master [00:23:17] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:25:14] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:27:11] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:29:08] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:31:05] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:32:53] RECOVERY - Puppet freshness on db1040 is OK: puppet ran at Wed Feb 29 00:32:42 UTC 2012 [00:33:02] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:34:59] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:36:29] PROBLEM - Packetloss_Average on emery is CRITICAL: CRITICAL: packet_loss_average is 8.46059248 (gt 8.0) [00:36:56] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:37:14] PROBLEM - Packetloss_Average on locke is CRITICAL: CRITICAL: packet_loss_average is 8.60164352 (gt 8.0) [00:38:53] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:39:11] PROBLEM - Puppet freshness on mw1010 is CRITICAL: Puppet has not run in the last 10 hours [00:40:50] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:42:47] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:44:44] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:46:14] PROBLEM - Puppet freshness on mw1020 is CRITICAL: Puppet has not run in the last 10 hours [00:46:14] PROBLEM - Puppet freshness on mw1110 is CRITICAL: Puppet has not run in the last 10 hours [00:46:41] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:48:56] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:50:53] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:52:05] RECOVERY - Puppet freshness on db1040 is OK: puppet ran at Wed Feb 29 00:51:36 UTC 2012 [00:52:23] RECOVERY - MySQL Slave Running on db24 is OK: OK replication [00:52:50] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:54:47] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:55:57] !log restarting gerrit again [00:56:00] Logged the message, Master [00:56:44] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:57:56] PROBLEM - MySQL Slave Delay on db24 is CRITICAL: CRIT replication delay 11499 seconds [00:58:34] ok. replication should work for gerrit now [00:58:41] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [00:58:52] damn it [00:59:01] org.eclipse.jgit.errors.TransportException: Short read of block. [00:59:52] I guess I need to wipe that one and try again [01:00:25] RECOVERY - Puppet freshness on db1040 is OK: puppet ran at Wed Feb 29 01:00:14 UTC 2012 [01:00:34] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:02:22] RECOVERY - Puppet freshness on db1040 is OK: puppet ran at Wed Feb 29 01:01:49 UTC 2012 [01:02:49] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:03:25] RECOVERY - Puppet freshness on db1040 is OK: puppet ran at Wed Feb 29 01:03:11 UTC 2012 [01:04:14] I may need to rsync everything while having the gerrit server off [01:04:55] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:06:52] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:07:25] New review: Ryan Lane; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/2514 [01:07:26] Change merged: Ryan Lane; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2514 [01:07:55] PROBLEM - Packetloss_Average on locke is CRITICAL: CRITICAL: packet_loss_average is 8.23574895161 (gt 8.0) [01:08:58] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:09:45] New patchset: Ryan Lane; "Adding sumanah back onto manganese" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2876 [01:11:04] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:12:09] New review: Ryan Lane; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/2876 [01:12:10] Change merged: Ryan Lane; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2876 [01:12:16] RECOVERY - Puppet freshness on db1040 is OK: puppet ran at Wed Feb 29 01:11:59 UTC 2012 [01:12:30] w00t. replication is working [01:13:01] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:14:58] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:16:55] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:19:10] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:20:29] Ryan_Lane: replication to where, toolserver ? [01:20:35] Or master/slaves [01:20:37] to the new server [01:20:47] oh, the one replacing fomey [01:20:50] I'm going to switch over to the new server soon, and then reverse the replication [01:20:55] so we'll always have a failover [01:21:01] and we'll have a backup [01:21:07] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:21:15] we should likely replicate most repos to github as well [01:21:30] yep [01:21:37] is there a wikimedia account yet on Github ? [01:21:50] There is one for mediawiki, but that should probably be merged into the wikimedia one I guess [01:21:52] RECOVERY - Puppet freshness on db1040 is OK: puppet ran at Wed Feb 29 01:21:32 UTC 2012 [01:22:36] I dunno [01:22:40] we need to be careful, though [01:22:44] we have private repositories [01:22:57] Ryan_Lane: Yahoo has had a good amount of success with their workflow. They have an internal staff-only git repo and replicate to Github. Then community can use the Git pull requests for suggested changed and staff can bring those into Gerrit [01:22:58] and need to make sure not to replicate those [01:23:04] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:23:17] where they eventually got into the private repo and then replicate back to Github [01:23:27] * Ryan_Lane nods [01:23:32] kind of like the good parts of Github without depending on it or using it as primary [01:23:39] Git allows that, awesome :) [01:23:47] yep [01:23:57] openstack uses github for cloning [01:24:00] and gerrit for pushing [01:24:00] we can probably fiddle together a way to bring pull requests from Github into gerrit as well [01:24:04] yeah [01:24:06] sounds good [01:24:10] it's faster [01:24:16] gerrit clones are kind of slow [01:24:23] new server should help that, though [01:24:38] What about wikis that are going to run on trunk (like translatewiki) [01:24:45] what's our recommendation for read-only checkouts [01:24:48] Github as well ? [01:25:01] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:25:21] gerrit server for now [01:25:23] we don't replicate yet [01:25:31] well, we don't have mediawiki in there yet [01:25:33] or do we [01:25:36] nope [01:25:43] wait [01:25:45] yes, we do [01:25:57] and most of the extensions, I think [01:25:59] but that's going to be re-done at some point, or is this is already [01:26:05] it* [01:26:24] I don't know. ^demon would [01:26:41] Ryan_Lane: btw, I need some help regarding gerrit/puppet. Roan's been away for 2+ hours so I guess he's gone for today [01:26:57] I'm about to leave [01:26:58] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:27:12] Ryan_Lane: maybe you can give some advice though, I can do tmyself [01:27:16] ok [01:27:18] what's up? [01:27:39] Ryan_Lane: hasher made testswarm in puppet and right now the php files live in ./files in the operations/puppet. I'd like to make it more like Jenkins in that we have a repository for those files (integration/testswarm) and the puppet thingy will simply do a git clone [01:27:57] ah [01:28:01] that's likely a good idea [01:28:02] so that when those php files update (which will be regularly) we only have to push to gerit, review them and them git pull on the integration machine [01:28:23] like mw-deployment basically [01:28:24] push it in and I'll review it ;) [01:28:27] yep [01:28:55] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:28:59] can you give me a general pointer as to how to create that repo and where to "make puppet git clones instead of copy ./files/testswarm" [01:29:09] clone* [01:29:21] oh. I'm not sure if you can create repos [01:29:57] "Session expired" oh, gerrit has that [01:30:03] heh [01:30:15] projects==repositories, right ? [01:30:16] so, I think you'll need to talk to roan about the second part [01:30:25] I don't know git well enough for that [01:30:27] yep [01:30:37] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:30:37] RECOVERY - MySQL Slave Delay on db24 is OK: OK replication delay 27 seconds [01:30:53] ok. I'm heading out [01:30:57] OK [01:30:58] I'll help you with that tomorrow. [01:31:01] if roan can't [01:31:03] OK [01:31:22] RECOVERY - MySQL Replication Heartbeat on db24 is OK: OK replication delay 0 seconds [01:32:34] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:34:04] RECOVERY - Puppet freshness on db1040 is OK: puppet ran at Wed Feb 29 01:33:38 UTC 2012 [01:34:31] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:36:28] PROBLEM - Puppet freshness on db1040 is CRITICAL: Puppet has not run in the last 10 hours [01:51:22] RECOVERY - Packetloss_Average on locke is OK: OK: packet_loss_average is 3.14903610169 [01:56:36] robla: good news and bad news. [01:56:50] * robla waits [01:56:57] ...and listens [01:57:05] I still haven't found any broken images created past Feb 14th. [01:57:21] but there are a lot of broken images in there. [01:57:36] how bad is it? [01:57:47] I've only been taking small sample sizes for my tests. [01:57:56] looks like 4% maybe? [02:17:46] PROBLEM - Puppet freshness on db1004 is CRITICAL: Puppet has not run in the last 10 hours [02:18:04] RECOVERY - Packetloss_Average on emery is OK: OK: packet_loss_average is 3.20444134454 [02:18:06] !log LocalisationUpdate completed (1.18) at Wed Feb 29 02:18:05 UTC 2012 [02:18:09] Logged the message, Master [02:27:49] PROBLEM - Puppet freshness on owa3 is CRITICAL: Puppet has not run in the last 10 hours [02:34:48] !log LocalisationUpdate completed (1.19) at Wed Feb 29 02:34:48 UTC 2012 [02:34:51] Logged the message, Master [02:36:49] PROBLEM - Puppet freshness on owa2 is CRITICAL: Puppet has not run in the last 10 hours [02:36:49] PROBLEM - Puppet freshness on owa1 is CRITICAL: Puppet has not run in the last 10 hours [02:45:55] Any folks from the ops team around? I'm putting together my app for a Labs Ops spot and wanted to see if I could borrow anybody's thoughts for five minutes. [02:53:24] New patchset: Bhartshorne; "added first iteration of the swift cleaner" [operations/software] (master) - https://gerrit.wikimedia.org/r/2877 [02:53:25] New review: gerrit2; "Lint check passed." [operations/software] (master); V: 1 - https://gerrit.wikimedia.org/r/2877 [02:54:47] New review: Bhartshorne; "(no comment)" [operations/software] (master); V: 1 C: 2; - https://gerrit.wikimedia.org/r/2877 [02:54:48] Change merged: Bhartshorne; [operations/software] (master) - https://gerrit.wikimedia.org/r/2877 [03:23:28] PROBLEM - Disk space on db1025 is CRITICAL: DISK CRITICAL - free space: / 284 MB (3% inode=80%): /var/lib/ureadahead/debugfs 284 MB (3% inode=80%): [03:24:31] PROBLEM - MySQL disk space on db1025 is CRITICAL: DISK CRITICAL - free space: / 284 MB (3% inode=80%): /var/lib/ureadahead/debugfs 284 MB (3% inode=80%): [03:31:25] RECOVERY - Disk space on db1025 is OK: DISK OK [03:32:28] RECOVERY - MySQL disk space on db1025 is OK: DISK OK [06:21:55] PROBLEM - Puppet freshness on db1022 is CRITICAL: Puppet has not run in the last 10 hours [07:58:56] New patchset: ArielGlenn; "move rsync to external mirrors off to download mirror host" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2879 [07:59:25] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/2879 [08:03:10] New review: ArielGlenn; "(no comment)" [operations/puppet] (production); V: 1 C: 2; - https://gerrit.wikimedia.org/r/2879 [08:03:11] Change merged: ArielGlenn; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2879 [08:34:10] hello [08:40:20] yo [08:50:41] New patchset: ArielGlenn; "download host kernel settings for eth buffer allocs" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2880 [08:51:08] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/2880 [08:52:48] New review: ArielGlenn; "(no comment)" [operations/puppet] (production); V: 1 C: 2; - https://gerrit.wikimedia.org/r/2880 [08:52:48] Change merged: ArielGlenn; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2880 [09:06:46] PROBLEM - Puppet freshness on hooper is CRITICAL: Puppet has not run in the last 10 hours [09:07:49] PROBLEM - Puppet freshness on cadmium is CRITICAL: Puppet has not run in the last 10 hours [09:08:43] PROBLEM - Puppet freshness on formey is CRITICAL: Puppet has not run in the last 10 hours [10:17:21] PROBLEM - Puppet freshness on virt0 is CRITICAL: Puppet has not run in the last 10 hours [10:21:51] !log hashar synchronized php-1.19/extensions/ApiSandbox 'ApiSandBox: r112114: show request time' [10:21:54] Logged the message, Master [10:24:38] 163 euros de taxe, 2 heuros de billet... [10:24:42] Ooops [10:24:48] Sorry wrong windows. [10:30:01] PROBLEM - Puppet freshness on mw70 is CRITICAL: Puppet has not run in the last 10 hours [10:30:01] PROBLEM - Puppet freshness on mw1098 is CRITICAL: Puppet has not run in the last 10 hours [10:40:58] PROBLEM - Puppet freshness on mw1010 is CRITICAL: Puppet has not run in the last 10 hours [10:48:01] PROBLEM - Puppet freshness on mw1020 is CRITICAL: Puppet has not run in the last 10 hours [10:48:01] PROBLEM - Puppet freshness on mw1110 is CRITICAL: Puppet has not run in the last 10 hours [10:55:04] PROBLEM - Puppet freshness on spence is CRITICAL: Puppet has not run in the last 10 hours [10:57:00] Zil: ça fait cher en taxes :-D [10:57:45] hashar, ce n'est que des taxes... [10:58:04] Zil: en fait tu prend l'avion pratiquement gratuitement :-) [10:58:09] vachement rassurant! [10:58:09] C'est toujours impressionant sur un billet d'avion. [10:58:21] hashar, bah, c'est du last minute... [10:58:46] enfin 2 euros pour emmener tes bagages + tes X kilos, ça fait pas cher [10:59:04] ils doivent toucher des marges arrières sur les taxes d'aéroport [10:59:35] Non, je pense que vu le remplissage de l'avion, ils se disent que c'est 2 euros de plus ou rien. [10:59:47] Y a beaucoup de concurence sur Nice-Londres. [10:59:55] tant mieux [11:00:01] PROBLEM - Puppet freshness on srv278 is CRITICAL: Puppet has not run in the last 10 hours [11:00:05] parceque Nantes - Londres c'est une seule compagnie :-D [11:00:33] hashar, oui, mais il n'y a pas de concurence sur l'aéroport de Nice. Du coup, ils se goinfrent. [11:00:57] Zil: j'ai un pote qui prenait des Paris - Nice très régulièrement, je ne me souviens plus des prix mais c'était dans le même genre. [11:01:02] du type 5 euros [11:01:48] hashar, la concurence a dminué sur Paris-Nice et les prix ont augmenté. Ça me coute moins cher d'aller à Londres. [11:13:04] PROBLEM - Puppet freshness on db25 is CRITICAL: Puppet has not run in the last 10 hours [11:13:58] PROBLEM - Puppet freshness on amssq42 is CRITICAL: Puppet has not run in the last 10 hours [11:13:58] PROBLEM - Puppet freshness on sq76 is CRITICAL: Puppet has not run in the last 10 hours [11:13:58] PROBLEM - Puppet freshness on mw71 is CRITICAL: Puppet has not run in the last 10 hours [11:15:01] PROBLEM - Puppet freshness on amslvs2 is CRITICAL: Puppet has not run in the last 10 hours [11:15:01] PROBLEM - Puppet freshness on cp1002 is CRITICAL: Puppet has not run in the last 10 hours [11:15:01] PROBLEM - Puppet freshness on db1019 is CRITICAL: Puppet has not run in the last 10 hours [11:15:01] PROBLEM - Puppet freshness on db10 is CRITICAL: Puppet has not run in the last 10 hours [11:15:01] PROBLEM - Puppet freshness on dataset1001 is CRITICAL: Puppet has not run in the last 10 hours [11:15:01] PROBLEM - Puppet freshness on es1 is CRITICAL: Puppet has not run in the last 10 hours [11:15:01] PROBLEM - Puppet freshness on db1030 is CRITICAL: Puppet has not run in the last 10 hours [11:32:04] !log hashar synchronized wmf-config/codereview.php 'CodeReview: autodefers /trunk/extensions/ParserFun' [11:32:07] Logged the message, Master [11:35:26] !log hashar synchronized wmf-config/codereview.php 'CodeReview: autodefers /trunk/extensions/ParserFun[/$] so ParserFunctions is not deferred' [11:35:29] Logged the message, Master [12:12:11] New patchset: Mark Bergsma; "Cleanup with hierarchy" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2881 [12:12:43] New review: Mark Bergsma; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/2881 [12:12:44] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2881 [12:19:24] New patchset: Mark Bergsma; "Move misc::install-server into a separate misc/ file" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2882 [12:19:53] New patchset: Mark Bergsma; "Fix mode of /srv/autoinstall" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2883 [12:20:21] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/2882 [12:20:21] New review: Mark Bergsma; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/2882 [12:20:21] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2882 [12:20:22] New review: Mark Bergsma; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/2883 [12:20:22] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/2883 [12:20:31] New review: Mark Bergsma; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/2883 [12:20:32] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2883 [12:41:12] New patchset: Mark Bergsma; "Add new, simple partman recipe for LVM on hw raid, root/swap LVs only" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2884 [12:41:39] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/2884 [12:41:50] New review: Mark Bergsma; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/2884 [12:41:51] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2884 [13:12:47] how do i check the iw list of a local wikimedia project? [13:16:25] got it [13:23:26] New patchset: Mark Bergsma; "Make lvm.cfg recipe fully automatic" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2885 [13:23:54] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/2885 [13:24:09] New review: Mark Bergsma; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/2885 [13:24:10] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2885 [13:27:07] New patchset: Hashar; "rt: force HTTPS protocol" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2446 [13:42:38] New patchset: Mark Bergsma; "Make partman recipes fully automatic" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2886 [13:43:45] New review: Mark Bergsma; "(no comment)" [operations/puppet] (production); V: 0 C: 2; - https://gerrit.wikimedia.org/r/2886 [13:43:46] Change merged: Mark Bergsma; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2886 [13:53:28] New patchset: Hashar; "git-setup script no more use "git config --global"" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2682 [13:53:58] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/2682 [14:02:36] New patchset: Demon; "Push script for extensions" [operations/software] (master) - https://gerrit.wikimedia.org/r/2887 [14:02:37] New review: gerrit2; "Lint check passed." [operations/software] (master); V: 1 - https://gerrit.wikimedia.org/r/2887 [14:03:09] New review: Demon; "(no comment)" [operations/software] (master); V: 0 C: 2; - https://gerrit.wikimedia.org/r/2887 [14:03:09] Change merged: Demon; [operations/software] (master) - https://gerrit.wikimedia.org/r/2887 [14:13:46] ^demon: would you mind look at bug 28469 https://bugzilla.wikimedia.org/show_bug.cgi?id=28469 [14:14:03] seems you could fix it if you have the rights to edit /srv/org/wikimedia/svn/robots.txt on formey [14:14:10] if not, I will open an RT ticket [14:17:27] <^demon> So under the Disallow: / I just add the Allow: line? [14:17:31] <^demon> Order doesn't matter? [14:19:04] <^demon> hashar: ^? [14:19:18] oh the order [14:19:20] no idea [14:19:24] let me find out [14:20:01] I had a document for that can't find it [14:21:23] ^demon: I would put the Allow statement above [14:21:39] User-Agent: * [14:21:39] Allow: /doc/* [14:21:39] Disallow: / [14:22:19] would need to puppetize that one day [14:22:25] <^demon> mmk [14:22:49] <^demon> The other option is just puppetizing it and the current file will get overwritten. [14:22:52] <^demon> It's not like this is urgent. [14:23:15] yeah let s do that [14:23:18] I will puppetize it [14:23:38] I like puppet [14:24:46] <^demon> I don't think I've ever heard "like" applied to puppet. [14:26:07] !log reedy synchronized php-1.19/extensions/GlobalUsage/GlobalUsage_body.php 'r112688' [14:26:10] Logged the message, Master [14:28:18] I will just Disallow: /viewvc/* [14:36:03] !log reedy synchronized php-1.18/extensions/GlobalUsage/GlobalUsage_body.php 'r112689' [14:36:06] Logged the message, Master [14:39:03] ^demon: did maxsem get ahold of you? (if so ignore me) [14:39:38] <^demon> No. [14:39:58] they were asking about new extnsions durin gcode slush [14:40:26] and would be happy to go straight to git if that would make things easier (or even if not, iirc) [14:40:41] <^demon> Well I'd rather things go straight into git at this point. [14:40:51] <^demon> But i18n support isn't ready for git, so that's a caveat. [14:40:55] ok [14:51:54] New patchset: Hashar; "Bug 28469 - Make SVN Documentation be indexed" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2888 [14:52:16] ^demon: ^^ [14:53:25] ^demon: and that user.php should be puppetized too I guess [14:53:57] I am not sure we want to keep the various docroot in operations/puppet [14:54:06] <^demon> meh [14:54:19] anyway, the robots.txt is puppetized now pending review :-) [14:54:38] I am off, will be back later tonight [15:14:20] !log Running a long slow sql query against db1020 in screen on fenari to pull globalusage titles with spaces in them [15:14:23] Logged the message, Master [15:19:25] New patchset: Demon; "Add rule for RL2 gadgets branch" [operations/software] (master) - https://gerrit.wikimedia.org/r/2889 [15:19:26] New review: gerrit2; "Lint check passed." [operations/software] (master); V: 1 - https://gerrit.wikimedia.org/r/2889 [15:50:39] New review: Demon; "(no comment)" [operations/software] (master); V: 0 C: 2; - https://gerrit.wikimedia.org/r/2889 [15:50:39] Change merged: Demon; [operations/software] (master) - https://gerrit.wikimedia.org/r/2889 [16:59:35] Hello Reedy, I would need you for something that may be wrong in the MediaWiki API [16:59:53] ? [17:00:00] I want to be sure it's a bug before reporting, and know if it's due to 1.19 or somethings else [17:00:12] Reedy: please consider http://fr.wiktionary.org/w/api.php?action=query&list=logevents&letype=patrol&lelimit=500&leuser=TAKASUGI%20Shinji [17:01:08] [17:01:08] why do we have blank fields after 2012-02-24 Reedy ? [17:01:38] Logging formats were changed [17:01:41] err [17:02:23] Reedy: so how can I know if things were autopatrol or not ? some months ago it worked, so I guess that's a bug... [17:02:45] !b [17:02:45] https://bugzilla.wikimedia.org/show_bug.cgi?id=$1 [17:02:55] !b 34653 [17:02:55] https://bugzilla.wikimedia.org/show_bug.cgi?id=34653 [17:02:57] is what I was thinking of [17:04:10] Reedy: okay, thanks, but this one is marked as fixed and one said it's deployed [17:04:16] yeah, I know [17:04:24] I didn't say it was the fix [17:05:26] But the issue looks very similar [17:06:13] Newer ones are fine [17:06:15] Older ones are not [17:06:21] Suggesting this fix broke the older ons [17:07:12] Let me try [17:08:28] !log reedy synchronized php-1.19/includes/api/ApiQueryLogEvents.php 'Test reverting r112532, merge of r112374' [17:08:31] Logged the message, Master [17:08:41] Quentinv57: yup, as expected [17:08:52] That fixes the old ones, and leaves the newer ones still serialisede [17:08:56] * Reedy blames Nikerabbi [17:08:58] * Reedy blames Nikerabbit [17:08:59] ;) [17:09:30] you can always blame me [17:09:39] heh [17:09:59] a miserable failure [17:10:08] I'll poke Arthur about it [17:10:20] Quentinv57: yes it is a bug, and it is related to 34653, fixing that bug caused this one [17:10:56] Reedy: you fixed ? ah, thanks a lot :) [17:11:00] No [17:11:04] I'm going to break it again [17:11:09] ah :( [17:11:13] If you look at the newer entries, they're now broken [17:11:18] It would seem we need variance on if it's serialised data or not [17:12:09] Nikerabbit: is there a way of knowing whether the row has the old or the new format? [17:13:49] hmm [17:13:51] Reedy: okay, are you going to do it right now or next days ? [17:13:58] Reedy: some heuristics [17:13:58] we have isLegacy() [17:15:07] I suppose DatabaseLogEntry should deal with/normalise this [17:17:07] just addLogParams needs fixing I guess [17:22:16] New patchset: Bhartshorne; "explaining why I don't use the normal URL to HEAD objects in swift" [operations/software] (master) - https://gerrit.wikimedia.org/r/2891 [17:22:33] New review: Bhartshorne; "(no comment)" [operations/software] (master); V: 1 C: 2; - https://gerrit.wikimedia.org/r/2891 [17:22:34] Change merged: Bhartshorne; [operations/software] (master) - https://gerrit.wikimedia.org/r/2891 [17:23:00] Reedy: thanks, but it seems that there is still a problem with the "auto" and the "prev" parameter :/ [17:23:11] Yes [17:23:12] As I said [17:23:16] One way fixes some [17:23:20] The other way breaks others [17:25:47] Reedy: but there is no way to make both work as you said above ? [17:26:04] There is, it just needs changing to cater for both cases [17:26:14] by the way, I noticed there is something wrong with the display of Special:Log too, that's not specific to the API [17:33:58] !log aaron synchronized wmf-config/InitialiseSettings.php 'A few tab w/s tweaks' [17:34:01] Logged the message, Master [17:36:38] !log aaron synchronized wmf-config/InitialiseSettings.php 'Give editors patrolmarks right on plwiki' [17:36:41] Logged the message, Master [17:38:58] !log aaron synchronized wmf-config/InitialiseSettings.php 'Give editors patrolmarks right on plwiki' [17:39:01] Logged the message, Master [17:39:28] explode() expects parameter 2 to be string, array given in /usr/local/apache/common-local/php-1.19/includes/api/ApiQueryLogEvents.php on line 201 [17:41:28] AaronSchulz: that'll be going away again in a few minutes [17:41:39] i should revert it back though for the moment [17:42:18] !log reedy synchronized php-1.19/includes/api/ApiQueryLogEvents.php 'Push back to 1.19wmf1 head' [17:42:21] Logged the message, Master [17:50:19] !log aaron synchronized wmf-config/InitialiseSettings.php 'Give editors patrolmarks right on plwikisource & plwiktionary' [17:50:22] Logged the message, Master [17:51:39] New review: Danakim; "Looks fine to me. Will this be merged in?" [operations/puppet] (production) C: 1; - https://gerrit.wikimedia.org/r/2682 [17:52:49] !log reedy synchronized php-1.19/includes/api/ApiQueryLogEvents.php 'r112701' [17:52:52] Logged the message, Master [17:53:28] Quentinv57: fixed for nwo [17:56:32] Quentinv57: I'm going AFK now for dinner... Any chance you could check some block/userright change log entries? I've got a feeling they're broken also [17:57:20] Based on my bug [18:22:26] New patchset: Bhartshorne; "grumble." [operations/software] (master) - https://gerrit.wikimedia.org/r/2892 [18:22:46] New review: Bhartshorne; "(no comment)" [operations/software] (master); V: 1 C: 2; - https://gerrit.wikimedia.org/r/2892 [18:22:46] Change merged: Bhartshorne; [operations/software] (master) - https://gerrit.wikimedia.org/r/2892 [19:21:05] New patchset: Bhartshorne; "changing the user for swift's rewrite stuff so I can use a new password" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/2893 [19:21:34] New review: Bhartshorne; "(no comment)" [operations/puppet] (production); V: 1 C: 2; - https://gerrit.wikimedia.org/r/2893 [19:21:35]