[00:12:47] AaronSchulz: mc1-16 were cabled with the new fiber today and now need some corresponding switch configs [00:13:02] ok [00:13:03] at least the physical bits should be done with now [00:19:49] !log aaron synchronized wmf-config/filebackend.php 'deployed 5aa6ab06fd4e0e76bd6a64e468c9eacb0f46f680' [00:19:58] Logged the message, Master [00:28:35] !log aaron synchronized wmf-config/ 'Write math files to swift and NFS' [00:28:44] Logged the message, Master [00:49:54] !log aaron synchronized wmf-config/CommonSettings.php 'Removed excess math global' [00:50:03] Logged the message, Master [00:51:23] hi, http://en.wikipedia.org/wiki/Distributive_property "Failed to parse (Cannot write to or create math output directory)" [00:51:50] Hi Gryllida. :) [00:51:51] huh, testwiki looked fine before :/ [00:51:53] AaronSchulz might know something about this. He just made some changes related to Math [00:52:05] oh there he is :) [00:52:15] * Jasper_Deng_sick sees no errors [00:52:32] Nope, no errors for me either [00:52:35] i still see now, just reloaded [00:52:45] Jasper_Deng_sick: did you scroll down? [00:52:50] http://en.wikipedia.org/wiki/Distributive_property?action=purge [00:52:55] looks good now [00:53:05] AaronSchulz: yeah [00:53:34] yup purge 'fixes' it, ta [00:58:39] !log aaron synchronized wmf-config/CommonSettings.php [00:58:48] Logged the message, Master [00:59:28] * AaronSchulz looks at various math articles [01:00:22] is it set for all wikis? [01:01:46] yes, I'm looking at en now, not seeing any problems though [01:02:01] gonna look at a few pages on el [01:02:52] !log Started copying math/ files into swift [01:03:01] Logged the message, Master [01:03:47] looked at a few, seem ok [01:06:46] What are you guys testing? [01:07:12] Math [01:08:06] Cool. [01:16:32] Notice: Use of undefined constant ExperimentsHooks - assumed 'ExperimentsHooks' in /home/wikipedia/common/php-1.20wmf11/extensions/E3Experiments/Experiments.php on line 63 [01:16:37] heh [01:17:00] Reedy: ^ [01:17:12] woops [01:21:38] bad ori-l-away [01:21:44] I'll fix it [02:19:44] !log LocalisationUpdate completed (1.20wmf11) at Fri Sep 7 02:19:43 UTC 2012 [02:19:54] Logged the message, Master [02:37:41] !log LocalisationUpdate completed (1.20wmf10) at Fri Sep 7 02:37:41 UTC 2012 [02:37:50] Logged the message, Master [03:23:33] uhoh [03:24:02] Reedy: thanks for fixing. i just logged on, looking at what the problem was [04:26:40] !log professor has stopped responding to ssh and is not reporting to ganglia, rebooting [04:26:50] Logged the message, Master [04:31:25] we have a box called "professor"? heh [04:37:55] we do [04:38:45] is someone in the DC at the moment? [04:42:22] I don't think so [04:43:34] and Chris is going to come to SF next week too [06:59:21] !log tstarling synchronized wmf-config/CommonSettings.php 'change cortado location' [06:59:31] Logged the message, Master [07:12:55] !log tstarling synchronized wmf-config/CommonSettings.php 'change cortado location back again' [07:13:04] Logged the message, Master [10:20:05] https://commons.wikimedia.org/wiki/Category:Files_with_404_errors [10:20:27] for anyone willing to look at filesystem trouble. apparently there is quite a bit still missing [10:20:39] quite a bit of 500 errors among those. [10:20:44] hmm [10:20:50] I'll have a look in a sec [10:27:08] File not found: /v1/AUTH_43651b15-ed7a-40b6-b745-47666abf8dfe/wikipedia-commons-local-public.b4/b/b4/AGUA_SANTA.jpg [10:50:14] thedj[work]: are 500s there? [13:10:00] Dereckson: I am looking at https://bugzilla.wikimedia.org/show_bug.cgi?id=38036#c1 [13:12:38] Ok. [13:16:12] Dereckson: so it is all about siwiktionnary using a specific file? :-D [13:17:22] Right. [13:17:31] And by error this file were set to si.wikipedia instead [13:19:12] By the way, when I add a new wmg configuration entry in wmf-config/InitialiseSettings.php, what should I do next to have it handled as a $wg variable by the relevant extension? e.g. https://gerrit.wikimedia.org/r/#/c/23065/1/wmf-config/InitialiseSettings.php [13:21:37] paravoid: is http://upload.wikimedia.org/ being served entirely from swift [13:21:38] ? [13:21:49] no [13:22:39] thx :) [13:26:34] !log hashar: {{bug|38036}} cp /mnt/upload6/wikipedia/favicon-si.ico /mnt/upload6/wiktionary/favicon-si.ico [13:26:44] Logged the message, Master [13:28:13] Dereckson: looks like it works :) [13:28:20] Thank you. [13:29:01] Dereckson: you did all the work :-) Go ahead and close https://bugzilla.wikimedia.org/show_bug.cgi?id=38036 now :) [13:44:35] hashar: that favicon is probably noop though... [13:47:46] paravoid: noon ? What do you mean? [13:48:01] no-op [13:48:53] oh nevermind [13:48:58] that works? wtf [13:50:16] apergos: yay more cruft [13:51:09] eh? [13:51:17] /mnt/upload6/wikipedia/favicon-si.ico [13:51:24] etc. [13:51:29] wtf are those [13:51:38] hashar: >_< [13:51:46] favicons :) [13:52:15] I laugh at how we initially wanted to switch *ALL* squid traffic to swift [13:52:21] and we actually attempted it [13:53:00] heeehee [13:53:01] apergos: history ? :-D [13:53:19] I guess we could host them on something like favicions.wikimedia.org/project/lang/ico [13:53:32] they are served directly from /mnt/upload6 apparently [13:53:35] why aren't they in bits? [13:53:44] why not bits? [13:53:49] I have noooooo ideaaaa [13:53:49] jinx [13:53:55] I guess we could migrate them indeed [13:53:59] good [13:54:20] please add them to the cruft page and then add a sentence or two about how you are going to migrate them :-D [13:54:30] http://wikitech.wikimedia.org/view/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7 [13:54:47] root@ms7:/export/upload$ ls -1 */favicon* [13:54:47] wikipedia/favicon-si.ico [13:54:47] wiktionary/favicon-piece.ico [13:54:47] wiktionary/favicon-si.ico [13:55:09] I began writing the section on the wiki page when I realized that that's about it [13:55:39] ok [13:56:00] we could put them in the docroot of operations/mediawiki-config.git I guess that is what is served by bits [13:56:06] ah you saw my note about originals over there? we're still getting requests [13:56:30] hashar: there are just those three icons; where did you find that URL? [13:56:35] the http://upload.wikimedia.org/wikipedia/favicon-si.ico one [13:56:39] where is it referenced? [13:57:26] apergos: I haven't managed to catch a request, do you have recorded in a snoop file? [13:57:35] no, I watch dtrac [13:57:36] e [13:57:46] ah, then it may be the /./ ones [13:57:48] we still have those [13:57:57] or even // or whatever else that's valid HTTP [13:58:08] yes, it might be, I mentioned that possibility on the page [13:58:21] the one from si wikitionary is using a relative url [13:58:28] configured by wgFavicon in the initsetting file [13:58:46] sq56.wikimedia.org -> ms7 HTTP GET /wikipedia/en/./4/43/Gramine_From_Indole_Scheme.png HTTP/1.0 [13:58:49] just now [13:59:27] hashar: can you do whatever it is that all the other wikis are doing? [13:59:30] no idea what that is :) [13:59:35] I see a pretty steady stream of them, [13:59:51] one every few seconds or sometimes one a second depending [14:00:15] not a lot compared to overall traffic obviosuuly but enough to be very annoying [14:00:20] last time we had a /./ thing, it was someone crawling the site [14:00:54] GET /wikipedia/commons/7/7b/Alfred_Escher.jpg [14:01:01] those seem pretty unrelated for a crawler [14:01:03] but who knows [14:01:35] oh you have a GET too? [14:02:18] well like I say I see em about 1 a second or a few seconds [14:03:31] the intersting thing is that the ones I've seen in the last few days have no referrer [14:03:41] (but we still shouldn't just turn em off I guess) [14:03:57] yeah [14:04:12] I'd say let's just work on everything else and figure out the mysteries at the end [14:04:31] but I won't stop you if you're feeling particuarly intrigued :-) [14:04:35] well fixing the /./ problem would be worth doing [14:04:41] and see what we are left with [14:05:26] I just snoop GETs and grep everything else... [14:05:40] btw http://wikitech.wikimedia.org/view/Talk:Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7 please place your bets [14:06:45] you are welcome to bet on an early date and try to influence the outcome by getting stuff the heck off there :-D [14:09:36] why don't you guys use bugzilla instead of a wikipage ? :-] [14:09:40] any prices? [14:10:20] apergos: paravoid: the favicon issue is already referenced in https://wikitech.wikimedia.org/view/Swift/Open_Issues_Aug_-_Sept_2012/Cruft_on_ms7#docroot [14:10:31] ok great [14:10:49] because we originally had an eherpad hashar :-P [14:10:51] I might prepare the change [14:10:52] *etherpad [14:11:01] and we could merge it on monday [14:11:17] isn't ia single config change? [14:11:19] I am landing at noon in SF, should be in Office by 4pm hopefully [14:11:43] yup a config change, that need to provides all the file then change the favicion script and wgFavicon variable [14:12:02] hm? [14:12:07] I don't understand [14:12:35] the favicon files are in /mnt/upload6 [14:12:53] need to move them to /home/wikipedia/common/docroot/bits/ I guess [14:13:07] and update the MediaWiki config file to change the upload.wm.org/.*favicon.ico to points to bits [14:13:31] there are just three favicons [14:13:46] two si ones and a "piece" one that I have no idea what it is [14:14:22] why can't we do for si whatever it is that we do for all the other languages? [14:15:01] history ? [14:15:04] I honestly have no idea [14:17:31] ahhh [14:19:10] ? [14:19:59] ohhhh? [14:33:10] https://gerrit.wikimedia.org/r/#/c/23074/ [14:33:18] I am removing the wgFavicon exceptions [14:33:39] then there are the pieces ones [14:35:38] ah, that's what the -piece is all about [14:37:40] I am doing the conf changes right now [14:39:23] moving it to bits? [14:39:31] yup [14:39:35] 'siwiktionary' => '//bits.wikimedia.org/favicon/wiktionary/si.ico', // Bug 38036 [14:39:41] ah! [14:39:58] ah I see it [14:40:10] (looking at the gerrit change) [14:40:20] yay for those to be gone [14:50:31] and https://gerrit.wikimedia.org/r/23077 migrate the favicons out of upload to bits [14:56:44] I have updated the cruft page [15:14:17] !log py synchronized wmf-config/lucene.php [15:14:27] Logged the message, Master [15:21:44] !log py synchronized wmf-config/lucene.php [15:21:53] Logged the message, Master [16:02:55] !log hashar synchronized wmf-config/ext-wmflabs.php '{{gerrit|22172}} - Deploying OnlineStatusBar on beta' [16:03:04] Logged the message, Master [16:58:44] hello everyone [16:59:41] does anyone know why one of my cron jobs didn't run yesterday, but the other did? [17:05:34] Magog_the_Ogre: Are you talking about the TS, wikimedia labs or the "real" Wikimedia cluster? [17:05:49] my job is on submit.toolserver.org [17:06:02] (hoo) [17:06:42] Magog_the_Ogre: Go to #wikimedia-toolserver then :P I had problems at my own in the past weeks, moving the crons to a less crowdy time resolved that [17:06:54] oh shoot, wrong one! [17:07:00] ha thanks [17:07:03] hoo [17:46:25] hey all [17:46:55] is it possible for an admin to disable or override the template transclusion limit for a particular page? [18:33:08] OlEnglish: no [18:33:32] OlEnglish: not even a sysadmin, if that's what you meant [18:33:38] thanks [18:34:05] and if dom as finds out he desysops you anyway, so [18:35:05] well i'll desysadmin him! [18:35:14] I don't think so :p [18:35:18] i'll dehuman him [18:35:25] ;P [18:35:52] see? [18:35:53] like that [18:43:50] hehe [18:43:54] I see you [18:44:45] uh oh [18:49:45] haha [18:51:00] Nemo_bis has /msg [18:52:25] hashar go away, i don't want to see you until monday! [18:52:27] ;P [18:52:40] :-D [18:52:53] I am addicted !! [20:01:02] I am out. See you monday! [22:29:06] gn8 folks [22:54:06] hoo: you around? [22:54:31] csteipp: Yes ;) [22:54:53] Hey, were you working on the hideuser gadget on meta? [22:55:06] I'm just trying to understand it.. no security bugs :) [22:56:34] csteipp: I dunno that gadget [22:56:55] hoo: ah, nevermind then. Got you confused with someone else ;) [22:57:21] ah ok :P [22:57:45] * hoo != DerHexer :D [22:59:37] Aber ihr seid Deutsch! [23:00:05] :P [23:00:06] Mh7kJ: * Deutsche [23:00:18] Ah well. It was never going to be correct anyway. [23:00:22] ;) [23:00:30] :P [23:01:27] * itu rollt ein Fass Bier herein und schwenkt die deutsche Fahne [23:01:43] Freibier!!!11einself [23:04:43] wtf [23:04:56] Prost