[00:02:10] * Reedy cleans up Brooke [00:02:31] I had to clean up my wall this morning. [00:03:24] It'd be nice if Bugzilla could get some love. [00:03:54] Reedy: do you want to query the master? [00:04:16] Not now [00:04:37] Not tonight, dear, I'm tired. [00:05:34] https://bugzilla.wikimedia.org/editwhines.cgi [00:05:35] Huh. [00:05:51] ? [00:06:08] I didn't know that feature existed. [00:06:23] exists, rather. [00:07:11] Brooke: do you have bz_canusewhines? [00:07:18] Dunno. [00:07:26] i think there's also a bz_canwhineatothers [00:07:30] Probably. It's the only blue link when I visit admin.cgi. [00:08:46] yup [00:39:36] https://noc.wikimedia.org/conf/httpd.conf [00:39:38] Hmm. [00:39:41] Is that a bug? [00:40:14] Anyone know where wiki families are defiend? [00:40:17] defined [00:40:35] wgConf.php, it looks like. [00:42:03] Brooke: that's all in git [00:42:48] jeremyb: Okay, but I'm not sure how that's relevant. [00:42:55] just saying [00:43:05] i prefer git browsing to noc.wm.o browsing [00:43:07] jeremyb: You're a git. [00:43:22] Because you're a sadist? [00:43:37] noc.wikimedia.org is usable. [00:44:46] nope [01:41:40] PROBLEM - MySQL Slave Delay on db1025 is CRITICAL: CRIT replication delay 231 seconds [01:42:43] PROBLEM - MySQL Slave Delay on storage3 is CRITICAL: CRIT replication delay 279 seconds [01:48:34] PROBLEM - Misc_Db_Lag on storage3 is CRITICAL: CHECK MySQL REPLICATION - lag - CRITICAL - Seconds_Behind_Master : 632s [01:53:23] !log midom synchronized wmf-config/mc.php [01:53:32] Logged the message, Master [01:54:07] RECOVERY - MySQL Slave Delay on storage3 is OK: OK replication delay 11 seconds [01:54:16] RECOVERY - Misc_Db_Lag on storage3 is OK: CHECK MySQL REPLICATION - lag - OK - Seconds_Behind_Master : 21s [01:54:25] RECOVERY - MySQL Slave Delay on db1025 is OK: OK replication delay 5 seconds [01:54:43] !log bumped memcached timeout to be slightly above min_rto, 200ms->250ms, should eliminate most of stupid memcached errors because of datacenter network failures [01:54:52] Logged the message, o lord of the trolls, my master, my love. I can't live with out you; oh please log to me some more! [01:58:04] :) [01:58:28] I was waiting to see how the bot addressed you domas - someone mentioned that it was rather amusing a day or two back :) [01:59:09] well, back in the day everyone felt abused, as it was my bot :( [01:59:21] kids couldn't find a better way to have fun [01:59:37] being original isn't too common here [02:00:38] seriously though, I like that, domas - a lot. I think I suggested if I was ever to use it, and it had any capability for AI, it would probably refer to me as "Oi, Dickhead" :) [02:01:33] it's good to see a streak of originality. People think of the devs and maintenance guys as constantly buried in the server, or up to their necks in racking and stuff. [02:01:50] it's just nice to see some humor :) [02:02:57] back in the day only few people had specialized errors [02:03:03] which made it kind of fun [02:03:09] ergh, specialized messages [02:04:28] so how many people have them now? [02:05:01] shouldn't be too hard to parse out of the logs [02:25:37] !log LocalisationUpdate completed (1.20wmf8) at Fri Aug 3 02:25:37 UTC 2012 [02:25:47] Logged the message, Master [03:09:44] PROBLEM - MySQL disk space on storage3 is CRITICAL: DISK CRITICAL - free space: /archive 163250 MB (3% inode=99%): [03:14:05] RECOVERY - Puppet freshness on analytics1006 is OK: puppet ran at Fri Aug 3 03:13:32 UTC 2012 [03:22:02] RECOVERY - Puppet freshness on cp1032 is OK: puppet ran at Fri Aug 3 03:21:55 UTC 2012 [04:42:25] PROBLEM - Puppet freshness on srv281 is CRITICAL: Puppet has not run in the last 10 hours [05:25:29] PROBLEM - Puppet freshness on neon is CRITICAL: Puppet has not run in the last 10 hours [05:50:13] PROBLEM - Puppet freshness on ocg3 is CRITICAL: Puppet has not run in the last 10 hours [06:29:12] PROBLEM - Puppet freshness on ms-be1003 is CRITICAL: Puppet has not run in the last 10 hours [06:44:51] PROBLEM - Puppet freshness on virt1001 is CRITICAL: Puppet has not run in the last 10 hours [06:58:56] PROBLEM - Puppet freshness on virt1002 is CRITICAL: Puppet has not run in the last 10 hours [07:13:56] PROBLEM - Puppet freshness on virt1003 is CRITICAL: Puppet has not run in the last 10 hours [07:51:39] TimStarling: weren't you rewriting our memcached client lib ? [07:52:21] I'm making a few changes to MemcachedClient.php, I'll commit in a couple of hours [08:42:24] PROBLEM - Puppet freshness on ms-be1009 is CRITICAL: Puppet has not run in the last 10 hours [08:42:24] PROBLEM - Puppet freshness on ms-be1006 is CRITICAL: Puppet has not run in the last 10 hours [08:42:24] PROBLEM - Puppet freshness on ms-be1005 is CRITICAL: Puppet has not run in the last 10 hours [13:57:08] is there a reason why gerrit no longer fits my screen width (1024x768)? [13:58:35] because you've got a small screen [14:00:07] Reedy: me too sometimes [14:00:55] Nemo_bis: https://gerrit.wikimedia.org/r/16841 [14:01:20] Reedy: yes I'm stingy [14:02:01] jeremyb: well yes I was able to connect it to the style changes, I just wondered if it's intentional/known [14:02:23] Nemo_bis: see last comment [14:03:07] "anomie" is always a worrying name for me btw [14:03:31] oh well, I'll wait [14:19:33] jeremyb: the query from yesterday finished: there are ~25000 pagelinks for pages which are redirection pages: http://p.defau.lt/?4_fvQZ5AEZL3Nn_ToJCxIw [14:20:35] (pagelinks other than the redirect itself) [14:21:32] jorn: k, feel free to file. or we can keep asking people but who knows when they'll have time (if you file then we can assign to someone :) ) [14:21:46] jorn: be sure to include the corresponding prod query not just the query you ran [14:21:57] !b 16660 | jorn [14:21:57] jorn: https://bugzilla.wikimedia.org/show_bug.cgi?id=16660 [14:23:57] uhm, i had repeated all the queries with the page, redirect and pagelinks table, guess that's what you meant with prod, right? [14:38:40] PROBLEM - Misc_Db_Lag on db10 is CRITICAL: CHECK MySQL REPLICATION - lag - CRITICAL - Seconds_Behind_Master : 672s [14:42:52] PROBLEM - Puppet freshness on srv281 is CRITICAL: Puppet has not run in the last 10 hours [14:43:48] jorn: idk. i mean so that the query works immediately without modification [14:45:42] !b 39011 | jeremyb [14:45:43] jeremyb: https://bugzilla.wikimedia.org/show_bug.cgi?id=39011 [14:47:33] shall i add a comment to 16660 or do you set the depend? [14:49:12] jorn: take another look [14:49:25] sorry, didn't know the structure that well [14:50:30] select * from redirect join page on rd_from=page_id where page_is_redirect != 1 limit 100; is easily fixed [14:52:21] yupp, you could just update, i was more concerned where it came from [14:52:45] seems in one of the occurrences in article namespace the page was deleted [14:53:08] the 25/5 don't seem worth investigating [14:53:12] PROBLEM - Misc_Db_Lag on db10 is CRITICAL: CHECK MySQL REPLICATION - lag - CRITICAL - Seconds_Behind_Master : 647s [14:54:45] maybe it should just be stated that the redirect table seems to take precedence (if my observation was correct) [14:57:08] hmm, seems there is something broken with the upload checks again [14:57:08] https://en.wikipedia.org/wiki/File:02_Calma_Pueblo.ogg [14:57:09] Reedy: in case of the additional pagelinks for redirect pages: many seem to link to stuff in namespace 4, e.g., to page_title "Subpages" which is why i excluded them from the query, else there are way more... [14:57:24] mp4 file uploaded as ogg just a couple of days ago. [15:00:42] PROBLEM - Misc_Db_Lag on db10 is CRITICAL: CHECK MySQL REPLICATION - lag - CRITICAL - Seconds_Behind_Master : 660s [15:02:12] PROBLEM - MySQL Replication Heartbeat on db1042 is CRITICAL: CRIT replication delay 220 seconds [15:02:12] PROBLEM - MySQL Replication Heartbeat on db1033 is CRITICAL: CRIT replication delay 221 seconds [15:02:21] PROBLEM - MySQL Replication Heartbeat on db1001 is CRITICAL: CRIT replication delay 229 seconds [15:02:30] PROBLEM - MySQL Replication Heartbeat on db42 is CRITICAL: CRIT replication delay 238 seconds [15:02:39] PROBLEM - MySQL Replication Heartbeat on db1043 is CRITICAL: CRIT replication delay 247 seconds [15:02:57] PROBLEM - MySQL Replication Heartbeat on db1047 is CRITICAL: CRIT replication delay 265 seconds [15:04:54] PROBLEM - Misc_Db_Lag on db10 is CRITICAL: CHECK MySQL REPLICATION - lag - CRITICAL - Seconds_Behind_Master : 616s [15:05:30] PROBLEM - MySQL Slave Delay on db1001 is CRITICAL: CRIT replication delay 206 seconds [15:05:48] PROBLEM - MySQL Slave Delay on db1042 is CRITICAL: CRIT replication delay 294 seconds [15:05:57] PROBLEM - MySQL Slave Delay on db1047 is CRITICAL: CRIT replication delay 232 seconds [15:06:07] PROBLEM - MySQL Slave Delay on db42 is CRITICAL: CRIT replication delay 239 seconds [15:06:07] PROBLEM - MySQL Slave Delay on db1043 is CRITICAL: CRIT replication delay 207 seconds [15:06:33] PROBLEM - MySQL Slave Delay on db1033 is CRITICAL: CRIT replication delay 235 seconds [15:07:00] RECOVERY - MySQL Slave Delay on db1001 is OK: OK replication delay 21 seconds [15:07:00] RECOVERY - MySQL Replication Heartbeat on db1043 is OK: OK replication delay 25 seconds [15:07:18] RECOVERY - MySQL Slave Delay on db1042 is OK: OK replication delay 0 seconds [15:07:27] RECOVERY - MySQL Slave Delay on db1043 is OK: OK replication delay 0 seconds [15:07:54] PROBLEM - Misc_Db_Lag on db10 is CRITICAL: CHECK MySQL REPLICATION - lag - CRITICAL - Seconds_Behind_Master : 631s [15:08:03] RECOVERY - MySQL Replication Heartbeat on db1042 is OK: OK replication delay 0 seconds [15:08:12] RECOVERY - MySQL Replication Heartbeat on db1001 is OK: OK replication delay 0 seconds [15:09:25] RECOVERY - MySQL Slave Delay on db1033 is OK: OK replication delay 0 seconds [15:09:33] RECOVERY - MySQL Replication Heartbeat on db1033 is OK: OK replication delay 0 seconds [15:10:18] RECOVERY - MySQL Slave Delay on db1047 is OK: OK replication delay 1 seconds [15:10:18] RECOVERY - MySQL Replication Heartbeat on db1047 is OK: OK replication delay 1 seconds [15:14:57] PROBLEM - Puppet freshness on labstore1 is CRITICAL: Puppet has not run in the last 10 hours [15:14:57] PROBLEM - Misc_Db_Lag on db10 is CRITICAL: CHECK MySQL REPLICATION - lag - CRITICAL - Seconds_Behind_Master : 620s [15:17:50] RECOVERY - MySQL Replication Heartbeat on db42 is OK: OK replication delay 0 seconds [15:18:26] RECOVERY - MySQL Slave Delay on db42 is OK: OK replication delay 0 seconds [15:20:35] what is the preferred extension to lock some namespaces to only users with flag "accreditated" so that others don't get to see or edit anything there ?? [15:20:52] jorn: seemingly very few instances of the first error across the cluster [15:21:09] have tidied them up [15:21:45] Reedy: you think leftover from some other MW version? [15:22:00] possibly [15:22:20] 25 entries on our biggest wiki doesn't seem a major issue [15:24:56] oops. wrong channel. [15:26:51] PROBLEM - Puppet freshness on neon is CRITICAL: Puppet has not run in the last 10 hours [15:26:59] jorn: jeremyb: on the 2nd query (select * from page left join redirect on page_id=rd_from where page_is_redirect != 0 and rd_from is null limit 100;) [15:27:06] I only see 2 entries on enwiki master [15:27:55] http://p.defau.lt/?pwJZMIVtTGGZYb69o8YWxg [15:27:58] 1 is a redirect to a url [15:28:07] those two? [15:28:13] from namespace 0? [15:28:24] no [15:28:31] http://p.defau.lt/?TnHWGgh9GbqNgXEqeHWhBg [15:29:09] both are "redirects" to google [15:29:45] * Reedy deletes the pages [15:29:51] without being in the redirect table? [15:30:07] how do they redirect then? via pagelinks? [15:30:12] They don't [15:30:31] #REDIRECT [http://www.google.com] [15:30:33] doesn't work [15:30:49] according to http://www.mediawiki.org/wiki/Manual:Redirect_table ? [15:30:57] ah sorry, misunderstood that [15:31:11] You get [15:31:13] 1. REDIRECT [1] [15:31:28] no sleep to be lost over those either :p [15:31:32] ;) [15:31:53] well, i'm more concerned about the 25K pagelinks i don't really understand [15:32:12] even though they seem to be nothing in 670M [15:32:39] and as i filter them out anyhow by excluding all redirects [15:33:42] I suspect the pagelinks ones are bad link updates on the pages [15:34:16] really slow queries don't help in getting working sets to look at [15:35:11] purging those pages might be enough to fix it [15:35:25] uhm, have a look first [15:35:36] there's weird links to other namespaces that i don't understand [15:41:20] Reedy: http://p.defau.lt/?hfWmHpiFqk7GbhP4kOhkBw there you can see what i mean [15:41:42] yeah, when I ran it again, it must've cached something ;) [15:43:19] now, how can we easily delete them [15:43:21] what i don't understand is all the pagelinks to namespace 4, title "Subpage" for example or 14 | Redirects_from_plurals... don't know if that's used somehow [15:44:08] is it necessary that the redirects appear in the pagelinks at all? [15:44:22] yes [15:44:31] but they should point to the same? [15:47:01] like this? select * from page inner join redirect on page_id = rd_from inner join pagelinks on rd_from=pl_from where rd_namespace != pl_namespace or rd_title != pl_namespace limit 100; [15:48:03] jorn: you mean pl_title? [15:48:15] omg [15:48:15] yes [15:48:45] that would've been bad [15:49:01] well limit 100 has a purpose! [15:49:15] and it only was a select on purpose ;) [15:50:50] PROBLEM - Puppet freshness on ocg3 is CRITICAL: Puppet has not run in the last 10 hours [15:53:27] * jorn runs to the bus [16:30:36] PROBLEM - Puppet freshness on ms-be1003 is CRITICAL: Puppet has not run in the last 10 hours [16:45:36] PROBLEM - Puppet freshness on virt1001 is CRITICAL: Puppet has not run in the last 10 hours [16:59:33] PROBLEM - Puppet freshness on virt1002 is CRITICAL: Puppet has not run in the last 10 hours [17:14:33] PROBLEM - Puppet freshness on virt1003 is CRITICAL: Puppet has not run in the last 10 hours [17:34:34] PROBLEM - Host ms-fe1001 is DOWN: PING CRITICAL - Packet loss = 100% [17:35:10] RECOVERY - Host ms-fe1001 is UP: PING OK - Packet loss = 0%, RTA = 35.42 ms [17:42:01] !log aaron synchronized php-1.20wmf8/extensions/TimedMediaHandler 'Updated to master (0207962155b810b11100bc6d05c3562949e7c1a9)' [17:42:10] Logged the message, Master [17:48:04] RECOVERY - Misc_Db_Lag on db10 is OK: CHECK MySQL REPLICATION - lag - OK - Seconds_Behind_Master : 38s [17:58:53] Reedy: speaking of jquery slowness on TWN, can I put firebug profiling output somewhere on bugzilla for you, Krinkle (and Niklas?) to see? [18:11:01] PROBLEM - Host ms-be1001 is DOWN: PING CRITICAL - Packet loss = 100% [18:11:01] PROBLEM - Host ms-be1012 is DOWN: PING CRITICAL - Packet loss = 100% [18:11:01] PROBLEM - Host ms-be1002 is DOWN: PING CRITICAL - Packet loss = 100% [18:11:02] PROBLEM - Host ms-be1006 is DOWN: PING CRITICAL - Packet loss = 100% [18:11:10] PROBLEM - Swift HTTP on ms-fe1001 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:26:43] https://commons.wikimedia.org/wiki/File:Caesars_Palace_Navidad.jpg (543 KB) isn't rendering a thumbnail [19:27:32] https://upload.wikimedia.org/wikipedia/commons/7/70/Caesars_Palace_Navidad.jpg [19:27:34] 404 [19:29:47] Is this related to the accident wipe of commons? [19:29:58] No idea [19:30:07] https://secure.flickr.com/photos/dan4th/2138608272/ [19:30:14] Just re-upload the flikr source image [19:30:43] though, the original is a lot larger than what was actually uploaded [19:30:51] Large 1024 (1024 x 768) [19:30:51] Original (3264 x 2448) [19:31:11] actually [19:31:15] I can probably just put the file in place.. [19:31:23] I don't upload, hate the copyright issues and don't own a good camera. [19:31:33] hah [19:31:41] Reedy: does checksum match? [19:31:54] I suspect it won't have one [19:32:09] Also came across https://commons.wikimedia.org/wiki/File:Fira_and_the_Old_Port_MC.jpg [19:32:21] kaldari: i have a recollection of you looking to put together a common data source for ISO-3166 info for MW. did you ever get anywhere with it? [19:32:34] hmm, it does [19:34:32] 0794157dbbffb15a2d0129b3753bf295cdcdaf59 Caesars_Palace_Navidad.jpg [19:37:23] 0vva4fng71pguvrxrlkxf7z748ih6xl [19:38:09] wrong abse [19:39:16] > echo wfBaseConvert( '0794157dbbffb15a2d0129b3753bf295cdcdaf59', 16, 36, 31 ); [19:39:16] 0vva4fng71pguvrxrlkxf7z748ih6xl [19:39:17] Yay [19:39:19] They do match [19:40:13] Dispenser: fixed [19:40:42] Thanks, no clue what the problem was? [19:40:59] No physical file, so it'd been lost at somepoint [19:41:05] for the 2nd one.. the source files seem to be there [19:41:13] but the newest full size one doesn't seem to want to load.. [19:43:42] Error creating thumbnail: convert: Insufficient memory (case 4) [19:44:28] yeah [19:44:33] original is fine if I wget it [19:44:45] isn't quick to open though [19:51:04] * Dispenser wonder where information on the largest image size is located in Wikimedia/Commons [19:52:39] On commons it is 2012_State_Of_The_Union_Address_(720p).ogv [19:52:51] img_size is usefully indexed [19:53:01] largest thumbnailable image size* [19:53:13] 1h 5m 2s, 1,280 × 720 (3.21 GB) [19:53:14] heh [19:54:37] Maybe I should create [[mw:Limitations of Image Magic]] [19:58:25] it's not 2 words [19:58:32] i think it has a k too [20:04:48] awjr: I have cldr supplying translated country names, currency names, and language names, but that's it. [20:05:21] kaldari: that's cool - the country names are iso-3166 names? [20:05:40] do you know offhand if it maps iso-3166 2-letter country codes to names? [20:05:51] yes, it does [20:05:57] cool [20:06:16] awjr: what this iso-3166 thing's about? [20:06:50] we need a way to map 2-letter country codes to translated country names, so that's sweet, but we also need to map iso-3166-2 subdivision codes to translated names. since you've already done a bunch of the work in cldr, perhaps we'll add support for the iso-3166-2 subdivisions [20:07:07] $countries = CountryNames::getNames( $code ); [20:07:22] where code is the language [20:07:28] Dispenser: for the wiki loves monuments mobile app, we are trying to allow people to browse monuments based on country and deeper subdivisions [20:07:50] kaldari do you know offhand if cldr will be functional in a standalone way? eg without MediaWiki? [20:08:26] it could be pretty easily [20:08:56] kaldari: awesome thanks! [20:09:00] i'll start poking it later today [20:09:01] most of the functions are static [20:09:14] and duplicated :D [20:09:20] :) [20:10:07] I've a revision to refactor that, but needs LSB stuffs adding [20:10:50] I should probably abandon it [20:10:54] and make it non staticy [20:11:22] Anyone here good with rtl stuff? [20:11:54] likely better asking in #mediawiki-i18n [20:12:57] Ok, but the API doesn't give any information about rtl. [20:13:50] What sort of information should it give? [20:14:44] hi - fyi (not sure if this is yet reported) the mailman server is quite... slow [20:15:09] as in, whatever the command is - it takes quite a while to process anything or load a mailman admin interface page [20:15:27] especially processing the moderation queue [20:15:37] up to over a minute per page [20:15:43] It's fine for me [20:15:51] wfm2 [20:16:07] effeietsanders: hmm, cant really confirm. works normal for me [20:16:08] specifically the lists wikimedianl-l and contact-nl [20:16:42] contact-nl simply doesn't accept my moderation processing request :S [20:16:49] (the only email in the queue there should be approved) [20:17:40] effeietsanders: sometimes helps to clean your browser cache and logiout / login to admin interface again [20:17:45] effeietsanders: Uitstellen Goedkeuren Weigeren Negeren , which one? [20:17:52] goedkeuren [20:18:10] Er zijn geen wachtende verzoeken. Klik hier om deze pagina te verversen. [20:18:15] worked within a second or so [20:18:16] weird :S [20:18:28] Danny_B|backup: that is what I thought too, until it happened with multiple lists [20:18:42] anyway, apparently the problem is on my side, thanks :) [20:18:42] are you using a proxy maybe? [20:18:46] nope [20:18:49] not that I know [20:34:42] [[Tech]]; AVB; /* missing feature: "else" for empty template-variables */ ; https://meta.wikimedia.org/w/index.php?diff=3988667&oldid=3982993&rcid=3432457 [20:41:18] Is there a Wikimedia cookie policy extensions need to observe? [20:41:25] (I don't suppose there is, but...) [20:45:31] Again with image oddities: http://en.wikipedia.org/wiki/File:Ipiales_-_D%C3%A9cembre_2008.jpg is a zero pixel JPEG [20:46:43] bad metadata extraction [20:48:00] let's try it locally [20:49:22] Dispenser: something seemingly up with that file [20:52:00] https://bugzilla.wikimedia.org/show_bug.cgi?id=39021 [20:52:31] thanks [21:53:06] !log reedy synchronized wmf-config/InitialiseSettings.php 'Bug 38988 - Enable Extension:Collection for Wikimedia Sverige' [21:53:15] Logged the message, Master [22:22:31] kaldari: how did translations get handled in cldr? [22:24:17] what do you mean? [22:24:42] they are handled with care :) [22:26:46] tehe [22:27:03] i mean, it looks like translations were handled outside of translatewiki - is that correct? [22:27:05] kaldari ^ [22:27:14] and if it is correct, how did they get translated? [22:27:23] yes, they all come from the unicode consortium's CLDR database [22:27:31] oh fancy [22:27:54] but any of the values can be overridden locally in the cldr extension [22:28:01] since we often have better data [22:28:22] see the LocalNames dir in the extension for examples [22:29:33] if you want to change or add any info to the official CLDR database, that can be done by our localization engineering team [22:29:46] since they are tech liasions for the Unicode Consortium [22:30:12] v22 in 26 days! [22:41:12] wow the cldr data is kind of amazing. unfortunately they do not have iso-3166-2 data though :( [23:50:26] !log reedy synchronized wmf-config/secure.php 'fix bits usages' [23:50:35] Logged the message, Master