[00:26:34] PROBLEM - Puppet freshness on ms1002 is CRITICAL: Puppet has not run in the last 10 hours [01:00:14] gn8 folks [01:01:45] RECOVERY - Puppet freshness on ms1002 is OK: puppet ran at Fri Dec 30 01:01:28 UTC 2011 [01:03:11] !log restarted puppetd on ms1002 [01:03:21] Logged the message, Mistress of the network gear. [02:05:02] !log LocalisationUpdate completed (1.18) at Fri Dec 30 02:05:02 UTC 2011 [02:05:15] Logged the message, Master [03:07:55] g'night [03:28:42] I have a couple of questions about the Book tool app. Can anyone help? [03:29:28] TVJunkie: like what? [03:30:09] I have generated a book with it [03:30:21] Yes? [03:30:34] I did it through the template of a wikipedia book page [03:30:58] which didn't turn out [03:31:12] afterwards I made big changes to the wikipedia book page [03:31:13] So what you generated was more of a sample from a tutorial? [03:31:28] but I cannot reload the app so that it would recreate the pdf file [03:31:50] is there a time limit between the creations of the pdf files? [03:32:04] as in only every 30 mins ? [03:32:05] So you are trying to empty the list of pages from that book without affecting the generated page? [03:32:13] no... [03:32:17] Oh [03:32:57] TVJunkie: I don't know, but I'd have good reason to think there might be due to the amount of traffic WP gets [03:33:18] http://en.wikipedia.org/wiki/Book:Computer_Networking [03:33:29] Perhaps so you can't put too much load on a server [03:33:54] I could be wrong, of course, especially since I have no idea if there is a "cooldown period" [03:34:16] whom would know ? [03:34:36] You could ask in #wikipedia-en-help [03:34:42] They might know [03:35:19] Though that channel is more for help editing wikipedia, they do answer lots of questions for other topics too [03:35:31] LL2|JedIRC: i think this is a fairly appropriate place to ask. but no harm asking in more than one place [03:35:40] is there any way to contact the developers ? [03:35:55] I need help creating the Hebrew version of this tool [03:36:05] for the Hebrew wikipedia [03:43:39] there's no rate limit [03:43:50] the new book is probably broken for some other reason [03:45:00] TimStarling: re i18n: all just in svn or have to talk to pediapress ppl? [03:45:25] there's a bug for hebrew support already [03:46:27] oh, i see http://translatewiki.net/wiki/Translating:Mwlib.rl [03:47:55] the pediapress.com bug tracker seems to have disappeared [03:48:08] https://bugzilla.wikimedia.org/30630 remotely relevant? [03:48:11] makes things a bit difficult [03:48:18] I want to help develop the Hebrew part of the tool [03:48:26] whom should I contact ? [03:48:37] jeremyb: no it's not relevant [03:49:23] comment 4 of https://bugzilla.wikimedia.org/show_bug.cgi?id=32316 is relevant [03:51:35] PROBLEM - Puppet freshness on es1002 is CRITICAL: Puppet has not run in the last 10 hours [03:52:44] I asked them a while ago if RTL support in mwlib was possible [03:53:01] and the answer was that it is difficult, but that it would be nice to have some day [03:55:08] right, some relevant bugs are marked fixed as of last august [03:55:29] e.g. https://bugzilla.wikimedia.org/show_bug.cgi?id=17766 [03:57:27] FWIW, http://tinyurl.com/html5bidi [03:57:34] (presented in haifa) [04:02:00] hrmm, apparently there is a #pediapress [04:02:24] 30 04:01:09 -!- Topic for #pediapress: PediaPress – wikis in print: http://pediapress.com | Wiki, documentation, and bug tracker here: http://code.pediapress.com/ [04:03:58] thanks [04:22:22] TVJunkie: were you interested in programming or translation or what? [04:23:10] translating a section which they did not translate yet [04:23:27] can you link to it? [04:23:42] sure [04:24:50] http://he.wikipedia.org/w/index.php?title=%D7%9E%D7%99%D7%95%D7%97%D7%93:%D7%A1%D7%A4%D7%A8&bookcmd=rendering&return_to=%D7%A1%D7%A4%D7%A8%3A%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94&collection_id=b1350b4c6afd3786&writer=rl [04:25:03] thats the screen I see during the conversion [04:25:31] which is still in English - but it is aligned to the right [04:25:35] as you can see [04:25:55] You should be able to translate that over at translatewiki [04:29:59] thanks [04:39:27] PROBLEM - MySQL slave status on es1004 is CRITICAL: CRITICAL: Slave running: expected Yes, got No [06:38:04] Hello. Someone claiming to work for telnet is reporting that Wikipedia isn't loading for some of their IPs (they geolocate to Russia) and they are getting timeouts. [06:38:14] status.wikimedia doesn't show anything wrong. [06:38:28] Does anyone have any info? [07:10:58] I haven't heard anthing about it [07:11:34] can they traceroute it? [07:15:01] [23:13:54] yep, traceroutes the same ( [07:15:06] not sure what that means ;) [07:15:47] well a traceeroute should show where the latency is or where packets start getting dropped [07:41:33] hello [07:41:48] guys, can u help me [07:42:08] we having troubles to access to wiki from 178.19.255.6 [07:42:40] what hostname are you using (ru.wikipedia.org, something else)? [07:42:47] 178.19.255.5 - ping ok, traceroute ok, telnet ok, but http - no [07:42:53] just wikipedia.org [07:43:01] ru. en. - doesnt matter [07:43:07] ok, I'll look at en then [07:43:09] 178.19.255.6 - everything is ok [07:43:27] can u send me a traceroute from wiki to 178.19.255.6 and 178.19.255.5 [07:43:40] may be they are different [07:44:21] do me a favor, give me the results of a dsn lookup on en.wikipedia.org from that host [07:44:55] nslookup en.wikipedia.org [07:44:57] Server: 10.0.1.254 [07:44:59] Address: 10.0.1.254#53 [07:45:01] Non-authoritative answer: [07:45:03] en.wikipedia.org canonical name = wikipedia-lb.wikimedia.org. [07:45:05] wikipedia-lb.wikimedia.org canonical name = wikipedia-lb.esams.wikimedia.org. [07:45:07] Name: wikipedia-lb.esams.wikimedia.org [07:45:09] Address: 91.198.174.225 [07:45:35] thanks [07:48:01] it looks good going back to you [07:48:08] to 178.19.255.5 [07:48:21] can u send me results? [07:48:51] from us it goes via telia.net [07:49:36] peterstar.net and telia.net, maybe from you it goes via another provider [07:49:47] hmm I don't see that [07:49:54] AMS-PE-1.megafonvolga.ru [07:50:01] Oo [07:50:05] thensomething not identified [07:50:17] then an ip we don't have a name for and then MX960-1-543-SPB-RU.xe-0-0-0- [07:50:31] let me get a full name for that just a sec [07:51:01] MX960-1-543-SPB-RU.xe-0-0-0-0.peterstar.net [07:51:28] which would your otherhost work? :-D [07:52:01] *why [07:52:15] i can't understand =)) [07:52:33] what does your traceroute to us from the other host show, same path? [07:52:56] for *.6 we have the same route to you as for *.5 [07:53:26] if a try to access to wiki from .6, can you wath tcpdump or something? [07:53:44] em not so much [07:53:50] we have way too much traffic to do that [07:53:57] =) [07:54:10] so does the traceroute from 6 to us follow the same path as for from 5 to us? [07:54:13] via telia? [07:54:19] yep [07:54:23] that is weird [07:55:03] anyways if telnet is good and http isn't, that's probably not a packet issue [07:57:46] that prefix isn't in our acls list so there's no reason you wouldn't get through [08:00:01] I see a request from you guys (we only keep samples) from today that got a 200 back from a squid [08:00:06] to *.5 I mean [08:02:33] if you have the capability I would look at incoming packets on your end after sending a request [08:19:37] wow [08:19:46] we fix it i think [08:19:51] great [08:19:53] but how [08:19:53] what was it? [08:20:07] dont know ) bgp restart [08:20:10] heh [08:20:14] ok, fabolous [08:20:17] *fabulous [08:20:50] apergos: When you get a chance, could you look at this? http://tinyurl.com/55k65l#Why_can.27t_I_upload_a_higher_resolution_version.3F [08:20:52] http://commons.wikimedia.org/wiki/Commons:Help_desk#Why_can.27t_I_upload_a_higher_resolution_version.3F [08:21:20] thanks a lot! ) [08:21:26] yw [08:28:15] juancarlos: I don't know what the problem would be. it seems that they should be an autoconfirmed user, so it should allow the new version to go up [08:28:28] based on the little bit of info that's in their report [08:28:42] I thought perhaps the hash checker thingy might be acting up. [08:29:55] I would ask them to give a screenshot if they are inclined, and have someone look at it after that.. but I'm not an expert in the file upload area [08:31:36] Okay, thanks for looking. [08:31:40] I asked them for more info. [08:32:12] since I see that rotatebot is still happily uploading new versions of images, things mut be generally working [08:32:30] http://commons.wikimedia.org/wiki/Special:Contributions/Rotatebot [08:32:37] good luck [08:32:43] juancarlos: a exact copy and paste of the error message would be helpful, because afaik we don't chuck a "Already uploaded! can't do thise message", also how they are uploading would be helpful (eg: which upload form) and what the complete filesize of the new file would be helpful [08:33:01] that's why I wanted the screen shot [08:33:05] Yeah, I asked what upload method they are using [08:33:47] I added to my request now ;) [08:33:52] cool [08:33:53] «if I try to create a new file for the new version, I am told that the image already exists on Commons» [08:34:05] is he trying to upload it on en.wiki? [08:34:19] we'll find out soon [08:34:40] en.wiki users are pretty convinced that the world ends at en.wiki borders [08:35:02] in that case, no wonder, he'd need to be sysop to be allowed such an action [08:35:15] Nemo_bis: UW isn't enabled at en.wiki afaik and that is how their other uploads are done [08:36:05] he doesn't mention UW [08:37:43] uh, lots of salmon [08:38:31] I got a timeout o; [08:39:36] MySQL error: 1205: Lock wait timeout exceeded; try restarting transaction (10.0.6.42) [08:39:47] hm. edit went through I guess. [08:59:27] Ryan_Lane: Are you around ? [09:06:08] uhm. apergos: [01:04:04] What is happened with wikipedia for russian users? [09:06:16] is this related to kitich? [09:06:20] 's issue [09:06:54] I can't tell from the time stamp [09:07:06] 2 min ago [09:07:09] ok [09:07:22] well in theory his issue got fixed [09:07:32] so I have no idea [09:12:28] http://www.ip-adress.com/ip_tracer/91.144.137.130 says it gets stuck loading and never loads [09:16:24] where does it show that it doesn't load/ [09:16:26] ? [09:16:59] s/he said in the browser window [09:17:14] um, I don't follow [09:17:21] from that link I don't see anything like that [09:17:28] I don't see anything about loading a web page at all [09:17:46] the link was just to give the IP and isp info. [09:17:54] sorry. [09:17:58] I see [09:19:57] well traceroute going back to them look sgood from here [09:20:47] mkay. [09:20:56] the issue that ki tich had was fixed on his end [09:21:55] kk. well, I'm going to sleep [09:22:01] thanks for the help :) [09:22:03] ok [09:22:05] good night [09:22:10] gnight [09:22:15] I'm going to get dressed and eat breakfast! [09:34:12] juancarlos: what is 91.144.137.130 ? [09:34:18] eh [09:35:13] their ip I suppose [10:01:14] RECOVERY - MySQL slave status on es1004 is OK: OK: [11:38:33] PROBLEM - Puppet freshness on ms1002 is CRITICAL: Puppet has not run in the last 10 hours [13:32:20] Ryan_Lane: Are you around ? [13:48:31] heya [13:48:55] I'm having a problem getting stuff from wikipedia-lb.esams.wikimedia.org has address 91.198.174.225 [13:49:02] e.g. curl 91.198.174.225 just stalls [13:49:14] whereas curl 208.80.152.201 works fine [13:49:25] my trace http://dpaste.com/679317/ [13:49:37] and the source IP is 92.255.174.192 [13:50:23] heh [13:50:23] http://p.defau.lt/?4uKKh0me9NSD1M5hLPmshg [13:50:46] some russian isp having issues, I guess [13:51:47] odd though, I see no packetloss [13:51:51] maybe they're having some filtering equipment [13:52:02] for http [13:52:18] rm: try https [13:52:21] so as I thought, the back route goes via Megafon [13:52:31] because I'm having the same issue on their 3G [13:53:15] curl -v https://91.198.174.225/ stalls on * SSLv3, TLS handshake, Client hello (1): [13:53:36] my guess would be an MTU problem somewhere [13:57:41] yeh, there's not a single packet loss on the way [13:57:51] I was running quite aggressive test [14:01:17] PROBLEM - Puppet freshness on es1002 is CRITICAL: Puppet has not run in the last 10 hours [15:31:30] PROBLEM - MySQL replication status on db1025 is CRITICAL: CHECK MySQL REPLICATION - lag - CRITICAL - Seconds_Behind_Master : 13454s [15:33:19] PROBLEM - MySQL replication status on storage3 is CRITICAL: CHECK MySQL REPLICATION - lag - CRITICAL - Seconds_Behind_Master : 11259s [15:34:20] PROBLEM - Misc_Db_Lag on storage3 is CRITICAL: CHECK MySQL REPLICATION - lag - CRITICAL - Seconds_Behind_Master : 11040s [16:12:20] RECOVERY - Misc_Db_Lag on storage3 is OK: CHECK MySQL REPLICATION - lag - OK - Seconds_Behind_Master : 0s [16:15:40] RECOVERY - MySQL replication status on storage3 is OK: CHECK MySQL REPLICATION - lag - OK - Seconds_Behind_Master : 1s [16:36:00] RECOVERY - MySQL replication status on db1025 is OK: CHECK MySQL REPLICATION - lag - OK - Seconds_Behind_Master : 0s [17:14:38] What is currently the operating limit of watchlists at the moment, does everyone think? [17:14:53] If you want to be able to edit it later. [17:16:56] Jarry1250: 500,000 pages will crash the servers [17:17:14] * Betacommand once did that [17:17:45] lol [17:17:46] really made brion not happy [17:18:05] I'm thinking of 22,000... [17:18:18] should be doable [17:18:25] But I don't think I'll be able to edit it after that? [17:18:34] Can you edit your own watchlist via the api? [17:18:59] you can use the raw list [17:19:11] for massive additions/removals [17:19:49] Jarry1250: yes [17:20:04] Danny_B|backup: that fails if the list is too large [17:20:25] Danny_B|backup: I had to have brion manually purge the database [17:21:06] anything too large fails [17:22:17] Ah, but action=watch is one at a time. [17:22:28] So I forsee 1000 requests... ho hum. [17:33:00] Betacommand: I've gotta ask, what the hell were you doing adding 500,000 pages to your watchlist? [17:33:28] For science. [17:34:48] http://www.youtube.com/watch?feature=player_detailpage&v=2IlHgbOWj4o#t=55s [17:36:27] $user->watchlist->add( $wiki->getListOfPagesInNs( 0 ) ); ? ;-) [17:58:06] phuzion: it was my bots watchlist [17:59:07] there was a bug where it added every page it edited to its watchlist [17:59:38] by the time I caught it, it had already made a crapton of edits [18:38:14] hi all, my friend has a problem accessing *.wikipedia.org projects, he says wiktionary, wikibooks, etc. are available. They all work for me, but I use another provider. Both Tampa and european servers work for me. [18:38:25] There are ping, nslookup and tracert: http://pastebin.com/z268AeWx [18:40:57] wizardist: looking now [18:41:26] same problem that I was describing above, it seems [18:41:32] thx, hightlight me if the problem reveals [18:41:32] LeslieCarr, IIRC, one domain is on a wildcard.. The others they are specifically set [18:41:35] at least the wikipedia IP is the same [18:41:44] Has one of the dns servers stopped again? [18:42:02] rm: can you repaste this ? i was not online when you mentioned it i believe [18:42:20] I'm having a problem getting stuff from wikipedia-lb.esams.wikimedia.org has address 91.198.174.225 [18:42:23] wizardist: can i get the same info to wikitionary (or any other project) [18:42:26] e.g. curl 91.198.174.225 just stalls [18:42:28] is Ryan_Lane working today? [18:42:31] LeslieCarr: just a moment, please [18:42:35] yep [18:42:43] thanks rm [18:43:02] http://dpaste.com/679317/ and the return trace http://p.defau.lt/?4uKKh0me9NSD1M5hLPmshg [18:43:29] it's working fo rme... [18:43:35] Ryan_Lane: Oren Bochman evidently needs something sorted out regarding his labs instance and it's blocking his Lucene work, and his time to do it is limited -- I forwarded you a few things [18:43:54] ah interesting - i wonder if it has something to do with the session with megafonvolga [18:44:15] Ryan_Lane: he writes: "Yes I have access to the instance but at this point I can only get into [18:44:15] Bastion and not into the lab itself. [18:44:16] Anyhow the lab is just a basic wiki and evrything needs to be set up including importing content." Whom should I contact to get him help in the next couple of days? [18:44:29] I don't have Windows. [18:44:36] I can't troubleshoot his putty problem [18:44:41] What is it? [18:44:46] he isn't forwarding his agent properly [18:45:02] ( Ryan_Lane: I have to delegate this because (a) I am on vacation & (b) Oren needs to work on this during his vacation time, which ends 5 Jan.) [18:45:07] it's one checkbox... [18:45:28] both are going via that route .. [18:49:14] LeslieCarr: be.wiktionary.org http://pastebin.com/3xDmEmAc [18:50:03] curl 91.198.174.226 works for me [18:50:06] buit ...225 stalls [18:50:11] but* [18:50:51] works both here [19:11:17] Ryan_Lane: i can work on it with oren tomorrow... (i don't have putty either but at least i've used it a fair bit less than 6 years ago) [19:11:47] I think it's actually another problem [19:11:52] he hasn't created an instance yet [19:12:13] which would make it hard to ssh to something :) [19:12:19] middle of wikimania meeting now btw [19:12:53] ah. cool. [19:12:57] I hope everything is going well [19:16:14] rm/wizardist - this is espeically strange as 91.198.174.226 and .225 are on the same server [19:25:39] LeslieCarr, it could be that only one of them goes via Megafon on the back route to me [19:26:09] nope, all the routing is identical [19:26:43] can you check the traceroute by using first the one, then the other IP as the source [19:27:19] I get 85 msec ping vs 92 msec [19:27:36] backstory: [19:27:54] we had an ru user earlier who packets went *to* us via telia, from us via megafon [19:28:10] pings ok, traceroute ook, http nothing... but only form one host in the subnet [19:28:16] from anotehr of his hosts, golden [19:28:25] he restarted bgp on his end and it "cleared up"... [19:28:27] apergos, are you talking about me? :) [19:28:29] no [19:29:00] another user in this channel [19:29:04] I can't restart BGP on my end, since I'm an end-user at home [19:29:11] yup [19:29:22] q is whether we can restart something [19:29:44] weird - we are actually getting this route via the ams-ix route server [19:30:14] i could try a soft flush [19:31:12] what are the possible side effects? [19:31:50] the brocade's route tables filling up completely due to their bug + the fact that we are getting tons of routes via ams-ix [19:32:19] maybe if i just try a filter to reject routes via megafon [19:32:55] ah hah [19:33:34] as long as telia doesn't crap out, why not [19:39:19] !log added 31133 to as path list "AVOID-PATHS" and soft reset AMS-IX route server peerings [19:39:28] yep works now [19:39:29] Logged the message, Mistress of the network gear. [19:39:52] now i am really curious why that worked :) but at least it worked [19:40:10] wizardist|2: how do you look ? [19:40:29] now your traffic is going via telia, which IMHO is a very reliable carrier [19:42:11] thanks [19:42:26] LeslieCarr: my friend says it works now. [19:42:28] thanks :) [19:42:35] cool [19:44:53] my friend also says the problem existed for about two days :/ [19:45:14] two days! the first reports I heard were today [19:45:25] doesn't mean they weren't issues, I just didn't hear about it [19:49:14] well, it's you or me using IRC, some folks heard nothing about bugzilla :) [19:50:00] I'm in a channel which should be reporting bug changes, but I admit I dont always follow it closely [19:50:17] hmm and I'm nont in it right now. stupid irc client [19:55:19] it's tough for me to find the right balance between irc channels and actually doing work [20:03:41] well that was work [20:04:15] I otoh am not looking for balance right now unless by "balance" one means "eating instead of working" :-) [20:05:49] that was definitely work, just that a lot of channels have content not related to my work… and then i get too caught up in reading all the channels :) [20:06:01] but then again, i have awesome coworkers who do check for those things and ping me when they think i can help [20:06:28] apergos: high five! [20:07:56] * apergos high fives wizardist [20:08:05] I am eating mushroom and cheese pie. hot out of the cooker [20:08:19] mmmm [21:28:57] * Krinkle will think about "Mistress of the network gear" next time he executed an rm command in shell. [21:48:11] PROBLEM - Puppet freshness on ms1002 is CRITICAL: Puppet has not run in the last 10 hours [22:25:20] gn8 folks [23:22:54] zzz