[02:55:13] http://bit.ly/183GBEv [04:33:20] Elsie: thanks for the back and forth (catching me up) on the massmessage bug. [10:17:23] DanielK_WMDE: you probably need to ping someone to approve your message, given the short time http://lists.wikimedia.org/pipermail/mediawiki-api-announce/2013-September/thread.html [10:18:11] Reedy, RoanKattouw_away, vvv? [10:36:36] Nemo_bis: everyone is in SF, and it's night there :/ [10:37:08] Nemo_bis: i cross-posted to wikidata-l and wikidata-tech, so most people should get it anyway [10:39:15] DanielK_WMDE: vvv isn't :) [10:39:53] uh, even Thehelpfulone is idle [10:41:01] Nemo_bis: vvv isn't going to the allhands? [10:51:53] mutante, you there? [10:58:07] DanielK_WMDE: never heard of him being a contractor recently? [10:58:14] * Nemo_bis confused [10:58:58] anyone knows why mutante's manual updatespecialpages.php did not finish yesterday? [11:01:13] svick, apergos: hey [11:01:37] hey [11:02:34] coming on now [11:02:50] apergos, parent5446: hello [11:03:19] hey [11:04:38] how are things going? [11:05:41] i'm cleaning up commits from the last week now, so that they are in presentable for for gerrit [11:06:35] that won't take much time, and then i'll work on making sure LZMA with groups works correctly in every possible case [11:07:28] Nemo_bis: idk - i thought he was at some point. [11:07:59] and that it works on Linux [11:08:19] hm yeah, if it only works on windows it won't help our runs much :-D [11:09:48] does that mean WMF really won't be switching to Windows Azure? :-) (there was a mailing list thread suggesting that) [11:09:57] but yeah, i know [11:10:00] XD [11:10:20] Windows is evil [11:10:27] yes I saw that thread. [11:10:44] it would have been a good one for around april 1 ( too bad it was serious) [11:12:17] WP sysadmin around? [11:13:25] otherwise, i can't think of anything else to discuss today (partially because of the time change, i tend to work in afternoons) [11:14:32] I am about to delete an article with 5 000+ versions, we have been recommended to check in with a sysadmin when doing so [11:16:55] OK, well I don't have anything else either. Sorry about the time change. [11:16:59] agergos? [11:17:16] nope, sounds like you know what needs to be done [11:17:21] see folks tomorrow then at this time [11:17:26] See you tomorrow [11:17:31] ok, see you both tomorrow [11:17:44] Elfix_113: is this en wp? [11:18:20] apergos: dewiki [11:18:33] ok [11:19:25] It shouldn't be a problem for the servers (but if the particular article breaks you get to keep the pieces) :-P [11:19:42] alrighty [11:19:58] lemme know when you are going to proceed [11:20:56] apergos: en route! [11:21:01] ok [11:21:21] DanielK_WMDE: never heard of him being a contractor recently? lemme know when it completes too please [11:22:10] apergos: it *appears* to have completed [11:22:15] great [11:22:22] that is more or less what I expected [11:22:37] great, thanks! [11:22:43] how does it look? gone? [11:23:35] it's gone, but generally the problems are losses of revisions in the deleted history [11:23:40] but they all appear to be there [11:23:56] excellent [11:50:48] hah, DanielK_WMDE is in front page of wikimedia.de [11:51:03] the website changed and i can't find anything any longer ^^ [11:52:17] oh, lockdown now (?) hides also history [11:52:48] p858snake|l: he's not currently in http://www.wikimedia.de/wiki/Mitarbeiter for sure [11:53:20] hes contracted to work on a11y issues [11:53:45] oh no wait, thats hoo [11:53:51] yes [11:59:08] hm... the TranslateExtension on Meta is broken [12:00:04] DanielK_WMDE: sorry for bothering you, but is lockdown now a viable option to make whole namespaces private, more or less? i.e. better than SimpleSecurity [12:00:08] Steinsplitter: broken in what way [12:24:08] greg-g: Happy to help! [12:25:02] Nemo_bis: I don't know about "now", I havn't checked in years :) But that was the intend when I wrote it, and I'm not aware of any gaping holes. [12:25:27] DanielK_WMDE: liar, I see commits only 20 months ago :P [12:25:49] that'S 4 months short of "years", and it was just a bugfix :) [12:26:00] hehe [12:27:27] DanielK_WMDE: specifically, I think this is why WMIT doesn't use it: https://www.mediawiki.org/wiki/Extension:Lockdown#Hiding_pages [12:31:09] Nemo_bis: that's a fundamental issue for which I don't really see any solution that doesn't require modifying core. [12:31:22] Nemo_bis: if there is any extension that does this, let me know, I'm curious how they do it. [12:31:39] DanielK_WMDE: SimpleSecurity sort of manages to [12:32:07] Nemo_bis: on *all* special pages? or only on a selected few? [12:32:09] not everything in there, and fails badly in some things, but several things work [12:32:20] i can imagine hooking into SpecialAllPages and SpercialSearch to do this [12:32:40] but there's dozens and dozens of other pages, and no generic way to filter them [12:33:04] I don't remember, last time I looked into it was years ago [12:33:05] Nemo_bis: i'm not interested in patch work. i'd go for a generic solution if i heard about one. [12:33:41] well, SimpleSecurity works as advertised apart from some problems [12:33:47] which I think I filed [12:34:03] usually it's overzealous rather than failing [12:36:21] hmm, no [12:36:47] search is the most important, second is RC [12:36:57] and RSS feeds [12:37:00] and whatlinks here [12:37:10] and... everything? [12:37:26] feeds have to be disabled indeed [12:37:41] the rest doesn't really give you access to private stuff [12:38:25] none of it will give you access to content, when lockdown is enabled [12:38:30] but the poages will be listed [12:38:48] how about edit summaries? [12:39:04] visible, iirc [12:39:07] ok [12:39:19] so search doesn't give snippets? [12:41:36] yes, snippets get disabled for pages you don't have access to [12:41:40] same in rss feeds [12:41:50] https://bugzilla.wikimedia.org/show_bug.cgi?id=25228 would be a very nice feature in SS if only it worked :) [12:43:24] good, added to docs [12:43:31] hi manybubbles [12:43:54] DanielK_WMDE: ah, here's the other thing, Lockdown doesn't have per-page "protection" does it [12:45:57] Nemo_bis: no, it's per namespace. per page is based on page content. that's very hard to make secure. [12:46:52] DanielK_WMDE: ok; I have no idea how much we use it anyway [12:47:35] Nemo_bis: i find it very helpful to know the access level of a page simply by looking at the namespace [12:47:41] it prevents mistakes [12:47:53] 50 pages [12:48:04] the main one is the category containing the board deliberations [12:48:15] WMDE has been using lockdown forever, and it works quite well :) [12:48:18] and indeed it seems the board forgot to do the same for last years ^^ [12:48:29] you're cheating ;) [12:48:33] you use three separate wikis [12:48:39] it was there before i got the job [12:48:43] we have everything in a single wiki [12:48:46] ...and i wrote it before i got the job :) [12:48:58] Nemo_bis: true. [12:48:59] :) [12:49:10] you are quite well informed :) [12:49:19] so we have always thought "if WMDE has 2 wikis [now 3], it must be because they can't have a single one" [12:49:35] Germans are mythologically efficient in Italian view [12:50:27] Nemo_bis: this isn't due to efficiency but paranoia :) [12:51:55] Nemo_bis: well, ideally, the office wiki would only be accessible internally (or via vpn). [12:52:01] we never got around to setting that up, though [12:52:10] but that kind of thing requires separate wikis, of course [12:53:15] DanielK_WMDE: ah, didn't know about this supposed requirement [14:53:34] Nemo_bis: hi! [14:53:42] oh wow that was a long time ago [15:31:16] manybubbles: there is a positive response from it.wikt about CirrusSearch, should I file a bug or what? [15:31:50] I think you can make CirrusSearch default there when you want [15:32:00] Nemo_bis: sure! for them? [15:32:20] Nemo_bis: like they don't like their search and want a new one as fast as they can? [15:32:29] yes :) [15:37:44] cool! go ahead and open a bug and I'll talk to chad about it. can you send me their contact information as well? [15:41:40] mutante? [15:42:31] enwiki: Disambiguations got 1000 rows in 4m 8.96s itwiki: Disambiguations got 5000 rows in 1h 42m 23.38s [15:43:26] i suppose the 2 wikis have different configs [15:43:48] but it's probably time to reduce the max rows for itwiki too [15:49:24] manybubbles: filed as https://bugzilla.wikimedia.org/show_bug.cgi?id=53995 [15:49:46] malafaya: I don't see why, we don't reduce them almost for any wiki [15:49:59] (only en.wiki and de.wiki) [15:50:46] Nemo_bis: i'm saying this cause enwiki returns only 1000 rows [15:50:55] and the rationale is really "otherwise everything blows up", not "let's save a few minutes" [15:50:59] Nemo_bis: thanks! [15:51:14] malafaya: I know, so what [15:51:27] i was looking at other wikis and the problem may not be the total rows returned [15:51:34] frwiki: Disambiguations got 5000 rows in 2m 59.69s [15:51:48] why frwiki takes 3 mins and itwikit 104? [15:51:58] "the problem"? there isn't any problem there AFAICS [15:53:29] also, why are you bothering at all? that page is going to die in few days [15:54:00] the problem being "a process taking 104 when it takes 3 in most cases" [15:54:06] that's not a problem [15:54:07] it's going to die? what do you mean? [15:54:14] vanish, disappear, kaput [15:54:25] what page are you refering to? [15:54:34] Special:Disabiguations? [15:54:49] https://www.mediawiki.org/wiki/MediaWiki_1.22#Special:Disambiguations_has_been_removed [15:54:50] malafaya: yeah, it was just removed from core [15:55:04] malafaya: there's a new extension that does this better [15:55:13] better so; "problem" solved then :) [15:56:43] Special:DisambiguationPages now [15:57:10] it's just that something is being "calculated" without even being needed anymore [16:13:52] how comes the job queue is stuck around 2 millions and can't get down? https://ganglia.wikimedia.org/latest/graph_all_periods.php?c=Miscellaneous%20pmtpa&h=hume.wikimedia.org&v=823574&m=Global_JobQueue_length&r=hour&z=default&jr=&js=&st=1365625056&z=large [16:16:13] oic, allhands got a host [16:17:16] nothing obvious in https://ganglia.wikimedia.org/latest/graph_all_periods.php?c=Jobrunners%20eqiad&m=cpu_report&r=hour&s=by%20name&hc=4&mc=2&st=1376083124&g=network_report&z=large or https://gdash.wikimedia.org/dashboards/jobq/ (ganglia frontpage doesn't load for me btw) [16:25:32] Nemo_bis: you mean stuck for months? must be wikidata? [16:26:07] at least that's my first guess [16:27:47] since beginning of August it seems [16:28:14] jeremyb: not months, only weeks :) [16:28:35] did they move wikidata dispatch to job queue already? [16:29:33] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fenari&service=check_job_queue says it's been critical only for 1 day and something but that report is SO untruthful [16:29:41] Nemo_bis: no, months [16:30:07] Nemo_bis: was using the job queue months ago iirc [16:30:29] certainly i remember having conversations about it [16:30:41] maybe hume is not the right place to be looking any more? [16:30:44] jeremyb: before august it went up and down [16:30:55] and before april? [16:30:55] jeremyb: that check is in three different places [16:31:04] before april that graph didn't exist [16:31:19] ok... [16:31:30] still not so sure about hume [16:32:11] https://bugzilla.wikimedia.org/47060 [16:32:27] well, it's not placed there randomly, it was a conscious decision by ops [16:32:45] i don't follow [16:32:51] months of discussion on my patch [16:34:22] welp, i'm running for a bit [16:41:40] there are only 600k or so wikidata "items" to deliver https://bugzilla.wikimedia.org/show_bug.cgi?id=45892#c17 [16:43:46] but there is still a dispatcher cron here, I doubt it's unused https://git.wikimedia.org/blob/operations%2Fpuppet/b8348e5e1818f30d5277f14aa2f2090f909bc727/manifests%2Fmisc%2Fmaintenance.pp#L255 [17:17:53] we need communety approval to add other wikis to the "transwiki" list? [17:18:12] transwiki list? [17:18:23] Reedy: Special:Import [17:18:29] on commons [17:18:32] Oh [17:19:05] Sort of [17:19:36] Reedy: i open a ticket? [17:19:53] *bug [17:19:55] Yeah [17:30:22] https://bugzilla.wikimedia.org/show_bug.cgi?id=54001 done :-) [17:40:37] i wonder when i last talked to gerrit? Warning: Permanently added the RSA host key for IP address '[208.80.154.81]:29418' to the list of known hosts. [17:40:47] jeremyb: new IP came in a few days ago [17:40:47] (before the window obviously) [17:40:54] brion: right :) [17:41:03] you gotta check in more dude :D [17:41:27] grrrr, trackpad acting up [17:41:30] jeremyb: we need communety consensus for adding other wikis to the import list o_O? [17:41:37] Warning: Permanently added the RSA host key for IP address '[208.80.154.81]:29418' to the list of known hosts. [17:41:40] A[A[A[A[A[A[A[A[A[AWarning: Permanently added the RSA host key for IP address '[208.80.154.81]:29418' to the list of known hosts. [17:41:44] Warning: Permanently added the RSA host key for IP address '[208.80.154.81]:29418' to the list of known hosts. [17:41:47] Warning: Permanently added the RSA host key for IP address '[208.80.154.81]:29418' to the list of known hosts. [17:41:50] grrrrr [17:41:52] (that was trackpad) [17:42:27] yea the keys were cpied [17:42:32] but cannot do anything about the IP change [17:43:04] yeah. i just can't believe i didn't log in for so long [17:43:19] jeremyb: ? [17:43:55] Steinsplitter: it can't hurt... you're adding a lot. i'm not saying you *need* it. but that shouldn't stop you from discussing it locally [17:44:47] jeremyb: ar only this tree : *mediawiki [17:44:47] *foundation [17:44:47] *wikidata [17:45:16] ? [17:46:42] you say " you're adding a lot", or only "mediawiki, fondation, and wikidata" ;-) [17:47:41] that's not what your request says [17:47:49] feel free to reread what you wrote :) [17:48:20] jeremyb: i say i can change the request. to only "mediawiki, fondation, and wikidata" [17:48:29] if you wish [17:48:43] i don't really wish that... [17:48:53] i do wish that foundation had a u in it [17:49:07] jeremyb: my english is bad... sorry.... [17:49:29] jeremyb: it doesn't really need consensus... [17:49:31] welp, i think maybe i need a reboot to diagnose trackpad [17:49:45] i thought maybe it was just water on trackpad but idk [17:51:59] does setting first list need consensus? if wiki has no list yet i mean [17:52:44] i hate these abusive votes where i need to poke smb to vote [17:53:02] because otherwise nobody cares [17:54:02] hrmmm, much better trackpad. \o/ [17:56:33] Steinsplitter: anyway, so i'm still unclear. has this been discussed anywhere? [17:56:57] jeremyb: no. we hav only 4 currently [17:57:06] we hav to many RFR on commons this year [17:57:12] i dos not like to start a new [17:58:09] i'm not saying it needs the same threshold as e.g. changing the name of the project. but i was asking if you discussed it with *anyone else* yet [17:58:25] (i'm also doing a patch btw) [17:58:58] jeremyb: no [17:59:08] i can post a notice on AN [18:02:02] ok, here's the current list: [18:02:02] 'commonswiki' => array( 'meta', 'en', 'de', 'b:en' ), [18:02:08] this is a minir change [18:02:10] jepp [18:02:50] *minor [18:18:51] enwiktionary has a massive import sources [18:20:07] as it should [18:20:29] most of the wikts should, so they can steal^reuse content from each other [18:20:52] i'm not complaining... [18:20:53] :P [18:21:16] fr (all projects) does too [18:21:22] I guess I accidentally the W in the ^W there. anyways... [18:21:28] good [18:21:53] I kinda wonder... if we shouldn't just allow import from all by default, on our projects... why wouldn't we? [18:22:18] I mean now we are stuck in 'community must request and approve' but it seems like it oughta be the default [18:23:38] Makes sense [18:23:38] i imagine someone has more institutional knowledge than i [18:23:39] apergos: copyright and content standards are different\ [18:23:44] otherwise no comment :) [18:23:48] Betacommand: ahhhh, good one [18:23:52] ok, wikinews excluded [18:23:56] SA vs. not SA [18:24:06] nothing gets imported and kept straight is though, that's a given [18:24:30] you have to translate, localize, add and tailor content, etc [18:48:49] ^^ O_O [18:49:53] apergos: right now import assumes that usernames are equal across wikis, which may not be the case. also the import source dropdown would need to be redesigned if you stick 700 choices in it :P [18:51:25] it's mostly the case since SUL…. but not 100% :) [18:52:37] yeah, but i guess we'd notice the issue a lot more once you enable import from everywhere to everywhere [18:52:48] * legoktm marks SUL finalization as a blocker :P [18:52:49] but i dos not see a need for cummunety consensus to add moor wikis on commons :-) (it is not abusive) [18:57:06] as long as the community doesn't disagree then it's not abusive :-D [18:57:42] jepp :D [19:02:11] hello [19:02:16] there are some issues ? [19:02:31] you tell me? [19:02:32] there are some issues ?? [19:02:42] wikipedia is slow. [19:02:49] europe here [19:02:53] the SPUR wifi is pretty slow, yeah [19:02:57] (sorry, joking) [19:03:09] wikipedia not load. [19:03:11] right now. [19:03:15] not at all? timeout? [19:03:29] no.. [19:03:46] waiting for response bits.wikimedia.org [19:03:47] which opsen is looking at IRC? [19:03:50] hey [19:03:52] ALL OF THEM [19:03:53] i'm here now [19:03:55] :) [19:04:09] cortexA9: can you give me the results of host en.wikipedia.org ? [19:04:12] and a traceroute ? [19:04:23] ok, battery running out, bbl [19:04:28] also, need to vote! [19:04:30] seems work now. [19:04:33] just got unstyled page on it.wikt, maybe bits has problems [19:04:53] jeremyb: ooo! weiner! [19:04:59] Caches and app servers look normal on ganglia [19:05:06] hey.. [19:05:11] bits.wilimedia.org.. [19:05:14] loading.. [19:05:17] loading a page after account creation took a couple min [19:05:18] another one.. [19:05:48] sometimes it's slow.. [19:05:54] or not loaded.. [19:06:41] cortexA9: Can you do what Leslie asked? [19:06:49] ok [19:06:52] Presumably with Nemo complaining it's esams [19:07:05] i'm assuming, but want to double check [19:07:16] i'm also checking out esams right now in the meantime [19:07:18] http://ganglia.wikimedia.org/latest/?r=hour&cs=&ce=&s=by+name&c=Bits%2520caches%2520esams&tab=m&vn= [19:07:25] There was a decent drop in network out [19:07:43] n.wikipedia.org is an alias for wikipedia-lb.wikimedia.org. [19:07:47] sorry [19:08:00] en.wikipedia.org is an alias for wikipedia-lb.wikimedia.org. [19:08:04] these are weird [19:08:20] wikipedia-lb.wikimedia.org is an alias for wikipedia-lb.esams.wikimedia.org. [19:08:29] Yup, thanks [19:08:40] wikipedia-lb.esams.wikimedia.org has address 91.198.174.225 [19:08:40] again waiting for bits.... [19:08:45] oh it loaded [19:09:28] yes not very fast.. [19:09:34] https://www.mediawiki.org/wiki/Gerrit/git-review is there a way to download fancy .bat that will do everything instead me? [19:09:51] and is it a right way if i want to try to solve bug myself? [19:10:38] well, bits is being consistently slow [19:10:46] sometimes it's also as slow as hell :) [19:10:57] LeslieCarr: you need traceroute ?wikipedia-lb.esams.wikimedia.org has address 91.198.174.225 [19:11:05] LeslieCarr: you need traceroute ? [19:11:06] sorry [19:11:14] traceroute would be useful cortexA9 , though not required [19:11:20] so definitely esams bits [19:12:17] abnormal number of TCP: Peer XXX:55620/80 unexpectedly shrunk window 2729538357:2729552876 on cp3020 [19:12:37] though not like 5 million a second so ... [19:12:45] 8 Tengi2-4.nl.ams.tc2.cr0.port80.se (82.96.1.109) 39.145 ms 40.014 ms 40.831 ms [19:12:52] trace route terminates there for me from home [19:12:56] well when I look at http://ganglia.wikimedia.org/latest/?c=Bits%20caches%20esams&h=cp3019.esams.wikimedia.org&m=cpu_report&r=hour&s=by%20name&hc=4&mc=2 [19:13:17] bytes and packets sent and received looks steady (until it doesn't) but [19:13:32] total processes is going up during that time, not sure what that means [19:14:24] wikipedia is not fast.. what's going on.. [19:15:06] tried it [19:15:24] i mean en.wikipedia.org [19:15:58] cp3020 and cp3021 are occasionally going out of lvs [19:16:21] and not the others? huh [19:16:55] LeslieCarr: what about him? :) [19:17:16] others also, 3022 and 3019 [19:17:31] jeremyb: oh just he's the funniest candidate to vote for [19:18:16] 3020 and 3022 just dropped out right now, for example , i'm pretty sure that is a symptom of the problem rather than the problem [19:18:52] ok seems fast now. [19:19:56] not here :) [19:20:08] eheh [19:20:12] Nemo_bis: sux2bu [19:20:16] LeslieCarr: there's spitzer too. but i'm not in spitzer's part of the city [19:24:11] I suspect it's only some URLs failing [19:24:17] I waited 9 seconds for http://bits.wikimedia.org/static-1.22wmf16/extensions/UniversalLanguageSelector/data/fontrepo/fonts/amiri/amiri-bold.woff?version=1.0.2&20120101 [19:24:39] now I logged in and got redirected to http://wikimediafoundation.org/wiki/Special:CentralLogin/start?token=788338bfaba35727a4f85c7b31534f5d but that's another bug :) [19:25:30] i think it's more of a random happening [19:26:13] oh [19:26:14] another one [19:26:19] bits.wikimedia.org.. [19:26:34] sometimes.. [19:27:01] waiting for it.. [19:27:55] well on the good side, they are no longer depoolingrepooling [19:27:56] now claims to have waited for 16 s for https://login.wikimedia.org/wiki/Special:CentralAutoLogin/checkLoggedIn?wikiid=enwikibooks&proto=https&type=1x1&from=itwikisource [19:28:14] * Nemo_bis is getting increasingly confused [19:28:49] ah that is likely what I was seeing in the graphs (depooling) that is now stable [19:36:12] many seconds.. [19:36:15] to load [19:36:20] main page.. [19:38:01] more and more resourced cached in this incognito window, but no request to bits takes less than 1 s [19:39:37] it's all ok with bits.wikimedia.org ? [19:42:41] 8 s for http://bits.wikimedia.org/it.wiktionary.org/load.php?debug=false&lang=it&modules=ext.centralNotice.bannerController%7Cext.centralauth.centralautologin%7Cext.uls.i18n%2Cime%2Cinit%2Cinterface%2Clanguagenames%2Cpreferences%2Cwebfonts%7Cext.uls.webfonts.repository%7Cjquery.client%2Ccookie%2CdelayedBind%2Ci18n%2CjStorage%2Cjson%2CmwExtension%2Ctipsy%2Culs%2Cwebfonts%7Cjquery.uls.data%2Cgrid%7Cmediawiki.Uri%2Capi%2Ccldr%2CjqueryMsg%2Clangua [19:42:53] and 6 for http://bits.wikimedia.org/static-1.22wmf16/extensions/UniversalLanguageSelector/data/fontrepo/fonts/amiri/amiri-regular.woff?version=1.0.2&20120101 [19:43:03] (after clearing cache) [19:43:03] mmm [19:43:21] ok, this is clearly something I can't help with :) [19:43:27] oh, i'm confused. spitzer is citywide. (his opponent's old office is outside my area so that confused me) [19:44:09] 8 is not high ? [19:45:13] cortexA9: it is high [19:46:57] main page a lot of seconds.. [19:48:50] Is there any chance that the ESAMS region has some network issues? Performance wise? [19:49:10] yes [19:49:12] it didn't look like network issues [19:49:29] well, some sort of issues :) [19:49:39] Well, i guess that explains 20% packet loss while pinging it. [19:50:47] Excirial: only 10 % here :) [19:51:09] Editing the hosts file to force en.wikipedia.org to resolve to the US edition works wonders if you care to try (And run windows :P) [19:52:34] run windows ? [19:52:35] lol [19:52:49] i am on linux [19:55:09] Wonderful OS indeed. But nothing says "quality" like an editable text file that can easily mess up.. pardon me, alter DNS resolution. [19:56:55] :) /etc/hosts [19:57:10] Exactly. :) [19:58:45] Hmm, I seem to have high (10-15%) packet loss too [19:58:59] Let's see what mister mtr has to say [19:59:14] Excirial: just about every OS has a hosts file [19:59:26] multichill: even from inside esams? :) [19:59:33] or knams i guess [19:59:50] xe-1-1-0.cr2-knams.wikimedia.org 20.0% [19:59:54]