[09:29:04] hi, Who would know about indexation of Wikimedia user pages, and user talk pages? [09:29:15] Someone has asked me about this, and I don't know what to say [09:29:25] https://fr.wikisource.org/w/index.php?title=Discussion_utilisateur:Nomen_ad_hoc&diff=7030530&oldid=6132072 [09:29:35] it seems the __NOINDEX__ tag has no effect [09:29:46] where should I ask? [09:29:58] or redirect this user to? [09:31:54] (answered in #-operations) [12:34:25] yannf: in https://meta.wikimedia.org/wiki/User:Nomen_ad_hoc it does have effect. maybe in wikisource.org where the copied userpage is shown it doesn't. [12:34:52] wait wait [12:35:01] you linked to the user talk page. I'm looking at the user page [12:35:35] yannf: it does have effect. in https://fr.wikisource.org/wiki/Discussion_utilisateur:Nomen_ad_hoc there's a noindex meta tag. [12:36:32] and the user page https://fr.wikisource.org/wiki/Utilisateur:Nomen_ad_hoc has a meta canonical tag that points to meta.wikimedia.org, which should also be enough [12:37:03] yannf: what's the problem then? the __NOINDEX__ tag does seem to have the effect I expect [12:37:56] yannf: although wait, it seems like maybe every user page already has noindex implicitly [12:38:42] very likely because user pages in wikimedia projects have laxer control, and even banned users are allowed to edit their own user talk page by default [12:38:47] makes sense to set them to noindex [12:39:17] yannf: so the __NOINDEX__ is probably already the default for that page [13:09:42] Is there any limitations to frequency of logging into Wikipedia? My bot is logging in every minute (don't ask why) and sometimes gets error "Check your login and password" [13:10:11] Yes [13:10:20] mbh: Why does it have to *log in* every minute? [13:10:33] Poorly coded/not keeping session cookies etc :P [13:11:01] it checks recentchanges and runs every minute from cron [13:11:23] yes, I will use cookies later [13:12:00] Hmm, https://www.mediawiki.org/wiki/API:Etiquette does not mention that explicitly [13:12:33] https://www.mediawiki.org/wiki/API:Login explains though [13:13:48] what are these limitations? How many times it can login in what period of time? [13:14:22] OK, I will rewrite it to more rare logging in [14:27:43] Hmmmmmm, successfully logging in every minute should be fine? [14:27:54] It's inefficient, but I don't think it's problematic. [14:28:48] Reedy: What limitation do you think there is? [14:29:24] If someone is using the same username and password and intermittently getting a "Check your login and password" error, that sounds like a bug to me. [14:29:25] " * A helper class for throttling authentication attempts" [14:29:34] Certainly potentially a bad error message, yes [14:29:44] Even if successful, it's still an attempt [14:29:58] What's the limit? [14:30:14] Not sure. It's buried somewhere in authmanager, I think [14:30:28] Hmm, yeah. I was gonna say, I feel like this must be a relatively new feature. [14:30:43] Or misfeature. There shouldn't be throttling on successful logins typically. [14:30:48] Once per minute is not that crazy. [14:31:02] No... But pointless [14:31:21] I mean, it's pretty common with a quick script. [14:31:22] we have throttling on lots of actions, if those are succesful or not usually doens't have too much bearing on the throttling. [14:31:31] thedj: Of course it does. [14:31:34] usually. [14:31:54] $this->throttleSettings = array_intersect_key( $params, [14:31:54] [ 'accountCreationThrottle' => true, 'passwordAttemptThrottle' => true ] ); [14:31:58] Depending on what the script is doing, mbh may not need to log in at all. [14:32:12] " * Limit password attempts to X attempts per Y seconds per IP per account. [14:32:12] " [14:32:13] But I've almost certainly done similar with dumb scripts and cron. [14:32:20] [ 'count' => 5, 'seconds' => 300 ], [14:32:23] [ 'count' => 150, 'seconds' => 60 * 60 * 48 ], [14:32:35] Question here... Is whether successful count [14:32:39] 5 per 300? [14:32:46] Isn't that one per minute? [14:32:46] One every 60 seconds [14:32:48] Yeah. [14:33:00] Do we know the script isn't doing slightly more than 1 per minute? Probably not [14:33:04] so yeah, if you are not on 1/2minutes, you might easily trip that. [14:33:10] Silly. [14:33:15] That's DefaultSettings [14:33:21] I don't think we change it in WMF config [14:33:29] Most wikis don't have throttling support set up, but yeah. [14:33:41] It requires memcached still or something, doesn't it? [14:33:54] Yeah [14:34:26] https://www.mediawiki.org/wiki/API:Login says there should be an explicit Throttled error. [14:34:35] In the result field. [14:35:32] thedj: Or if someone is re-using the same account and is manually logging in. [14:35:41] That would explain the intermittent behavior. [14:36:04] yup [14:37:15] I changed login rate to "one in two minutes", this errors appears also [14:37:36] mbh: Are you capturing the whole response? Can you paste it somewhere? [14:37:56] mbh: Or can you paste the script you're running (without the password)? [14:37:58] this message creates by DotNetWikiBot framework [14:38:32] Unhandled Exception: DotNetWikiBot.WikiBotException: Login failed. Check your username and password. at DotNetWikiBot.Site.LogIn () [0x00287] in <23e3846f9c6342ecb0d00441b535fea5>:0 at DotNetWikiBot.Site.Initialize () [0x00531] in <23e3846f9c6342ecb0d00441b535fea5>:0 at DotNetWikiBot.Site..ctor (System.String address, System.String userName, System.String userPass, System.String userDomain) [0x00081] in <23e3846f9c634 [14:38:55] Yeah, that's not the actual response from the Web server, tho. [14:39:06] I mean, part of it might be, but the actual response should be JSON, I believe. [14:39:13] Or some other serialized language. [14:39:19] yup [14:41:37] it this with action=login ? [14:45:29] instead of clientlogin? I think, it's just login, because of 1) this framework was not updated last 1,5 years; 2) I don't create bot password for bot [14:46:01] i wonder if maybe the xsrf/login token isn't being replagged over the cluster fast enough, so that it doesn't know the token yet when you do the actual login.... [14:47:36] as a bot likely has almost no delay between those two requests, you might easily trigger such a bug in this setup. [14:48:13] again, without having the actual response from the server, it's hard to debug I think. [14:51:57] I think, I will rewrite bot to infinite working with inner sleeps instead of every minute starting from cron, so this problem will not matter [14:52:04] mbh: another reason might be that there is an encoding bug in the framework, which only triggers when certain characters are in the token... [14:52:36] then delay wouldn't matter, it's just 1 in every ... requests. [14:53:11] int tokenPos = respStr.IndexOf("token=\""); [14:53:11] if (tokenPos < 1) [14:53:11] throw new WikiBotException( [14:53:12] "\n\n" + Bot.Msg("Login failed [14:53:58] my god... that framework is... so bad... [14:54:49] what are the more correct ways to get every new edit from recentchanges? My bot reads ORES scores for every edit in ruwiki [14:54:58] it seems to be based originally on screenscraping, and then someone bolted api requests on top, without doing proper parsing... [14:56:37] mbh: use the api. [14:56:44] but don't use shitty frameworks :) [14:57:18] i'm not sure if there other dotnet frameworks wrapping the api... [14:57:47] but honestly, you might be better off writing your own .net interactions with the api. [14:57:49] You could use the IRC feed? [14:58:03] But that wouldn't include ORES scores automatically. [14:58:10] Does ORES have a feed of some kind? [14:58:22] Esther: #wikimedia-ai [14:58:28] Ask there [14:58:29] Hi Zppix. [14:58:35] I will not. [14:59:19] ? [15:01:30] normally i'd say https://wikitech.wikimedia.org/wiki/EventStreams.. but i don't think that includes ores yet either. [15:03:07] Hence is why i said ask in #wikimedia-ai [15:03:50] mbh: -> redirect wikimedia-ai [15:05:16] This channel is fine to discuss in. [15:29:52] Hm I am getting a lot of DB errors while trying to view various log pages on commons. Example I just got on Special:Log/INeverCry : [Wh7R7gpAMFgAAK80EDsAAAAR] 2017-11-29 15:28:42: Fatal exception of type "Wikimedia\Rdbms\DBQueryTimeoutError" [15:31:43] Fluffernutter, on which wiki? [15:31:47] Technical Advice IRC meeting starting in 30 minutes in channel #wikimedia-tech, hosts: @Amir1 & @Thiemo_WMDE - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [15:31:58] andre__: On Commons [15:34:29] Fluffernutter, that one is: "Error: 2062 Read timeout is reached (10.64.0.164:3314)" [15:34:31] likely https://phabricator.wikimedia.org/T169429 [15:35:18] but feel free to file a new task on Phab with tag #Wikimedia-log-errors . Cannot hurt IMHO [15:35:20] huh, I didn't realize ORES was involved in stuff like log viewing. Much technological, very advance! [15:35:31] might not be, according to later comments in that very task [15:36:29] Well, the good news is my third refresh got the page to load, yay! [15:36:44] (now if only I could remember why I was loading it in the first place...) [15:39:43] Welcome to my life :D [15:40:38] Lol [15:41:51] watchlists and recent changes infrastructure really needs some major architectional rework next year i think :/ [16:01:54] Welcome to the Technical Advice IRC Meeting! Your hosts for the next 60 minutes are Thiemo_WMDE and Amir1. I see no questions at https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting so feel free to bring up any tech topic you like. [16:04:02] so, a wiktionary gadget I built for uploading audio recordings started getting "Upload failed: This file did not pass file verification." errors from commons a few months ago. any tips on figuring out where that comes from, or what that is? [16:04:06] As usual we are not going to present anything upfront. ;-) This hour is yours. [16:04:36] YairRand: Do you have a link or the name of that gadget? [16:04:48] if no one has any real questions, i'd like to ask if WMDE folks liked my unsolicited review of AdvancedSearch yesterday ;) (it's pretty cool by the way) [16:05:01] Thiemo_WMDE: wikt:User:Yair_rand/AddAudio.js [16:05:16] YairRand: it would help to know the exact response from the upload API; you might be running into the AbuseFilters for cross-wiki uploads that Commons has set up recently [16:06:13] "code":"stashfailed","info":"This file did not pass file verification." [16:07:26] MatmaRex: We are not in the TCB team (people who did the advanced search) but I can ask them, they are literally in the next room [16:08:16] YairRand: I'm just digging into the MediaWiki code a bit. A failed "file verification" looks like something that happens when an SVG contains script code, or when a file is only partially uploaded, or rejected for an other (security related) reason. [16:09:00] … or a mismatch between MIME type and file extension. [16:10:41] so, the file plays fine on the browser directly, and the upload is handled via mw.ForeignUpload, which wasn't showing any errors of its own... [16:11:41] MatmaRex: I see you uploaded a whole bunch of Gerrit patches for AdvancedSearch. The fact that most are already merged most probably means that the team is super happy about them. :-) [16:11:48] MatmaRex: Hi! [16:12:03] I brought CFisch_WMDE :) [16:12:10] MatmaRex: Super happy indeed :-) [16:12:37] All seemed really help- and useful [16:13:06] also filed you a bunch of bugs [16:13:30] For the last one with the transformation to the OOjs UI button I have to ping back to UX if we want to have that "pressed" effect [16:14:04] CFisch_WMDE: i liked your overrides to the layout of the form, by the way, i think we should steal some of that back into OOUI [16:14:19] MatmaRex: yeah that's really great. That's exactly what beta testing is about. And providing patches even :-) [16:15:09] About the info icon, the only thing we do is letting it float right... the tab order is due to the order in the DOM that's a bit harder to change. [16:15:32] YairRand: I look at https://en.wiktionary.org/wiki/User:Yair_rand/AddAudio.js and wonder. If the upload succeeds, when does the error happen then? [16:15:32] I looked a bit into it today but also have some more pressing things [16:16:10] I don't know if having a config var for the position of the help button is overdone [16:16:40] or if we try to default it to be right of the input box [16:16:51] or "after" in the dom [16:16:55] Is this a good place to ask about the mobile app? [16:17:19] Thiemo_WMDE: it's actually been failing silently, which is quite unfortunate. [16:17:20] Adotchar: Depends what you want to ask. #wikimedia-mobile might be better [16:17:22] Adotchar: You can, we can at least try to point you top the right people or place. :-) [16:17:46] I was wondering if the ability to use Special:Recent Changes on mobile will ever be supported. [16:19:55] coreyfloyd can answer this question I guess [16:20:07] Adotchar: iOS or Android or the mobile skin? https://phabricator.wikimedia.org/T133600 ? [16:20:33] iOS [16:21:03] Yea, thats the ticket then. You can add your vote or a comment on the ticket to bring it back to peoples attention. [16:21:07] Adotchar: we do have history in the app is there a particular feature you are looking for? [16:21:13] Okay thanks! [16:21:30] Oh I was just wanting to do RC patrol on iOS. Thank’s for the link! [16:22:00] So the history is not great for patrolling but it works [16:22:11] YairRand: I would check if there is something wrong with the MIME types your browser creates vs. the ones mentioned in your code vs. the ones Commons expects. Other than that, I'm out of ideas. [16:22:49] But we want to make it better for mobile patrolling… so please file a ticket for recent changes [16:23:16] Adotchar: ^ and tag iOS and Android [16:23:48] coreyfloyd: I think T133600 already exists. [16:23:48] T133600: Special:RecentChanges not working on iOS mobile app - https://phabricator.wikimedia.org/T133600 [16:23:57] Thiemo_WMDE: thanks, I'll try and look into that [16:47:17] Can anyone point me to where the source code for WikiSource would be? [16:47:56] Do you mean https://en.wikisource.org/wiki/Main_Page ? [16:49:16] https://en.wikisource.org/wiki/Special:Version is always a good start to see which exact code is running in a MediaWiki installation. If you follow the links you will also find the source code. [16:49:48] yes thats exactly what I was looking for, thanks [16:57:39] @mlock [16:58:48] Thiemo_WMDE: looks like the mime type was in fact the issue. not sure why it wasn't making any fuss a few months ago... maybe the browsers changed how they handle recordings... [16:59:29] now I just need to figure out why mw.ForeignUpload seems to be uploading only to the stash, and why commons is saying something about "embedded data" [16:59:52] "Unidentified type (application/octet-stream, data)" [16:59:55] Progress! ;-) [17:00:03] progress indeed :) [17:00:26] octet-stream is just some arbitrary binary data. It basically means "no MIME type". [17:01:16] ...oh [17:01:22] well, that's not a good sign [17:02:44] Thiemo_WMDE: thanks [17:06:19] Our hosted 60 minutes are over. Thanks for the good questions! [17:08:09] cheers :)