[01:17:53] Hello, I am having a little bit of trouble with my Phabricator account. I need to either change my Phabricator username or create a new Phabricator account. I just registered at Wikitech under the LDAP/shell name "nicolesharp" (MediaWiki name [[user:Nicole Sharp]]). There is an old Phabricator account already registered as "NicoleRuizSharp" though, that I would like to either delete or rename as "nicolesharp". [01:18:54] I tried renaming on the old account, but the rename option is ghosted, and I cannot log into Phabricator under "nicolesharp" to create a new account. [01:21:32] Hello. [03:21:59] Lydia_WMDE: ok thanks anyway, i told him i will mail some as i find them [03:42:43] Hey TimStarling, I've been asked if I could mass purge files on Commons again to beat TimedMediaHandler into functioning. Advice? [03:43:48] what sort of purge? [03:44:59] on video files, apparently purge is one way to get the missing 160p/240p/360 to initialize [03:45:34] action=purge [03:46:02] API action=purge without forcelinkupdate or forcerecursivelinkupdate? [03:47:13] Not sure (I was just asked if it was possible). Which is better? [03:47:39] I think index.php action=purge and API action=purge are basically the same [03:47:45] just looking at the code... [03:48:12] so the idea is to purge video thumbnails? [03:48:37] To get new transcodes initialized [03:48:48] Oh. hai. [03:48:54] TimStarling: Ok… [03:49:11] It’s not the ‘thumbnails’, specifically. [03:49:32] does the problem with missing transcodes have a phabricator ticket? [03:49:52] When ‘targets’ have been added, for video transcoding, since the file was uploaded, they don’t get added to the ‘table’. [03:50:09] (the db table, I mean) [03:50:32] The only way I know of to get them to show up is to purge the file pages. [03:50:46] (they are then added as ‘unitialized’) [03:52:10] TimStarling: I don’t think it has a ticket, no…. until all the failed ones got ‘bulk’ reset, it was just something being addressed as the file were reset manually. [03:52:52] (i.e. it was not a big deal, since was actually ‘looking’ at the page, purging it was trivial) [03:53:01] have you got a link to a page where it is broken? [03:53:16] Ummm. sec, I will have to hunt one down. [03:53:35] I'm not really very familiar with TMH [03:54:12] The ‘failed’ list was a pretty good list of them, but somebody reset them all. :P [03:55:09] ok, what is a file where it is fixed? [03:55:16] i.e. it used to be broken? [03:55:35] https://commons.wikimedia.org/wiki/File:GLAM-WIKI_2015_-_10_April_-_Wikidata_intro_for_GLAMS.webm [03:55:50] https://commons.wikimedia.org/wiki/File:Vesna_Vuk_Godina_-_Mo%C4%8D_dru%C5%BEboslovne_imaginacije.webm [03:56:11] https://commons.wikimedia.org/wiki/File:2014-10-23_Zeitzeugen_-_25_Jahre_Berliner_Mauerfall_-_Armin_Schuster.webm [03:56:38] The first two, I had reset the ‘added’ targets, the last I have not. [03:56:56] https://commons.wikimedia.org/wiki/File:GLAM-Wiki_2.0_-_New_Opportunities_for_Growing_GLAM-Wiki_in_the_United_States,_part_1.webm also [03:57:15] by target do you mean a row in the "transcode status" table? [03:57:22] TimStarling: Yes. [03:58:12] Until the pages were purged, the ones that are ‘unknown’, or added about an hour ago, were not in the table. [04:00:00] Here is an example that’s still broken… https://commons.wikimedia.org/wiki/File:Christiane_Amanpour_named_UNESCO_Goodwill_Ambassador_for_Freedom_of_Expression_and_Journalist_Safety.webm [04:00:13] Tho that file seems to have other issues, since the ogg ones failed. [04:00:14] Looking for videos without 160p.webm version I get 57 files [04:00:51] https://commons.wikimedia.org/wiki/File:Archaelogical_site_of_Nimrud_(before_destruction).webm <- also messed up. [04:00:52] so you just want to do action=purge on those 57 files? [04:01:09] I'll do [04:01:24] Umm… there are a lot more than those 57 files with ‘missing targets’, tho. [04:02:16] At least, I’m prety sure there are…. it’s something I’ve seen a ‘lot’. [04:02:57] Oops, just looking at errors [04:03:15] Dunno if there is a sane way to search for videos that have ‘ogg’ and not ‘webm’ at a particular resolution, or vice versa. [04:04:51] For 160p.webm I get 60,200 of 91,246 files [04:05:08] That sounds about right. :/ [04:06:46] My impression is that any time a ‘new’ target resolution was added to the server config, the transcodes were never added to the transcode table. [04:07:04] I think you should file a task, so that we have a place to discuss this, and wait for comments from some relevant people [04:07:25] maybe https://phabricator.wikimedia.org/T104061 is related? [04:07:46] Umm... [04:07:57] That’s kinda actually what Dispenser did... [04:08:36] At least, the ones ‘shown’ as missing, because they were in the table. [04:08:55] The problem ‘here’ is ones that the server doesn’t know are missing. [04:10:08] Dispenser: You should probably comment on that task he linked, actually, since that’s basically what you did by clearing out the ‘failed’ list. [04:11:03] if it's resolved then you can just mark it resolved [04:11:57] https://p.defau.lt/?zoXjkk52Q1p_1TmAw9OGgA Missing 160p.webm transcodes query [04:11:59] Yeah, I think it might be better if ‘he’ does it, since he can describe what he did better. [04:13:13] Dispenser: Umm, in quarry that only returns ‘146’ [04:13:57] Quarry been weird with that table [04:14:19] OK, so create a task, saying what you want to do and why [04:14:23] (Also that's 146 on enwiki) [04:14:31] Ol, lol. [04:15:24] CC brion, thedj, matthiasmullie [04:16:03] Dispenser: Yes, when switched to commonswiki_p, indeed 60,200 [04:17:02] TimStarling: So I can’t just purge 60k pages with the API? :P [04:17:46] I was prepared to let you purge 58 pages, but 60k I think I'll have to defer :) [04:21:58] But I LIKE hitting the API HARD! [04:22:12] Too bad there isn’t (I assume) a way to purge the ‘page’ without rethumbnailing the video. [04:22:48] null edit? [04:23:06] probably not what you're looking for though [04:23:25] I’m unsure if a null edit would do it.. let’s check. [04:24:33] Nope. [04:25:10] https://commons.wikimedia.org/wiki/File:%22Amsterdam_Diamanstad%22_Weeknummer_57-27_-_Open_Beelden_-_44071.ogv <- even a ‘dummy edit’ does not do it. [04:26:24] Oook.... [04:26:34] But rolling back the dummy edit… does. [04:27:11] I closed https://phabricator.wikimedia.org/T104061 [04:27:26] (and tells TMH to requeue all the transcodes on the page, which would be unhelpful) [04:28:35] unhelpful in which it would rerun a lot of transcodes that ‘don’t need to be rerun. [04:30:03] https://commons.wikimedia.org/wiki/File:%22Varen_op_schaal%22_in_het_Scheepsbouwkundig_Proefstation-512056.ogv <- it’s also work noting, I think that a lot of the ones with ‘missing’ transcodes also have ‘extra’ transcodes, at higher resolution that the source file. [04:34:37] > I was prepared to let you purge 58 pages, but 60k I think I'll have to defer :) <-- This is why you just do it and ask for forgiveness later. Permission is overrated. <_< [04:37:16] it's all fun and games until the site goes down [04:38:19] I know the usual response to this is "it's your fault for not physically stopping me from purging 60k pages" [04:39:02] to which the appropriate response to that is blackholing your IP address [04:43:09] TimStarling: I’ve been trying, futilely, to see if I can trick some enwiki admin into trying to block a /0 [04:43:17] heh [04:43:36] Supposedly it doesn’t work, but… lol. [04:44:00] maybe with TitleBlacklist [04:44:16] Blocking a /0 with autoblock enabled would definitely put ya in the stocks. [04:44:25] [[Tech]]; MediaWiki message delivery; /* Developer Wishlist Survey: Vote for Proposals */ new section; https://meta.wikimedia.org/w/index.php?diff=16291217&oldid=16285805&rcid=8940766 [04:44:55] Yvette: Would be the second time for me... [05:03:52] Is there a physical purge button somewhere? This is more "we've given you a technical hack to work around our inability to purge automatically for you." [05:04:14] I'm fully supportive of killing the purge action. [05:04:48] Anyway, you'd probably just end up blocking Wikimedia Labs' IP address. ^_^ [05:07:19] Yvette: in this case I think the point is more how fragile the transcode queue is. [05:07:48] Otherwise would not even need to worry too much. [05:08:01] There was talk of turning every app server into an image scaler server as well. [05:08:09] Not sure if that ever happened. [12:09:28] hello [12:42:00] aaaaaaaaaaua [19:04:31] @seen Karen-WMF [19:04:31] Josve05a: Last time I saw Karen-WMF they were changing the nickname to , but is no longer in channel #wikipedia-en-helpers at 1/5/2017 4:40:01 PM (32d2h24m29s ago) [19:05:26] Fluffernutter can help though [19:14:52] I am here but can't talk right now. You can leave me a pm or email me though [20:23:03] Dispenser: why do I bother [20:23:59] TimStarling: What now? [20:24:26] did you file a task? [20:24:33] nope [20:25:27] did you just run all the purges anyway? [20:25:55] I've run less than a dozen purges [20:26:41] ah, right [20:32:28] I've got to get the kids ready for school [20:32:48] there's a multimedia standup meeting in 2.5 hours, maybe someone relevant will be around [21:02:26] Hey Dispenser [21:02:34] hi [21:02:35] Can you walk me through what's happening? Links? [21:02:49] What is happening? [21:03:09] Dispenser: Something about purging files to trigger transcodes [21:05:00] Revent, You're the one explaining to me that a purge will reinitialize the list of transcode targets right (+160p, +240p, -1080p for 480p source) [21:05:00] Dispenser: I pinged marktraceur about the thing we were talking about yesterday [21:05:13] I'll paste a log... [21:06:37] http://paste.tstarling.com/p/lDPDoS.html [21:09:39] OK, so Dispenser, over how much time are you planning to do this? [21:09:41] no https, Tim? :) [21:09:54] purging a file page won't trigger transcodes, but it should refresh the transcode _state_ [21:10:11] will cause new thumbnails, maybe some other data fetches [21:11:51] marktraceur: I only asked if it was possible. We have 60,000 files. So what can we get away with? [21:12:47] I dunno, man. If we're talking about actually restarting transcodes, 60k files (depending on their size) could be prohibitively bad. [21:13:11] Dispenser: But if brion doesn't think it'll actually cause new transcode jobs, then maybe it's okay. [21:13:27] shouldn't explode, but it will cause some load increase during [21:13:49] (very large files will be slowish to purge) [21:13:59] keep it throttled and i don't expect too much worry :) [21:14:11] 360 purge / hour (6/min), we'd be done in a week [21:15:10] * Dispenser can't believe he's being roped into this [21:15:36] Dispenser: I mean, I was asked about the feasibility, I'm now asking for clarification [21:15:49] Dispenser: I'd say that would be fine, but I'm no opsen [21:17:38] can he monitor the transcode queue size somehow? [21:18:17] maybe this is it https://grafana.wikimedia.org/dashboard/db/job-queue-health?var-jobType=webVideoTranscode&from=now-24h&to=now-5m&panelId=12&fullscreen [21:19:18] not sure why it is nonzero though, it hasn't been below ~70k for months [21:20:36] transcode queue size won't be affected directly by page purging [21:20:41] though people might push the buttons [21:23:25] the whole transcode queue system needs a lot of maintenance love [21:23:54] lots of leaky edges and nobody officially maintains it [21:38:05] so, let Dispenser run it [21:38:15] Its running [21:38:20] if he manages to break the queue, maybe that justifies giving it some love ;) [21:39:30] Can someone more experienced with common.css than me check this out? https://phabricator.wikimedia.org/T157387 [21:40:00] that's odd [21:40:19] James_F: You asked them (https://sv.wikipedia.org/wiki/MediaWiki-diskussion:Common.css#.5Ben.5D_Please_do_not_change_the_site_logo_through_this_page) not to tinker with the logo-code, so they instead pinged me... [21:40:30] hmm, indeed [21:41:28] if I change the zoom to 150% I no longer see it [21:41:43] Same [21:41:47] Failed to load resource: the server responded with a status of 404 () [21:41:57] I think I know what they did… [21:42:21] Feel free to fix ;) [21:42:30] yeah, 150% and 170% hides it for me [21:42:56] I always run Wikipedia in 90% zoom, and Commons and WIkidata at 80% [21:42:58] can't you drag your fellow idiots in the 20th century with a proper theme ? [21:43:04] where is the css logo override? [21:44:30] they must have used a css fallback [21:44:36] not fully understanding it [21:46:24] hmm [21:46:34] maybe not svwiki community fault [21:47:30] Hmm...I got the same issue on enwp, but only for a fraction of a second... [21:47:44] then logo came 'back' [21:48:13] Might just been slow loading.. [21:53:34] Anyway this could be "fixed" on the wiki-side, or wouldone hav to code in Gerrit or stuff...? [21:53:55] (i.e. what can/should I report to the community, since they pinged me about this) [21:54:15] NotASpy: I found your sibling: https://commons.wikimedia.org/wiki/User:Notafly [21:54:28] it's something loaded just after resources/src/mediawiki.skinning/interface.css [21:56:26] found it [21:57:15] Josve05a: You're welcome? ;-) [21:57:47] Platonides: yay [21:57:54] James_F: lol :) [22:12:22] Josve05a: https://gerrit.wikimedia.org/r/#/c/336330/ [22:14:20] YAY [22:14:29] :) [22:38:32] Now, Meeerge :p