[00:34:26] 06Multimedia, 10Analytics, 06Commons, 10Tabular-Data, and 3 others: Allow structured datasets on a central repository (CSV, TSV, JSON, GeoJSON, XML, ...) - https://phabricator.wikimedia.org/T120452#2859028 (10Yurik) 05Open>03Resolved Enabled in https://gerrit.wikimedia.org/r/#/c/326046/ - T148745 I th... [15:06:44] 06Multimedia, 06Commons, 10MediaWiki-File-management: EXIF metadata displayed incorrectly - https://phabricator.wikimedia.org/T152693#2857345 (10matmarex) I suspect this is the same problem as T97253. Screenshot for future reference: {F5016746} [15:13:36] 06Multimedia, 06Commons, 10MediaWiki-File-management: EXIF metadata displayed incorrectly - https://phabricator.wikimedia.org/T152693#2859894 (10matmarex) I reuploaded the file and the metadata now displays correctly. If buggy metadata is a problem for any specific files, you can just reupload them to fix it... [15:13:47] 06Multimedia, 06Commons, 10MediaWiki-File-management: EXIF metadata displayed incorrectly - https://phabricator.wikimedia.org/T152693#2859902 (10matmarex) [15:13:51] 06Multimedia, 06Commons, 10MediaWiki-File-management, 07HHVM, 07Upstream: Exif values retrieved incorrectly if they appear before IFD - https://phabricator.wikimedia.org/T97253#2859900 (10matmarex) [15:16:48] 06Multimedia, 10UploadWizard: Update UploadWizard for recent API error message changes - https://phabricator.wikimedia.org/T152607#2859909 (10matmarex) @matthiasmullie Thanks for taking this. Can I help somehow? [15:23:49] 06Multimedia, 10UploadWizard: Update UploadWizard for recent API error message changes - https://phabricator.wikimedia.org/T152607#2859943 (10matthiasmullie) Not at this point, and it doesn't seem like much (if anything) will be broken - BC is quite good. But I'm sure I can use some help in testing of all kind... [15:24:26] (03PS1) 10Matthias Mullie: [WIP] Simplify error handling [extensions/UploadWizard] - 10https://gerrit.wikimedia.org/r/326134 (https://phabricator.wikimedia.org/T115946) [15:28:09] (03CR) 10jenkins-bot: [V: 04-1] [WIP] Simplify error handling [extensions/UploadWizard] - 10https://gerrit.wikimedia.org/r/326134 (https://phabricator.wikimedia.org/T115946) (owner: 10Matthias Mullie) [15:38:42] 06Multimedia, 10Wikimedia-Site-requests: Run refreshImageMetadata.php --force - https://phabricator.wikimedia.org/T32961#2859974 (10Reedy) For testwiki ``` Finished refreshing file metadata for 4644 files. 1 needed to be refreshed, 4643 did not need to be but were refreshed anyways, and 714 refreshes were sus... [16:55:10] 06Multimedia, 10MediaWiki-API, 10MediaWiki-Uploading: Non transcluded variable in stashfailed error message - https://phabricator.wikimedia.org/T147720#2860057 (10Anomie) I can confirm it now, but it's not an API bug. To reproduce: Make a chunked upload where one of the chunks after the first fails the IE m... [17:03:39] 06Multimedia, 10Wikimedia-Site-requests: Run refreshImageMetadata.php --force - https://phabricator.wikimedia.org/T32961#2860064 (10matmarex) Here are some statistics on the changes. I ran `select img_name, img_metadata as img_metadata from image;` before and after Reedy ran the maintenance, and compared the r... [17:16:37] 06Multimedia, 10Wikimedia-Site-requests: Run refreshImageMetadata.php --force - https://phabricator.wikimedia.org/T32961#2860104 (10matmarex) At least the "Changed" ones are harmless. Some values were previously recorded as rational numbers, as in the EXIF data; now they are stored as floats: ``` Changed: GPS... [18:48:37] 06Multimedia, 10Wikimedia-Site-requests: Run refreshImageMetadata.php --force - https://phabricator.wikimedia.org/T32961#2860324 (10matmarex) I've looked at a couple files in detail, and it looks like the "Removed" values are caused by a PHP bug: https://bugs.php.net/bug.php?id=72682 (the missing data is all a... [21:35:37] 06Multimedia, 10Wikimedia-Site-requests: Run refreshImageMetadata.php --force - https://phabricator.wikimedia.org/T32961#2860669 (10matmarex) Looking at the new changes: Some DateTimes have changed by a few seconds. Looking at the problematic files, they seem to have duplicate DateTime tags, with actually dif... [22:15:20] 06Multimedia, 10Wikimedia-Site-requests: Run refreshImageMetadata.php --force - https://phabricator.wikimedia.org/T32961#2860776 (10matmarex) Right, so I believe we're fine from the correctness perspective. 4644 files is not a huge sample, but testwiki tends to have all the weird files causing problems uploade... [22:26:34] 06Multimedia, 10Wikimedia-Site-requests: Run refreshImageMetadata.php --force - https://phabricator.wikimedia.org/T32961#2860779 (10matmarex) [23:04:52] (03PS1) 10Bartosz DziewoƄski: uw.DescriptionsDetailsWidget: Update styles for spacing between multiple descriptions [extensions/UploadWizard] - 10https://gerrit.wikimedia.org/r/326190 [23:18:25] (03Abandoned) 10Aaron Schulz: Make TimedMediaTransformOutput::$serial logic clearer [extensions/TimedMediaHandler] (REL1_27) - 10https://gerrit.wikimedia.org/r/325825 (owner: 10Aaron Schulz) [23:22:09] 06Multimedia, 06Commons, 10MediaWiki-File-management: File histories won't display more than 10 files on a page - https://phabricator.wikimedia.org/T152813#2860902 (10matmarex) [23:22:25] 06Multimedia, 10Wikimedia-Site-requests: Run refreshImageMetadata.php --force - https://phabricator.wikimedia.org/T32961#345988 (10greg) @jcrespo question for you on this: @matmarex estimates it'll take roughly 2 months to complete. Should we start now-ish or wait until after the new year? I'm on the fence, ho... [23:27:03] 06Multimedia, 10Wikimedia-Site-requests: Run refreshImageMetadata.php --force - https://phabricator.wikimedia.org/T32961#2860921 (10jcrespo) > my estimate for processing 34,000,000 image files on Commons is around two months I (and probably Releng neither) will not allow a single script to run uninterruptedly... [23:42:46] 06Multimedia, 10Wikimedia-Site-requests: Run refreshImageMetadata.php --force - https://phabricator.wikimedia.org/T32961#2860966 (10greg) /me waits for follow-up questions to be resolved :)