[02:16:47] !log LocalisationUpdate completed (1.19) at Mon Apr 2 02:16:47 UTC 2012 [02:16:52] Logged the message, Master [04:11:31] Are your image servers just recovered? [15:32:08] can I use wikimedia's etherpad to do some wiki content coordiation? [15:32:15] *coordination [15:34:26] Sure [15:34:32] Just don't assume the Etherpad will live forever [15:34:40] Copy the data to a wiki page when you're done [15:36:15] RoanKattouw: can I expect it there for one day or one week or what? [15:36:40] In practice it does stick around forever, currently [15:36:48] But we don't want people to rely on it too much [16:46:51] !log preilly synchronized php-1.19/extensions/ZeroRatedMobileAccess/ZeroRatedMobileAccess.body.php 'changes for zero needed for carrier testing header of landing page only for mswiki' [16:46:53] Logged the message, Master [17:15:35] !log preilly synchronized php-1.19/extensions/ZeroRatedMobileAccess/ZeroRatedMobileAccess.body.php 'changes for zero needed for carrier testing header of landing page only for mswiki' [17:15:37] Logged the message, Master [17:15:48] !log carrier testing push for DIGI [17:15:49] Logged the message, Master [17:19:45] preilly: hmm? [17:20:20] Nikerabbit: DIGI is a wireless carrier that is testing a feature for zero [17:20:37] kay [17:34:49] apergos, you here? [17:34:59] υεαη [17:35:01] yeah [17:35:05] off the clock but here [17:35:08] whazzup? [17:35:25] apergos, looks like IA wants to set up a rsync mirror of image dumps [17:35:31] if I understand correctly [17:35:40] or a mirror of some sort at least [17:35:41] I don't se that [17:35:53] see [17:36:11] well, I'm investigating and I'll let you know [17:36:19] ok, but [17:36:23] I'm in touch with them directly [17:36:35] if they want something like that they could [17:36:41] email me right this second [17:37:00] and I have heard nothing whatsoever [17:37:20] where did you hear this from? [17:37:31] apergos, an IA intern [17:37:52] who was authorized by the collection manager to do... I don't know exactly what [17:37:54] Nemo_bis: what's IA? [17:37:58] archive.org [17:38:02] oh [17:38:37] apergos, the point is probably that they don't want to do it themselves with their staff, just like you're too busy for this part of the mirroring job [17:38:47] but they might let volunteers do it [17:39:09] what's the name of the intern? [17:40:13] !log nikerabbit synchronized php-1.19/languages/Names.php 'I18ndeploy r114656' [17:40:15] Logged the message, Master [17:40:27] I'm gonna leave an im for someone over there which they will see when they come on, but it helps to have a name of the ersn interested [17:41:26] Nemo_bis: [17:41:30] *person [17:45:26] !log nikerabbit synchronized wmf-config/InitialiseSettings.php 'Bug 35328 - Enable WebFonts for fr.wikisource.org' [17:45:27] Logged the message, Master [17:47:08] !log preilly synchronized wmf-config/InitialiseSettings.php 'add disable images option for default on zero domain' [17:47:09] Logged the message, Master [17:47:53] Nemo_bis: ? [17:50:33] apergos, ehm, I'm not sure I even remember the name, only the username; let me pm [17:50:51] ok [17:54:36] !log nikerabbit synchronized wmf-config/InitialiseSettings.php '35436 - Enable Narayam at Hindi Wikipedia' [17:54:37] Logged the message, Master [18:24:50] So far image compression is going well at Wikia: [18:24:53] +---------------------+-------------------+-----------------+----------------------------+ [18:24:53] | timestamp | numImagesLookedAt | gigabytes_saved | average_percent_compressed | [18:24:53] +---------------------+-------------------+-----------------+----------------------------+ [18:24:53] | 2012-04-02 18:23:36 | 370773 | 7.4166 | 13.5233 | [18:24:53] +---------------------+-------------------+-----------------+----------------------------+ [18:25:13] (sorry for wideness). Anywho... more than happy to share our system w/the Foundation if there's interest [18:29:20] Sean_Colombo: How do you compress the images? [18:30:47] DaBPunkt: the best-case between OptiPNG and pngcrush for PNGs and best-case between jpegoptim and jpegtran for jpegs. [18:31:10] then we verify their losslessness with ImageMagick's "compress" and update the file-size on the mediawiki image table. [18:34:32] sounds interresting (but I am not from the wmf) [18:35:08] Sean_Colombo: can you email wikitech-l ? [18:49:47] if you crush a png, does it hurt the png? [18:49:52] do png have feelings? :p [18:50:06] ToAruShiroiNeko: I will ask next time ;) [18:50:31] ToAruShiroiNeko: beware of PNG rights activists [18:52:49] don't report me! [18:52:58] ^^; [20:20:41] * schoolcraftT slaps Laaknor a few times [20:47:43] hello [20:47:59] had to file a ticket for database dump of s6 [20:48:11] https://rt.wikimedia.org/Ticket/Display.html?id=2754& [21:51:19] apergos: it's alex buie from the archive [21:51:22] jfyi [21:51:24] :) [22:16:54] Hi. What characters are allowed in uploaded file names? I've been searching but can't find anything on that topic. [22:26:00] gn8 folks [22:26:36] nois0x: I think the ppl in #mediawiki are more likely to know [23:05:52] !log awjrichards synchronizing Wikimedia installation... : Deploying MobileFrontend changes at r114671 per http://www.mediawiki.org/wiki/Extension:MobileFrontend/Deployments#2_April.2C_2012 [23:05:54] Logged the message, Master [23:14:09] Can somebody explain to me what enwiki-20120307-imagelinks.sql.gz contains? It's available on http://dumps.wikimedia.org/enwiki/20120307/ and its title is just "Wiki media/files usage records". Does it contain all the uploaded files actually used on the English Wikipedia, both residing locally and on Commons? [23:14:56] i'm seeing this for a lot of hosts during scap: [23:14:57] srv285: rsync: write failed on "/usr/local/apache/common-local/php-1.19/cache/l10n/l10n_cache-ab.cdb": No space left on device (28) [23:14:57] srv285: rsync error: error in file IO (code 11) at receiver.c(302) [receiver=3.0.7] [23:14:57] srv285: rsync: connection unexpectedly closed (2051 bytes received so far) [generator] [23:14:57] srv285: rsync error: error in rsync protocol data stream (code 12) at io.c(601) [generator=3.0.7] [23:15:24] awjr: rsync has run out of disk space. [23:15:56] nois0x: well it definitely won't contain the images. I would guess it is a list of what pages link to or use each image. [23:16:01] nois0x indeed [23:16:09] hence my concern :) [23:16:36] Prodego: I took a look at it and it has rows like [23:16:38] ,(1942,'Tam.a330-200.pt-mvl.arp.jpg'),(1942,'Tran12G7.jpg'),(1942,'Virgin_atlantic_a340-600_g-vyou_arp.jpg'),(1942,'World-airline-routemap-2009.png'),(1943,'Ambox_content.png'),(1943,'Australian_Coat_of_Arms.png'),(1943,'Commons-logo.svg'),(1943,'DemsBannerGold.jpg'),(1943,'DonChipp-1977.jpg'),(1943,'HainesChipp.jpg'),(1943,'LynAllison.jpg'),(1943,'Natasha-Stott-Despoja.jpg'),(1943,'SandraKanckTreeRally.jpg'), [23:16:42] I'm not sure what the numbers mean. [23:16:47] sync done. [23:18:07] Prodego: I misspoke, what I mean to say is, does it contain all the file *names* of all uploaded files which are actually being used? [23:18:24] because that's what I'm looking for right now. [23:18:30] but I'm not sure if that's it. [23:19:07] well you know, I'm not sure now [23:19:28] the description is pretty sparse :) any place I could ask? [23:21:02] uh, never mind, found it: http://www.mediawiki.org/wiki/Manual:Imagelinks_table [23:21:08] nois0x: yea [23:21:15] the number is the pageid of the page using that image [23:21:46] !log awjrichards synchronized wmf-config/CommonSettings.php 'Bumping MobileFrontend resource version number' [23:21:48] Logged the message, Master [23:21:54] so it looks like that is what you want [23:22:02] yea, great. thanks :) [23:22:13] I guess we could deploy to /a instead... [23:23:31] funny that the site's not down [23:23:40] I wonder why that happens [23:26:29] http://ganglia.wikimedia.org/latest/graph.php?r=day&z=xlarge&c=Application+servers+pmtpa&h=mw27.pmtpa.wmnet&v=99.3&m=part_max_used&jr=&js=&vl=%25&ti=Maximum+Disk+Space+Used [23:27:01] did someone run a scap around 20:30? [23:27:27] guess not [23:28:06] ah, 1.9GB /var/log, that couldn't help matters [23:30:45] TimStarling: oh see my update ? [23:30:51] do you see the huge number of php errors ? [23:30:55] that's why /var/log is so huge [23:31:08] maybe caused by a failed scap [23:31:12] Apr 2 20:32:30 mw27 apache2[26676]: PHP Warning: readdir() expects parameter 1 to be resource, boolean given in /usr/local/apache/common-local/php-1.19/extensions/ConfirmEdit/FancyCaptcha.class.php on line 100 [23:31:47] we could update our logrotate to a size based threshold there ? or maybe just specifically for messages and syslog ? [23:32:07] !log awjrichards synchronized php/extensions/MobileFrontend/templates/ApplicationTemplate.php 'r114673' [23:32:09] Logged the message, Master [23:32:36] heh, awjr just keeps pushing things out as if it's going to make a difference [23:32:54] I'll run logrotate -f on all of them for now [23:33:04] heh ok i'll stop [23:34:12] looks like some 20 of the application servers are impacted (all out os space) [23:34:15] !log on all apaches: running logrotate -f and deleting the resulting backup syslog files, to free up disk space [23:34:17] Logged the message, Master [23:36:39] running scap now [23:37:05] !log tstarling synchronizing Wikimedia installation... : [23:37:07] Logged the message, Master [23:40:53] sync done. [23:43:15] LeslieCarr: logrotate is currently in cron.daily, and it rotates the syslogs daily already [23:44:14] ah, but /var/log/messages is rotated weekly, interesting [23:44:52] also, stupid amount of php errors [23:46:06] on mw27 the log files were the same size and /var/log/syslog went back to 07:52 [23:46:22] i.e. messages and syslog were the same size [23:46:26] so maybe someone cleared them already [23:48:59] > var_dump(readdir(false)) [23:48:59] PHP Warning: readdir() expects parameter 1 to be resource, boolean given in /home/wikipedia/common/php-1.19/maintenance/eval.php(72) : eval()'d code on line 1 [23:48:59] Warning: readdir() expects parameter 1 to be resource, boolean given in /home/wikipedia/common/php-1.19/maintenance/eval.php(72) : eval()'d code on line 1 [23:48:59] NULL [23:49:07] it's an infinite loop [23:51:26] !log tstarling synchronized php-1.19/extensions/ConfirmEdit/FancyCaptcha.class.php [23:51:27] Logged the message, Master [23:53:02] # /home/wikipedia/bin/apache-restart-all-hard [23:53:02] /home/wikipedia/bin/apache-restart-all-hard: line 11: /home/wikipedia/common/apachelist: No such file or directory [23:53:06] sad [23:54:07] * TimStarling fixes [23:54:23] !log restarting all apaches with apache-restart-all-hard [23:54:26] Logged the message, Master