[00:16:25] PROBLEM - MySQL Slave Running on db12 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [00:16:43] PROBLEM - MySQL Recent Restart on db12 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [00:17:10] PROBLEM - MySQL Idle Transactions on db12 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [00:17:46] RECOVERY - MySQL Slave Running on db12 is OK: OK replication Slave_IO_Running: Yes Slave_SQL_Running: Yes Last_Error: [00:17:55] RECOVERY - MySQL Recent Restart on db12 is OK: OK 5796904 seconds since restart [00:18:31] RECOVERY - MySQL Idle Transactions on db12 is OK: OK longest blocking idle transaction sleeps for 0 seconds [00:30:31] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:32:46] RECOVERY - MySQL Slave Delay on db12 is OK: OK replication delay 0 seconds [00:33:04] RECOVERY - MySQL Replication Heartbeat on db12 is OK: OK replication delay 0 seconds [00:33:31] PROBLEM - Puppet freshness on srv281 is CRITICAL: Puppet has not run in the last 10 hours [00:40:25] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 7.332 seconds [00:45:22] PROBLEM - MySQL Slave Delay on db12 is CRITICAL: CRIT replication delay 201 seconds [00:45:49] PROBLEM - MySQL Replication Heartbeat on db12 is CRITICAL: CRIT replication delay 225 seconds [00:52:09] RECOVERY - MySQL Replication Heartbeat on db12 is OK: OK replication delay 30 seconds [00:52:36] RECOVERY - MySQL Slave Delay on db12 is OK: OK replication delay 0 seconds [00:56:27] New patchset: Tim Starling; "Disabled AFT due to db12 overload from ArticleFeedbackv5Hooks::contributionsData() queries" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/16939 [00:57:19] New review: Tim Starling; "Already live." [operations/mediawiki-config] (master); V: 1 C: 2; - https://gerrit.wikimedia.org/r/16939 [00:57:20] Change merged: Tim Starling; [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/16939 [01:00:41] New patchset: Alex Monk; "(bug 38806) Enable FlaggedRevs on eswikibooks." [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/16941 [01:13:54] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:18:15] PROBLEM - Puppet freshness on neon is CRITICAL: Puppet has not run in the last 10 hours [01:25:27] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 5.508 seconds [01:42:15] PROBLEM - Puppet freshness on ocg3 is CRITICAL: Puppet has not run in the last 10 hours [01:42:24] PROBLEM - MySQL Slave Delay on db1025 is CRITICAL: CRIT replication delay 278 seconds [01:42:33] PROBLEM - MySQL Slave Delay on storage3 is CRITICAL: CRIT replication delay 281 seconds [01:49:09] PROBLEM - Misc_Db_Lag on storage3 is CRITICAL: CHECK MySQL REPLICATION - lag - CRITICAL - Seconds_Behind_Master : 677s [01:52:27] RECOVERY - MySQL Slave Delay on db1025 is OK: OK replication delay 5 seconds [01:53:21] RECOVERY - Misc_Db_Lag on storage3 is OK: CHECK MySQL REPLICATION - lag - OK - Seconds_Behind_Master : 3s [01:53:48] RECOVERY - MySQL Slave Delay on storage3 is OK: OK replication delay 12 seconds [01:59:03] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:10:18] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.779 seconds [04:13:26] PROBLEM - Puppet freshness on db63 is CRITICAL: Puppet has not run in the last 10 hours [04:53:13] PROBLEM - Puppet freshness on ms-be10 is CRITICAL: Puppet has not run in the last 10 hours [05:59:01] any ops around? [05:59:08] * jeremyb needs help on labsconsole [06:03:12] https://www.mediawiki.org/wiki/Developer_access#User:Madman is a straightforward request, no prior SVN account. but needs ops to create to edit through titleblacklist [06:03:23] https://labsconsole.wikimedia.org/wiki/MediaWiki:Titleblacklist [06:03:28] * jeremyb sleeps [06:19:05] I was around but not watching here, sorry... [06:19:20] and now I have the same question: any ops around that want to review a dns change? [06:19:37] /tmp/dns.diff-atg on sockpuppet, adding ms10 [06:24:28] PROBLEM - udp2log log age for aft on emery is CRITICAL: CRITICAL: log files /var/log/aft/clicktracking.log, have not been written in a critical amount of time. For most logs, this is 4 hours. For slow logs, this is 4 days. [06:27:10] RECOVERY - udp2log log age for aft on emery is OK: OK: all log files active [07:40:28] !log gallium/jenkins: updating Android SDKs [07:40:38] Logged the message, Master [07:55:33] New patchset: Hashar; "structure for WLMMobile nightly builds" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/16948 [07:56:10] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/16948 [07:57:23] apergos: would you mind submitting they easy https://gerrit.wikimedia.org/r/16948 please ? :-D [07:57:32] some simple files copy around for the gallium host [07:57:51] PROBLEM - Puppet freshness on mw60 is CRITICAL: Puppet has not run in the last 10 hours [07:57:54] would be nice to have it merged in sock puppet, but you can skip the manual puppet run on the gallium host (where the class is applied) [07:59:54] why are there directories with 644 permissions? [08:00:57] hashar: [08:01:20] ohh there is the recurse => true flag [08:01:27] so all files would be 0644 [08:01:37] and puppet automatically add the +x flag on directories [08:01:50] so that is merely to avoid having +x on regular files [08:02:00] ok [08:02:35] it automatically adds -x for owner/group/all? [08:02:44] I think so yes [08:02:51] ok then [08:03:07] Change merged: ArielGlenn; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/16948 [08:04:23] apergos: I can't find the reference in puppet doc :/ [08:04:34] ok well you'll fix it later if it's wrong :-P [08:04:48] well I just copy pasted from the previous block [08:04:51] you should do your test run on gallium now [08:04:52] so that must be correct :-] [08:04:58] yeah I figured you copy pasted it [08:05:09] however the next step of your logic.. meh :-D [08:05:25] thanks! will wait for puppet to kick in :-) [08:05:30] ok [08:05:41] thanks! [08:05:47] yw [08:06:59] hashar, did you see the duplicate /mnt/thumbs puppet rule in labs? [08:07:10] Platonides: yup [08:07:21] Platonides: would fix that today hopefully [08:07:40] I have just seen the mail, not really read it nor started to investigate it [08:10:42] Platonides: I am more worried about the wikimedia-task-appserver attempting to delete /mnt/upload6 ;-) [08:11:19] !log gallium/jenkins: deployed job for the WLMMobile nightly builds [08:11:27] Logged the message, Master [08:11:28] not just attempting, it was gone [08:11:52] I guess that it owns /mnt/upload6/common [08:12:11] then on removing, it deleted that file with its parent now-empty "folder" [08:12:57] I don't know why it would consider wikimedia-task-server as unneeded [08:13:11] although with a corrupted disk, who knows [08:13:18] lets move to -labs :-] [08:13:27] I was told that it happened continuosuly on production, though ! [09:33:32] New patchset: Hashar; "captcha generation packages" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/16952 [09:34:12] New patchset: Hashar; "document bastion has captcha related tools" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/16953 [09:34:48] New patchset: Hashar; "new role::bastion::*" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/16954 [09:35:25] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/16952 [09:35:25] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/16953 [09:35:25] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/16954 [10:19:51] New patchset: Hashar; "`rake` on contint host gallium" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/16957 [10:20:29] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/16957 [10:34:11] PROBLEM - Puppet freshness on srv281 is CRITICAL: Puppet has not run in the last 10 hours [10:51:44] PROBLEM - check_job_queue on neon is CRITICAL: JOBQUEUE CRITICAL - the following wikis have more than 9,999 jobs: , zhwiki (23548) [10:53:50] PROBLEM - check_job_queue on spence is CRITICAL: JOBQUEUE CRITICAL - the following wikis have more than 9,999 jobs: , zhwiki (23560) [11:18:44] PROBLEM - Puppet freshness on neon is CRITICAL: Puppet has not run in the last 10 hours [11:42:44] PROBLEM - Puppet freshness on ocg3 is CRITICAL: Puppet has not run in the last 10 hours [11:55:57] it's quiet today [11:56:13] because everything died on weekend [11:56:16] :D [11:59:52] nah, two minor incidents [11:59:57] that's fine :) [12:02:38] I think labs died a bit because of puppet [12:02:53] see !logs from weekend :P [12:03:16] actually new instances didn't work [12:04:51] ldap died I think [12:04:52] that's about it [12:29:22] paravoid: care to double check a small dns change? (just cause someone shoudl always double check 'em), see /tmp/dns.diff-atg o sockpuppet if you do [12:29:48] sec [12:30:13] it's fine, go ahead [12:30:17] trivial enough :) [12:31:18] yup [12:31:19] thanks [12:42:21] New patchset: ArielGlenn; "add ms10 to dhcp" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/16962 [12:42:58] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/16962 [13:05:01] Change merged: ArielGlenn; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/16962 [13:17:36] mark: around? [13:17:58] he's having some computer trouble :) [13:18:00] can I help? [13:19:14] i guess not, since you are not visiting datacenter, are you? [13:19:37] I am not [13:21:06] not having trouble [13:21:12] just installing new mountain lion [13:22:11] ah, I thought your reinstall was related with the trouble you were facing the other day [13:22:25] it has been a bit unstable lately yeah [13:22:28] perhaps this install will fix that [13:22:34] mark: do you have any idea when is your next visit to datacenter? [13:22:40] why do you care? [13:23:21] been told some restart is needed on which some reinstall i am impatiently looking forward is depending [13:24:10] wolfsbane? [13:25:41] fuck you libvirt. [13:26:46] or s/libvirt/openstack/ [13:28:22] mark: yup mgmt console [13:30:24] might be this week, might be next week [13:31:59] awesome [13:32:26] paravoid: http://mysql-dba-journey.blogspot.com/2012/07/vmware-vm-default-platform-for-mysql.html ;-) [13:32:49] wtf? [13:33:17] "A key best practice for MySQL is putting it in a VMware VM. Every new MySQL database should be created in a VMware VM." [13:33:20] srsly? [13:33:34] "A VMware VM will take MySQL to new levels of stability, agility, availability and enterprise functionality." [13:33:57] * mark checks the date [13:34:00] people selling off their souls [13:34:23] mark: can I get two machines to install VMware and move all of our dbs there? [13:34:41] we'll have new levels of stability agility availability [13:34:46] AND WE'LL BE ENTERPRISE! [13:36:00] tbh, I'd love to have live migrations with only 2% impact [13:41:05] but will we be webscale? [13:53:37] so what's this "you need 1mb reserved for the boot loader" stuff? [13:53:46] I don't recall seeing this from ubuntu before [13:53:52] (I'm in the partitioner) [13:56:14] I'm not sure what exactly are you referring to, but the initial 1mb reserved is fairly common nowadays [13:56:36] well I am seeing a big fait warnign from the precise installer [13:56:38] it's for alignment with 4K sector disks [13:56:44] do I need to do something about it or can I ignore it? [13:57:04] what does it say? [13:57:25] The partition table format in use on your disks normally requires you to create a separate partition for boot loader code. This partition should be marked for use as a "Reserved BIOS boot area" and should be at least 1 MB in size. Note that this is not the same as a partition mounted on /boot. [13:57:43] If you do not go back to the partitioning menu and correct this error, boot loader installation may fail later, although it may still be possible to install the boot loader to a partition [13:57:45] oh crap [13:57:47] that's EFI [13:57:54] which is what I figured [13:57:59] has no one done a precise install yet? [13:58:05] I thought there had been some [13:58:08] I have and got no such warning [13:58:13] "Go back to the menu and correct this problem?" [13:58:17] so... ? [13:58:26] maybe this is on a newer machine that has EFI while the others didn't? [13:58:29] I have no idea [13:58:44] r510, 3 md1200s and an internal perc h700 with 12 3t disks as well [13:58:44] I have only once messed with EFI and then ran in horror [13:59:08] I have it on my mac, well I did until I wiped it to put macos on it, stupid juniper :-P [13:59:22] it was painful enoough that I dded a copy of the image so I will never have to do it again [13:59:42] I suppose if it failes I can just reinstall, whatever [14:01:02] bah, I guess I didn't set up the logical volumes. oh well that can be later [14:01:10] if it boots :-P [14:12:26] New patchset: Matthias Mullie; "Re-enabled AFT after fixing the db overload issue - https://gerrit.wikimedia.org/r/#/c/16966/" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/16967 [14:14:30] PROBLEM - Puppet freshness on db63 is CRITICAL: Puppet has not run in the last 10 hours [14:15:14] New patchset: Alex Monk; "(bug 38245) Change upload link to Wikipedia:Upload on aswiki." [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/16968 [14:20:22] New review: Matthias Mullie; "Do not submit before https://gerrit.wikimedia.org/r/#/c/16966/ is approved" [operations/mediawiki-config] (master); V: 0 C: -2; - https://gerrit.wikimedia.org/r/16967 [14:42:00] hmm, https:// on wikitech.wikimedia.org is br0ken, "The site's security certificate is not trusted! [14:42:00] " - is it because it's self-signed? [14:42:12] Yeah [14:42:23] Needs it's own ssl certificate, can't use the *.wikimedia cert there [14:42:56] I don't think it really matter there [14:43:11] self signed is fine, or not? :P [14:43:18] indeed [14:43:26] It's not meant for the general public ;) [14:43:39] yeah I only noticed it because I started using https everywhere [14:43:52] and hey, hopefully we'll be killing it off soon anyways :P [14:44:18] I get it via http with httpseverywhere enabled [14:46:26] <^demon> wikitech is still going to exist as a r/o mirror of labsconsole--offsite matters :) [14:50:25] good morning east coast [14:50:40] * jeremyb still needs ops [14:50:53] apergos: want another DNS change? [14:51:26] and, also unrelated: 30 05:59:08 * jeremyb needs help on labsconsole [14:51:29] 30 06:03:12 < jeremyb> https://www.mediawiki.org/wiki/Developer_access#User:Madman is a straightforward request, no prior SVN account. but needs ops to create to edit through titleblacklist [14:51:33] 30 06:03:23 < jeremyb> https://labsconsole.wikimedia.org/wiki/MediaWiki:Titleblacklist [14:54:33] PROBLEM - Puppet freshness on ms-be10 is CRITICAL: Puppet has not run in the last 10 hours [14:55:59] New patchset: Hashar; "new role::bastion::*" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/16954 [14:56:36] New review: Hashar; "Patchset 2 fix issues reported by Nikerabbit" [operations/puppet] (production) C: 0; - https://gerrit.wikimedia.org/r/16954 [14:56:36] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/16954 [14:58:46] jeremyb: trolololol [14:58:46] The user name "Madman" has been banned from creation. It matches the following blacklist entry: .*man.* [14:59:22] Reedy enwiki? [14:59:26] labsconsole [14:59:29] aha [14:59:34] why? :D [15:05:39] hah [15:05:45] they should ban .*a.* [15:06:22] Reedy: i said labs ;) [15:06:31] errr [15:06:37] Reedy: i said *ops* ;) [15:06:46] Why does ops need to do it? [15:06:54] I've got create user rights [15:06:56] Reedy: because they are the only sysops on that wiki [15:07:06] Reedy: so they can edit through blacklist [15:07:10] Oh [15:07:24] you want ops to do what exactly? [15:07:26] unless someone else can that i don't know about [15:07:35] paravoid: create a labs account please [15:08:16] why do we have that blacklist? [15:08:32] so users don't get created with local system usernames [15:09:03] ('man' did exist as a user on the instance I checked) [15:09:37] that's "man", not ".*man.*" though? [15:09:56] idk how titleblacklist works. [15:10:07] me neither :) [15:10:37] anyway, there's a fair number of existing, legit accounts for real humans (not services) that end in man. so it should be fine [15:10:48] New patchset: Hashar; "Overhauling gerrit manifest to be a role class" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/13484 [15:10:58] (just `getent passwd` on labs and search for man) [15:11:24] New review: Hashar; "PS6: cleaned few whitespaces, added some comments. Will rebase next." [operations/puppet] (production) C: 0; - https://gerrit.wikimedia.org/r/13484 [15:11:24] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/13484 [15:12:33] * jeremyb also has an RT waiting for DNS. not urgent but also trivial ;) [15:13:42] good morning rob [15:17:44] jeremyb: which one? [15:18:19] paravoid: erm? RT? [15:18:33] would be nice if there were some method for me to find out the # [15:22:30] New patchset: Hashar; "Overhauling gerrit manifest to be a role class" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/13484 [15:22:33] RT: > subject: create wikimania2013.m.wikimedia.org as a CNAME for m.wikimedia.org. [15:23:09] New review: Hashar; "Restore the Gerrit manifest and rebase to latest production branch." [operations/puppet] (production) C: 0; - https://gerrit.wikimedia.org/r/13484 [15:23:09] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/13484 [15:24:02] jeremyb: There's quite a lot more of those needed [15:24:13] multichill logged a bug about it last night [15:24:18] Reedy: this is the one the localteam complained about [15:24:29] https://bugzilla.wikimedia.org/show_bug.cgi?id=38799 [15:24:34] *click* [15:24:37] A lot of the *.wikimedia wikis are missing it [15:28:52] damnit, i forgot the interwiki prefix ;( [15:28:57] * jeremyb is half asleep ? [15:29:10] (on that bug) [15:33:55] jeremyb: I presume you meant #3343 re: wikimania2013.m; check your mail :) [15:35:12] paravoid: great. i don't know what the appropriate response is in greek ;-( [15:35:15] New patchset: Hashar; "cron to clear gerrit logs" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/16971 [15:35:48] ^demon: can you review https://gerrit.wikimedia.org/r/16971 ? I extracted your log cleanup cronjob from the role class. I believe we want it applied right now :-) [15:35:53] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/16971 [15:36:23] * jeremyb remembers the time apergos and others spent a while reading https://en.wikipedia.org/wiki/Greek_to_me#In_other_languages [15:36:31] paravoid: and the labs account? [15:37:34] let me ask Ryan about the .*man.* blacklist, I propose we should adjust it but should probably ask the person who put it there in the first place :) [15:38:36] paravoid: right, but in the meantime i thought we could just fulfill the request [15:38:51] not sure how… [15:39:03] it should let sysops edit through the blacklist [15:39:08] idk the details exactly [15:39:16] https://labsconsole.wikimedia.org/wiki/Special:CreateAccount [15:39:28] New patchset: Hashar; "Overhauling gerrit manifest to be a role class" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/13484 [15:40:06] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/13484 [15:40:10] New review: Hashar; "Cleaned up the role class from dupe entries already in gerrit.pp." [operations/puppet] (production) C: 0; - https://gerrit.wikimedia.org/r/13484 [15:40:22] well, I meant how to override the blacklist [15:45:25] hrmmm, can has sysop on testwiki ? [15:45:39] Thehelpfulone: ^ [15:45:45] i have a few other places but none of those seem to have active blacklists. testwiki does [15:45:57] the real one or the wmflabs one? [15:46:24] test.wikipedia [15:46:28] not labs [15:46:40] done [15:46:51] although i guess i could have tried labs [15:46:59] yes, danke [15:47:13] np :) [15:49:16] so for edits it just works, doesn't even let you know that it was blacklisted [15:52:07] Change merged: Reedy; [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/16968 [15:52:41] Change merged: Reedy; [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/16941 [15:53:48] !log Created FlaggedRevs tables on eswiki [15:53:57] Logged the message, Master [15:54:59] Change merged: Reedy; [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/16921 [15:56:27] Change merged: Faidon; [operations/apache-config] (master) - https://gerrit.wikimedia.org/r/16742 [15:56:48] Change merged: Reedy; [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/16675 [15:58:46] paravoid: for me there's 2 extra checkboxes as sysop on testwiki. idk if you get them on labsconsole [15:58:51] > Ignore the blacklist [15:58:56] > Ignore spoofing checks [15:59:43] New review: Reedy; "Why?" [operations/mediawiki-config] (master); V: 0 C: 0; - https://gerrit.wikimedia.org/r/16935 [16:01:20] Reedy, wasn't that supposed to be eswikibooks..? [16:02:00] I'm about to run sync-apache for the first time [16:02:07] Blah [16:02:10] I wonder if I'll finally break the site [16:02:12] !log Created FlaggedRevs tables on eswikiboooks [16:02:19] Logged the message, Master [16:02:22] boooks :D [16:04:28] paravoid: this is shorturl? [16:05:26] yes [16:05:50] RECOVERY - Apache HTTP on mw8 is OK: HTTP OK - HTTP/1.1 301 Moved Permanently - 0.037 second response time [16:05:58] !log sync-apache/apache-graceful-all for RT #2121 [16:06:06] Logged the message, Master [16:06:29] Reedy: so, en.wp.org/s/foo redirects to /wiki/Main_Page [16:06:32] is that the intended behavior? [16:06:39] test2.wp.org works though [16:07:13] Only testwiki/test2wiki have shorturl enabled [16:07:16] I know [16:07:36] the question is: for the non-enabled wikis, is redirect to Main_Page the intended behavior? [16:07:46] Yeah [16:07:51] I think we have some weird catch all type things for this [16:09:10] Ok, so I can enable it on all the requested wikis [16:09:18] The question is then later if we enable it "everywhere" [16:09:43] But then we'll have people complaining about the urls under the title.. [16:11:20] New patchset: ArielGlenn; "settings for high network usage for ms10" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/16972 [16:11:59] New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/16972 [16:12:26] I can't reach http://education.wmflabs.org/wiki/ for some reason. Can SSH into the box though, and apache appears to be running. Reboot did not fix the issue. Anyone an idea what might be going on? [16:15:17] New review: Hashar; "I have notified Ryan about this change so he can get a peak at it." [operations/puppet] (production) C: 0; - https://gerrit.wikimedia.org/r/16971 [16:15:30] off [16:15:33] Change merged: ArielGlenn; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/16972 [16:15:35] will be back later tonight [16:21:47] paravoid: I wonder if we should pre-populate the table for shorturl [16:22:01] I seem to recall someone saying not to, for some reason, but no idea who or why.. [16:22:01] what table? :) [16:22:44] I only very recently became involved with that ticket, so I don't know much I'm afraid [16:23:10] Which RT # is it? I don't know if iut's on there [16:24:46] it's not [16:24:55] it was RT #2121 [16:24:57] meh, won't bother then ;) [16:25:48] let's install it on a few places then [16:25:55] I'd be happy to help [16:26:49] !log Add ShortUrl table to hiwiki, orwiki and tawiki [16:26:57] Logged the message, Master [16:28:02] tbh, I'm not sure I see the whole point of ShortUrl [16:28:16] Give me a minute, and I'll show you :p [16:28:27] since it's per-wiki and you have to write the long hostname anyway [16:28:52] https://hi.wikipedia.org/wiki/%E0%A4%A1%E0%A5%8B%E0%A4%B2%E0%A4%BE,_%E0%A4%A8%E0%A5%88%E0%A4%A8%E0%A5%80%E0%A4%A4%E0%A4%BE%E0%A4%B2_%E0%A4%A4%E0%A4%B9%E0%A4%B8%E0%A5%80%E0%A4%B2 [16:28:53] vs [16:28:58] https://hi.wikipedia.org/s/s [16:29:12] heh [16:29:19] url encoding nightmares [16:29:21] Now do you see? :D [16:29:39] so for folks who might see the efi warning, I have rebooted a few times and it's been fine (without some fanc y1mb extra partition etc) [16:29:52] apergos: add it to preseed? [16:30:06] paravoid: well, my blacklist may be stupid, for all I know [16:30:15] it obviously is blocking legitimate users :) [16:30:15] Reedy: to be fair, el.wikipedia.org/wiki/Τρελαντώνης will work too [16:30:25] Ryan_Lane: good moorning :) [16:30:28] Sure [16:30:32] sometimes it will work [16:30:38] https://labsconsole.wikimedia.org/wiki/MediaWiki:Titleblacklist [16:30:45] I guess I've seen people in irc where their client doesn't like the unicode links [16:30:52] (though they can read and write unicode itself just fine) [16:31:24] all of those with ^$ should likely work [16:31:24] paravoid: I dunno which hosts are going to have that issue, not sure how to set it up [16:31:39] !log Created ShortUrl table on numerous tawiki* wikis [16:31:47] Logged the message, Master [16:31:49] apergos: set it up on the global config maybe? [16:31:53] the force yes [16:32:26] the "force yes" :) [16:32:28] good morning Ryan_Lane! [16:32:50] Ryan_Lane: does it need a User: prefix though ? [16:33:04] the docs for this extension suck [16:33:14] but, not really [16:33:22] I'm mostly trying to block for shellaccountname [16:33:32] my brief testing on testwiki using exist rules (not editing the list at all) makes me think it needs User: [16:33:51] right and shell name can be different anyway [16:34:06] though it would be nice if it blocked for both [16:34:12] can you just give acct creators rights to edit through blacklist? [16:34:20] no [16:34:33] just incase they make a poor decision [16:34:44] there's so few of us! [16:34:47] ;P [16:34:53] anyway, what do you want to do [16:34:54] ? [16:35:07] I changed it to this: https://labsconsole.wikimedia.org/wiki/MediaWiki:Titleblacklist [16:35:37] Ryan_Lane: 30 16:33:32 < jeremyb> my brief testing on testwiki using exist rules (not editing the list at all) makes me think it needs User: [16:35:42] existing* [16:36:15] so ^User:nagios$ [16:39:19] ok. I'll double up the rules, then [16:39:47] because it can't for shell account name [16:40:28] (User:)? <— would that work? [16:40:58] should [16:41:17] speaking of which i owe you an apache test ;) [16:42:20] heh [16:42:30] wow, wi.ki is being sold in a bid [16:42:38] min. bid $50k [16:43:02] en.wi.ki would probably blow the bank then [16:43:12] username blacklist should be more sane, now [16:43:43] i guess that means i should try to make him again [16:43:52] Ryan_Lane: you forgot the last 4 entries ) [16:43:58] er, 5 [16:44:00] bah [16:44:13] well, they're on User: list above [16:44:14] i figured that was intentional but didn't know why exactly [16:44:19] just delete those? [16:45:15] yeah, they are repeats [16:46:03] A randomly generated password for Madman has been sent to ... [16:46:07] ;) [16:46:12] yay :) [16:46:26] JeroenDeDauw: what's the name of the instance? [16:47:32] wep [16:47:50] Reedy: wpa. [16:55:32] oh it's not efi after all [16:55:34] partman-partitioning/no_bootable_gpt_biosgrub [16:55:51] there's a diferent warnign for efi, named partman-partitioning/no_bootable_gpt_efi [17:04:16] Reedy, how do you make a short URL then? [17:09:57]