[00:02:00] New patchset: Trevor Parscal; "Update default/index.html in Apache configuration." [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/16241 [00:36:02] New review: Platonides; "There are a couple of typos in the commit message." [operations/mediawiki-config] (master) C: -1; - https://gerrit.wikimedia.org/r/16241 [00:37:40] New patchset: Platonides; "Use random captchas in testwiki wmflabs." [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/16874 [00:55:02] New patchset: Platonides; "Fatal error at http://test.wikipedia.beta.wmflabs.org/ There's no extensions/E3Experiments/Experiments.php" [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/16875 [01:41:47] PROBLEM - MySQL Slave Delay on storage3 is CRITICAL: CRIT replication delay 236 seconds [01:42:23] PROBLEM - MySQL Slave Delay on db1025 is CRITICAL: CRIT replication delay 275 seconds [01:48:32] PROBLEM - Misc_Db_Lag on storage3 is CRITICAL: CHECK MySQL REPLICATION - lag - CRITICAL - Seconds_Behind_Master : 641s [01:52:08] RECOVERY - MySQL Slave Delay on db1025 is OK: OK replication delay 6 seconds [01:53:11] RECOVERY - MySQL Slave Delay on storage3 is OK: OK replication delay 23 seconds [01:54:05] RECOVERY - Misc_Db_Lag on storage3 is OK: CHECK MySQL REPLICATION - lag - OK - Seconds_Behind_Master : 47s [02:08:29] PROBLEM - Puppet freshness on db63 is CRITICAL: Puppet has not run in the last 10 hours [02:14:24] New review: Krinkle; "@Platonides: Its not really using HTML5. There are no new HTML5-specific tags or features used. All ..." [operations/mediawiki-config] (master) C: 1; - https://gerrit.wikimedia.org/r/16241 [02:22:44] New patchset: Krinkle; "Update default/index.html in Apache configuration." [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/16241 [02:23:21] New review: Krinkle; "Let's also not forget that it is primarily to get something out there that's not half a decade old, ..." [operations/mediawiki-config] (master) - https://gerrit.wikimedia.org/r/16241 [02:48:18] PROBLEM - Puppet freshness on ms-be10 is CRITICAL: Puppet has not run in the last 10 hours [03:02:15] RECOVERY - Puppet freshness on virt1002 is OK: puppet ran at Sat Jul 28 03:02:02 UTC 2012 [06:04:25] what's the process for submitting a package for inclusion in reprepro? [06:05:12] rather: for inclusion in the wmf apt repo, managed by reprepro [06:35:45] ori-l: did you receive my email? [06:36:15] Nemo_bis: i haven't checked in a bit, let me see [06:37:20] Nemo_bis: don't think i have, but i'm not sure who you are :) [06:38:04] Federico Leva [06:39:12] To: olivneh AT wikimedia.org Subject: Translatewiki.net support request Date: Mon, 23 Jul 2012 13:33:32 +0200 [06:41:07] Nemo_bis: ah, yes, and i created an account. my relationship with the LastModified extension is a bit unusual -- the e3 team used it for an experiment and now we seem to be its permanent maintainers even though we don't use it. [06:41:38] I don't mind making fixes, but comments like this (https://translatewiki.net/wiki/Thread:Support/About_MediaWiki:Lastmodified-label-seconds) left a bad taste in my mouth: "Yes. This is a great example of crappy development. " [06:43:18] :/ [06:44:21] can you leave this comment there? sympathyzing is useful too :) ; maybe also who would be actually responsible of fixing it [06:44:55] Nemo_bis: I'll take a look, but IMHO it ought to be deprecated -- the extension is an old hackathon effort by someone and has quite a few deficiencies. [06:47:03] Nemo_bis: I'll try to fix the problems mentioned in the thread now -- might as well [06:50:45] ori-l: thanks [07:09:19] Nemo_bis: fixed; i'll update the thread [07:11:29] great [07:19:48] Nemo_bis: np -- thanks for reminding me [08:29:58] PROBLEM - Puppet freshness on srv281 is CRITICAL: Puppet has not run in the last 10 hours [09:14:49] PROBLEM - Puppet freshness on neon is CRITICAL: Puppet has not run in the last 10 hours [09:38:49] PROBLEM - Puppet freshness on ocg3 is CRITICAL: Puppet has not run in the last 10 hours [11:44:58] ori-l-away: is your package for the repo in gerrit? [12:09:36] PROBLEM - Puppet freshness on db63 is CRITICAL: Puppet has not run in the last 10 hours [12:49:39] PROBLEM - Puppet freshness on ms-be10 is CRITICAL: Puppet has not run in the last 10 hours [14:29:34] does a puppet class of class nfs::upload::labs automatically inherit from nfs::upload ? [14:40:57] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:45:00] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.047 seconds [15:15:11] PROBLEM - LDAP on virt0 is CRITICAL: Connection refused [15:15:20] PROBLEM - LDAPS on virt0 is CRITICAL: Connection refused [15:18:20] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:26:44] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 1.925 seconds [15:59:26] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:12:02] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 7.002 seconds [16:45:38] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:58:23] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.036 seconds [17:28:02] jeremyb: the source code yes, the debian package is in a PPA i set up. i could check in the packaged version too. [17:28:29] * aude waits patiently (well, impatient) [17:29:12] no puppet in the last day [17:30:11] 22:29 <+nagios-wm> PROBLEM - Puppet freshness on srv281 is CRITICAL: Puppet has not run in the last 10 hours [17:30:56] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:40:50] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 3.338 seconds [18:13:48] aude: srv281 is out of rotation. full disk [18:14:39] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:15:14] ori-l: the packaging should be checked into gerrit. not the package itself [18:15:38] jeremyb: you mean the debian/* stuff? [18:15:47] yes [18:16:04] you'll probably need a repo created [18:16:11] or maybe you have rights to do that yourself [18:16:44] ori-l: see operations/debs/* e.g. https://gerrit.wikimedia.org/r/#/admin/projects/operations/debs/gerrit [18:17:54] jeremyb: aha, that's useful -- i'll take a look and try to follow the conventions. as for rights: i probably will need someone to do that for me, unless the labs route works (i'm still trying). [18:22:51] ori-l: https://gerrit.wikimedia.org/r/#/admin/groups/119,members [18:26:03] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 8.229 seconds [18:30:51] PROBLEM - Puppet freshness on srv281 is CRITICAL: Puppet has not run in the last 10 hours [18:59:39] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:13:17] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.015 seconds [19:15:32] PROBLEM - Puppet freshness on neon is CRITICAL: Puppet has not run in the last 10 hours [19:20:29] PROBLEM - check_all_memcacheds on spence is CRITICAL: MEMCACHED CRITICAL - Could not connect: 10.0.8.19:11000 (timeout) 10.0.8.22:11000 (Connection timed out) [19:21:32] PROBLEM - Apache HTTP on srv269 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:21:32] PROBLEM - Apache HTTP on srv272 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:21:50] PROBLEM - Memcached on srv272 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:22:44] RECOVERY - Apache HTTP on srv269 is OK: HTTP OK - HTTP/1.1 301 Moved Permanently - 2.584 second response time [19:22:44] RECOVERY - Apache HTTP on srv272 is OK: HTTP OK - HTTP/1.1 301 Moved Permanently - 5.817 second response time [19:23:20] RECOVERY - Memcached on srv272 is OK: TCP OK - 9.001 second response time on port 11000 [19:23:47] PROBLEM - SSH on srv282 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:24:05] PROBLEM - Apache HTTP on srv282 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:26:29] RECOVERY - SSH on srv282 is OK: SSH OK - OpenSSH_5.3p1 Debian-3ubuntu7 (protocol 2.0) [19:29:38] RECOVERY - Apache HTTP on srv282 is OK: HTTP OK - HTTP/1.1 301 Moved Permanently - 0.029 second response time [19:30:32] RECOVERY - check_all_memcacheds on spence is OK: MEMCACHED OK - All memcacheds are online [19:38:11] PROBLEM - Apache HTTP on srv262 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:38:56] PROBLEM - check_all_memcacheds on spence is CRITICAL: MEMCACHED CRITICAL - Could not connect: 10.0.8.12:11000 (timeout) [19:39:32] RECOVERY - Apache HTTP on srv262 is OK: HTTP OK - HTTP/1.1 301 Moved Permanently - 0.121 second response time [19:39:32] PROBLEM - Puppet freshness on ocg3 is CRITICAL: Puppet has not run in the last 10 hours [19:40:26] RECOVERY - check_all_memcacheds on spence is OK: MEMCACHED OK - All memcacheds are online [19:44:20] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:55:44] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 7.837 seconds [20:29:20] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:40:35] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.825 seconds [21:14:51] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:26:06] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 5.539 seconds [22:00:00] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:10:30] PROBLEM - Puppet freshness on db63 is CRITICAL: Puppet has not run in the last 10 hours [22:11:15] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.035 seconds [22:44:57] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:50:03] PROBLEM - Puppet freshness on ms-be10 is CRITICAL: Puppet has not run in the last 10 hours [22:57:33] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.054 seconds [23:30:15] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:40:18] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 4.475 seconds