[00:36:43] <grrrit-wm>	 (03PS1) 10John F. Lewis: Add modify restricted to sysop at Wikidata [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/101605 
[01:57:31] <Gloria>	 apergos: https://bugzilla.wikimedia.org/show_bug.cgi?id=58496
[02:09:37] <logmsgbot>	 !log LocalisationUpdate completed (1.23wmf6) at Sun Dec 15 02:09:37 UTC 2013
[02:09:56] <morebots>	 Logged the message, Master
[02:16:36] <logmsgbot>	 !log LocalisationUpdate completed (1.23wmf7) at Sun Dec 15 02:16:36 UTC 2013
[02:16:53] <morebots>	 Logged the message, Master
[02:26:19] <logmsgbot>	 !log LocalisationUpdate ResourceLoader cache refresh completed at Sun Dec 15 02:26:19 UTC 2013
[02:26:36] <morebots>	 Logged the message, Master
[03:14:38] <grrrit-wm>	 (03CR) 10MZMcBride: "Matt: that would be wonderful, thanks!" [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/97675 (owner: 10MZMcBride)
[05:20:05] <icinga-wm>	 PROBLEM - RAID on searchidx1001 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds.  
[05:21:55] <icinga-wm>	 RECOVERY - RAID on searchidx1001 is OK: OK: optimal, 1 logical, 4 physical  
[05:34:06] <icinga-wm>	 ACKNOWLEDGEMENT - RAID on db1001 is CRITICAL: CRITICAL: 1 failed LD(s) (Degraded) Sean Pringle RT 6510
[06:28:06] <icinga-wm>	 PROBLEM - udp2log log age for lucene on oxygen is CRITICAL: CRITICAL: log files /a/log/lucene/lucene.log,  have not been written in a critical amount of time.  For most logs, this is 4 hours.  For slow logs, this is 4 days.  
[06:30:05] <icinga-wm>	 RECOVERY - udp2log log age for lucene on oxygen is OK: OK: all log files active  
[08:19:05] <icinga-wm>	 PROBLEM - RAID on searchidx1001 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds.  
[08:21:05] <icinga-wm>	 RECOVERY - RAID on searchidx1001 is OK: OK: optimal, 1 logical, 4 physical  
[10:08:00] <logmsgbot>	 !log maxsem synchronized php-1.23wmf6/includes/parser/ParserOutput.php  'Debugging'
[10:08:17] <morebots>	 Logged the message, Master
[10:18:05] <icinga-wm>	 PROBLEM - RAID on searchidx1001 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds.  
[10:20:05] <icinga-wm>	 RECOVERY - RAID on searchidx1001 is OK: OK: optimal, 1 logical, 4 physical  
[11:24:48] <logmsgbot>	 !log maxsem synchronized php-1.23wmf6/includes/parser/ParserOutput.php  'Debugging done'
[11:25:04] <morebots>	 Logged the message, Master
[11:31:54] <grrrit-wm>	 (03CR) 10MaxSem: "Caused bug 58496?" [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/95846 (owner: 10Odder)
[11:35:22] <grrrit-wm>	 (03CR) 10Bartosz Dziewoński: "Has anybody ran namespaceDupes.php after this was deployed?" [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/95846 (owner: 10Odder)
[11:38:33] <grrrit-wm>	 (03CR) 10Odder: "No idea." [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/95846 (owner: 10Odder)
[11:42:33] <MatmaRex>	 MaxSem: namespaceDuuuupes
[11:45:49] <MaxSem>	 wrong
[11:46:04] <MaxSem>	 $ mwscript namespaceDupes.php --wiki=angwiki --fix
[11:46:04] <MaxSem>	  
[11:46:04] <MaxSem>	 Looks good!
[11:50:00] <MatmaRex>	 do we have some other script to check for bad titles?
[11:50:18] <MatmaRex>	 cleanupTitles.php
[11:52:28] <MaxSem>	 nah still:)
[11:56:12] <MatmaRex>	 lols.
[11:57:08] <MaxSem>	 let's just close that wiki, it's not serving any educational purpose anyway:P
[13:53:25] <icinga-wm>	 PROBLEM - HTTP 5xx req/min on tungsten is CRITICAL: CRITICAL: reqstats.5xx [crit=500.000000  
[14:50:25] <icinga-wm>	 RECOVERY - HTTP 5xx req/min on tungsten is OK: OK: reqstats.5xx [warn=250.000  
[15:34:05] <icinga-wm>	 PROBLEM - RAID on searchidx1001 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds.  
[15:34:55] <icinga-wm>	 RECOVERY - RAID on searchidx1001 is OK: OK: optimal, 1 logical, 4 physical  
[17:05:25] <icinga-wm>	 PROBLEM - HTTP 5xx req/min on tungsten is CRITICAL: CRITICAL: reqstats.5xx [crit=500.000000  
[17:13:51] <grrrit-wm>	 (03CR) 10Ottomata: "Quick response to Dan:" [operations/puppet/varnishkafka] - 10https://gerrit.wikimedia.org/r/101431 (owner: 10Ottomata)
[19:02:25] <icinga-wm>	 RECOVERY - HTTP 5xx req/min on tungsten is OK: OK: reqstats.5xx [warn=250.000  
[20:04:05] <icinga-wm>	 PROBLEM - RAID on searchidx1001 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds.  
[20:08:05] <icinga-wm>	 RECOVERY - RAID on searchidx1001 is OK: OK: optimal, 1 logical, 4 physical  
[20:22:05] <icinga-wm>	 PROBLEM - RAID on searchidx1001 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds.  
[20:22:55] <icinga-wm>	 RECOVERY - RAID on searchidx1001 is OK: OK: optimal, 1 logical, 4 physical  
[20:53:30] <Jamesofur>	 !log insert arbcom election decryption key
[20:53:47] <morebots>	 Logged the message, Master
[21:39:05] <icinga-wm>	 PROBLEM - RAID on searchidx1001 is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds.  
[21:44:05] <icinga-wm>	 RECOVERY - RAID on searchidx1001 is OK: OK: optimal, 1 logical, 4 physical  
[22:35:25] <icinga-wm>	 PROBLEM - SSH on searchidx1001 is CRITICAL: CRITICAL - Socket timeout after 10 seconds  
[22:36:25] <icinga-wm>	 RECOVERY - SSH on searchidx1001 is OK: SSH OK - OpenSSH_5.9p1 Debian-5ubuntu1.1 (protocol 2.0)  
[22:59:18] <grrrit-wm>	 (03PS1) 10John F. Lewis: Redirect m.wikidata to www.wikidata.org [operations/apache-config] - 10https://gerrit.wikimedia.org/r/101787 
[22:59:22] <grrrit-wm>	 (03CR) 10jenkins-bot: [V: 04-1] Redirect m.wikidata to www.wikidata.org [operations/apache-config] - 10https://gerrit.wikimedia.org/r/101787 (owner: 10John F. Lewis)
[23:00:15] <JohnLewis>	 >.>
[23:15:16] <grrrit-wm>	 (03PS1) 10Ori.livneh: Delete unused files [operations/software/mwprof] - 10https://gerrit.wikimedia.org/r/101789 
[23:15:33] <grrrit-wm>	 (03CR) 10Ori.livneh: [C: 032 V: 032] Delete unused files [operations/software/mwprof] - 10https://gerrit.wikimedia.org/r/101789 (owner: 10Ori.livneh)
[23:18:48] <grrrit-wm>	 (03PS1) 10Ori.livneh: Retab [operations/software/mwprof] - 10https://gerrit.wikimedia.org/r/101790 
[23:19:05] <grrrit-wm>	 (03CR) 10Ori.livneh: [C: 032 V: 032] Retab [operations/software/mwprof] - 10https://gerrit.wikimedia.org/r/101790 (owner: 10Ori.livneh)