[08:09:32] <petan_>	 Ryan_Lane: no please don't use /data/project for sql
[08:09:33] <petan_>	 it's broken, I told you
[08:09:37] <Ryan_Lane>	 I think it's due to the version of gluster
[08:09:37] <petan_>	 maybe
[08:09:37] <petan_>	 did you update it recently?
[08:09:38] <Ryan_Lane>	 so, for now let's avoid it
[08:09:40] <Ryan_Lane>	 I didn't upgrade yer
[08:09:44] <petan_>	 hm...
[08:09:54] <petan_>	 Beetstra: sql2 is much bigger
[08:09:57] <petan_>	 you can use it now
[08:10:18] <Ryan_Lane>	 at some point we should test the upgraded version
[08:10:23] <Beetstra>	 Hmm .. but then I need to migrate the tables??
[08:10:44] <Ryan_Lane>	 I was told it's likelier to work
[08:10:45] <petan_>	 yes I am not going to switch to it uless it's tested :) recovering the db on deployment took me few days
[08:11:18] <Ryan_Lane>	 I was also told that others are using the newest version in production with no issues with mysqk
[08:11:21] <Ryan_Lane>	 *mysql
[08:12:08] <Ryan_Lane>	 it would be ideal to use gluster directly, rather than via local storage
[08:12:54] <Ryan_Lane>	 well, it would be more ideal to use real hardware, but shared storage is a step in the right direction ;)
[08:14:36] <Ryan_Lane>	 I fixed something for you, btw ;)
[08:14:59] <Ryan_Lane>	 petan_: https://bugzilla.wikimedia.org/show_bug.cgi?id=35850
[08:15:28] <Ryan_Lane>	 it isn't pushed to production yet, but it will be soon :)
[08:15:49] <Ryan_Lane>	 you'll be able to manage sudo in a project based on users and hosts
[08:16:43] <Beetstra>	 petan .. I don't seem to have an account on sql2 .. only on sql3?
[08:17:44] <Ryan_Lane>	 you have an account on every bots instance
[08:18:08] <Beetstra>	 so, why does phpmyadmin refuse my connection on sql2?
[08:20:03] <Ryan_Lane>	 I dunno
[08:20:23] <Ryan_Lane>	 mysql accounts are set up manually in that project
[10:16:33] <gerrit-wm>	 New review: Dzahn; "afaik this was meant to be a replacement for the existing check, but meanwhile we have puppet checks..." [operations/puppet] (test); V: 0 C: 0;  - https://gerrit.wikimedia.org/r/3376
[12:14:13] <labs-home-wm_>	 04/16/2012 - 12:14:13 - Creating a home directory for johlig at /export/home/bastion/johlig
[12:15:14] <labs-home-wm_>	 04/16/2012 - 12:15:14 - Updating keys for johlig
[12:30:42] <labs-nagios-wm_>	 PROBLEM Free ram is now: CRITICAL on bots-3 i-000000e5 output: Critical: 3% free memory
[12:45:44] <JeroenDeDauw>	 I want to install git on a labs server - looks like it's no in the apt-get repo for some reason
[12:45:55] <vvv>	 git-core?
[12:46:10] <vvv>	 Because I run git on OpenGrok for sure
[12:50:12] <labs-nagios-wm_>	 PROBLEM Puppet freshness is now: CRITICAL on nova-production1 i-0000007b output: Puppet has not run in last 20 hours
[12:54:12] <labs-nagios-wm_>	 PROBLEM Puppet freshness is now: CRITICAL on nova-gsoc1 i-000001de output: Puppet has not run in last 20 hours
[20:55:51] <labs-nagios-wm_>	 RECOVERY Free ram is now: OK on bots-3 i-000000e5 output: OK: 39% free memory
[21:08:37] <gerrit-wm>	 New review: Rich Smith; "(no comment)" [operations/puppet] (test) C: 1;  - https://gerrit.wikimedia.org/r/4986
[22:38:11] <labs-nagios-wm_>	 PROBLEM Puppet freshness is now: CRITICAL on jenkins2 i-00000102 output: Puppet has not run in last 20 hours
[22:51:11] <labs-nagios-wm_>	 PROBLEM Puppet freshness is now: CRITICAL on nova-production1 i-0000007b output: Puppet has not run in last 20 hours
[22:55:11] <labs-nagios-wm_>	 PROBLEM Puppet freshness is now: CRITICAL on nova-gsoc1 i-000001de output: Puppet has not run in last 20 hours
[23:40:33] <labs-nagios-wm_>	 PROBLEM Free ram is now: WARNING on deployment-squid i-000000dc output: Warning: 19% free memory