[00:01:52] <labs-nagios-wm>	 PROBLEM Free ram is now: WARNING on ipv6test1 i-00000282.pmtpa.wmflabs output: Warning: 19% free memory
[00:07:22] <labs-nagios-wm>	 PROBLEM host: i-000004de.pmtpa.wmflabs is DOWN address: i-000004de.pmtpa.wmflabs PING CRITICAL - Packet loss = 100%
[00:29:42] <labs-nagios-wm>	 PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs)
[00:37:22] <labs-nagios-wm>	 PROBLEM host: i-000004de.pmtpa.wmflabs is DOWN address: i-000004de.pmtpa.wmflabs PING CRITICAL - Packet loss = 100%
[00:59:42] <labs-nagios-wm>	 PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs)
[01:07:32] <labs-nagios-wm>	 PROBLEM host: i-000004de.pmtpa.wmflabs is DOWN address: i-000004de.pmtpa.wmflabs PING CRITICAL - Packet loss = 100%
[01:09:50] <jeremyb>	 !log deployment-prep test
[01:19:02] <wm-bot>	 Change on 12mediawiki a page Developer access was modified, changed by Jeremyb link https://www.mediawiki.org/w/index.php?diff=598243 edit summary: done
[01:21:38] <jeremyb>	 !log deployment-prep test
[01:21:40] <labs-morebots>	 Logged the message, Master
[01:23:08] <jeremyb>	 hrmmm, no rdns
[01:23:13] <jeremyb>	 (just noticed that...)
[01:27:14] <jeremyb>	 !log 27 11:20:06 < Jan_Luca> !log centralauth Update centralauth-daemons and centralauth-mysql and reboot them
[01:27:14] <labs-morebots>	 27 is not a valid project.
[01:27:17] <jeremyb>	 !log 27 23:23:35 < beta-logmsgbot> !log deployment-prep csteipp: ran mwscript extensions/WikimediaMaintenance/addWiki.php --wiki=aawiki de wikivoyage dewikivoyage de.wikivoyage.beta.wmflabs.org
[01:27:17] <labs-morebots>	 27 is not a valid project.
[01:27:21] <jeremyb>	 !log 27 23:30:46 < beta-logmsgbot> !log deployment-prep csteipp: added dewikivoyage to all-wmflabs.dblist
[01:27:21] <labs-morebots>	 27 is not a valid project.
[01:27:24] <jeremyb>	 !log 27 23:31:42 < beta-logmsgbot> !log deployment-prep csteipp: added dewikivoyage config to db-wmflabs.php (temp hack)
[01:27:24] <labs-morebots>	 27 is not a valid project.
[01:27:27] <jeremyb>	 !log 27 23:35:40 < beta-logmsgbot> !log deployment-prep csteipp: running mwscript update.php dewikivoyage to update from 1.13 import
[01:27:28] <labs-morebots>	 27 is not a valid project.
[01:27:31] <jeremyb>	 damnit
[01:27:33] <jeremyb>	 thanks labs-morebots ;)
[01:29:42] <labs-nagios-wm>	 PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs)
[01:31:47] <jeremyb>	 !log centralauth 11:20:06 < Jan_Luca> !log centralauth Update centralauth-daemons and centralauth-mysql and reboot them
[01:31:50] <jeremyb>	 !log deployment-prep 23:23:35 < beta-logmsgbot> !log deployment-prep csteipp: ran mwscript extensions/WikimediaMaintenance/addWiki.php --wiki=aawiki de wikivoyage dewikivoyage de.wikivoyage.beta.wmflabs.org
[01:31:54] <jeremyb>	 !log deployment-prep 23:30:46 < beta-logmsgbot> !log deployment-prep csteipp: added dewikivoyage to all-wmflabs.dblist
[01:31:57] <jeremyb>	 !log deployment-prep 23:31:42 < beta-logmsgbot> !log deployment-prep csteipp: added dewikivoyage config to db-wmflabs.php (temp hack)
[01:32:00] <jeremyb>	 !log deployment-prep 23:35:40 < beta-logmsgbot> !log deployment-prep csteipp: running mwscript update.php dewikivoyage to update from 1.13 import
[01:32:13] <jeremyb>	 labs-morebots: ping
[01:38:12] <labs-nagios-wm>	 PROBLEM host: i-000004de.pmtpa.wmflabs is DOWN address: i-000004de.pmtpa.wmflabs PING CRITICAL - Packet loss = 100%
[01:43:34] <jeremyb>	 !log centralauth 11:20:06 < Jan_Luca> !log centralauth Update centralauth-daemons and centralauth-mysql and reboot them
[01:43:35] <labs-morebots>	 Logged the message, Master
[01:43:44] <jeremyb>	 !log deployment-prep 23:23:35 < beta-logmsgbot> !log deployment-prep csteipp: ran mwscript extensions/WikimediaMaintenance/addWiki.php --wiki=aawiki de wikivoyage dewikivoyage de.wikivoyage.beta.wmflabs.org
[01:43:45] <labs-morebots>	 Logged the message, Master
[01:43:48] <jeremyb>	 !log deployment-prep 23:30:46 < beta-logmsgbot> !log deployment-prep csteipp: added dewikivoyage to all-wmflabs.dblist
[01:43:50] <labs-morebots>	 Logged the message, Master
[01:43:51] <jeremyb>	 !log deployment-prep 23:31:42 < beta-logmsgbot> !log deployment-prep csteipp: added dewikivoyage config to db-wmflabs.php (temp hack)
[01:43:52] <labs-morebots>	 Logged the message, Master
[01:43:54] <jeremyb>	 !log deployment-prep 23:35:40 < beta-logmsgbot> !log deployment-prep csteipp: running mwscript update.php dewikivoyage to update from 1.13 import
[01:43:56] <labs-morebots>	 Logged the message, Master
[01:44:05] <jeremyb>	 woot
[01:45:10] <jeremyb>	 now, why doesn't the damn but stay connected?
[01:45:12] <jeremyb>	 ;)
[01:47:01] <jeremyb>	 !log bots booted labs-morebots twice (it broke itself again in fairly short order after the first time) and then re!log'd the stuff it had missed in the interim from my own scrollback buffer
[01:47:02] <labs-morebots>	 Logged the message, Master
[01:48:12] <jeremyb>	 !log bots (timestamps are UTC of course)
[01:48:13] <labs-morebots>	 Logged the message, Master
[01:59:42] <labs-nagios-wm>	 PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs)
[02:08:23] <labs-nagios-wm>	 PROBLEM host: i-000004de.pmtpa.wmflabs is DOWN address: i-000004de.pmtpa.wmflabs PING CRITICAL - Packet loss = 100%
[02:29:43] <labs-nagios-wm>	 PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs)
[02:38:53] <labs-nagios-wm>	 PROBLEM host: i-000004de.pmtpa.wmflabs is DOWN address: i-000004de.pmtpa.wmflabs PING CRITICAL - Packet loss = 100%
[02:41:45] <labs-nagios-wm>	 RECOVERY Free ram is now: OK on ipv6test1 i-00000282.pmtpa.wmflabs output: OK: 35% free memory
[03:02:03] <labs-nagios-wm>	 PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs)
[03:09:02] <labs-nagios-wm>	 PROBLEM host: i-000004de.pmtpa.wmflabs is DOWN address: i-000004de.pmtpa.wmflabs PING CRITICAL - Packet loss = 100%
[03:29:44] <wm-bot>	 Change on 12mediawiki a page Developer access was modified, changed by Hosiryuhosi link https://www.mediawiki.org/w/index.php?diff=598250 edit summary: 
[03:33:02] <labs-nagios-wm>	 PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs)
[03:39:02] <labs-nagios-wm>	 PROBLEM host: i-000004de.pmtpa.wmflabs is DOWN address: i-000004de.pmtpa.wmflabs PING CRITICAL - Packet loss = 100%
[04:03:02] <labs-nagios-wm>	 PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs)
[04:09:03] <labs-nagios-wm>	 PROBLEM host: i-000004de.pmtpa.wmflabs is DOWN address: i-000004de.pmtpa.wmflabs PING CRITICAL - Packet loss = 100%
[04:09:53] <labs-nagios-wm>	 RECOVERY Current Load is now: OK on parsoid-roundtrip3 i-000004d8.pmtpa.wmflabs output: OK - load average: 0.21, 1.17, 4.12
[04:15:53] <labs-nagios-wm>	 RECOVERY Current Load is now: OK on parsoid-roundtrip4-8core i-000004ed.pmtpa.wmflabs output: OK - load average: 2.91, 3.04, 4.60
[04:17:53] <labs-nagios-wm>	 RECOVERY Current Load is now: OK on ve-roundtrip2 i-0000040d.pmtpa.wmflabs output: OK - load average: 2.67, 3.12, 4.82
[04:32:52] <labs-nagios-wm>	 RECOVERY Current Load is now: OK on parsoid-roundtrip5-8core i-000004db.pmtpa.wmflabs output: OK - load average: 3.82, 3.95, 4.78
[04:33:02] <labs-nagios-wm>	 PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs)
[04:39:03] <labs-nagios-wm>	 PROBLEM host: i-000004de.pmtpa.wmflabs is DOWN address: i-000004de.pmtpa.wmflabs PING CRITICAL - Packet loss = 100%
[05:03:02] <labs-nagios-wm>	 PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs)
[05:09:33] <labs-nagios-wm>	 PROBLEM host: i-000004de.pmtpa.wmflabs is DOWN address: i-000004de.pmtpa.wmflabs PING CRITICAL - Packet loss = 100%
[05:33:02] <labs-nagios-wm>	 PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs)
[05:39:42] <labs-nagios-wm>	 PROBLEM host: i-000004de.pmtpa.wmflabs is DOWN address: i-000004de.pmtpa.wmflabs PING CRITICAL - Packet loss = 100%
[06:03:04] <labs-nagios-wm>	 PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs)
[06:09:42] <labs-nagios-wm>	 PROBLEM host: i-000004de.pmtpa.wmflabs is DOWN address: i-000004de.pmtpa.wmflabs PING CRITICAL - Packet loss = 100%
[06:33:03] <labs-nagios-wm>	 PROBLEM host: i-000003ef.pmtpa.wmflabs is DOWN address: i-000003ef.pmtpa.wmflabs CRITICAL - Host Unreachable (i-000003ef.pmtpa.wmflabs)
[06:40:22] <labs-nagios-wm>	 PROBLEM host: i-000004de.pmtpa.wmflabs is DOWN address: i-000004de.pmtpa.wmflabs PING CRITICAL - Packet loss = 100%
[17:29:55] <wm-bot>	 Change on 12mediawiki a page Developer access was modified, changed by Jeremyb link https://www.mediawiki.org/w/index.php?diff=598374 edit summary: /* User:Hosiryuhosi */ done