[00:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:16:43] /sql on thyme is CRITICAL: DISK CRITICAL - free space: /sql 64852 MB (6% inode=99%): [00:25:23] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [00:31:12] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [00:31:22] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [00:31:43] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:35:13] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1331437 [00:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:38:12] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [00:41:03] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1331675.000000 [00:43:52] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [01:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:25:23] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [01:31:12] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [01:31:22] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [01:31:42] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:35:12] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1333888 [01:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:38:13] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [01:41:03] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1334168.000000 [01:43:52] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [02:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:25:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [02:31:13] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [02:31:23] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [02:31:43] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:35:13] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1336319 [02:37:42] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:38:13] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [02:41:03] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1336540.000000 [02:43:53] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [02:52:43] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 93556 MB (9% inode=98%): [02:52:43] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 93557 MB (9% inode=98%): [03:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [03:25:23] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [03:31:13] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [03:31:23] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [03:31:43] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:35:13] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1338784 [03:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:38:13] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [03:41:22] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1339064.000000 [03:43:53] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [04:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [04:25:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [04:31:13] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [04:31:23] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [04:31:43] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:35:13] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1341366 [04:37:42] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:38:12] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [04:41:22] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1341613.000000 [04:43:53] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [05:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [05:25:23] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [05:31:23] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [05:31:23] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [05:31:43] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:35:13] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1343944 [05:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:38:22] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [05:42:13] s1 replag on thyme is CRITICAL: (Service Check Timed Out) [05:43:53] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [05:45:43] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 29708 MB (2% inode=97%): [05:53:19] @replag [05:53:20] Earwig: s1-rr-a: 20m 8s [+0.05 s/s]; s1-user: 2w 1d 13h 32m 11s [+0.69 s/s]; s2-user: 23s [+0.00 s/s]; s3-rr-a: 1m 5s [+0.00 s/s]; s3-user: 1m 5s [+0.00 s/s]; s5-rr-a: 11s [+0.00 s/s]; s5-user: 11s [+0.00 s/s] [05:53:27] just btw [05:58:13] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:58:13] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:58:13] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [06:01:02] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 93197 MB (9% inode=98%): [06:01:03] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 40202 MB (9% inode=99%): [06:02:11] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 93276 MB (9% inode=98%): [06:25:33] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [06:31:22] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [06:31:23] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [06:31:43] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:35:13] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1346456 [06:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:38:22] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [06:43:23] s1 replag on thyme is CRITICAL: (Service Check Timed Out) [06:43:42] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 23980 MB (5% inode=99%): [06:43:52] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [07:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:26:33] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [07:31:23] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [07:31:23] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [07:31:42] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:35:12] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1348959 [07:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:38:23] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [07:43:53] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [07:44:03] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1349343.000000 [08:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:27:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [08:31:22] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [08:31:23] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [08:31:43] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:35:13] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1351523 [08:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:38:22] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [08:42:13] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:42:13] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:42:53] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 92451 MB (9% inode=98%): [08:42:53] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 92451 MB (9% inode=98%): [08:43:53] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [08:44:03] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1351870.000000 [08:58:13] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:58:13] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:59:13] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:00:03] SSH on z-dat-s7-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [09:27:23] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [09:31:22] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [09:31:32] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [09:31:42] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 91500 MB (9% inode=98%): [09:31:43] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 91500 MB (9% inode=98%): [09:31:43] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:35:12] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1353839 [09:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:38:22] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [09:43:52] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [09:44:03] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1354177.000000 [09:54:13] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:54:13] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:55:43] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 89407 MB (9% inode=98%): [09:55:43] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 89407 MB (9% inode=98%): [10:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:27:33] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [10:31:23] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [10:31:33] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [10:31:43] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:35:13] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1356144 [10:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:38:23] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [10:43:43] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 27964 MB (6% inode=99%): [10:43:53] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [10:44:03] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1356487.000000 [11:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:27:32] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:31:23] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [11:31:33] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [11:31:43] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:35:13] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1358699 [11:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:38:23] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [11:43:53] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [11:44:03] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1359050.000000 [12:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:16:43] /sql on thyme is CRITICAL: DISK CRITICAL - free space: /sql 62101 MB (6% inode=99%): [12:27:32] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [12:31:22] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [12:31:32] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [12:31:42] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:35:13] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1361133 [12:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:38:22] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [12:43:52] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [12:44:13] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1361482.000000 [12:56:45] is the query killer supposed not to work on enwiki? [13:00:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [13:13:03] s4 replag on cassia is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2134.000000 [13:19:49] @replag [13:19:50] russblau: s1-user: 2w 1d 18h 36m 21s [+0.67 s/s]; s2-user: 1h 3m 40s [+0.21 s/s]; s2-user-c: 41m 57s [+0.14 s/s]; s3-rr-a: 1m 25s [+0.00 s/s]; s3-user: 1m 25s [+0.00 s/s]; s5-user-c: 41m 58s [+0.14 s/s] [13:27:33] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:31:23] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [13:31:33] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [13:31:43] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:35:13] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1363638 [13:37:42] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:38:23] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [13:43:02] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3620.000000 [13:43:53] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [13:44:32] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1364042.000000 [13:47:05] Russell Blau * [Toolserver-l] s1 replag update, suggestion, and question [14:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:27:33] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [14:31:22] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [14:31:32] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [14:31:42] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:34:37] @replag [14:34:38] russblau: s1-user: 2w 1d 19h 32m 49s [+0.75 s/s]; s2-user: 1h 23m 32s [+0.27 s/s]; s2-user-c: 1h 34m 10s [+0.70 s/s]; s3-rr-a: 11s [-0.02 s/s]; s3-user: 11s [-0.02 s/s]; s5-user-c: 1h 34m 10s [+0.70 s/s] [14:35:12] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1366389 [14:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:38:22] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [14:43:03] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 5910.000000 [14:43:52] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [14:44:33] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1366852.000000 [15:00:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:12:48] @replag [15:12:49] russblau: s1-rr-a: 40s [+0.00 s/s]; s1-user: 2w 1d 20h 2m 4s [+0.77 s/s]; s2-user: 1h 23m 57s [+0.01 s/s]; s2-user-c: 1h 2m 2s [-0.84 s/s]; s3-rr-a: 11s [-]; s3-user: 11s [-]; s4-user: 15s [+0.00 s/s]; s5-user-c: 1h 2m 2s [-0.84 s/s] [15:15:03] s4 replag on cassia is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3593.000000 [15:27:33] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:31:23] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [15:31:32] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [15:31:42] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:35:12] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1369104 [15:37:03] Daniel Schwen * Re: [Toolserver-l] s1 replag update, suggestion, and question [15:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:38:23] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [15:43:53] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [15:44:32] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1369534.000000 [15:51:35] Hey folks, I think I managed to break my ssh-key authentication for my ts user (grphack). Can anyone here help me? [15:57:04] Russell Blau * Re: [Toolserver-l] s1 replag update, suggestion, and question [16:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [16:00:04] Platonides * Re: [Toolserver-l] s1 replag update, suggestion, and question [16:00:15] * halfak emailed ts-admins [16:08:03] s4 replag on cassia is OK: QUERY OK: SELECT ts_rc_age() returned 1671.000000 [16:27:33] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [16:30:38] @replag [16:30:38] russblau: s1-user: 2w 1d 21h 4m 8s [+0.80 s/s]; s2-user: 1h 54m 0s [+0.39 s/s]; s3-rr-a: 38s [+0.01 s/s]; s3-user: 38s [+0.01 s/s] [16:31:23] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [16:31:33] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [16:31:43] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:35:13] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1372066 [16:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:38:23] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [16:43:53] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [16:45:22] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1372533.000000 [17:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:27:32] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:31:22] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [17:31:33] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [17:31:43] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:35:13] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1374592 [17:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:38:22] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [17:43:52] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [17:45:22] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1375057.000000 [17:45:42] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 31774 MB (2% inode=98%): [18:00:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:27:33] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [18:31:22] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [18:31:32] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [18:31:42] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:35:12] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1377462 [18:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:38:22] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [18:43:52] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [18:45:22] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1377957.000000 [19:00:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:27:33] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [19:31:23] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [19:31:32] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [19:31:43] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:35:12] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1380292 [19:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:38:23] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [19:43:53] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [19:45:23] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1380749.000000 [20:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:27:32] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:31:23] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [20:31:33] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [20:31:43] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:35:13] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1383146 [20:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:38:23] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [20:43:53] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [20:45:22] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1383577.000000 [20:47:35] @replag [20:47:36] russblau: s1-user: 2w 2d 21m 19s [+0.77 s/s] [21:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:27:33] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:31:22] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [21:31:32] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [21:31:42] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:35:12] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1385518 [21:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:38:22] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [21:43:52] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [21:45:52] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1385956.000000 [21:55:43] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 92567 MB (9% inode=98%): [21:55:43] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 92567 MB (9% inode=98%): [22:00:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:27:33] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [22:31:23] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [22:31:33] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [22:31:43] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:35:13] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1388066 [22:37:42] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:38:23] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [22:43:43] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 40557 MB (9% inode=99%): [22:43:53] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [22:46:22] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1388600.000000 [23:00:03] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:27:32] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [23:31:22] APT on mayapple is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [23:31:32] APT on yarrow is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [23:31:42] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:35:12] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1390736 [23:37:43] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:38:22] APT on nightshade is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates). [23:43:52] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [23:46:22] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1391202.000000