[09:12:46] @replag [09:12:46] liangent: s2-user: 1d 8h 48m 44s [+1.00 s/s]; s3-rr-a: 4m 45s [+0.62 s/s]; s3-user: 4m 45s [+0.62 s/s]; s6-rr-a: 2m 22s [-1.09 s/s]; s6-user: 2m 22s [-1.09 s/s]; s7-rr-a: 7m 32s [+0.99 s/s]; s7-user: 7m 34s [+1.01 s/s] [09:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:33:21] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:53:23] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [09:56:21] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [10:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 99667 MB (16% inode=99%): [10:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:34:21] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [10:54:28] @replag [10:54:28] liangent: s2-user: 1d 10h 30m 41s [+1.00 s/s]; s3-rr-a: 34s [-0.01 s/s]; s3-user: 34s [-0.01 s/s]; s6-rr-a: 13s [-0.02 s/s]; s6-user: 13s [-0.02 s/s] [10:56:21] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 99343 MB (16% inode=99%): [11:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:33:21] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [11:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:57:22] @replag [11:57:22] jimmyxu: s2-user: 1d 11h 33m 35s [+1.00 s/s] [12:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 98979 MB (16% inode=99%): [12:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [12:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 98633 MB (16% inode=99%): [13:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [13:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [13:56:21] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [14:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 98214 MB (16% inode=99%): [14:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [14:56:21] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 97849 MB (16% inode=99%): [15:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:34:21] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [15:56:21] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [16:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 97442 MB (16% inode=99%): [16:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [16:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:34:21] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [16:56:21] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 97109 MB (15% inode=99%): [17:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:47:12] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 32619 MB (2% inode=98%): [17:53:21] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [17:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:59:02] Load avg. on willow is WARNING: WARNING - load average: 25.17, 20.59, 14.92 [18:01:02] Load avg. on willow is CRITICAL: CRITICAL - load average: 31.92, 25.18, 17.37 [18:02:01] Load avg. on willow is WARNING: WARNING - load average: 22.39, 23.71, 17.34 [18:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 96641 MB (15% inode=99%): [18:25:22] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 132958 MB (13% inode=99%): [18:26:01] Load avg. on willow is OK: OK - load average: 11.67, 13.25, 14.94 [18:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:33:21] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:53:21] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [18:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [19:06:11] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 96220 MB (15% inode=99%): [19:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:33:21] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:53:21] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [19:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:06:11] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 95746 MB (15% inode=99%): [20:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:33:21] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:53:21] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [20:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:06:11] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 95402 MB (15% inode=99%): [21:10:01] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 28180 MB (6% inode=99%): [21:10:01] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 98417 MB (10% inode=98%): [21:10:11] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 98417 MB (10% inode=98%): [21:16:00] Which server hosts commonswiki-p.userdb (z-dat-s4-a)? [21:17:02] Load avg. on willow is WARNING: WARNING - load average: 18.96, 18.08, 14.91 [21:22:02] Load avg. on willow is OK: OK - load average: 10.82, 14.27, 14.21 [21:22:02] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24080 MB (5% inode=99%): [21:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:34:21] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:41:02] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 28920 MB (7% inode=99%): [21:47:01] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24276 MB (5% inode=99%): [21:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [21:56:21] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:58:01] MySQL slave on rosemary is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2179 [21:58:32] s1 replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2208.000000 [22:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 94965 MB (15% inode=99%): [22:07:01] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 29224 MB (7% inode=99%): [22:16:02] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24244 MB (5% inode=99%): [22:17:02] Load avg. on willow is WARNING: WARNING - load average: 17.21, 16.42, 13.94 [22:20:02] Load avg. on willow is OK: OK - load average: 12.14, 14.83, 13.78 [22:30:02] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 29089 MB (7% inode=99%): [22:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:34:21] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:35:02] MySQL slave on rosemary is OK: Uptime: 11517458 Threads: 25 Questions: 4712659653 Slow queries: 1060032 Opens: 85893 Flush tables: 6 Open tables: 3522 Queries per second avg: 409.175 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1592 [22:35:32] s1 replag on rosemary is OK: QUERY OK: SELECT ts_rc_age() returned 1519.000000 [22:48:02] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24344 MB (5% inode=99%): [22:51:01] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 24487 MB (6% inode=99%): [22:52:02] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24239 MB (5% inode=99%): [22:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [22:56:21] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [23:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 94569 MB (15% inode=99%): [23:12:02] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 33753 MB (8% inode=99%): [23:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:34:21] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [23:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default