[00:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 94194 MB (15% inode=99%): [00:17:02] Load avg. on willow is WARNING: WARNING - load average: 20.35, 18.08, 15.18 [00:30:31] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:34:21] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:49:02] Load avg. on willow is OK: OK - load average: 14.27, 14.29, 14.98 [00:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [00:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [00:57:02] Load avg. on willow is WARNING: WARNING - load average: 16.02, 15.84, 15.54 [01:06:11] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 93809 MB (15% inode=99%): [01:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:33:21] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:53:21] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [01:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [01:57:01] Load avg. on willow is WARNING: WARNING - load average: 16.24, 18.34, 18.14 [02:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 93433 MB (15% inode=99%): [02:16:02] Load avg. on willow is CRITICAL: CRITICAL - load average: 24.24, 23.00, 20.43 [02:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [02:56:21] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [03:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 93065 MB (15% inode=99%): [03:16:02] Load avg. on willow is CRITICAL: CRITICAL - load average: 26.92, 26.09, 24.43 [03:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [03:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:34:21] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:44:22] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:48:02] Load avg. on willow is WARNING: WARNING - load average: 15.86, 17.13, 19.79 [03:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [03:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [03:59:11] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [04:04:02] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 23989 MB (5% inode=99%): [04:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 92753 MB (15% inode=99%): [04:11:02] Load avg. on willow is CRITICAL: CRITICAL - load average: 33.53, 23.86, 20.70 [04:24:02] Load avg. on willow is WARNING: WARNING - load average: 14.04, 18.75, 19.88 [04:27:01] Load avg. on willow is CRITICAL: CRITICAL - load average: 22.12, 20.01, 20.13 [04:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [04:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:34:21] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:44:02] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 33489 MB (8% inode=99%): [04:48:02] Load avg. on willow is CRITICAL: CRITICAL - load average: 21.60, 21.43, 21.74 [04:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [04:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [05:00:02] Load avg. on willow is WARNING: WARNING - load average: 17.82, 18.58, 19.97 [05:01:02] Load avg. on willow is CRITICAL: CRITICAL - load average: 21.03, 19.91, 20.39 [05:05:02] Load avg. on willow is WARNING: WARNING - load average: 18.43, 19.13, 19.95 [05:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 92376 MB (15% inode=99%): [05:08:02] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24128 MB (5% inode=99%): [05:25:01] Load avg. on willow is CRITICAL: CRITICAL - load average: 23.03, 22.23, 21.32 [05:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [05:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:34:21] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:46:02] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 33217 MB (8% inode=99%): [05:47:02] Load avg. on willow is WARNING: WARNING - load average: 9.90, 16.26, 19.71 [05:47:22] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 35340 MB (2% inode=98%): [05:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [05:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [06:02:02] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24006 MB (5% inode=99%): [06:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 91962 MB (15% inode=99%): [06:16:02] Load avg. on willow is CRITICAL: CRITICAL - load average: 23.40, 22.03, 20.16 [06:25:21] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 131356 MB (13% inode=99%): [06:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [06:33:01] Load avg. on willow is WARNING: WARNING - load average: 16.77, 19.05, 20.00 [06:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:38:02] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 35748 MB (8% inode=99%): [06:53:01] Load avg. on willow is OK: OK - load average: 10.04, 12.71, 14.90 [06:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [06:56:21] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [07:05:01] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24373 MB (5% inode=99%): [07:06:11] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 91506 MB (15% inode=99%): [07:07:01] Load avg. on willow is WARNING: WARNING - load average: 20.23, 18.21, 16.32 [07:30:31] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:37:02] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 32436 MB (7% inode=99%): [07:44:02] Load avg. on willow is OK: OK - load average: 10.81, 12.70, 14.88 [07:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [07:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [08:02:02] Load avg. on willow is WARNING: WARNING - load average: 21.29, 19.18, 16.47 [08:06:11] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 91103 MB (14% inode=99%): [08:20:02] Load avg. on willow is OK: OK - load average: 12.89, 14.07, 14.97 [08:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:33:21] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [08:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [09:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 90710 MB (14% inode=99%): [09:10:02] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 97880 MB (10% inode=98%): [09:10:12] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 97880 MB (10% inode=98%): [09:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:34:21] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [09:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [10:06:11] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 90306 MB (14% inode=99%): [10:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:33:21] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:53:21] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [10:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:06:11] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 89909 MB (14% inode=99%): [11:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:34:21] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [11:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [12:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 89496 MB (14% inode=99%): [12:30:31] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:37:39] @replag [12:37:40] liangent: s2-user: 2d 12h 13m 52s [+1.00 s/s] [12:37:56] DaBPunkt: s2 replication is still broken [12:38:18] mm [12:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [12:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:03:59] @replag [13:04:00] DaBPunkt: s2-user: 2d 12h 40m 12s [+1.00 s/s] [13:04:18] @replag [13:04:18] DaBPunkt: s2-user: 2d 12h 40m 31s [+1.02 s/s]; s3-rr-a: 28s [+0.00 s/s]; s3-user: 28s [+0.00 s/s] [13:06:11] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 89055 MB (14% inode=99%): [13:08:26] @replag [13:08:26] DaBPunkt: s2-user: 2d 12h 44m 39s [+1.00 s/s]; s2-user-c: 1m 39s [-0.00 s/s]; s3-rr-a: 25s [-0.01 s/s]; s3-user: 25s [-0.01 s/s]; s5-user-c: 1m 39s [-0.00 s/s] [13:10:29] @replag [13:10:29] DaBPunkt: s2-user: 2d 12h 46m 42s [+1.00 s/s]; s2-user-c: 3m 26s [+0.87 s/s]; s3-rr-a: 12s [-0.11 s/s]; s3-user: 12s [-0.11 s/s]; s5-user-c: 3m 26s [+0.87 s/s] [13:22:02] @replag [13:22:03] DaBPunkt: s2-user: 2d 12h 58m 15s [+1.00 s/s]; s2-user-c: 3m 15s [-0.02 s/s]; s3-rr-a: 28s [+0.02 s/s]; s3-user: 28s [+0.02 s/s]; s5-user-c: 3m 15s [-0.02 s/s] [13:22:37] liangent: the replication is running, but it may take some time until it start to decrease the replag [13:24:58] DaBPunkt: at least it won't be +1s/s? [13:28:05] liangent: it will be +1s/s until the replication-process reachs the correct binlog-position, after that the replag will drecrease [13:29:17] DaBPunkt: so it was restarted from a point before it stopped [13:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [13:30:48] liangent: that's my assumption. The log-file was incomplete and so I choose the best number I had [13:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:33:24] DaBPunkt: ok thx [13:34:21] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [13:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [14:06:11] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 88630 MB (14% inode=99%): [14:18:17] @replag [14:18:18] liangent: s2-user: 2d 13h 54m 30s [+1.00 s/s]; s2-user-c: 1m 9s [+0.13 s/s]; s5-user-c: 1m 9s [+0.13 s/s] [14:27:47] DaBPunkt: Hi. I feel a bit stupid about the sql index ticket. But why don't those indices show up on 'show index from page/image' [14:28:08] dschwen: because they are hidden by the views [14:30:31] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:34:11] @replag [14:34:12] liangent: s2-user: 2d 14h 10m 24s [+1.00 s/s]; s3-rr-a: 1m 34s [+0.08 s/s]; s3-user: 1m 34s [+0.08 s/s]; s5-user-c: 10s [-0.06 s/s] [14:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:53:21] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [14:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:06:11] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 88181 MB (14% inode=99%): [15:16:10] DaBPunkt: so it happened again, at Aug 23 22:14 (toolserver time) my script bailed out with [15:16:12] DBD::mysql::st execute failed: MySQL server has gone away at ./build_qtree_index.pl line 252. [15:18:05] halfway done it looses the connection and crashes [15:18:24] it relies ona temporary table, so resuming is not trivial [15:24:03] dschwen: "INSERT INTO u_dschwen.compics SELECT /* SLOW_OK */" ? [15:24:35] yeah [15:24:40] hold on [15:24:45] was killed auf 3,5h runtime [15:24:51] auf → after [15:25:04] no, that one wenth through as far as I can see [15:25:14] that was a different query [15:25:21] nothing to do with the error [15:25:29] wir koennen auch deutsch reden [15:25:34] wie Du willst [15:25:47] CALL InsertLabel(... [15:26:08] that is the one that died due to "mysql server went away" [15:26:22] it is a tiny query that should only take a second or so [15:26:27] @replag [15:26:27] liangent: s2-user: 2d 15h 2m 40s [+1.00 s/s] [15:26:37] nein, ist nichts im Log. Es gibt noch ein Select das gekillt wurde , aber kein CALL AFAIS [15:27:38] was heisst denn "MySQL server has gone away"? [15:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:33:21] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:33:52] dschwen: das musst du in der Dokumentation deiner Programmiersprache nachsehen [15:34:18] ich finde das in der MySQL doku [15:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:34:37] es erklaert mir aber nicht, warum der server thread beendet wurde [15:34:55] 8h timeout? nein, ich habe ja aktivitaet [15:35:09] vom admin gekillt? wohl auch nicht? [15:35:30] dschwen: welcher server war's denn? [15:35:46] commonswiki-p.userdb.toolserver.org [15:36:03] nein, da hab' ich nix per hand gekilt [15:36:27] ahrgh, was soll ich denn jetzt machen? [15:36:31] reconnect? [15:36:57] der server stirbt mitten in einer loop ueber ein 2mio row result [15:37:13] bist du sicher, dass es nicht doch der insert-thread war, der gekillt wurde und das der nachfolgene Befehl (CALL) nicht mehr ausgeführt werden konnte, weil die Verbidung nun ja weg war? [15:37:58] ziemlich. der insert thread den du erwaehnst fuellt eine temporaere tabelle [15:38:09] moment mal zu dem kill habe ich eine mail bekommen... [15:38:15] kann man ja an der uhrzeit sehen [15:38:27] ich hatte den inser von hand gestartet, nicht im script [15:38:39] mm, ok [15:39:02] mom. [15:39:20] du wießt aber schon, dass dein script dann die ergebnisse nicht sehen kann? [15:39:37] ja, war ja eine temp table [15:39:47] moment mal ich komme hier sonst etwas durcheinander [15:40:06] ich sehe in der db eintraege von nach dem insert [15:40:29] welcher insert? [15:41:04] eine temporäre Tabelle stirbt wenn die db-verbindung beenden wird UND ist auch NUR im Kontest einer Verbindung sichtbar [15:41:38] das log file zeigt auch an, dass der insert in 2614 sekunden beendet wurde [15:41:53] und der darauffolgende select in 37263 sekunden [15:42:03] der select liefert dann 2.7 mio rows [15:42:32] von denen wurden etwas ueber 1mio gefetcht und bearbeitet (und die CALL queries ausgefuehrt) [15:43:48] ich habe zwei db connections von connection 1 wird das 2.7mio row result gezohen [15:44:09] connection2 schreibt mittels CALL query die bearbeiteten resultate in eine andere db [15:44:18] connection2 stirbt [15:44:30] da muesste eigentlich ein reconnect funktionieren [15:44:40] jaa, müsste es [15:44:54] ok, ich muss mal schauen wie man das in perl am besten macht [15:44:59] ich bin nun erstmal weg, Abendessen machen [15:45:05] bis späte [15:45:07] r [15:45:16] guten appetit [15:52:22] dschwen: wegen dem proxy gehen temp tabellen (bie mir leider) nicht immer gleich verloren [15:52:43] aeh [15:52:55] ok, was hat das fuer auswirkungen? [15:53:21] das sollte dann doch einen fehler bei CREATE TEMPORARY TABLE geben, oder? [15:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [15:54:02] bie mir gab es das problem dass mehrere prozesse die den gleiche temp-tabellen namen nutzen. das ist zwar kein problem, aber verlangsamt das ganze enorm [15:54:30] create temporary table funktioniert imme, wiel es ältere temp tables versteckt [15:55:22] oh [15:55:28] was kann man dagegen machen? [15:55:36] die verbindung vom proxy zur db bleibt noch etwas nach dem proxy disconnect [15:55:53] wie lange? minuten oder stunden? [15:56:09] wo ist denn da ein proxy? [15:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:56:38] keine Ahnung, musst du DaBPunkt fragen. War ja nur ein hinweis, dass ein automatischer reconnect die daten der temp-tabelle retten kann [16:01:28] oh, ok, danke [16:06:11] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 87771 MB (14% inode=99%): [16:14:22] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [16:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:34:11] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [16:34:21] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [16:56:21] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 87461 MB (14% inode=99%): [17:22:00] @replag [17:22:00] jimmyxu: s1-rr-a: 7m 48s [-0.11 s/s]; s1-user: 7m 48s [-0.11 s/s]; s2-user: 2d 16h 58m 13s [+1.00 s/s]; s3-rr-a: 18s [-0.00 s/s]; s3-user: 18s [-0.00 s/s] [17:30:02] Load avg. on willow is WARNING: WARNING - load average: 25.23, 20.76, 16.21 [17:30:31] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:34:23] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:35:58] @replag [17:35:59] liangent: s2-user: 2d 17h 12m 11s [+1.00 s/s]; s3-rr-a: 2m 40s [+0.17 s/s]; s3-user: 2m 40s [+0.17 s/s] [17:36:01] Load avg. on willow is OK: OK - load average: 9.02, 14.21, 14.99 [17:47:22] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 31748 MB (2% inode=98%): [17:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [17:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [18:06:11] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 87033 MB (14% inode=99%): [18:08:38] @replag [18:08:39] liangent: s2-user: 2d 17h 44m 52s [+1.00 s/s]; s3-rr-a: 1m 12s [-0.04 s/s]; s3-user: 1m 12s [-0.04 s/s] [18:25:22] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 131705 MB (13% inode=99%): [18:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:33:21] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:53:21] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [18:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [19:06:11] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 86667 MB (14% inode=99%): [19:16:02] Load avg. on willow is WARNING: WARNING - load average: 19.72, 18.18, 14.49 [19:23:02] Load avg. on willow is OK: OK - load average: 11.73, 14.32, 13.99 [19:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:33:21] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:37:02] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 34523 MB (8% inode=99%): [19:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [19:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:06:11] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 86328 MB (14% inode=99%): [20:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:33:23] @replag [20:33:24] dcambie: s2-user: 2d 20h 9m 37s [+1.00 s/s]; s3-rr-a: 57s [-0.00 s/s]; s3-user: 57s [-0.00 s/s] [20:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:44:21] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [20:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:59:01] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [21:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 85944 MB (14% inode=99%): [21:10:02] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 96849 MB (9% inode=98%): [21:10:11] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 96849 MB (9% inode=98%): [21:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:34:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [21:56:21] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [22:01:05] Sumana Harihareswara * [Toolserver-l] Lists you might not know about [22:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 85564 MB (14% inode=99%): [22:26:54] nacht ts [22:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:34:21] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [22:56:21] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [23:06:12] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 85166 MB (13% inode=99%): [23:30:32] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:33:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:34:21] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:53:22] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [23:56:22] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default