[00:00:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 163001 [00:00:31] hey guys [00:00:37] I'm running something on the DB [00:00:44] and I got the textual result "DB://cluster22/49688457" [00:01:03] how can I get access to that data? [00:05:14] Magog_the_Ogre: You're trying to get page text? [00:05:22] yes [00:05:54] Magog_the_Ogre: Right, you can't do that. [00:06:01] *what* [00:06:02] A lot of it is compressed or in external storage or whatever. [00:06:06] Use the API. [00:06:08] True story. [00:06:13] what the hell is the point of the DB then? [00:06:15] Or the dumps. [00:06:18] Metadata. [00:06:24] Jesus [00:06:36] You can do a lot with metadata. [00:06:42] except the toolserver is being an asshole right now and is crapping out when my API queries go beyond a certain length [00:06:58] What do you mean by length? [00:07:05] If you're having a problem, you should just paste the error in here. [00:07:10] And explain what you're doing (or better, show code). [00:07:16] ah ok [00:07:18] here goes [00:07:24] Lamenting the Toolserver's lack of page text access isn't very helpful. ;-) [00:07:31] one sec [00:08:16] bc it is being a huge pain :( [00:08:50] You get what you pay for. [00:08:55] :-) [00:09:54] lol [00:10:09] are you ready? [00:10:11] it's coming... [00:10:43] one sec [00:11:14] http://pastebin.com/cDru6FMc [00:11:18] I submit that [00:11:27] and the toolserver throws curl errors at me [00:11:37] it's a query on commons.wikimedia [00:11:39] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 61771 [00:11:44] and it works on my local machine in both linux and windows [00:17:29] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 163134.000000 [00:26:10] I was on the edge of my seat. [00:26:16] Then I got distracted with other things. [00:26:22] lol [00:26:32] reminds me of that blink 182 song [00:26:47] "what the hell is ADD?" [00:30:38] You're using post or get? [00:30:54] Get has a maximum URL length, as I recall. [00:30:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [00:31:01] Post can handle up to 2 MB or something silly big. [00:32:35] I don't see the error you're getting. [00:32:39] Can you paste it somewhere? [00:33:53] huh [00:33:55] let me try post [00:34:09] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [00:34:11] maybe the unix box implementation can't handle long get variables [00:34:28] Well, passing all that data in the URL is kinda dumb even if it can handle it. [00:34:33] This is what post was made for. [00:35:28] lol [00:35:33] why do something the smart way [00:35:38] if it works the dumb way? [00:35:56] jk [00:36:05] I don't even think about it because it is abstracted away [00:36:10] there we go! [00:36:13] no curl error [00:36:26] :-) [00:36:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [00:38:29] the reason I have it set that way is that, for some ridiculous unknown reason, MW only accepts some queries as GET [00:38:32] idek why [00:39:30] Such as? [00:39:42] I could swear that some frameworks only interact with the API via POST. [00:39:46] But maybe not. [00:41:22] gosh I have no idea [00:41:30] all I know is once I automatically turned all my queries into post [00:41:34] and some of them quit working [00:41:41] maybe I did something stupid, who knows [00:41:50] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [00:42:42] Seems likely. [00:43:50] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 61705.000000 [00:45:16] well, you're about as pleasant to me as I would expect me to be to a stranger [00:47:27] Heh. [00:47:29] I'm adored. [00:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:54:40] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 124628 MB (20% inode=99%): [00:55:50] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:57:10] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 569148 MB (10% inode=48%): [01:00:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 163588 [01:11:40] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 61744 [01:22:45] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 163720.000000 [01:31:00] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [01:35:09] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [01:36:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [01:41:49] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [01:43:50] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 61004.000000 [01:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:54:11] Merlissimo, around? :) [01:54:39] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 123311 MB (20% inode=99%): [01:55:50] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 569119 MB (10% inode=48%): [02:00:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 164312 [02:12:40] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 60264 [02:14:40] /sql on thyme is WARNING: DISK WARNING - free space: /sql 173093 MB (18% inode=99%): [02:17:50] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 164595.000000 [02:30:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [02:35:09] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [02:36:49] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [02:41:49] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [02:43:49] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 59884.000000 [02:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:54:39] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 124433 MB (20% inode=99%): [02:55:49] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 566986 MB (10% inode=47%): [03:00:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 164914 [03:13:39] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 59606 [03:17:50] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 165186.000000 [03:31:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [03:35:09] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [03:36:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [03:41:50] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [03:43:50] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 59413.000000 [03:44:29] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 106404 MB (10% inode=98%): [03:44:39] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 106576 MB (10% inode=98%): [03:48:30] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:54:39] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 124357 MB (20% inode=99%): [03:55:50] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [03:57:10] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 567112 MB (10% inode=47%): [04:00:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 165856 [04:00:40] /sql on z-dat-s6-a is OK: DISK OK - free space: /sql 108240 MB (11% inode=98%): [04:01:29] /sql on z-dat-s3-a is OK: DISK OK - free space: /sql 107541 MB (11% inode=98%): [04:13:39] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 59406 [04:17:49] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 166191.000000 [04:32:00] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [04:35:09] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [04:36:49] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [04:41:49] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [04:44:29] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 59638.000000 [04:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:54:39] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 124258 MB (20% inode=99%): [04:55:50] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [04:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 567031 MB (10% inode=47%): [05:00:20] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 166645 [05:13:39] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 60052 [05:17:50] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 166976.000000 [05:24:50] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 57566 MB (4% inode=98%): [05:32:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [05:35:09] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [05:36:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [05:41:49] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [05:44:59] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 60245.000000 [05:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:54:40] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 124153 MB (20% inode=99%): [05:55:50] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [05:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 566984 MB (10% inode=47%): [06:00:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 167355 [06:13:39] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 60239 [06:17:50] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 167607.000000 [06:31:50] Load avg. on willow is WARNING: WARNING - load average: 23.87, 20.08, 16.42 [06:33:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [06:35:09] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [06:36:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [06:39:50] Load avg. on willow is OK: OK - load average: 8.34, 12.88, 14.69 [06:41:50] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [06:44:59] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 60353.000000 [06:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:54:40] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 123988 MB (20% inode=99%): [06:55:50] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [06:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 566926 MB (10% inode=47%): [07:00:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 167878 [07:06:40] /sql on ptolemy is OK: DISK OK - free space: /sql 128405 MB (21% inode=99%): [07:10:26] so I think my account expired while I was on business [07:10:56] and it's not letting me log in to renew [07:12:00] I'm trying to get it re-enabled for http://en.wikipedia.org/wiki/User_talk:Slakr#Your_Toolserver_Account [07:14:39] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 60332 [07:16:53] slakr: open a jira ticket. But the first mail was send to you 28 days before it was expired [07:17:07] I just sent a mail to ts-admins [07:17:28] yeah, the 28 days before it expired, I didn't even have time to check personal email [07:17:46] 'cause I was prepping for the logistics of a convention [07:17:49] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 168034.000000 [07:18:16] (the aforementioned business) [07:26:29] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 41572 MB (10% inode=99%): [07:34:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [07:35:09] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [07:37:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [07:41:50] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [07:45:00] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 60373.000000 [07:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:49:29] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 57495 MB (14% inode=99%): [07:55:49] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 566837 MB (10% inode=47%): [08:01:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 168243 [08:14:40] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 60266 [08:17:50] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 168280.000000 [08:34:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [08:35:09] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [08:37:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [08:41:49] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [08:44:59] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 60288.000000 [08:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:56:50] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 566734 MB (10% inode=47%): [09:01:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 168661 [09:14:40] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 60169 [09:17:50] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 168854.000000 [09:24:40] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 106367 MB (10% inode=98%): [09:26:29] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 106185 MB (10% inode=98%): [09:33:29] /sql on z-dat-s3-a is OK: DISK OK - free space: /sql 106936 MB (11% inode=98%): [09:33:40] /sql on z-dat-s6-a is OK: DISK OK - free space: /sql 106934 MB (11% inode=98%): [09:35:09] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [09:35:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [09:37:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [09:40:29] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 106547 MB (10% inode=98%): [09:40:40] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 106627 MB (10% inode=98%): [09:42:50] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [09:44:59] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 60016.000000 [09:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:56:49] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:57:29] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 40529 MB (9% inode=99%): [09:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 566641 MB (10% inode=47%): [10:01:20] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 169734 [10:14:29] /sql on z-dat-s3-a is OK: DISK OK - free space: /sql 108132 MB (11% inode=98%): [10:14:40] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 59851 [10:14:40] /sql on z-dat-s6-a is OK: DISK OK - free space: /sql 108189 MB (11% inode=98%): [10:17:50] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 170014.000000 [10:20:29] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24457 MB (5% inode=99%): [10:23:29] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 57189 MB (14% inode=99%): [10:35:09] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [10:35:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [10:37:49] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [10:42:49] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [10:44:59] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 59579.000000 [10:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:56:49] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:59:08] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 566502 MB (10% inode=47%): [11:01:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 170440 [11:08:02] hello [11:14:40] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 59315 [11:18:09] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 170759.000000 [11:25:29] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 40961 MB (10% inode=99%): [11:35:09] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [11:35:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [11:37:49] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [11:42:49] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:45:59] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 59433.000000 [11:47:29] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24424 MB (5% inode=99%): [11:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:49:29] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 54689 MB (13% inode=99%): [11:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:57:50] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:59:10] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 566396 MB (10% inode=47%): [12:01:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 171178 [12:14:39] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 59452 [12:18:09] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 171271.000000 [12:35:09] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [12:36:00] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [12:37:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [12:42:50] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [12:46:10] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 59587.000000 [12:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:58:49] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 566322 MB (10% inode=47%): [13:01:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 171809 [13:13:29] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 40535 MB (9% inode=99%): [13:14:40] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 59286 [13:18:10] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 172077.000000 [13:25:29] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 54636 MB (13% inode=99%): [13:35:09] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [13:36:00] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [13:37:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [13:42:50] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:46:10] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 59256.000000 [13:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:58:49] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [13:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 566205 MB (10% inode=47%): [14:01:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 172367 [14:14:40] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 59199 [14:14:40] /sql on thyme is WARNING: DISK WARNING - free space: /sql 171059 MB (17% inode=99%): [14:18:10] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 172582.000000 [14:20:05] Russell Blau * [Toolserver-l] s1 replag, some observations [14:35:05] Petr Onderka * Re: [Toolserver-l] s1 replag, some observations [14:35:09] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [14:36:00] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [14:37:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [14:43:50] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [14:44:05] DaB. * Re: [Toolserver-l] s1 replag, some observations [14:46:08] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 59390.000000 [14:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:57:10] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:58:50] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 565871 MB (10% inode=47%): [15:01:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 173003 [15:15:39] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 59440 [15:18:09] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 173119.000000 [15:35:09] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [15:36:00] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [15:37:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [15:43:50] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:46:09] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 59674.000000 [15:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:58:50] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 565709 MB (10% inode=47%): [16:01:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 173337 [16:15:39] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 59999 [16:17:05] Michael Peel * [Toolserver-l] WMUK developer job opening [16:18:19] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 173574.000000 [16:35:09] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [16:36:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [16:37:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [16:43:49] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [16:46:09] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 60580.000000 [16:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 565606 MB (10% inode=47%): [16:59:49] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:01:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 173756 [17:16:39] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 60977 [17:18:19] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 173992.000000 [17:24:50] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 57138 MB (4% inode=98%): [17:31:25] @replag [17:31:25] Dispenser: s1-rr-a: 16h 58m 5s [+0.15 s/s]; s1-user: 2d 21m 38s [+0.13 s/s]; s3-rr-a: 13s [-0.00 s/s]; s3-user: 13s [-0.00 s/s] [17:35:10] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [17:37:00] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [17:37:49] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [17:43:50] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:46:09] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 61467.000000 [17:48:28] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 565540 MB (10% inode=47%): [17:59:49] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:02:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 174357 [18:17:40] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 61861 [18:18:18] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 174692.000000 [18:31:18] @replag [18:31:18] Earwig: s1-rr-a: 17h 13m 22s [+0.26 s/s]; s1-user: 2d 34m 37s [+0.22 s/s] [18:35:19] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [18:36:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [18:37:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [18:40:05] DaB. * Re: [Toolserver-l] s1 replag, some observations [18:43:50] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [18:46:09] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 62261.000000 [18:48:30] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:50:29] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 43941 MB (10% inode=99%): [18:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:59:10] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 565449 MB (10% inode=47%): [18:59:49] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:02:20] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 175307 [19:03:29] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 55143 MB (13% inode=99%): [19:17:39] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 62803 [19:18:19] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 175554.000000 [19:35:19] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [19:37:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [19:38:49] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [19:43:49] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [19:46:09] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 63239.000000 [19:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:57:29] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 41072 MB (10% inode=99%): [19:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 565300 MB (10% inode=47%): [19:59:49] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:02:00] how do I see my memory usage: [20:02:02] ? [20:02:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 176258 [20:02:52] matanya: sge job or normaly process? [20:03:06] normal [20:03:14] I don't have any sge jobs [20:03:17] solaris? [20:03:55] willow [20:04:42] prstat -U matanya -a [20:05:05] the processes on top, and below the summary of all your processes [20:05:44] rss is the memory? [20:06:05] rss ist used memory and size/swap is reserved memory [20:06:44] means - swap 82 and rss 99 I use 181 M? [20:07:19] and there is a field memory says 0.6%, what does that stand for? [20:07:22] no [20:08:02] percentace of total memory [20:08:44] 100M / 16G = 0,7% [20:10:54] cpu = 15% means that you are using a more more than one cpu [20:15:35] I know I'm consuming [20:15:59] but it is temporary [20:17:39] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 63374 [20:18:19] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 176387.000000 [20:21:29] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 49238 MB (12% inode=99%): [20:21:56] wow 15 % ! :D [20:25:20] Toto_Azero: 15% is not the problem, but running in default project and not in batch and running with max priority could cause a problem for other if the system becomes busy (but willow is not busy atm) [20:25:50] ok [20:27:39] I never do heavy short-term stuff when the server is busy, that isn't fair [20:30:29] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 40546 MB (9% inode=99%): [20:33:50] Load avg. on willow is WARNING: WARNING - load average: 14.42, 15.36, 13.17 [20:34:49] Load avg. on willow is OK: OK - load average: 12.49, 14.66, 13.06 [20:35:19] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [20:37:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [20:38:49] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [20:39:29] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 23357 MB (5% inode=99%): [20:43:49] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:46:29] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 63706.000000 [20:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 565086 MB (10% inode=47%): [20:59:49] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:02:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 177025 [21:05:29] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 40258 MB (9% inode=99%): [21:17:40] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 63838 [21:18:19] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 177141.000000 [21:32:29] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24207 MB (5% inode=99%): [21:33:29] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 60809 MB (14% inode=99%): [21:35:19] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [21:37:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [21:38:29] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 106885 MB (10% inode=98%): [21:38:40] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 106880 MB (10% inode=98%): [21:38:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [21:43:29] /sql on z-dat-s3-a is OK: DISK OK - free space: /sql 106929 MB (11% inode=98%): [21:43:39] /sql on z-dat-s6-a is OK: DISK OK - free space: /sql 106929 MB (11% inode=98%): [21:43:50] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:46:29] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 64133.000000 [21:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:49:11] @replag [21:49:11] Krenair: s1-rr-a: 17h 49m 12s [+0.18 s/s]; s1-user: 2d 1h 22m 28s [+0.24 s/s]; s2-user: 27s [+0.00 s/s]; s3-rr-a: 16s [+0.00 s/s]; s3-user: 16s [+0.00 s/s] [21:52:29] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 106919 MB (10% inode=98%): [21:53:39] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 106920 MB (10% inode=98%): [21:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 564968 MB (10% inode=47%): [21:59:50] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:02:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 177914 [22:04:29] /sql on z-dat-s3-a is OK: DISK OK - free space: /sql 107062 MB (11% inode=98%): [22:04:39] /sql on z-dat-s6-a is OK: DISK OK - free space: /sql 107062 MB (11% inode=98%): [22:12:55] @replag [22:12:55] Brooke: s1-rr-a: 17h 52m 47s [+0.15 s/s]; s1-user: 2d 1h 29m 24s [+0.29 s/s] [22:16:04] nacht ts [22:17:40] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 64455 [22:18:19] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 178225.000000 [22:30:29] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 106814 MB (10% inode=98%): [22:30:39] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 106811 MB (10% inode=98%): [22:35:19] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [22:37:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [22:38:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [22:43:50] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [22:46:29] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 64563.000000 [22:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 564902 MB (10% inode=47%): [22:59:50] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:02:19] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 178552 [23:17:40] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 64357 [23:18:29] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 178811.000000 [23:20:29] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 43596 MB (10% inode=99%): [23:35:19] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [23:37:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [23:38:30] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 55525 MB (13% inode=99%): [23:38:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [23:43:50] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [23:46:29] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 64401.000000 [23:48:29] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:57:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:57:29] /sql on z-dat-s3-a is OK: DISK OK - free space: /sql 107407 MB (11% inode=98%): [23:57:40] /sql on z-dat-s6-a is OK: DISK OK - free space: /sql 107405 MB (11% inode=98%): [23:59:09] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 563504 MB (10% inode=47%): [23:59:50] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output