[00:11:41] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:25:11] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.027 seconds [00:45:59] PROBLEM - Puppet freshness on ms-be1006 is CRITICAL: Puppet has not run in the last 10 hours [00:45:59] PROBLEM - Puppet freshness on ms-be1005 is CRITICAL: Puppet has not run in the last 10 hours [00:45:59] PROBLEM - Puppet freshness on ms-be1009 is CRITICAL: Puppet has not run in the last 10 hours [00:57:05] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:07:26] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 6.262 seconds [01:38:11] PROBLEM - MySQL Replication Heartbeat on db1035 is CRITICAL: CRIT replication delay 186 seconds [01:38:29] PROBLEM - MySQL Slave Delay on db1035 is CRITICAL: CRIT replication delay 188 seconds [01:40:08] PROBLEM - MySQL Slave Delay on db1025 is CRITICAL: CRIT replication delay 296 seconds [01:40:35] PROBLEM - MySQL Slave Delay on storage3 is CRITICAL: CRIT replication delay 229 seconds [01:41:56] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:42:50] PROBLEM - MySQL Slave Delay on db33 is CRITICAL: CRIT replication delay 184 seconds [01:42:59] PROBLEM - MySQL Replication Heartbeat on db33 is CRITICAL: CRIT replication delay 184 seconds [01:43:31] onoes [01:45:30] hey who looks over bugzilla bugs? [01:45:41] PROBLEM - MySQL Slave Delay on db33 is CRITICAL: CRIT replication delay 184 seconds [01:46:08] PROBLEM - MySQL Replication Heartbeat on db33 is CRITICAL: CRIT replication delay 183 seconds [01:47:38] PROBLEM - Misc_Db_Lag on storage3 is CRITICAL: CHECK MySQL REPLICATION - lag - CRITICAL - Seconds_Behind_Master : 650s [01:48:41] PROBLEM - MySQL Slave Delay on db33 is CRITICAL: CRIT replication delay 194 seconds [01:48:59] PROBLEM - MySQL Replication Heartbeat on db33 is CRITICAL: CRIT replication delay 197 seconds [01:49:10] SteveAway: the bugmeister? why? [01:49:38] well dario put in a bug for my staff account to have +researcher added [01:49:48] just wondering when it was going to be looked at :-) [01:50:01] bug # ? [01:50:28] idk how to find it. [01:50:35] i don't know bugzilla very well :P [01:50:39] hrmmm, i can search [01:50:45] but this is probably the wrong time and place [01:50:51] and bugzilla isn't right either [01:50:53] lemne look [01:52:04] really, it's not? [01:52:16] SteveAway: the last bug he filed is 2012-06-03 13:58 UTC [01:52:17] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 5.408 seconds [01:52:33] hmm [01:52:40] SteveAway: yes, really it's not. it's not even a job for developers or for ops [01:52:52] it's a job for? [01:53:04] SteveAway: philippe could do it or lots of other people [01:53:09] oh [01:53:13] assuming you really mean researcher [01:53:25] yeah, Dario said he filed a request somewhere [01:53:42] Looks like a job for the A-Team. [01:54:21] SteveAway: maybe it was RT. but that's *still* not the right place for it [01:54:32] RT? [01:54:50] RECOVERY - Misc_Db_Lag on storage3 is OK: CHECK MySQL REPLICATION - lag - OK - Seconds_Behind_Master : 1s [01:54:51] RECOVERY - MySQL Slave Delay on db1025 is OK: OK replication delay 1 seconds [01:55:06] SteveAway: https://meta.wikimedia.org/w/index.php?title=Special:GlobalUsers&offset=&limit=100&username=&group=Staff [01:55:09] RECOVERY - MySQL Slave Delay on storage3 is OK: OK replication delay 6 seconds [01:55:14] SteveAway: those people can do it for you [01:55:45] SteveAway: is that at a specific wiki or what? [01:55:49] en [01:55:52] i think [01:56:13] PROBLEM - MySQL Slave Delay on db1020 is CRITICAL: CRIT replication delay 199 seconds [01:56:15] yeah. those are the people you want to ask i think [01:56:21] PROBLEM - MySQL Replication Heartbeat on db1020 is CRITICAL: CRIT replication delay 203 seconds [01:56:39] SteveAway: funny thing is dartar is on the list! ;) [01:56:48] RECOVERY - MySQL Replication Heartbeat on db1035 is OK: OK replication delay 21 seconds [01:56:51] -_- [01:57:42] RECOVERY - MySQL Slave Delay on db1035 is OK: OK replication delay 0 seconds [02:24:31] !log LocalisationUpdate completed (1.20wmf8) at Sun Aug 5 02:24:31 UTC 2012 [02:24:43] Logged the message, Master [02:26:04] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:37:37] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.030 seconds [04:37:53] PROBLEM - check_job_queue on spence is CRITICAL: JOBQUEUE CRITICAL - the following wikis have more than 9,999 jobs: , zhwiki (10348) [04:49:13] http://en.wikipedia.org/wiki/Wikipedia:Bureaucrats%27_noticeboard#Revising_the_user_rights_for_the_Education_Program_extension [04:53:21] PROBLEM - check_job_queue on neon is CRITICAL: JOBQUEUE CRITICAL - the following wikis have more than 9,999 jobs: , zhwiki (10078) [04:59:48] RECOVERY - MySQL Replication Heartbeat on db1020 is OK: OK replication delay 28 seconds [04:59:57] RECOVERY - MySQL Slave Delay on db1020 is OK: OK replication delay 0 seconds [05:03:51] RECOVERY - check_job_queue on spence is OK: JOBQUEUE OK - all job queues below 10,000 [05:08:48] RECOVERY - check_job_queue on neon is OK: JOBQUEUE OK - all job queues below 10,000 [05:45:33] PROBLEM - check_job_queue on spence is CRITICAL: JOBQUEUE CRITICAL - the following wikis have more than 9,999 jobs: , zhwiki (11449) [05:48:14] RECOVERY - MySQL Replication Heartbeat on db33 is OK: OK replication delay 0 seconds [05:48:41] RECOVERY - MySQL Slave Delay on db33 is OK: OK replication delay 0 seconds [05:50:29] PROBLEM - check_job_queue on neon is CRITICAL: JOBQUEUE CRITICAL - the following wikis have more than 9,999 jobs: , zhwiki (11360) [06:46:11] PROBLEM - Puppet freshness on srv281 is CRITICAL: Puppet has not run in the last 10 hours [07:17:42] PROBLEM - Puppet freshness on labstore1 is CRITICAL: Puppet has not run in the last 10 hours [07:30:45] PROBLEM - Puppet freshness on neon is CRITICAL: Puppet has not run in the last 10 hours [07:54:45] PROBLEM - Puppet freshness on ocg3 is CRITICAL: Puppet has not run in the last 10 hours [08:10:16] nagios-wm: I don't remember, since when you make us company again here? [08:13:43] uh, August 2, 21.41 UTC it seems [08:34:05] PROBLEM - Puppet freshness on ms-be1003 is CRITICAL: Puppet has not run in the last 10 hours [08:39:17] Nemo_bis: I thought there was a bug to remove nagios-wm from here. [08:40:20] Brooke: it has been removed ages ago [08:41:54] omg nagios-wm² to report status of nagios-wm https://bugzilla.wikimedia.org/show_bug.cgi?id=26784 [08:44:56] there's two of them in -operations! [08:48:06] "Well, who's gonna monitor the monitors of the monitors?" [08:49:04] PROBLEM - Puppet freshness on virt1001 is CRITICAL: Puppet has not run in the last 10 hours [08:52:24] closedmouth: There are, not there is. [08:52:55] there're two fingers that i'm holding up to the screen right now [08:53:22] Making a peace sign? [08:54:41] nope! [09:02:11] PROBLEM - Puppet freshness on virt1002 is CRITICAL: Puppet has not run in the last 10 hours [09:17:28] PROBLEM - Puppet freshness on virt1003 is CRITICAL: Puppet has not run in the last 10 hours [10:01:52] anyone able to tell me why GADGETS are missing at meta? [10:02:08] are they? [10:02:14] they are for me [10:02:48] so do they for me [10:03:12] I will check bugzilla [10:04:07] weird, extension is enabled [10:07:46] Reedy https://bugzilla.wikimedia.org/show_bug.cgi?id=39050 [10:09:23] sDrewth: i actually never sued anybody... [10:09:58] hehehe [10:10:23] phat phlingers [10:11:12] Danny_B|backup: you can sue for peace [10:12:09] (transitive) To seek by request; to make application; to petition; to entreat; to plead. [10:47:30] PROBLEM - Puppet freshness on ms-be1006 is CRITICAL: Puppet has not run in the last 10 hours [10:47:31] PROBLEM - Puppet freshness on ms-be1005 is CRITICAL: Puppet has not run in the last 10 hours [10:47:31] PROBLEM - Puppet freshness on ms-be1009 is CRITICAL: Puppet has not run in the last 10 hours [12:35:27] PROBLEM - Puppet freshness on bayes is CRITICAL: Puppet has not run in the last 10 hours [12:37:23] PROBLEM - Puppet freshness on niobium is CRITICAL: Puppet has not run in the last 10 hours [12:37:23] PROBLEM - Puppet freshness on srv242 is CRITICAL: Puppet has not run in the last 10 hours [12:38:26] PROBLEM - Puppet freshness on srv238 is CRITICAL: Puppet has not run in the last 10 hours [12:38:26] PROBLEM - Puppet freshness on mw27 is CRITICAL: Puppet has not run in the last 10 hours [12:38:26] PROBLEM - Puppet freshness on srv190 is CRITICAL: Puppet has not run in the last 10 hours [13:14:34] Can some seriously claim that this diff "style" is a matter of taste?! http://it.wikipedia.org/w/index.php?title=Idazio&diff=27241333&oldid=27227724 [13:14:54] I wonder how many wikis have obsoleted diff crap in their styles. [13:15:04] Maybe hoo would know [13:15:51] Nemo_bis: I'm not sure what you mean [13:16:11] Where are several wikis which emulate the old diffs [13:16:14] eg. dewiki does that [13:16:21] hoo: it.wiki still has the french diff styles in the local common.css [13:16:32] together with the MW 1.20 style it makes a crime [13:17:18] but local users seem to be clueless about it (I guess all techy sysops resigned or were removed) [13:18:56] dewiki doesn't have the gadget as default... anyway, if I change it on itwiki, I'll probably go strait to jail :P [13:24:36] Nemo_bis: I can remove it, if there's consens, but I guess there isn't... so what should we do about that? [13:34:34] hoo: I only wondered if you knew about the general situation [13:35:09] most small wikis are likely to have years old styles nobody maintains [13:36:36] Nemo_bis: That's true, but I'm not aware of many wikis copying the itwiki JS... possible the it sister projects, but not much more [13:36:58] It's worse with de, fr and mostly of course with enwiki [13:38:12] hoo: what do you mean that it's worse? [13:38:28] it.wiki just has the old fr.wiki style [13:38:30] They're blindly copied to more wikis [13:40:07] Nemo_bis: You could loop though all projects, wget the common.css and look for the class name [13:40:07] s [13:40:17] that could even be done in bash, I guess [13:43:46] yawn [13:44:25] Nemo_bis: Shall I run it on TS? [13:44:44] hoo: yes :) [13:53:18] Nemo_bis: Which string(s) shall I search for? [13:53:40] hoo: I don't know exactly [13:54:22] hoo: maybe just td.diff would be enough [14:04:32] any idea whom i could ask about encoding / escaping rules of the pagecount files on http://dumps.wikimedia.org/other/pagecounts-raw/2012/2012-08 ? [14:05:49] seems %27 are not translated into ' while %20 seem to be translated to _ [14:08:20] ezachte AT wikimedia.org [14:09:15] Nemo_bis: http://pastebin.com/tuwb0jG4 Just started it ;) [14:09:17] :) [14:13:13] For such jobs bash just beats all Scripting/ Programming languages :) [14:16:25] Nemo_bis: http://toolserver.org/~hoo/tmp/diffWikis.txt [14:17:46] (I have to admit, the empty lines look uggly) [14:52:36] hoo|away: I think you could remove it where it was added before 1.20 saying they can revert if they really want it? at least on the small wikis [14:54:59] Nemo_bis: Mhm [15:01:24] hoo: or maybe warn on the talk before and do it if there are no objections, I don't know [15:01:31] luckily there are not many wikis [15:01:44] or what else could/should we do? [15:02:45] Nemo_bis: That's probably the way to go... do you want to notify them? [15:02:59] ok [16:47:13] PROBLEM - Puppet freshness on srv281 is CRITICAL: Puppet has not run in the last 10 hours [17:18:25] PROBLEM - Puppet freshness on labstore1 is CRITICAL: Puppet has not run in the last 10 hours [17:20:32] * jubo2 observes tumbleweed rolling by [17:31:19] PROBLEM - Puppet freshness on neon is CRITICAL: Puppet has not run in the last 10 hours [17:55:19] PROBLEM - Puppet freshness on ocg3 is CRITICAL: Puppet has not run in the last 10 hours [17:58:28] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:02:40] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 2.279 seconds [18:13:40] hi. I am having problem to approve mails sent to here: https://lists.wikimedia.org/mailman/listinfo/unblock-pt-l [18:14:11] the page keeps loading for a while and then server fails [18:35:18] PROBLEM - Puppet freshness on ms-be1003 is CRITICAL: Puppet has not run in the last 10 hours [18:36:20] doesn't seem to be good [18:37:15] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:46:07] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.032 seconds [18:50:19] PROBLEM - Puppet freshness on virt1001 is CRITICAL: Puppet has not run in the last 10 hours [18:56:42] Teles: eia had a similar problem [18:57:04] you should probably file a bug if nobody did already [19:00:55] Nemo_bis: is it recent for you? [19:01:11] oh... I mean eia [19:02:05] Teles: yes, yesterday maybe? [19:03:22] PROBLEM - Puppet freshness on virt1002 is CRITICAL: Puppet has not run in the last 10 hours [19:03:36] Teles: is it the same on http? [19:07:26] now I can't access anymore... I will check if the password was changed as I just refered this problem to the administrator of the list [19:18:22] PROBLEM - Puppet freshness on virt1003 is CRITICAL: Puppet has not run in the last 10 hours [19:18:22] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:30:12] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 8.491 seconds [20:04:30] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:16:30] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.026 seconds [20:18:18] PROBLEM - SSH on amslvs1 is CRITICAL: Server answer: [20:19:57] RECOVERY - SSH on amslvs1 is OK: SSH OK - OpenSSH_5.9p1 Debian-5ubuntu1 (protocol 2.0) [20:45:34] hoo: warning projects [20:45:49] hoo: https://jv.wikipedia.org seems to load HTTP stuff over HTTPS [20:45:50] ah, fine :) [20:46:09] not to mention the huge (outdated?) sitenotice [20:48:09] PROBLEM - Puppet freshness on ms-be1009 is CRITICAL: Puppet has not run in the last 10 hours [20:48:10] PROBLEM - Puppet freshness on ms-be1005 is CRITICAL: Puppet has not run in the last 10 hours [20:48:10] PROBLEM - Puppet freshness on ms-be1006 is CRITICAL: Puppet has not run in the last 10 hours [20:49:19] Nemo_bis: Can't find any on first sight... what skin? [20:49:57] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:51:28] hoo: ehm I don't know can't find that tab right now [20:51:37] maybe the warning was about another wiki? [20:52:04] probably that one looks fine in both vector and monobook [20:55:21] uh big sitenotice on es.news [20:56:01] Nemo_bis: what version of librsvg we have on servers? [20:56:05] hoo: it was id.wikt [20:56:08] !log reedy synchronized wmf-config/CommonSettings.php 'Add some eqiad internal ips for squids to wgSquidServersNoPurge' [20:56:11] matanya: why should I know? [20:56:18] Logged the message, Master [20:56:18] of course an old and broken one, as always [20:56:23] Reedy: ^ [20:56:28] maybe you do? [20:56:50] reedy@fenari:~$ rsvg --version [20:56:50] rsvg version 2.26.3 (Wikimedia) [20:57:08] Nemo_bis: Oh my god... it's common.js looks terrible [20:57:08] when was it updated? [20:57:17] matanya: Quite recently [20:57:24] thought so [20:57:24] hoo: done [20:57:34] matanya: together with Ubuntu update surely? [20:57:40] new bugs? [20:57:55] That's why I can reproduce an old bug [20:58:00] *can't [20:58:05] orly [20:58:09] unbelievable [20:58:16] probably the bug was invalid before as well [20:58:21] Nemo_bis: No actually, we update it quite regularly [20:58:29] Jarry1250: ?? [20:58:41] More often than Ubuntu [20:58:44] hoo: you can edit talks can't you? [20:58:51] hear hear [20:58:53] (I'm guessing, mind) [20:58:59] Nemo_bis: Sure [20:59:02] then you're probably wrong [20:59:11] :O [20:59:12] hoo: https://wo.wiktionary.org/wiki/Waxtaani_MediaWiki:Common.css#Diff_style copy to https://zh.wikibooks.org/?title=MediaWiki_talk:Common.css&action=edit§ion=new&preloadtitle=Diff+style [20:59:21] crazy zh censors [20:59:54] Nemo_bis: current version is 2.36, so we lag behind [21:00:27] matanya: define "current" [21:00:35] latest stable [21:00:39] wtf, map-bms.wikipedia.org is not part of autologin? [21:00:40] I believe we just stick with whatever's in the repo [21:01:12] It's up to date for 10.04 [21:01:16] it should be upgraded for 12.04 [21:01:37] Jarry1250: yep [21:01:40] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.022 seconds [21:01:53] I can't login to map-bms.wikipedia.org [21:02:31] Nemo_bis: there you go https://zh.wikibooks.org/wiki/MediaWiki_talk:Common.css#Diff_style [21:02:37] hoo: thanks [21:02:50] hoo: also map-bms.wikipedia.org [21:03:06] on it [21:03:26] and krc.wikipedia.org [21:03:37] have we introduced an autocreation throttle or something?? [21:03:54] Nemo_bis: No [21:04:01] Title blacklist, probably [21:04:28] hoo: ?? [21:04:35] omg blinking "new messages" on bjn.wikipedia.org [21:04:48] Nemo_bis: The title blacklist blocks local account creations often [21:04:56] either the global one or a local one [21:05:03] I've seen that more than often enough [21:05:04] hoo: how so? [21:05:22] my username is surely not blacklisted [21:06:00] I have created only 14 accounts btw [21:06:27] including those two wikis, it just doesn't let me login [21:06:39] I suppose that's tha old bug still [21:07:55] ah no https://bugzilla.wikimedia.org/show_bug.cgi?id=29234 is another story [21:08:22] done on krc [21:08:28] Krenair: ^ [21:08:30] checking your account on map-bms [21:09:10] Nemo_bis: | 4810 | Nemo bis | 20120805204443 [21:09:16] on map_bmswiki_p [21:10:27] Nemo_bis, ? [21:11:14] Krenair: some reincarnation of that bug [21:11:32] hoo: also wo.wikt and mwl.wiki please [21:11:33] sigh [21:12:27] Nemo_bis: Your accounts there look fine... can't you use them? [21:13:46] hoo: no [21:14:33] Nemo_bis: Do they appear in Special:MergeAccount? (to lazy to look myself) [21:15:24] hoo: they appear in stalktoy [21:15:42] Yes, but what about MergeAccount [21:15:53] hoo: they do [21:15:53] does it say, they're merged? It probably does :/ [21:16:06] Have you tried logging in and out again? [21:16:06] pathos' tools never lie [21:16:19] hmpf no, how can it matter [21:16:27] !log reedy synchronized wmf-config/CommonSettings.php 'more cp updates to $wgSquidServersNoPurge' [21:16:35] Logged the message, Master [21:17:52] Nemo_bis: I've tried to edit both now... but you were faster... [21:18:04] what happens if you try to log in there locally? [21:18:35] hoo: error [21:18:58] ah found it [21:19:01] Nemo_bis: thanks for you effort on he.wiki [21:19:08] perhaps [21:19:11] matanya: hm? [21:19:23] the diff stuff [21:21:35] https://bugzilla.wikimedia.org/show_bug.cgi?id=39060 [21:25:34] Nemo_bis: The user table seem to be missing information [21:25:49] hoo: email? [21:26:12] I'm not sure how CentralAuth works, tbh... but I guess it tries to catch information from somewhere and that doesn't work out... so it creates "broken" users [21:26:29] Nemo_bis: I guess not (user_email_authenticated is 0) [21:26:39] I can't see the mail itself, I only got TS access :/ [21:27:09] of course [21:27:58] ah, those are coming from memcached [21:28:13] hoo: isn't that field for accounts attached with email [21:29:29] matanya: ah your diff was already udpated? I posted messages a bt blindly :p [21:30:38] you can rollback it if you want :D [21:34:44] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:43:03] Nemo_bis: $user->loadDefaults( $userName ); $user->addToDatabase(); [21:43:15] I guess in your cases $user just wasn't complete [21:44:47] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.182 seconds [21:54:10] hoo: CA's DB has some problem I think [21:54:27] !log reedy synchronized wmf-config/CommonSettings.php 'Update per rearrangements etc' [21:54:31] I doubt it's the DB [21:54:35] Logged the message, Master [21:55:41] I guess at that point in attemptAddUser the extension should try to verify the values it inserts into the DBs against it's master [21:56:12] cause the values probably come from memcached or another not 100% reliable source [22:13:15] Nemo_bis: Do you keep track of all the discussion contributions? [22:18:32] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:19:18] hoo: hm? [22:19:43] Nemo_bis: I mean the common.css diff thingy [22:21:26] hoo: I still don't understand [22:21:35] I just posted the message to the wikis you listed. [22:21:54] I know... do you have any plan of keeping track of those? [22:22:49] I'm not going to discuss there; after a week or more you pass, if the message is there and noone objected you go on; if someone replied and you don't understand or they disagrees or they reverted my message in anger or whatever, you don't do aythign and we forget about them [22:23:46] I know... the question was, whether you keep track of that and tell me which wikis I can "do" or I have to do that [22:24:01] I'm fine with that work, those aren't to many wikis, but still only one should do it :D [22:28:40] hoo: no I don't, I suggest to do as above. ^ [22:28:57] ok, I'll keep the list then and look in a week (?) [22:30:14] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.032 seconds [22:35:56] PROBLEM - Puppet freshness on bayes is CRITICAL: Puppet has not run in the last 10 hours [22:38:02] PROBLEM - Puppet freshness on niobium is CRITICAL: Puppet has not run in the last 10 hours [22:38:02] PROBLEM - Puppet freshness on srv242 is CRITICAL: Puppet has not run in the last 10 hours [22:38:56] PROBLEM - Puppet freshness on srv190 is CRITICAL: Puppet has not run in the last 10 hours [22:38:56] PROBLEM - Puppet freshness on mw27 is CRITICAL: Puppet has not run in the last 10 hours [22:38:57] PROBLEM - Puppet freshness on srv238 is CRITICAL: Puppet has not run in the last 10 hours [22:44:29] gn8 folks [23:00:07] Broken JS... I hate it [23:02:39] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:05:35] who doesn't [23:12:51] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 7.167 seconds [23:47:05] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:56:14] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 8.185 seconds