[00:31:29] Coren, did you ever get my emaill? [06:13:19] 3Pywikibot-compat-to-core, Tool-Labs, pywikibot-compat, pywikibot-core: patrol.py depends on mwlib.uparser not available on wmflabs - https://phabricator.wikimedia.org/T71980#944239 (10jayvdb) [06:56:08] PROBLEM - Puppet failure on tools-dev is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [07:26:06] RECOVERY - Puppet failure on tools-dev is OK: OK: Less than 1.00% above the threshold [0.0] [08:10:25] 3Tool-Labs: Transfer domain toolserver.org to WMF - https://phabricator.wikimedia.org/T62864#944296 (10TTO) 5stalled>3Resolved ``` $ whois toolserver.org Whois v1.12 - Domain information lookup utility Sysinternals - www.sysinternals.com Copyright (C) 2005-2014 Mark Russinovich Connecting to ORG.whois-serv... [08:10:27] 3Tool-Labs: Toolserver migration to Tools (tracking) - https://phabricator.wikimedia.org/T60788#944299 (10TTO) [08:10:28] 3Tool-Labs: Set up redirect webserver for toolserver.org - https://phabricator.wikimedia.org/T62238#944300 (10TTO) [08:42:58] hmm [08:43:06] Shinken has 2.0 packages in jessi [08:43:06] e [08:43:20] so yay there [17:59:08] 3Tool-Labs: Gerrit Patch Uploader does not work - https://phabricator.wikimedia.org/T85319#944498 (10DLindsley) @Fomafix: You're probably saying that the patch uploader delivers the empty HTML page when clicking the "Submit" button. Does the patch still upload, however? [17:59:19] Coren, ping [18:04:51] 3Tool-Labs: Gerrit Patch Uploader delivers empty HTML page when submitting patch - https://phabricator.wikimedia.org/T85319#944500 (10DLindsley) [18:06:40] 3Tool-Labs: Gerrit Patch Uploader delivers empty HTML page when submitting patch - https://phabricator.wikimedia.org/T85319#943939 (10DLindsley) [20:02:08] Is there anyone available that can restart wm-bot2? It's currently known as user155. Thanks. [20:02:08] Hey T13|mobile, you are welcome! [20:02:16] ... [20:29:31] Coren, I'm getting Internal Errors on xTools. Nothing has changed there. [20:31:32] Nvm. They went away on their own. [20:54:40] 3Tool-Labs: Gerrit Patch Uploader delivers empty HTML page when submitting patch - https://phabricator.wikimedia.org/T85319#944576 (10Fomafix) @DLindsley: The patch does not get uploaded. I just get an empty HTML page. It doesn't matter if I fill all fields or not. [20:56:01] Cyberpower678: is it a lack of resources to keep up with requests or are available resources not being allocated effectively enough? [20:57:26] TBH, not sure exactly. Hedonil did so much tinkering to it, I'm a little lost in what he changed. [20:58:00] But the xTools is being called on a lot and it's definitely noticed immediately when it goes down. [21:06:18] I hedonil ever available anymore? [21:07:02] @seen TParis [21:07:03] T13|mobile: Last time I saw TParis they were quitting the network with reason: no reason was given N/A at 12/1/2014 8:01:53 AM (25d13h5m9s ago) [21:07:20] @seen Hedonil [21:07:20] T13|mobile: Last time I saw Hedonil they were leaving the channel #wikimedia-labs at 9/22/2014 10:02:49 PM (94d23h4m31s ago) [21:07:28] Even worse.. [21:40:51] T13|mobile, I've tried contacting him. [21:40:55] But no luck. [21:41:57] He's the only one currently on the project with access to the tool, right? [21:42:15] T13|mobile, I was thinking about moving xTools to it's own instance on Labs. xtools.wmflabs.org [21:42:22] Or was that another tool? [21:42:24] T13|mobile, I have access. [21:42:35] Wikiviewstats, is what I need access to. [21:43:04] Ahh. I had them confused. Can Coren add you to that? [21:43:34] I've been asking him, but he never responds [21:44:57] An xTools instance might be a good idea. [21:46:00] Except I'm missing the expertise needed to set one up. [21:46:35] stwalkerster might be able to help? [21:46:46] ? [21:46:53] He may be too busy for that, and in completely wrong timezones. [21:47:02] He's here. :O [21:47:53] Cyberpower678, is xtools currently running under zend or hhvm? [21:48:13] stwalkerster, I'm thinking of moving xTools to it's own instance, but have no idea how to set one up. [21:48:23] Cp wants help setting up an xTools.wmflabs and I'm wondering which branch you wanted me to test for acc [21:49:05] Cyberpower678, what's the issue that is making you want your own instance? [21:49:12] IDK. I'm completely clueless with server setups. All I know is coding. My field of study is electrical engineering. [21:49:26] T13|mobile, I think I already put it live :P [21:49:42] stwalkerster, tools is seemingly in high demand. [21:49:48] It's causing outages. [21:50:35] But weather that is really the cause of outages or not is the big. Heeding made so many modifications to the tools, it's like an entirely new set of tools. [21:50:46] stwalkerster: fair enough. [21:51:04] AKA I feel like I was just added as maintainer to tools that were already in existence. [21:51:30] Cyberpower678, rollback to the old version and see if the outages stop? That would give you more of an idea :P [21:51:46] That makes the outages worse. [21:52:02] hedonic's version did stabilize it, but not completely. [21:52:41] Web services are still OOMing. But I can't find any locations of memory leaks. My conclusion, so many requests are being made causing the OOM to happen. [21:53:15] Have you checked access logs to confirm there's lots of requests? [21:56:19] and what specifically is OOMing? also, have you thrown a profiler at the code? [21:58:25] An average of 4 requests per second [21:58:48] stwalkerster, ^ [21:58:59] Out Of Memory [21:59:07] And what's a profiler? [21:59:18] * Cyberpower678 thinks he should step down as tool maintainers [22:00:29] yeah, a number of things can trigger that. Is it the script hitting the php mem limit, or is it something lower-level like the process getting killed? [22:02:22] If it was the script hitting the PHP me limit, then a fatal error would show up on the browser. But the web service on tools is getting killed, and that is happening when it hits the set mem limit of the web service, which is likely due to all these request. [22:07:50] stwalkerster, ^ [22:07:53] Right, ok. I think you'd definitely benefit from knowing exactly what is causing your memory usage [22:08:12] I can add you as a maintainer. [22:09:04] * T13|mobile chuckles. [22:09:19] You can use a profiler for that - if it's a good-enough profiler then it'll show you detailed stats on mem usage. There's a php extension you can use called xdebug for that, I recommend you look at installing it on your development machine :) [22:10:03] T13|mobile, glad I can make you chuckle. I'm going to need the replication DBs to even test the scripts. [22:10:22] stwalkerster, the second sentence was for you. [22:10:40] T13|mobile, Can I know what is funny? :p [22:12:02] Cyberpower678, pass me a link to your source repository, and I'll have a quick play on my local machine [22:13:24] stwalkerster, https://github.com/x-Tools/xtools FWIW, I added you to xTools. Welcome to the xTools family. [22:17:56] I think it's funny Simon is getting sucked into another project. :P [22:19:00] Projects on labs are like a black hole... walk too close and you get sucked in as a maintainer... :P [22:19:54] T13|mobile, I really don't need another project. My current project is fixing my desktop, that I managed to accidentally delete the EFI partition on (long story...) [22:20:50] That makes it even funnier! Sorry, I'm a wee bit twisted that way. :p [22:28:05] T13|mobile, that actually is funny. [22:28:25] (03PS1) 10Ricordisamoa: Fix some typos in documentation files [labs/tools/lists] - 10https://gerrit.wikimedia.org/r/181876 [22:28:45] * Cyberpower678 FINALLY found his soldering iron. :p [22:30:01] (03CR) 10Ricordisamoa: Fix some typos in documentation files (031 comment) [labs/tools/lists] - 10https://gerrit.wikimedia.org/r/181876 (owner: 10Ricordisamoa)