[11:51:24] (03PS1) 10Giuseppe Lavagetto: Add fake docker credentials to hieradata [labs/private] - 10https://gerrit.wikimedia.org/r/388034 [11:53:13] (03CR) 10Giuseppe Lavagetto: [V: 032 C: 032] Add fake docker credentials to hieradata [labs/private] - 10https://gerrit.wikimedia.org/r/388034 (owner: 10Giuseppe Lavagetto) [13:48:21] (03CR) 10Hashar: "check experimental" [labs/striker] - 10https://gerrit.wikimedia.org/r/387068 (owner: 10BryanDavis) [13:50:10] (03CR) 10jenkins-bot: Fix "E722 do not use bare except" [labs/striker] - 10https://gerrit.wikimedia.org/r/387068 (owner: 10BryanDavis) [14:04:48] matanya, quiddity: I'd like to get Topbanana tools working again. https://wikitech.wikimedia.org/wiki/Help:Toolforge/Abandoned_tool_policy#Adoption https://en.wikipedia.org/wiki/User_talk:Topbanana#Tools_are_502ing [14:05:19] They're vital in http://enwp.org/WP:RLR [14:06:56] And other Toolforge standards committee members: Eranroz - Harej - Huji - Ladsgroup - Zhuyifei1999 [15:06:45] There was response lack on login.tools.wmflabs.org and tools-bastion-03 but now it seems ok. [15:07:46] fnielsen: perhaps a load peak [15:08:46] 0,45 1.5 6.0 [15:16:31] we have had quite a few people running pywikibot processes directly on the bastions lately. :/ [15:16:56] When I see the processes running I just kill them, but that's a very imperfect solution [15:18:27] alias pywikibot='echo nooooo please dont' and let puppet add that to all ~/.bashrc ? [15:21:44] aren't there any alternative for users? [15:26:37] or the system wide /etc/bashrc :) [15:57:34] python pwb.py <--- is this pywikibot? [16:00:23] arturo: yes https://github.com/wikimedia/pywikibot-core https://en.wikipedia.org/wiki/Wikipedia:Creating_a_bot [16:02:36] my method of checking is -- ps auxw|grep -v ^diamond|grep python [16:14:00] isn't the bastion supposed to only be used for (potentially long-running) ssh sessions and proxied connections to other VMs? [16:14:12] and perhaps a few other (short running) commands [16:14:32] perhaps have an alert for any process that is 1) long-running, and 2) not one in a whitelist of (ssh, netcat, ...) [16:15:43] !log tools Restarted nslcd on tools-bastion-03 [16:15:46] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [16:29:13] Dispenser, it might help if you give Topbanana a link to the tool interface directly. That makes things easier for them - people like it when things are made easy! I.e. https://tools.wmflabs.org/admin/tool/tb-dev [16:29:50] It's like his only tool [16:37:31] Dispenser, yes, but the difference between "1 easy click", versus "I have to search/remember where the interface is", can be the difference between procrastinating and not-procrastinating. [16:43:12] It would've been really useful if I had gotten the chance to save the databases before the server burned up. [16:44:46] can they be regenerated? [16:48:23] quiddity: https://en.wikipedia.org/w/index.php?title=User_talk:Topbanana&diff=808397957&oldid=806596887 [16:49:09] :) (I'm just trying to make things easier/more-likely to work. :) [16:49:37] Dispenser: I haven't sent a message yet, but we have been able to get c1.labsdb up and running again. We aren't sure how long it will last, but right now you can try to archive tables/databases from it. [16:49:55] Depends how he handled his Toolserver => Tool Labs transition. Sometimes things are incrementally built with no clean build option. [16:49:58] If it goes down again it will probably be done forver [16:50:17] login.tools.wmflabs.org is unresponsibe again [16:50:30] (or it's just me?) [16:50:38] yeah. I think there are scp copies eating all of the IOPS [16:50:44] :/ [16:52:12] load 6 5 3 [16:52:17] the IO should seriously be quota'ed somehow [16:52:42] bd808: Should I downgrade encryption on my SSH tunnel? I've noticed 2-5x increase when transferring data to a raspberry pi. [16:53:29] (raspberry pi as only an example) [16:54:32] Dispenser: the first thing you could do is to move your tunnel endpoint to tools-dev [16:54:48] already done [16:55:12] and you are still getting lag that you think is ssh encryption overhead? [16:55:40] load on tools-dev is 0.16 [17:00:47] Just looking to improve everyday operations [17:11:15] IIRC, I ask to join Topbanana in TS days, but he wasn't interested. RLR isn't really my thing, but I'd like to do some UI overhaul. [17:13:35] zhuyifei1999_ and Amir1: From earlier today: I'd like to get Topbanana tools working again. https://wikitech.wikimedia.org/wiki/Help:Toolforge/Abandoned_tool_policy#Adoption https://en.wikipedia.org/wiki/User_talk:Topbanana#Tools_are_502ing They're vital in http://enwp.org/WP:RLR [17:15:46] Dispenser: have you created a phabricator task. I think that's the published process. https://phabricator.wikimedia.org/project/view/2457/ [17:22:07] Dispenser: yeah we’ll get that processes [17:22:34] There aint a template yet [17:23:31] you can just specify the name of the tool you are adopting [17:23:43] and link to the notification [17:24:30] *processes => processed [17:38:46] hey Cyberpower678 [17:39:21] iabot has a job queue started from around 911-920 [17:39:28] and its not started [17:46:55] zhuyifei1999_, Amir1, matanya, quiddity: https://phabricator.wikimedia.org/T179599 [18:07:16] bd808: see https://en.wikipedia.org/wiki/User_talk:Bishonen#strangeness - any idea why this happened? [18:09:17] DatGuy: that's way out of my MediaWiki internals comfort zone. I bet Reedy could figure it out. [18:38:40] (03CR) 10Ayounsi: [V: 032 C: 032] Add fake keys for Netbox deployment [labs/private] - 10https://gerrit.wikimedia.org/r/387878 (owner: 10Ayounsi) [18:53:20] Seems TB has incremental backups /data/project/tb-dev/db_backup [20:22:46] !log tools.tb-dev Added Zhuyifei1999 as maintainer to investigate T179599 [20:22:50] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.tb-dev/SAL [20:22:51] T179599: Adoption of tb-dev Red Link Recovery tools - https://phabricator.wikimedia.org/T179599 [20:30:55] DatGuy: is Kees08 still trying to help you out with SportsStatsBot? Their toolforge access is still pending with an ask from me for some additional data. [20:31:51] well, one task got approved, but I think we're still trying to automate every statistics sport-related thing [20:32:00] what do you mean "with an ask from me for some additional data" ? [20:32:33] they haven't linked their account with their SUL or Phabricator accounts [20:32:57] having one or the other makes it easier for us to make sure we have a way to contact people [20:33:11] ah alright, I'll tell him that when he gets back from work [20:33:25] we pretty much live in flipped timezones so it's pretty difficult to collaborate [20:33:34] heh. I know how that goes [20:42:10] bd808: What are the plans for tools that require user tables? E.g. I have several tools using summary tables, total backlink count, articles in WikiProjects. [20:44:26] Dispenser: the tools.db.svc.eqiad.wmflabs server will remain open for user tables. There is also discussion but no final decision yet on supporting 'curated' tables that would be replicated from tools.db to the wiki replica servers. [20:45:06] the discussion about replicated tables is at T173511 [20:45:07] T173511: Implement technical details and process for "datasets_p" on wikireplica hosts - https://phabricator.wikimedia.org/T173511 [20:49:27] (03Draft2) 10Zppix: Start an area for the proposed GCI Task: "Document ZppixBot" [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/388168 [20:50:45] (03CR) 10Zppix: [C: 032] Start an area for the proposed GCI Task: "Document ZppixBot" [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/388168 (owner: 10Zppix) [20:50:52] (03Merged) 10jenkins-bot: Start an area for the proposed GCI Task: "Document ZppixBot" [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/388168 (owner: 10Zppix) [20:53:11] bd808: seems like I lied when I said that OAuth is pretty much done. "The authorization headers in your request are not valid: No approved grant was found for that authorization token" error.log: https://pastebin.com/2tkBbHKm createpage.php: https://pastebin.com/QSX7BGw0 [20:56:19] DatGuy: can you share the access token? [20:57:02] I believe it fails at $requestToken [20:57:54] not 100% sure why since I'm pretty sure I use the same exact line in another file [21:02:35] "Undefined property: stdClass::$key in /data/project/olympics/public_html/vendor/mediawiki/oauthclient/src/Client.php on line 179" -- that doesn't look good [21:04:23] that looks like the json_decode() of the server response failing [21:04:33] (crappy error handling there too) [21:10:57] "no approved grant" should be in response to an access token since that's the only step that happens after the grant approval process [21:19:59] I mean, it just breaks when trying to get the access token [21:20:16] request token* [21:20:50] so that's probably a non-fatal error, but crashes the script when it can't execute $client->complete [21:30:47] hmm wikibugs has left [21:30:51] legoktm ^^ [21:52:33] paladox: it came back by itself I assume? [21:52:39] oh [21:52:43] heh thanks :) [23:08:38] !log wikilabels staging ores-wmflabs-deploy:06b43e9 [23:08:40] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikilabels/SAL [23:10:35] !log wikilabels deploying ores-wmflabs-deploy:06b43e9 [23:10:37] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikilabels/SAL [23:55:14] !log tools.tb-dev Added harej as maintainer to double check stuffs for T179599 [23:55:17] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.tb-dev/SAL [23:55:17] T179599: Adoption of tb-dev Red Link Recovery tools - https://phabricator.wikimedia.org/T179599