[00:11:32] 10MediaWiki-extensions-OpenStackManager: Remove pre-AuthManager compability - https://phabricator.wikimedia.org/T178031#3678327 (10Reedy) [00:39:14] 10MediaWiki-extensions-OpenStackManager, 10Patch-For-Review: Remove pre-AuthManager compability - https://phabricator.wikimedia.org/T178031#3678478 (10Reedy) a:03Reedy [00:40:07] 10MediaWiki-extensions-OpenStackManager, 10Patch-For-Review, 10Technical-Debt: Remove pre-AuthManager compability - https://phabricator.wikimedia.org/T178031#3678484 (10Reedy) [01:42:09] zhuyifei1999_, re: HEAD/master, possibly you ran into the same problem I did at https://phabricator.wikimedia.org/T177785 [01:42:44] (or related. or that'll help explain something. :) [01:53:05] quiddity: k [04:31:58] File "./oge-crontab", line 92, in _remote [04:31:58] encoding='utf-8') [04:31:58] TypeError: __init__() got an unexpected keyword argument 'encoding' [04:32:10] am I misreading the docs? o.O [04:32:19] (subprocess.Popen) [04:34:24] argh https://docs.python.org/3.4/library/subprocess.html#subprocess.Popen no encoding in py3.4 [04:55:13] (03PS1) 10Zhuyifei1999: crontab: make tempfile use utf-8 encoding [labs/toollabs] - 10https://gerrit.wikimedia.org/r/383770 (https://phabricator.wikimedia.org/T156174) [05:00:43] 10Toolforge, 10Tracking: Tools that should get deleted (tracking) - https://phabricator.wikimedia.org/T133777#3678661 (10Liuxinyu970226) @MarcoAurelio @QChris Since archive/deletions of extensions or skins are handled by #cleanup, why don't we replace this by creating "Archive tools" column on that tag? [05:12:59] 10Toolforge, 10Tracking: Tools that should get deleted (tracking) - https://phabricator.wikimedia.org/T133777#3678667 (10zhuyifei1999) Because the process of deleting a tool has not been developed. [06:24:48] (03CR) 10Legoktm: [C: 032] Remove gerrit notifications for #wikimedia-codereview [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/383656 (https://phabricator.wikimedia.org/T177974) (owner: 10EddieGP) [06:25:12] (03Merged) 10jenkins-bot: Remove gerrit notifications for #wikimedia-codereview [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/383656 (https://phabricator.wikimedia.org/T177974) (owner: 10EddieGP) [06:25:21] (03CR) 10jenkins-bot: Remove gerrit notifications for #wikimedia-codereview [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/383656 (https://phabricator.wikimedia.org/T177974) (owner: 10EddieGP) [07:01:21] 10Cloud-Services, 10Outreachy (Round-15): Proposal: Improvements for the Toolforge 'webservice' command - https://phabricator.wikimedia.org/T177603#3678720 (10Sowjanyavemuri) Hi @madhuvishy , Thanks for the suggestions. I was held up with exams for a while. Shall start working on the proposal and surely will... [09:38:18] 10Tools: pagetranslation log_type missing on replicas - https://phabricator.wikimedia.org/T178052#3678975 (10Steinsplitter) [10:10:36] 10MediaWiki-extensions-OpenStackManager, 10MW-1.31-release-notes (WMF-deploy-2017-10-17 (1.31.0-wmf.4)), 10Patch-For-Review, 10Technical-Debt: Remove pre-AuthManager compability - https://phabricator.wikimedia.org/T178031#3679042 (10Reedy) 05Open>03Resolved [14:06:59] 10Horizon, 10cloud-services-team (Kanban): Difficulty applying profile class parameters in Horizon interface - https://phabricator.wikimedia.org/T177855#3679716 (10Andrew) p:05Triage>03Normal [14:14:48] 10Tools: pagetranslation log_type missing on replicas - https://phabricator.wikimedia.org/T178052#3678975 (10Andrew) It looks to me like this is filter in maintain-views.yaml via logging_whitelist. However, I don't see that 'pagetranslation' has ever been in that list (or at least not since 2016-10-12 which is... [14:40:49] 10Tools: pagetranslation log_type missing on replicas - https://phabricator.wikimedia.org/T178052#3679798 (10Steinsplitter) >>! In T178052#3679737, @Andrew wrote: > It looks to me like this is filter in maintain-views.yaml via logging_whitelist. However, I don't see that 'pagetranslation' has ever been in that... [15:20:30] (03PS140) 10Ricordisamoa: Initial commit [labs/tools/wikidata-slicer] - 10https://gerrit.wikimedia.org/r/241296 [15:29:00] (03CR) 10Ricordisamoa: [C: 04-2] "PS140 replaces some uses of jQuery with native Array methods" [labs/tools/wikidata-slicer] - 10https://gerrit.wikimedia.org/r/241296 (owner: 10Ricordisamoa) [16:10:20] 10Cloud-VPS, 10OfflineContentGenerator: Shutdown ocg Cloud VPS project? - https://phabricator.wikimedia.org/T178082#3680099 (10bd808) [16:16:52] 10Cloud-VPS, 10OfflineContentGenerator: Shutdown ocg Cloud VPS project? - https://phabricator.wikimedia.org/T178082#3680145 (10Dzahn) Looks like i created that back in May 2016 and there was something related to the issues with exim on labs instances (T135033) https://wikitech.wikimedia.org/wiki/Nova_Resource... [16:30:45] !help. I am trying to make a tool at https://toolsadmin.wikimedia.org/ , I have created a tool, added description to it, but unable to figure out a way to add my code for that tool. [16:31:27] sayani_: after registering there, you should be able to log in over ssh [16:31:29] sayani_: https://wikitech.wikimedia.org/wiki/Help:Toolforge#Using_Toolforge_and_managing_your_files [16:32:00] Okay. Going through it. [16:33:14] depending on what you are doing you will probably ssh in and edit files directly or (better in my opinion) clone a git repo that you have your source in [16:39:09] valhallasw`cloud: that --help patch for webservice is nice. thanks! [16:40:12] 10Cloud-VPS, 10OfflineContentGenerator: Shutdown ocg Cloud VPS project? - https://phabricator.wikimedia.org/T178082#3680206 (10Dzahn) a:03Dzahn The project/instance was originally created for T135034 but that is declined now because we don't run OCG anymore. so yea. this can go. I can handle it since i also... [16:43:51] bd808: :-) [16:53:23] !log tools Upgraded toollabs-webservice to 0.38 [16:53:27] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [16:57:26] !log tools Rebuilding all Kubernetes Docker images to include toollabs-webservice 0.38 [16:57:31] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [17:20:05] !log ocg shutting down instance ocg-jessie-01 - nobody ever logged in/had a home besides krenair and myself (T178082) [17:20:07] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Ocg/SAL [17:20:07] T178082: Shutdown ocg Cloud VPS project? - https://phabricator.wikimedia.org/T178082 [17:20:27] mutante: do you think we can remove that whole project? [17:20:33] bd808: yes, i do [17:20:43] nice. [17:20:57] Every old project we shutdown is a new project we can approve :) [17:22:24] !log ocg deleted instance ocg-jessie-01 in Horizon [17:22:25] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Ocg/SAL [17:27:38] bd808: where do you delete projects? not sure if i can (nowadays in horizon) though i created it in the past in wikitech [17:27:51] either way, it's empty now, so it can be removed [17:28:58] mutante: I'm actually not 100% sure. andrewbogott has been taking care of that step most of the time. I don't know if there is a UI for it in horizon for some people or if it is all cli stuff these days. [17:29:19] ok, fair enough. maybe i should just pass on that ticket at this step then [17:29:23] the instance is gone [17:29:24] you can just assign the task to andrewbogott with a note that deletion is appoved [17:29:30] ok :) yes, that [17:29:30] *approved [17:32:38] 10Cloud-VPS, 10OfflineContentGenerator: Shutdown ocg Cloud VPS project? - https://phabricator.wikimedia.org/T178082#3680514 (10Dzahn) a:05Dzahn>03Andrew Hi Andrew, I created this project back in Wikitech and just deleted the only instance in it, so now it's empty. Could you delete the project itself? I do... [17:42:23] !log wikilabels wikilabels:e1a3d26 is going to staging [17:42:25] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikilabels/SAL [17:45:18] works like a fucking charm [17:45:32] !log wikilabels wikilabels:e1a3d26 is going to prod [17:45:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikilabels/SAL [17:51:29] mutante, bd808, indeed currently project deletion can only be done by an admin and only on wikitech. Thanks for cleaning up! [17:52:42] andrewbogott: ok :) thx [17:55:16] !log ocg deleting project as per https://phabricator.wikimedia.org/T178082#3680514 [17:55:18] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Ocg/SAL [17:57:40] 10Cloud-VPS, 10OfflineContentGenerator: Shutdown ocg Cloud VPS project? - https://phabricator.wikimedia.org/T178082#3680572 (10Andrew) 05Open>03Resolved Horizon can't quite delete everything yet, so I generally delete everything that Horizon can see first and then use the 'delete' link in wikitech. Horizo... [19:34:41] !log git preparing gerrit-test3 for the gerrit 2.14 update. testing 2.13 -> 2.14 update for T156120 [19:34:43] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL [19:34:43] T156120: Update gerrit to 2.14.4 - https://phabricator.wikimedia.org/T156120 [19:51:00] !log git stopping gerrit on gerrit-test3 (https://gerrit2.git.wmflabs.org) systemctl stop gerrit [19:51:02] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL [19:56:08] (03PS5) 10Lokal Profil: [WIP] Add Eslint [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378011 (https://phabricator.wikimedia.org/T175907) (owner: 10Jean-Frédéric) [19:57:25] (03CR) 10Lokal Profil: "In the last patch exempted the same directories as we exempt in phpcs.xml there may be more which we wish to exempt though." [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378011 (https://phabricator.wikimedia.org/T175907) (owner: 10Jean-Frédéric) [20:04:54] !log git gerrit-test3 on gerrit 2.14 now https://phabricator.wikimedia.org/P6113 [20:04:55] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL [20:05:48] 10Data-Services, 10cloud-services-team (Kanban), 10DBA: Prepare and check storage layer for amwikimedia - https://phabricator.wikimedia.org/T176043#3680984 (10bd808) a:03Andrew This should be ready for the https://wikitech.wikimedia.org/wiki/Add_a_wiki#Cloud_Services steps. [20:07:13] !log git gerrit-test3 systemd start gerrit 2.14 update completed successfully T156120 [20:07:16] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL [20:07:16] T156120: Update gerrit to 2.14.4 - https://phabricator.wikimedia.org/T156120 [20:08:20] 10Cloud-VPS, 10cloud-services-team: unattended-upgrades not upgrading "-wikimedia" packages automatically in wmcs - https://phabricator.wikimedia.org/T177920#3680995 (10bd808) [20:09:32] 10Data-Services, 10cloud-services-team, 10Operations: Switch labstore servers to default SSH configuration - https://phabricator.wikimedia.org/T177914#3680996 (10bd808) [20:12:00] 10Data-Services, 10cloud-services-team (Kanban): Automatically run maintain-views and and maintain-meta_p when config changes on cloud replicas - https://phabricator.wikimedia.org/T177880#3680999 (10bd808) [20:13:41] 10Toolforge, 10cloud-services-team (Kanban), 10monitoring: Page if the grid engine master is unreachable - https://phabricator.wikimedia.org/T177850#3681005 (10bd808) [20:14:13] 10Data-Services, 10cloud-services-team, 10Operations: Switch labstore servers to default SSH configuration - https://phabricator.wikimedia.org/T177914#3681006 (10chasemp) I believe paramiko is no longer in use. I know it's been removed for all the backup components that have been redone, but I'm unsure if t... [20:14:21] 10Data-Services, 10DBA, 10XTools: Request to increase active connection quota for user s51187 on analytics.db.svc.eqiad.wmflabs - https://phabricator.wikimedia.org/T177570#3681008 (10bd808) [20:14:52] 10Data-Services, 10DBA: Provide a new sanitarium host for s8 - https://phabricator.wikimedia.org/T177274#3681009 (10bd808) [20:17:08] 10Data-Services, 10cloud-services-team, 10Operations: Switch labstore servers to default SSH configuration - https://phabricator.wikimedia.org/T177914#3674761 (10Paladox) backporting paramiko 2.0 will benefit zuul. Zuul uses this library and i had to update it and build zuul manually for the new gerrit updat... [20:17:21] (03CR) 10jerkins-bot: [V: 04-1] [WIP] Add Eslint [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378011 (https://phabricator.wikimedia.org/T175907) (owner: 10Jean-Frédéric) [20:18:41] 10cloud-services-team (FY2017-18), 10Operations, 10Puppet, 10User-Joe: Upgrade to puppet 4 (4.8 or newer) - https://phabricator.wikimedia.org/T177254#3681039 (10bd808) [20:20:28] 10Data-Services, 10cloud-services-team (Kanban), 10DBA: Identify tools hosting databases on labsdb100[13] and notify maintainers - https://phabricator.wikimedia.org/T175096#3681046 (10bd808) [20:23:21] 10Data-Services, 10Community-Tech, 10DBA, 10Security: Create core ip_changes view for replicas - https://phabricator.wikimedia.org/T173891#3681051 (10bd808) >>! In T173891#3546336, @Bawolff wrote: >> Should the data be made available on the labs replicas and/or dumps: Yes, nothing in the table is private d... [20:31:25] (03CR) 10Lokal Profil: "* toolbox/js/jQuery can be replaced with that on https://tools.wmflabs.org/cdnjs/" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378011 (https://phabricator.wikimedia.org/T175907) (owner: 10Jean-Frédéric) [20:40:55] 10Data-Services, 10DBA, 10XTools: Request to increase active connection quota for user s51187 on analytics.db.svc.eqiad.wmflabs - https://phabricator.wikimedia.org/T177570#3681083 (10MusikAnimal) This seems to have done the trick. The last max connections error on the API server was on 2017-10-09, as reporte... [20:41:07] 10Cloud-VPS (Project-requests): Request creation of reading-infrastructure VPS project - https://phabricator.wikimedia.org/T178110#3681085 (10Tgr) [20:44:41] 10Cloud-VPS (Project-requests): Request creation of reading-infrastructure VPS project - https://phabricator.wikimedia.org/T178110#3681085 (10bd808) >>! In T177616#3665067, @bd808 wrote: > > We have tried for a couple of years now to discourage projects scoped to a Foundation team or department. We have many le... [20:53:09] 10Toolforge: Update Toolforge to PHP 5.6 - https://phabricator.wikimedia.org/T176897#3640641 (10bd808) > it would be good to match the PHP we are using in Kubernetes That would mean converting the job grid from Ubuntu Trusty to Debian Jessie. [20:53:40] 10Toolforge: Update Bastion/Grid Engine to PHP 5.6 - https://phabricator.wikimedia.org/T176897#3681190 (10bd808) [21:00:33] (03CR) 10Lokal Profil: "api/jscss/custom.js includes a LOT of cruff which is probably not used by the FormatHtml.php anymore (it is also referenced in tools/ranki" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378011 (https://phabricator.wikimedia.org/T175907) (owner: 10Jean-Frédéric) [21:01:57] 10Toolforge, 10cloud-services-team (Kanban), 10puppet-compiler, 10Patch-For-Review: toolsbeta: set up puppet-compiler / temporary-apply - https://phabricator.wikimedia.org/T97081#3681225 (10Andrew) Here's my latest attempt to describe what works. Once the concerned patches are merged I'll try to get this... [21:03:03] 10Cloud-VPS (Project-requests): Request creation of reading-infrastructure VPS project - https://phabricator.wikimedia.org/T178110#3681227 (10Tgr) [21:03:12] 10Cloud-VPS (Project-requests): Request creation of reading-lists VPS project - https://phabricator.wikimedia.org/T178110#3681085 (10Tgr) [21:07:11] 10Cloud-VPS (Project-requests): Request creation of reading-lists VPS project - https://phabricator.wikimedia.org/T178110#3681259 (10Tgr) Updated the request accordingly. (From where I sit, the main attraction of a team project is less friction: it means I don't have to go through a potentially slow bureaucrati... [21:10:41] bd808: Pickup from yesterday. What I need to run PHP, wsgi python script, regular python scripts (rewrite is needed for wsgi), and I'd like regular lighttpd directory listing. I don't think it's impossible, it just seem everyone else is doing monolithic (combine all script and build into a web server) [21:28:27] hey, is commons help down? tools.wmflabs.org/commonshelper/ [21:29:15] andrewbogott: ^ :) [21:29:37] matanya: works for me, I think? [21:29:42] back now [21:29:49] :/ [21:29:52] got timeouts for the last 15 or so [21:32:57] matanya: could you mount /srv on gfg01.video.eqiad.wmflabs? someone is asking me on my talk page to use that old script and imagemagick is running out of memory on a gigapixel [21:33:23] yes, zhuyifei1999_ sec please [21:34:48] zhuyifei1999_: /srv/mnt is mounted [21:35:17] mount | grep srv => nothing [21:35:41] uh [21:35:52] a sec, moving that dir away [21:36:18] matanya: done [21:36:59] zhuyifei1999_: where do you want it mounted ? [21:37:09] and don't you have sudo on the machine ? [21:37:37] * zhuyifei1999_ meant https://wikitech.wikimedia.org/wiki/Help:Adding_Disk_Space [21:37:47] labs::lvm::srv [21:38:26] sudo doesn't mean I can apply puppet roles :P [21:41:01] matanya: ^ [21:41:53] doing [21:42:11] thanks [21:42:49] looks like my 2fa broke :( [21:42:54] might need andrewbogott to help [21:43:08] uh oh:( [21:43:28] yes, broken [21:43:39] can't login to wikitech either [21:44:00] matanya: do you know what you mean by 'broke'? [21:44:05] Like, you got a new phone? [21:44:12] yes, that [21:44:19] :) ok, hang on... [21:44:25] 10Tool-Zppixbot, 10User-Zppix: .task command for mh.org - https://phabricator.wikimedia.org/T178117#3681356 (10NDKilla) [21:45:28] matanya: to confirm that you are probably yourself, can you touch a file name 'resetmy2fa' in your homedir on tools-login? [21:48:31] andrewbogott: in the meantime, could you apply that labs::lvm::srv puppet role on gfg01.video.eqiad.wmflabs? [21:48:38] * zhuyifei1999_ gtg soon [21:49:36] zhuyifei1999_: done [21:49:41] thanks [21:50:13] * zhuyifei1999_ runs puppet [21:51:04] done andrewbogott [21:51:24] matanya: ok, you should be able to re-enable and reset 2fa on wikitech now [21:51:50] (although via a new script I've never used before so I'm not 100% confident) [21:52:19] andrewbogott: thanks, was able to login, trying to enable 2fa [22:09:31] Dispenser: *nod* That's what I meant by "polyglot" yesterday. You want one tool account that can use a bunch of different languages/runtimes at once. The current (and planned) direction of Kubernetes on Toolforge is definitely in another direction. We are moving more and more towards providing the best support for tools that use one language to do one thing. [22:10:25] there are a couple of reasons that I feel that is a nicer model. One is that it should make it easier for an abandoned tool to be picked up by others. [22:10:48] another is that it makes distributing resources (ram, cpu) fairly easier to manage [22:11:16] but I do understand that its not the world everyone wants to develop in [22:15:14] andrewbogott: worked well, thanks much [22:15:33] great [22:17:40] bd808: I don't think the maintainer model works (though better than nothing). E.g. DPLbot is written in (bad) PHP, the lead developer User:JaGa mostly left the project. Myself and R'n'B primarily program in Python (and I assume very differently). Neither of us have reviewed the codebase nor really understand how it function. We both interface it via the public SQL databases. [22:18:58] He runs Python reports as the DPL user and I use bash for database snapshoting [22:19:12] 10Cloud-Services, 10cloud-services-team (Kanban), 10Patch-For-Review: Remove non-interactive bots from #wikimedia-cloud - https://phabricator.wikimedia.org/T177427#3681468 (10Quiddity) >>! In T177427#3676595, @Dzahn wrote: > Also see T177974 for a similar thing that was attempted in the past and lead to remo... [22:19:55] Dispenser: yeah. the way things actually get done can be fuzzy for sure. [22:20:24] I can't imagine a future where bash isn't around, nor direct mysql interfaces [22:20:59] bash as in bash or shell in general ? [22:21:09] bash scripting [22:21:15] and when we get further along it may become easier to have say a php webservice and a python3 one running as the same tool [22:21:42] we are kind of stuck in an early stage due to staffing [22:22:20] Yuvi started us in some awesome directions but then we had to slow down and fix some really old tech debt. [22:22:29] I know I could technically switch all python environment (include prompt), but that costs time. Additionally it limits other packages I can use (e.g. Piwik for analytics) [22:22:35] that debt was old because fixing it is hard, and its taking a lot of time [22:23:41] off to dinner now [22:24:21] 10Data-Services: pagetranslation log_type missing on replicas - https://phabricator.wikimedia.org/T178052#3681495 (10bd808) [22:36:55] 10Data-Services: pagetranslation log_type missing on replicas - https://phabricator.wikimedia.org/T178052#3678975 (10bd808) There are quite a few filtered out compared to the raw production wikidb: ``` (wikiadmin@db1091) [commonswiki]> SELECT DISTINCT log_type from logging; +-------------------+ | log_type... [22:47:49] 10Data-Services, 10DBA, 10Security-Team: pagetranslation log_type missing on replicas - https://phabricator.wikimedia.org/T178052#3681564 (10bd808) The [[https://phabricator.wikimedia.org/source/operations-puppet/browse/production/modules/role/templates/labs/db/views/maintain-views.yaml;1cc8cd81639bbddf23f0a... [23:17:47] 10cloud-services-team, 10DBA, 10Operations, 10Ops-Access-Requests: Access to raw database tables on labsdb* for wmcs-admin users - https://phabricator.wikimedia.org/T178128#3681627 (10bd808) [23:54:39] 10cloud-services-team (Kanban), 10Analytics: Remove logging from labs for schema https://meta.wikimedia.org/wiki/Schema:CommandInvocation - https://phabricator.wikimedia.org/T166712#3681708 (10bd808) a:05bd808>03None The code has been rolled out everywhere to stop sending events to the eventlogging beacon... [23:59:22] 10cloud-services-team, 10Goatification, 10Wikimania-Hackathon-2017, 10User-bd808: Engage the unicorn community - https://phabricator.wikimedia.org/T173112#3681722 (10bd808) 05Open>03Resolved 🦄 and 🐐 are as one.