[05:45:01] !log tools Manually installed python3-venv on tools-sgebastion-06. Gerrit patch submitted for proper automation. [05:45:04] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [07:16:25] HI, why I get timeouts when I want to connect to login-stretch.tools.wmflabs.org via SSH? [07:16:30] !help [07:16:30] Zoranzoki21: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team [07:18:55] Oh, I found https://phabricator.wikimedia.org/T212360#4857842 Ok than [12:55:36] Hi, can anyone confirm this https://phabricator.wikimedia.org/T212058#4858942? [13:00:42] I'm not familiar with that script. If nobody answers here, I suggest trying on #wikimedia-tech maybe [13:02:28] gtirloni: OK [13:03:01] I asked because zeljkof (SWAT deployer) told me to do it because I requested running of that script because of T212058 [13:03:01] T212058: Drop FlaggedRevs rights from users at srwikinews - https://phabricator.wikimedia.org/T212058 [13:05:06] !log tools.stewardbot Replace symlink "~/StewardBot/StewardBot.py" to "~/public_html/StewardBot/StewardBot.py" [13:05:07] rxy: Unknown project "tools.stewardbot" [13:05:16] !log tools.stewardbots Replace symlink "~/StewardBot/StewardBot.py" to "~/public_html/StewardBot/StewardBot.py" [13:05:17] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stewardbots/SAL [13:05:37] gtirloni: it's Reedy 's turf, that script I mean :) [13:06:37] ah cool, ok [14:15:33] !log bastion applied kernel update and rebooted bastion-restricted-eqiad1-01 [14:15:35] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Bastion/SAL [14:32:08] !log bastion applied kernel update and rebooted all bastion VMs [14:32:09] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Bastion/SAL [15:54:22] !log tools T67777 Set stretch grid user job limit to 16 [15:54:25] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [15:54:26] T67777: Limit number of jobs users can execute in parallel - https://phabricator.wikimedia.org/T67777 [16:41:40] are toolforge bastions and "vps bastions" different bastions? [16:44:12] mutante: yes, in that Toolforge has its own bastions that have public ips. This is a historical simplification so that Toolforge users do not need to learn how to use jump hosts [16:45:08] bd808: gotcha, wasn't really sure since i am just a VPS user. hx [16:45:12] you can use the general Cloud VPS bastions to jump into Toolforge instance too, but you do not have to for login.tools.wmflabs.org and a few other bastions in Toolforge itself [16:46:05] alright, the background is i have a patch that needs to wait because "bastions, which are Trusty at the moment. " and then i saw Andrew's mail about the upgrade t stretch [16:46:27] but this is about Toolforga bastions i guess. because it's in k8s/flannel [16:48:47] mutante: ah. we are working on those too, but will have Trusty bastions in Toolforge until the end of the quarter [16:49:42] bd808: ok, i will put this in waiting mode but also not abandon: https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/482118/ [16:55:50] mutante: thanks for working on that, that patch looks just fine [16:56:24] gtirloni: you're welcome, it's just trying to track down all the "base::service_units" in repo :) [16:56:31] there are more [16:56:54] thanks for review. i am fine just keeping it open until it is ready [16:57:22] :) [17:21:11] !log tools T67777 - set the max_u_jobs global grid config setting to 50 in the new grid [17:21:15] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [17:21:15] T67777: Limit number of jobs users can execute in parallel - https://phabricator.wikimedia.org/T67777 [17:48:52] !log wikibase-registry root@wbregistry-01:~/wikibase-registry# docker pull wikibase/wdqs-frontend:latest [17:48:53] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikibase-registry/SAL [18:00:42] !log wikibase-registry Added HOST env vars for wdqs-frontend (needed by new image) [18:00:44] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikibase-registry/SAL [18:06:56] !log wikibase-registry root@wbregistry-01:~/wikibase-registry# docker pull wikibase/wdqs-frontend:latest [18:06:57] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikibase-registry/SAL [18:09:12] !log wikibase-registry root@wbregistry-01:~/wikibase-registry# docker-compose up -d wdqs-frontend [18:09:12] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikibase-registry/SAL [19:32:36] !log deployment-prep T212530: ORES revscoring 2.3.0 [19:32:40] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL [19:32:40] T212530: Rebuild models for new revscoring (2.3.0) - https://phabricator.wikimedia.org/T212530 [21:08:03] !log cloudinfra upgraded kernel and rebooted mx-out{01,02} [21:08:04] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Cloudinfra/SAL [21:08:10] !log ores staging ores-wmflabs-deploy:5634d1 [21:08:11] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Ores/SAL [21:13:36] !log ores deploying ores-wmflabs-deploy:5634d1 [21:13:38] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Ores/SAL [23:36:28] anybody knows what access logstash-beta.wmflabs.org requires? [23:36:41] the password for regular logstash does not work [23:40:47] SMalyshev: HTTP Auth permissions are on office wiki – see https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/Log_Files – but it's not showing anything today. [23:41:16] James_F: ahh, thanks! [23:42:21] James_F: yep, looks like completely barren and no file logging is happening as far as I can see... [23:43:16] Most recent event is 2019-01-02Z01:14:14 FWICS. [23:49:49] James_F: ok, I found the logs on fluorine, so it's enough for me, I think I know what causes the problems there [23:50:10] Oh, neat.