[00:01:30] !log tools Installed toollabs-webservice 0.43 on tools-bastion-02 for T212390 [00:01:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [00:01:35] T212390: Basic lighttpd+php webservice fails to run on Stretch grid - https://phabricator.wikimedia.org/T212390 [00:19:11] !log tools Installed toollabs-webservice 0.43 on all hosts for T212390 [00:19:15] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [00:19:15] T212390: Basic lighttpd+php webservice fails to run on Stretch grid - https://phabricator.wikimedia.org/T212390 [00:22:32] !log tools Rebuiliding all docker containers with toollabs-webservice 0.43 for T212390 [00:22:35] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [00:35:56] !log tools Installed tools-manifest 0.14 for T212390 [00:36:00] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [00:36:00] T212390: Basic lighttpd+php webservice fails to run on Stretch grid - https://phabricator.wikimedia.org/T212390 [02:51:33] what is sodium.wikimedia.org? [04:40:26] Sumdumbum: https://wikitech.wikimedia.org/wiki/Sodium [08:20:34] legoktm: thanks, was getting strange traffic from this ip, not really sure whats up... [08:39:58] Sumdumbum: what kind of traffic? [08:45:40] godog: was part of a ddos, didnt try to get any specific info about it [had other porblems at the time obviously] but when i saw that ip resolve to that url, i thought it was interesting and maybe id catch a lead here... [08:48:18] Sumdumbum: ack, thanks for the context, let us know if it happens again. I take it there are no packet captures? [08:51:24] godog: unfortunatly not, theres also a good chance it was udp traffic, so the ip could have been spoofed too, if there was no disturbance on your end, it probably has nothing to do with you, tho my bandwidth is much smaller than yours, so there is a chance that even if it did it may have gone unnoticed... [14:59:44] !log project-proxy Added 172.16.0.0/21 to the one-off port listed by those proxy hosts' security group [14:59:45] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Project-proxy/SAL [15:42:48] Hello. I'm a toolforge user mbh and I can't delete some of my incorrect worked jobs through qdel, system responces me that job with this name doesn't exist, but job name is correct [15:43:08] this processes are shown in qstat [15:43:42] with titles, shortened to first 10 letters [15:47:24] mbh: use the job id rather than the job name [15:53:14] it works, thanks [15:53:33] but earlier it was work with job titles [16:01:56] !log tools moving tools-grid-master to labvirt1004 [16:01:59] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [16:08:04] I can't launch qstat [16:08:07] error: commlib error: got select error (No route to host) error: unable to send message to qmaster using port 6444 on host "tools-grid-master.tools.eqiad.wmflabs": got send error [16:09:27] mbh: known, maint in progress [16:10:01] "Status: grid outage in progress" -- we are moving the primary grid master to a new physical host [16:16:50] bigbrother (the cronjob) one seem to be invoking jobs when the job is active [16:20:18] revi: hi, which tool? the grid master was done until just now so it's possible the script ran into an unexpected error [16:21:03] tool.stewardbots [16:21:53] mbh: things should be back to normal with the grid now [16:22:27] нуыб йыефе цщклы [16:22:36] yes, qstat works [16:24:09] revi: thanks, i've fixed the script so it fails when qstat fails [16:24:43] gtirloni: thx! [16:29:37] !log tools migrating tools-exec-1416 to labvirt1004 [16:29:39] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [17:46:18] !log tools.indic-wsstats Created indic-wsstats tool on toolsadmin (T212517) [17:46:21] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.indic-wsstats/SAL [17:46:21] T212517: Create and Deploy Indic Wikisource Stats Tool - https://phabricator.wikimedia.org/T212517