[01:06:03] !log tools cleared E state from 6 queues [01:06:08] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [10:46:14] zhuyifei1999_ I can do it in a few hours [14:37:10] !log video restarting encoding01 [14:37:12] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Video/SAL [14:37:25] zhuyifei1999_: ^ [14:37:46] encoding03 has been shut down since mid-February. There aren't any notes in the SAL about it though, so I'm not sure why. [15:41:03] I can't seem to ssh into toolforge [15:41:09] it fails with packet_write_wait: Connection to 185.15.56.48 port 22: Broken pipe [15:41:21] andrewbogott: ok thanks [15:41:29] i am using login.tools.wmflabs.org [15:43:10] MacFan4000: it's working for me… has it worked properly for you recently? [15:43:53] I haven't tried to ssh until today, last time i was connected to tool forge was a month or two ago [15:44:01] MacFan4000: what's the verbose ssh output via ssh -v ? [15:45:46] debug1: Sending env LANG = en_US.UTF-8 and then broken pipe [15:46:15] https://www.irccloud.com/pastebin/yoGoqD0m/ [15:48:33] ? There is no entered command and no broken pipe in that output [15:48:52] packet_write_wait: Connection to 185.15.56.48 port 22: Broken pipe [15:49:09] i didn't paste the full thing [15:49:49] you should paste the whole thing [15:51:35] Not passing the whole thing means other people need to guess random things, which is not the best use of time :) [15:53:29] https://www.irccloud.com/pastebin/YOgTYTDP/ [15:54:58] that's the whole thing [16:00:23] MacFan4000: does your IP end with 207 or 23? [16:01:02] in 23 yes [16:02:48] the logs says toolforge didn't close the connection. toolforge found the client to have closed. eg. Apr 7 15:55:45 tools-sgebastion-07 sshd[23376]: Read error from remote host [IP REDACTED] port 37148: Connection reset by peer [16:03:03] might ssh-ing with -vvv? [16:03:46] you can redact the lines you don't like it to be public, but please say explicitly it's redacted [16:06:17] also I'll note that you do have a ssh session in PID 26712, which logs indicate are logged in around Apr 7 16:03:36 [16:06:30] https://www.irccloud.com/pastebin/aeeWWoc3/ [16:10:01] for my login the next message after debug2: channel 0: open confirm rwindow 0 rmax 32768 should be debug3: receive packet: type 99 [16:12:27] MacFan4000: could you try https://unix.stackexchange.com/a/324390 the chmod? [16:14:21] i just restarted my mac, and it seems to work now [16:14:46] huh ok [16:54:46] !log toolstools-sgeexec-0928 unresponsive since around 22 UTC. No data on Graphite. Can't ssh in even as root. Hard rebooting via Horizon [16:54:47] zhuyifei1999_: Unknown project "toolstools-sgeexec-0928" [16:54:51] !log tools tools-sgeexec-0928 unresponsive since around 22 UTC. No data on Graphite. Can't ssh in even as root. Hard rebooting via Horizon [16:54:52] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [22:18:14] !log puppet-diffs upgrade puppet-compiler version to 0.5.0 (via hiera setting on Horizon) for T219430 [22:18:16] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Puppet-diffs/SAL [22:18:17] T219430: Support targetting WMCS instances with the Jenkins puppet compiler - https://phabricator.wikimedia.org/T219430