[00:06:26] <ebernhardson>	 edit on wikitech is giving me "Error contacting the Parsoid/RESTBase server (HTTP 404)"" 
[00:34:04] <bd808>	 ebernhardson: were you by any chance trying to create a new page using VE? We had a bug about that recently on wikitech, but I thought it had maybe been fixed by now.
[00:35:03] <bd808>	 VE on wikitech is a bit fragile as it is one of a very few Wikimedia wikis which is not connected to a RESTBase instance. This makes it show some interesting regressions.
[01:36:56] <ebernhardson>	 bd808: yea that's exactly what it was, i ended up copying it to my sandbox, saving, and copying back over. Don't know why, but that worked
[09:56:29] <mateusbs17>	 Hello everyone, I'm having trouble to ssh into a fresh instance created for the maps project
[09:56:48] <mateusbs17>	 https://www.irccloud.com/pastebin/SVC4W8RE/
[09:57:04] <mateusbs17>	 Any thoughts why is this happening?
[09:57:59] <mateusbs17>	 Note: I had to delete deployment-maps06, and also tried to recreate with the same name, which I discovered is not a good practice, so I deleted the second deployment-maps06 and created deployment-maps07
[11:07:13] <joakino>	 hi mateusbs17 ! did you see the email "[Cloud-announce] Phasing out the .wmflabs tld on September 8th"?
[11:07:50] <joakino>	 https://lists.wikimedia.org/pipermail/cloud-announce/2020-September/000311.html
[12:19:10] <mateusbs17>	 joakino: It seems that I've missed it. Thank you so much!
[13:14:21] <Amir1>	 If anyone from WMCS team can approve this, it would be great, he's our new WMDE hire: https://toolsadmin.wikimedia.org/tools/membership/status/903
[13:28:34] <Amir1>	 bstorm: arturo bd808 ^ hey, if possible. Thanks!
[14:02:11] <andrewbogott>	 Amir1: done
[14:06:15] <Amir1>	 andrewbogott: Thanks!
[14:09:25] <Amir1>	 I have another one but she hasn't made the request yet
[20:21:42] <hauskatze>	 legoktm: hi - codesearch seems down, are you aware?
[20:22:03] <hauskatze>	 https://codesearch.wmcloud.org/_health
[20:22:19] <legoktm>	 hauskatze: now I am :)
[20:22:20] <legoktm>	 lemme see
[20:22:42] <hauskatze>	 ok, because for some reason I always arrive late at reporting this kind of issues
[20:23:15] <hauskatze>	 legoktm: tl;dr it says connection refused
[20:23:23] <hauskatze>	 can paste the error message if it helps
[20:24:12] <hauskatze>	 https://phabricator.wikimedia.org/P12738
[20:24:44] <legoktm>	 hauskatze: it's starting up, will take a bit of time though
[20:26:22] <hauskatze>	 ack
[20:26:31] <legoktm>	 Sep 22 20:26:24 codesearch6 docker[24444]: fatal: unable to access 'https://gerrit-replica.wikimedia.org/r/mediawiki/services/wikispeech/pronlex.git/': The requested URL returned error: 502
[20:26:32] <legoktm>	 Sep 22 20:26:24 codesearch6 docker[24444]: Continuing...
[20:26:32] <legoktm>	 Sep 22 20:26:24 codesearch6 docker[24444]: 2020/09/22 20:26:24 vcs pull error (mediawiki/services/wikispeech/pronlex - https://gerrit-replica.wikimedia.org/r/mediawiki/services/wikispeech/pronlex.git): exit status 128
[20:26:49] <legoktm>	 Sep 22 20:26:17 codesearch6 docker[8973]: fatal: unable to access 'https://gerrit-replica.wikimedia.org/r/mediawiki/extensions/AutoCreateCategoryPages.git/': The requested URL returned error: 502
[20:27:36] <legoktm>	 I think gerrit-replica might be down
[20:27:44] <legoktm>	 I'm waiting for the monitoring page to load...
[20:29:16] <mutante>	 yea.. that seems down.. ugh. taking a look
[20:30:10] <legoktm>	 thanks
[20:32:08] <hauskatze>	 A couple of days ago Diffusion complained that it couldn't reach gerrit-replica either
[20:32:22] <hauskatze>	 So it might be having issues
[20:32:27] <hauskatze>	 It was certainly slow to load
[20:33:50] <legoktm>	 !log codesearch (re)starting all hound instances now that gerrit-replica is back up
[20:33:54] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Codesearch/SAL
[21:27:56] <legoktm>	 andrewbogott: does the phasing out of .wmflabs affect the host names that I provide to the puppet patch compiler?
[21:29:06] <legoktm>	 https://integration.wikimedia.org/ci/job/operations-puppet-catalog-compiler/25319/console
[21:29:13] <legoktm>	 [ 2020-09-22T21:22:44 ] CRITICAL: Unexpected error running the payload: Unable to find fact file for: codesearch6.eqiad.wmflabs
[21:29:20] <legoktm>	 not sure if it's just out of date or if I need to use the new hostname?
[21:30:10] <legoktm>	 codesearch6.codesearch.eqiad1.wikimedia.cloud didn't work either
[21:30:12] <legoktm>	 (https://integration.wikimedia.org/ci/job/operations-puppet-catalog-compiler/25322/console)
[22:09:47] <bd808>	 legoktm: that sounds like someone needs to update the facts -- https://wikitech.wikimedia.org/wiki/Nova_Resource:Puppet-diffs#How_to_update_the_compiler's_facts?_(e.g._INFO:_Unable_to_find_facts_for_host_conf2001.codfw.wmnet,_skipping)
[22:10:03] <andrewbogott>	 I can do that in a few
[22:16:47] <legoktm>	 Ack and thanks!
[22:17:06] <legoktm>	 I had thought that because it had already been in PCC it didn't need an update
[22:23:58] <andrewbogott>	 legoktm: is that VM managed by the central puppetmaster or by a project-local one?
[22:25:24] <andrewbogott>	 actually, nevermind...
[22:25:42] <andrewbogott>	 legoktm, on that vm hostname -f returns 'codesearch6.codesearch.eqiad.wmflabs'
[22:25:45] <andrewbogott>	 and that seems to work in the compiler
[22:26:21] <andrewbogott>	 this is all keyed off of what the puppetmaster thinks a host is called, which usually comes from hostname -f or similar
[22:27:28] <andrewbogott>	 legoktm: I'm going back to cooking but ping me again if you still run into trouble
[22:36:59] <legoktm>	 andrewbogott: it works perfectly, thanks! I'll document that on wiki
[22:37:28] <andrewbogott>	 thx
[22:39:59] <legoktm>	 https://wikitech.wikimedia.org/w/index.php?title=Help%3APuppet-compiler&type=revision&diff=1882488&oldid=1880992