[00:06:51] 10serviceops, 10Operations, 10Wikimedia-Logstash: ensure httpd error logs from "misc apps" (krypton) end up in logstash - https://phabricator.wikimedia.org/T216090 (10Dzahn) [01:07:30] 10serviceops, 10Operations, 10Parsoid: parsoid-vd - "no such file or directory, open '/srv/visualdiff/testreduce/testrun.ids" - https://phabricator.wikimedia.org/T215049 (10Dzahn) [01:13:13] 10serviceops, 10Mail, 10Operations, 10Phabricator, and 2 others: Convert Phabricator mail config to use cluster.mailers - https://phabricator.wikimedia.org/T212989 (10Dzahn) deployed in production (phab1001) , please test that mail still works [01:48:37] 10serviceops, 10Operations, 10Parsoid: rack/setup/install scandium.eqiad.wmnet (parsoid test box) - https://phabricator.wikimedia.org/T201366 (10Dzahn) [06:56:54] 10serviceops, 10Operations, 10Wikidata, 10Wikidata-Termbox-Hike, and 4 others: New Service Request: Wikidata Termbox SSR - https://phabricator.wikimedia.org/T212189 (10Smalyshev) Thanks, T213318 makes it a bit clearer though not entirely 100% clear which parts stay in PHP and which parts move to JS. Would... [07:28:27] 10serviceops, 10Operations, 10Wikidata, 10Wikidata-Termbox-Hike, and 4 others: New Service Request: Wikidata Termbox SSR - https://phabricator.wikimedia.org/T212189 (10daniel) @Smalyshev My understanding (which may be dated or incomplete) is this: there would be no PHP rendering, JS rendering would need to... [08:48:16] 10serviceops, 10Operations, 10Wikidata, 10Wikidata-Termbox-Hike, and 4 others: New Service Request: Wikidata Termbox SSR - https://phabricator.wikimedia.org/T212189 (10WMDE-leszek) We do not intend to maintain the "proper" UI logic in PHP. SSR service will render the page on the server side which will (via... [09:22:55] 10serviceops, 10Performance-Team, 10Thumbor, 10Patch-For-Review: Failing Thumbor PDF build test (JPX) - https://phabricator.wikimedia.org/T215253 (10Gilles) I reverted the change, as expected the test works on Jessie once again. [09:26:52] 10serviceops, 10Performance-Team, 10Thumbor, 10Patch-For-Review: Failing Thumbor PDF build test (JPX) - https://phabricator.wikimedia.org/T215253 (10Gilles) 05Open→03Resolved [09:35:30] 10serviceops, 10TechCom, 10TechCom-RFC: RfC: Standards for external services in the Wikimedia infrastructure. - https://phabricator.wikimedia.org/T208524 (10Joe) [09:36:58] 10serviceops, 10Operations, 10HHVM, 10Wikimedia-production-error: mw1338 hhvm complaining intermittently about TC - https://phabricator.wikimedia.org/T216084 (10Joe) [09:36:59] <_joe_> can someone take a look at ^^ ? [09:37:08] <_joe_> most likely just needs an HHVM restart [11:41:41] <_joe_> ook, chi fa da se' fa per tre. [11:42:13] <_joe_> , "tc-hot-free-size":0 [11:43:39] 10serviceops, 10Operations, 10HHVM, 10Wikimedia-production-error: mw1338 hhvm complaining intermittently about TC - https://phabricator.wikimedia.org/T216084 (10Joe) a:03Joe [11:44:35] 10serviceops, 10Operations, 10HHVM, 10Wikimedia-production-error: mw1338 hhvm complaining intermittently about TC - https://phabricator.wikimedia.org/T216084 (10Joe) 05Open→03Resolved The Jit TC hot portion was completely full and exhausted on that server. A restart of HHVM should've solved the issue. [14:08:42] 10serviceops, 10Operations, 10Thumbor, 10ops-eqiad: thumbor1004 memory errors - https://phabricator.wikimedia.org/T215411 (10CDanis) [14:27:28] 10serviceops, 10Operations, 10Thumbor, 10ops-eqiad: thumbor1004 memory errors - https://phabricator.wikimedia.org/T215411 (10jijiki) @RobH How should we proceed? [14:34:46] 10serviceops, 10Operations, 10Thumbor, 10Patch-For-Review, 10User-jijiki: Thumbor upgrade to stretch plan - https://phabricator.wikimedia.org/T214597 (10jijiki) [15:46:28] https://gerrit.wikimedia.org/r/c/operations/docker-images/production-images/+/490621 [15:46:33] akosiaris: ^^ [15:47:55] +1ed [16:12:16] TIL that there is an Italian proverb about being a lone wolf hero [16:12:21] ;) [16:25:17] <_joe_> bd808: it's more like "don't wait for others to do your chores for yourself" [16:25:46] <_joe_> bd808: it's the thing my mother would repeat me when I asked for help on things I was grown up enough to do myself [16:27:42] google translate failure or bad description on https://it.wikipedia.org/wiki/Chi_fa_da_s%C3%A9_fa_per_tre then. gtranslate says "According to this proverb, if a person undertakes an activity alone, he can manage to do it surprisingly well, better than he could do if he involved other people." [16:28:00] which has a different connotation than yours [16:28:35] it does seem to be marked as a stub though so safe to fix ;) [16:36:59] <_joe_> it literally means that [16:37:29] <_joe_> but the way it's used is "you'd be better off doing it yourself instead than relying on others" [16:45:36] Sounds a bit like the colloquialism "the Lord helps those who help themselves" [16:46:08] which was the sarcastic way my grandfather would tell me to get up and do something [17:00:43] <_joe_> bd808: exactly [17:00:53] <_joe_> we have that too though [17:01:04] <_joe_> "aiutati che il ciel t'aiuta" [22:52:07] 10serviceops, 10Operations, 10Parsoid, 10Patch-For-Review: parsoid-vd - "no such file or directory, open '/srv/visualdiff/testreduce/testrun.ids" - https://phabricator.wikimedia.org/T215049 (10Dzahn) 05Open→03Resolved If the file in question does not exist, puppet will create it, avoiding this issue f... [22:52:38] 10serviceops, 10Operations, 10Parsoid, 10Patch-For-Review: parsoid-vd - "no such file or directory, open '/srv/visualdiff/testreduce/testrun.ids" - https://phabricator.wikimedia.org/T215049 (10Dzahn) The other 2 changes above i should have linked to T201366 but it's kind of related. [23:12:48] 10serviceops, 10Operations, 10Wikimedia-Logstash: ensure httpd error logs from "misc apps" (krypton) end up in logstash - https://phabricator.wikimedia.org/T216090 (10colewhite) p:05Triage→03Normal