[01:47:05] 10serviceops, 10Mail, 10Operations, 10Phabricator, and 2 others: Convert Phabricator mail config to use cluster.mailers - https://phabricator.wikimedia.org/T212989 (10Dzahn) deployed in production and we tested mail still works. this just adds the new config and does not remove the old config though [07:09:43] 10serviceops, 10MediaWiki-Cache, 10Operations, 10Core Platform Team (Security, stability, performance and scalability (TEC1)), and 2 others: Use a multi-dc aware store for ObjectCache's MainStash if needed. - https://phabricator.wikimedia.org/T212129 (10Joe) >>! In T212129#4932035, @EvanProdromou wrote: >... [07:17:27] 10serviceops, 10MediaWiki-Cache, 10Operations, 10Core Platform Team (Security, stability, performance and scalability (TEC1)), and 2 others: Use a multi-dc aware store for ObjectCache's MainStash if needed. - https://phabricator.wikimedia.org/T212129 (10Joe) >>! In T212129#4935629, @EvanProdromou wrote: >... [07:36:53] 10serviceops, 10MediaWiki-Cache, 10Operations, 10Core Platform Team (Security, stability, performance and scalability (TEC1)), and 3 others: Use a multi-dc aware store for ObjectCache's MainStash if needed. - https://phabricator.wikimedia.org/T212129 (10jijiki) [10:31:42] 10serviceops, 10MediaWiki-Cache, 10Operations, 10Patch-For-Review, and 3 others: Apply -R 200 to all the memcached mw object cache instances running in eqiad/codfw - https://phabricator.wikimedia.org/T208844 (10jijiki) [10:58:39] 10serviceops, 10Operations, 10User-jijiki: Fix spamassassin's "warn: netset: cannot include " warning - https://phabricator.wikimedia.org/T215496 (10jijiki) 05Open→03Resolved a:03jijiki Resolved by @akosiaris in https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/488894/ [12:57:18] 10serviceops, 10Thumbor, 10User-jijiki: First page of a specific PDF files on Commons does not render a preview - https://phabricator.wikimedia.org/T213771 (10Elitre) (Such bugs never really go away, do they. We never really knew what actually fixed T72734 - I sure hope y'all can figure out what's going on h... [15:36:16] akosiaris: o/ [15:36:32] resolved comments in https://gerrit.wikimedia.org/r/#/c/operations/deployment-charts/+/484498/ and most in https://gerrit.wikimedia.org/r/#/c/operations/deployment-charts/+/483035/, but I have a question or two on that one [15:36:41] ottomata: yeah I answering already :-) [15:36:50] OH nice ok thank you! [15:36:58] I am looking at your Hm, ok. I'm having trouble if I set my main_app.port different than my service.port. I get [15:36:58] Failed to connect to 192.168.99.100 port 31855: Connection refused [15:37:02] thing. Trying to reproduce [15:42:33] 10serviceops, 10MediaWiki-Cache, 10Operations, 10Core Platform Team (Security, stability, performance and scalability (TEC1)), and 3 others: Use a multi-dc aware store for ObjectCache's MainStash if needed. - https://phabricator.wikimedia.org/T212129 (10jijiki) @EvanProdromou I will try to pull you some st... [15:48:56] 10serviceops, 10Operations, 10Wikimedia-General-or-Unknown, 10PHP 7.2 support, 10User-jijiki: mwscript dies on mwmaint with PHP=php7.2 due to php-redis missing - https://phabricator.wikimedia.org/T215376 (10Joe) `All the extensions were not upgraded at the time we did the 7.0 => 7.2 transition - my bad!... [15:52:21] akosiaris: can you reproduce? or other problems on the way? [15:58:35] ottomata: still fighting, I 'll ping ya [15:59:24] k [16:13:37] 10serviceops, 10Core Platform Team (Session Management Service (CDP2)), 10Core Platform Team Kanban (Doing), 10User-Clarakosi, 10User-Eevans: Plan/design a session storage service - https://phabricator.wikimedia.org/T206015 (10Clarakosi) [17:13:56] ottomata: I get {"name":"eventgate","hostname":"eventgate-analytics-nuanced-spaniel-7587f95f67-khwl8","pid":15,"level":60,"err":{"message":"timed out","name":"Error","stack":"Error: Local: Timed out\n at Function.createLibrdkafkaError [as create] (/srv/service/node_modules/node-rdkafka/lib/error.js:261:10)\n at /srv/service/node_modules/node-rdkafka/lib/client.js:339:28","code":-185,"origin":"local","errno":-185,"leve [17:13:56] lPath":"fatal/service-runner/worker"},"msg":"timed out","time":"2019-02-08T17:12:51.925Z","v":0} [17:14:17] I 've passed kafka_broker_list as --set main_app.kafka_broker_list=10.109.83.124:9092 [17:14:22] I guess it should work, right ? [17:14:50] or is that thing where it needs to know itself or whatever and needs promisc or something? [17:15:16] btw indeed I get connection refused but it's because the pod is not running [17:15:24] cause of that ^ [17:46:02] 10serviceops, 10Mail, 10Operations, 10Phabricator, and 2 others: Convert Phabricator mail config to use cluster.mailers - https://phabricator.wikimedia.org/T212989 (10greg) [17:52:12] akosiaris: i think akfka is exporting the port not as 9092 [17:53:15] its 30092 [17:53:48] see README.MD in that patch [17:53:49] helm install --set main_app.kafka_broker_list=$(minikube ip):30092 [17:54:25] akosiaris: which pod is not running [17:54:26] the kakfa one? [17:54:56] i've not been able to run the kafka one with out sudo ip link set docker0 promisc on [18:39:26] ottomata: you set a nodeport the default nodeport range is between 30000 to 32000 you probably don't need a nodeport unless you want to interact Kafka from outside the cluster [18:39:37] Definitely you don't need it for the eventgate to run [18:39:56] A nodeport service I mean [18:41:43] Change it for a cluster ip service and link to cluster using in-cluster DNS (this works in minikube) as kafka.NAMESPACE.svc.cluster.local [18:42:29] fsero: i do use it [18:42:43] i use it from my local laptop to consume and see events as they are produced [20:46:22] 10serviceops, 10Language-Team, 10MediaWiki-Language-converter, 10Parsing-Team, and 5 others: RFC: Spin off (Parsoid) language variants functionality as a Node.js microservice? - https://phabricator.wikimedia.org/T213345 (10daniel) As far as I know, variant conversion requires the use of conversion tables t... [21:42:22] 10serviceops, 10Cloud-VPS, 10Puppet: upgrade simplelap / simpelap classes (apache -> httpd and mysql -> mariadb) or deprecate them - https://phabricator.wikimedia.org/T215662 (10Dzahn) [21:44:09] 10serviceops, 10Cloud-VPS, 10Puppet: upgrade simplelap / simpelap classes (apache -> httpd and mysql -> mariadb) or deprecate them - https://phabricator.wikimedia.org/T215662 (10Dzahn) [21:45:33] 10serviceops, 10Cloud-VPS, 10Puppet: upgrade simplelap / simpelap classes (apache -> httpd and mysql -> mariadb) or deprecate them - https://phabricator.wikimedia.org/T215662 (10Dzahn) [21:48:29] 10serviceops, 10Cloud-VPS, 10Puppet: upgrade simplelap / simplelamp classes (apache -> httpd and mysql -> mariadb) or deprecate them - https://phabricator.wikimedia.org/T215662 (10Dzahn) [21:56:22] 10serviceops, 10Cloud-VPS, 10Puppet: upgrade simplelap / simplelamp classes (apache -> httpd and mysql -> mariadb) or deprecate them - https://phabricator.wikimedia.org/T215662 (10Dzahn) [22:15:44] 10serviceops, 10Cloud-VPS, 10Puppet: upgrade simplelamp class (apache -> httpd and mysql -> mariadb) or deprecate it - https://phabricator.wikimedia.org/T215662 (10Dzahn) [23:20:25] 10serviceops, 10Cloud-VPS, 10Patch-For-Review, 10Puppet: upgrade simplelamp class (apache -> httpd and mysql -> mariadb) or deprecate it - https://phabricator.wikimedia.org/T215662 (10Slevinski) Thanks for the heads up. The SignWriting project is active and the two websites I administer are needed. I che... [23:59:03] 10serviceops, 10Cloud-VPS, 10Patch-For-Review, 10Puppet: upgrade simplelamp class (apache -> httpd and mysql -> mariadb) or deprecate it - https://phabricator.wikimedia.org/T215662 (10Dzahn) @Slevinski Not yet, i would warn you before i actually merge any changes. But be aware this role is currently broken...