[06:40:44] 10serviceops, 10Operations, 10RESTBase-API, 10TechCom, and 2 others: Decide whether to keep violating OpenAPI/Swagger specification in our REST services - https://phabricator.wikimedia.org/T217881 (10santhosh) After reading the openapi spec and examples, I think the best approach to address optional params... [06:42:13] 10serviceops, 10Operations, 10RESTBase-API, 10TechCom, and 2 others: Decide whether to keep violating OpenAPI/Swagger specification in our REST services - https://phabricator.wikimedia.org/T217881 (10Joe) Well instead of copy/pasta, there is that thing called YAML anchors/references that deal with data rep... [06:43:05] 10serviceops, 10Operations, 10RESTBase-API, 10TechCom, and 2 others: Decide whether to keep violating OpenAPI/Swagger specification in our REST services - https://phabricator.wikimedia.org/T217881 (10Joe) >>! In T217881#5016597, @santhosh wrote: > After reading the openapi spec and examples, I think the be... [06:50:16] 10serviceops, 10Operations, 10RESTBase-API, 10TechCom, and 2 others: Decide whether to keep violating OpenAPI/Swagger specification in our REST services - https://phabricator.wikimedia.org/T217881 (10santhosh) > I would advise against making a breaking change to our API so that a YAML file is easier to wri... [08:28:40] are these URLs ok for now as Icinga notes URLs for Mediawiki monitoring? https://gerrit.wikimedia.org/r/c/operations/puppet/+/495834 [09:57:27] 10serviceops, 10Operations, 10RESTBase-API, 10TechCom, and 2 others: Decide whether to keep violating OpenAPI/Swagger specification in our REST services - https://phabricator.wikimedia.org/T217881 (10daniel) >>! In T217881#5016597, @santhosh wrote: > ` > /required?optional1=value1&optional2=value2 > ` Doe... [10:19:03] 10serviceops, 10Operations, 10RESTBase-API, 10TechCom, and 2 others: Decide whether to keep violating OpenAPI/Swagger specification in our REST services - https://phabricator.wikimedia.org/T217881 (10Nikerabbit) https://cxserver.wikimedia.org/v2?doc#!/Tools/get_v1_list_tool_from_to has two optional paramet... [11:13:24] 10serviceops, 10Operations, 10Wikidata, 10Wikidata-Termbox-Hike, and 4 others: New Service Request: Wikidata Termbox SSR - https://phabricator.wikimedia.org/T212189 (10Tarrow) >>! In T212189#5011311, @akosiaris wrote: > I have to say I am wondering a bit about the latency as the low end seems to be quite h... [11:32:54] 10serviceops, 10Operations, 10Wikidata, 10Wikidata-Termbox-Hike, and 4 others: New Service Request: Wikidata Termbox SSR - https://phabricator.wikimedia.org/T212189 (10WMDE-leszek) >>! In T212189#5011311, @akosiaris wrote: > I have to say I am wondering a bit about the latency as the low end seems to be q... [11:48:18] What's the deal with the helm.yaml in .pipeline? Are there any docs about that? [12:07:12] i think that would be https://wikitech.wikimedia.org/wiki/Kubernetes/Helm [13:07:16] so is the helm chart specified in helm.yaml put into /srv/scap-helm by some job? [13:08:32] from https://releases.wikimedia.org/charts/ [13:41:31] 10serviceops, 10Operations, 10RESTBase-API, 10TechCom, and 2 others: Decide whether to keep violating OpenAPI/Swagger specification in our REST services - https://phabricator.wikimedia.org/T217881 (10Pchelolo) > Well instead of copy/pasta, there is that thing called YAML anchors/references that deal with d... [14:07:39] <_joe_> tarrow: no those are production charts, they're hosted at https://gerrit.wikimedia.org/g/operations/deployment-charts/+/refs/heads/master [14:07:49] <_joe_> you create a new one using the scaffolding script [14:08:04] <_joe_> https://gerrit.wikimedia.org/r/plugins/gitiles/operations/deployment-charts/+/refs/heads/master/create_new_service.sh [14:08:22] <_joe_> sorry, documenting this is part of one of our quarterly goals [14:08:30] <_joe_> and I'm not sure where we got with that [14:09:09] <_joe_> tarrow: if you have more doubts, you probably need to wait for Alex to be around [14:09:26] Cool, is he on PST? [14:30:53] So to check the way it works is: new chart into deployment-charts. Then is there a manual copy from /srv/deployment-charts to /srv/scap-helm? and .pipeline/helm.yaml doesn't play into it? [14:47:19] tarrow: he is in EU but I am not sure if he is off today [15:19:56] i forget, what do I have to wait for to be aable to deploy a new chart version? [15:20:01] and how long? [15:20:08] (asking for https://gerrit.wikimedia.org/r/#/c/operations/deployment-charts/+/495904/) [15:30:34] ottomata: alex is not around :/ [15:30:50] neither is joe [15:32:49] and jijiki doesn't know?! :p [15:33:00] i don't know what or how long, but i noticed that my chart is at https://releases.wikimedia.org/charts/ [15:33:09] so if this is a yes/no question [15:33:23] I can randomly answer "yes" if you like [15:33:29] haha [15:33:35] tarrow: what I know about your Q [15:33:48] /srv/scap-helm does not contain the charts [15:34:07] those get synced with https://releases.wikimedia.org/charts/ from the gerrit repo somehow after merge [15:34:19] helm uses it as its chart repo when installing/upgrading charts [15:34:34] /srv/scap-helm just contains values files for overriding template vars [15:34:53] and the stuff in /srv/scap-helm is manually edited for now [15:34:59] i think they want to put it in puppet or somewhere [15:35:03] for now it is just manual [15:36:21] ottomata: right! and so what does .pipeline/helm.yaml have to do with it all? [15:37:09] tarrow: i wasn't aware of a .pipeline/helm.yaml... [15:37:32] maybe https://phabricator.wikimedia.org/T210267 [15:37:44] ottomata: also digging through IRC logs earlier "5 mins after the change was merged the repo was updated on deploy1001" "well something more cause you know, puppet runs and all" according to Alex talking ot you last month :P [15:38:35] I just saw it in mathoid and wondered if I was supposed to have one too / what it was used for [15:40:46] i'm not sure what is 'updated on deploy1001' means there... [15:40:56] maybe releases.wm.org is hosted on deploy1001? [15:41:11] but ya dunno what .pipeline/helm.yaml is for [18:43:56] 10serviceops, 10Operations, 10Thumbor, 10ops-eqiad: thumbor1004 memory errors - https://phabricator.wikimedia.org/T215411 (10RobH) >>! In T215411#4946625, @jijiki wrote: > ` > [Tue Feb 12 06:13:31 2019] mce: [Hardware Error]: Machine check events logged > [Tue Feb 12 06:13:31 2019] EDAC sbridge MC1: HANDLI... [19:27:33] 10serviceops, 10Operations, 10Thumbor, 10ops-eqiad: thumbor1004 memory errors - https://phabricator.wikimedia.org/T215411 (10RobH) a:05RobH→03Cmjohnson Ok, updating this after IRC discussion for clarity. This system has had repeated memory errors reported above, and the SEL previously showed errors on... [19:38:40] 10serviceops, 10Operations, 10Thumbor, 10ops-eqiad: thumbor1004 memory errors - https://phabricator.wikimedia.org/T215411 (10RobH) Ok, system is powered back on for now. The next steps are as follows: * @cmjohnson to sync with @jijiki tomorrow before powering down system. ** this typically only involves... [23:03:17] 10serviceops, 10Operations, 10ops-eqiad, 10HHVM: mw1272 crashed: Bad page map in process hhvm - https://phabricator.wikimedia.org/T211668 (10RobH) 05Open→03Resolved