[09:43:32] 10serviceops, 10Operations, 10Release-Engineering-Team-TODO, 10Patch-For-Review, and 2 others: Upgrade MediaWiki appservers to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10MoritzMuehlenhoff) >>! In T245757#6650080, @Dzahn wrote: > Done! I reimaged mwdebug1003 and it went just fi... [10:22:03] 10serviceops, 10MW-on-K8s, 10Release-Engineering-Team, 10Release Pipeline (Blubber): Blubber needs to check if a user is present before creating it as part of its runs stanza - https://phabricator.wikimedia.org/T268819 (10Joe) p:05Triage→03High [10:22:31] 10serviceops, 10MW-on-K8s, 10Release-Engineering-Team, 10Release Pipeline (Blubber): Blubber needs to check if a user is present before creating it as part of its runs stanza - https://phabricator.wikimedia.org/T268819 (10Joe) I did set the priority to 'high' because this is a blocker to the production dep... [10:39:20] 10serviceops, 10MW-on-K8s, 10Release-Engineering-Team, 10Release Pipeline (Blubber): Blubber needs to check if a user is present before creating it as part of its runs stanza - https://phabricator.wikimedia.org/T268819 (10Joe) To clarify: when using ` runs: uid: X gid: Y ` the user and group get cre... [11:13:46] 10serviceops, 10MW-on-K8s, 10Release-Engineering-Team, 10Release Pipeline (Blubber): Blubber needs to check if a user is present before creating it as part of its runs stanza - https://phabricator.wikimedia.org/T268819 (10Joe) [11:24:35] 10serviceops, 10MW-on-K8s, 10Release-Engineering-Team, 10Release Pipeline (Blubber): Blubber needs to check if a user is present before creating it as part of its runs stanza - https://phabricator.wikimedia.org/T268819 (10Joe) p:05High→03Low After reviewing some more details: www-data is already presen... [12:44:56] 10serviceops, 10Release-Engineering-Team, 10Patch-For-Review: replace production deployment servers - https://phabricator.wikimedia.org/T265963 (10MoritzMuehlenhoff) Let's directly install deploy1002 with Buster? This allows to adapt Puppet manifests/packages for Buster and run tests and then in January the... [13:39:57] 10serviceops, 10Release-Engineering-Team, 10Patch-For-Review: replace production deployment servers - https://phabricator.wikimedia.org/T265963 (10jijiki) [13:40:03] 10serviceops, 10Operations, 10Release-Engineering-Team-TODO, 10Patch-For-Review, and 2 others: Upgrade MediaWiki appservers to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10jijiki) [13:57:29] 10serviceops, 10Release-Engineering-Team, 10Patch-For-Review: replace production deployment servers - https://phabricator.wikimedia.org/T265963 (10jijiki) [13:58:51] 10serviceops, 10Release-Engineering-Team, 10Patch-For-Review: replace production deployment servers - https://phabricator.wikimedia.org/T265963 (10jijiki) >>! In T265963#6651261, @MoritzMuehlenhoff wrote: > Let's directly install deploy1002 with Buster? This allows to adapt Puppet manifests/packages for Bust... [14:07:52] akosiaris jayme is the etcd cluster supposed to do that ? [14:17:15] effie you mean the one that I try to instantiate right now? [14:17:40] ah ! [14:17:42] see [14:17:45] needless to say, it's PEBKAC after PEBKAC [14:17:50] then it is supposed to do that [14:18:02] * akosiaris hates computers [14:18:21] hahaha [14:21:22] cluster is healthy [14:21:24] finally! [14:21:30] I think I need a break [14:53:55] the cluster needs a break from you too I reckon [15:06:56] ah I saw that the deployment servers went to icu63 today, that's the last of them isn't it? [15:12:30] 10serviceops, 10Beta-Cluster-Infrastructure, 10DBA, 10Operations, 10Patch-For-Review: Upgrade the MediaWiki servers to ICU 63 - https://phabricator.wikimedia.org/T264991 (10jijiki) [15:13:14] 10serviceops, 10Operations, 10Release-Engineering-Team-TODO, 10Patch-For-Review, and 2 others: Upgrade MediaWiki appservers to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10jijiki) [15:13:18] 10serviceops, 10Beta-Cluster-Infrastructure, 10DBA, 10Operations, 10Patch-For-Review: Upgrade the MediaWiki servers to ICU 63 - https://phabricator.wikimedia.org/T264991 (10jijiki) 05Open→03Resolved a:03jijiki I am marking this as resolved 🎉 [15:14:16] 10serviceops, 10Release-Engineering-Team, 10Patch-For-Review: Replace production deployment servers and update them to Buster - https://phabricator.wikimedia.org/T265963 (10jijiki) [15:14:41] apergos: yes ! [15:14:45] we are done [15:14:53] woo hooooo! congrats [16:34:51] 10serviceops, 10Operations, 10Kubernetes, 10Patch-For-Review: Migrate to helm v3 - https://phabricator.wikimedia.org/T251305 (10JMeybohm) [16:41:33] <_joe_> well done effie / rzl :) [16:52:22] actually there's one more role missing, the labweb role misses ICU63 [16:52:46] and scandium, but not sure which state that currently is in after the various testreduce parts were split off [17:00:26] what a wonderful gift from helm 3 - every command run now yells to stderr: WARNING: Kubernetes configuration file is group-readable. This is insecure. Location: /etc/kubernetes/....config [17:19:02] 10serviceops, 10Operations, 10Kubernetes, 10Patch-For-Review: Migrate to helm v3 - https://phabricator.wikimedia.org/T251305 (10JMeybohm) [17:21:53] 10serviceops, 10Operations, 10Kubernetes, 10Patch-For-Review: Migrate to helm v3 - https://phabricator.wikimedia.org/T251305 (10JMeybohm) Need to update/fix helm (2) to satisfy helmfile's "helm version" parser (it panics again) [21:18:32] 10serviceops, 10Operations: Add python3.8 to buster-wikimedia pyall component - https://phabricator.wikimedia.org/T241195 (10Jdforrester-WMF)