[07:41:15] <wikibugs>	 10serviceops: setup new, buster based, kubernetes etcd servers for staging/codfw/eqiad cluster - https://phabricator.wikimedia.org/T239835 (10akosiaris) 05Resolved→03Open Reopening, this is more than just getting the VMs and etcd up and running. Gonna track the migration as well in this one
[08:08:43] <wikibugs>	 10serviceops, 10Patch-For-Review: setup new, buster based, kubernetes etcd servers for staging/codfw/eqiad cluster - https://phabricator.wikimedia.org/T239835 (10akosiaris) Process for the migration  ` 0 - Schedule downtime for  * apiserver  * calico-node  * services 0.5 - Populate IPPool and BGP nodes in the...
[08:34:59] <wikibugs>	 10serviceops, 10Patch-For-Review: setup new, buster based, kubernetes etcd servers for staging/codfw/eqiad cluster - https://phabricator.wikimedia.org/T239835 (10akosiaris) Steps for 0.5 for staging.   Get a modified calicoctl.cfg on the kubernetes nodes that references the new etcds  * calicoctl config set as...
[09:35:09] <wikibugs>	 10serviceops, 10Operations: kubestagetcd1003 alerts daily via email to root@ for 'unexpected non snapshot file' - https://phabricator.wikimedia.org/T240932 (10elukey)
[12:04:04] <wikibugs>	 10serviceops, 10Patch-For-Review: setup new, buster based, kubernetes etcd servers for staging/codfw/eqiad cluster - https://phabricator.wikimedia.org/T239835 (10akosiaris) The process has worked up to a point, I hit a snag, I 've had to edit system:node clusterrolebinding and add  ` subjects: - apiGroup: rbac...
[12:09:40] <wikibugs>	 10serviceops, 10Patch-For-Review: setup new, buster based, kubernetes etcd servers for staging/codfw/eqiad cluster - https://phabricator.wikimedia.org/T239835 (10akosiaris) 1 more snag.   The "master" tiller, the one that exists in `kube-system` could not be started because of  ` Error creating: pods "tiller-d...