[09:01:13] !log admin Will start the ceph upgrade in 15 min, no downtime nor performance impact is expected (T272303) [09:01:17] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [09:01:17] T272303: [ceph] Upgrade to 14.2.16 from 14.2.5 - https://phabricator.wikimedia.org/T272303 [09:16:02] !log admin Starting eqiad ceph upgrade, upgrading the mon servers cloudcephmon1* (T272303) [09:16:07] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [09:16:07] T272303: [ceph] Upgrade to 14.2.16 from 14.2.5 - https://phabricator.wikimedia.org/T272303 [09:22:13] !log admin Mon daemons upgraded and running, upgrading mgr daemons on servers cloudcephmon1* (T272303) [09:22:15] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [09:22:16] T272303: [ceph] Upgrade to 14.2.16 from 14.2.5 - https://phabricator.wikimedia.org/T272303 [09:24:39] !log admin Mgr daemons upgraded and running, upgrading osd daemons on servers cloudcephosd1*, this make take a bit longer (T272303) [09:24:42] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [09:37:55] !log admin 25% of the eqiad cluster upgraded... continuing (T272303) [09:37:58] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [09:37:58] T272303: [ceph] Upgrade to 14.2.16 from 14.2.5 - https://phabricator.wikimedia.org/T272303 [09:46:29] !log admin 75% of the eqiad cluster upgraded... continuing (T272303) [09:46:33] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [09:46:33] T272303: [ceph] Upgrade to 14.2.16 from 14.2.5 - https://phabricator.wikimedia.org/T272303 [09:55:08] !log admin Eqiad ceph cluster uprgaded, doing sanity checks (T272303) [09:55:11] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [09:55:11] T272303: [ceph] Upgrade to 14.2.16 from 14.2.5 - https://phabricator.wikimedia.org/T272303 [10:05:10] !log admin Everything looks ok, created a new vm with a volume in ceph without issues, and on warnings/errors on ceph status, closing (T272303) [10:05:13] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:05:13] T272303: [ceph] Upgrade to 14.2.16 from 14.2.5 - https://phabricator.wikimedia.org/T272303 [10:34:32] Hi. I have been going through the various protection levels in wikis from https://en.wikipedia.org/wiki/Wikipedia:Protection_policy. But then I query the database I find some more terms that I don't think I found in the link. Can someone exlpain how the protection levels are named or maybe point me to where they are explained? The new terms I am finding are 'editautopatrolprotected', 'editeditorprotected', [10:34:32] 'editautoreviewprotected', 'review', 'editextendedsemiprotected' (other terms were 'autoconfirmed', 'sysop', 'templateeditor', 'extendedconfirmed'). P.S: I am working with Scribunto modules only. [10:40:20] tanny411: are all of those from enwiki? [10:42:28] 'autoconfirmed', 'sysop', 'templateeditor', 'extendedconfirmed', 'review' are values that refer to a group instead of a user right, those can still be used in old protections but new ones use 'edit*protected' [10:44:24] Majavah: No they are in various wikis, frwiki, hewiki etc. [10:45:31] Those are values I find from as protection level of pages. So im not sure if I understand [10:47:08] a protection restricts a certain action to users who have a certain right, so if a page has a [10:47:40] 'edit' action protection for 'editprotected', that means that only users with the 'editprotected' user right can edit that page [10:48:15] so i believe 'editautopatrolprotected', 'editeditorprotected', 'editautoreviewprotected', 'editextendedsemiprotected' are like autoconfirm, templateedito, review and extendedconfirmed? [10:48:16] oh ok, i think i should read up on user and group rights then [10:48:51] special:listgrouprights on each wiki shows which rights each group has [10:49:40] !log admin merging core router firewall change https://gerrit.wikimedia.org/r/c/operations/homer/public/+/657302 (T209082) [10:49:42] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:52:03] Majavah: Thanks [15:22:32] Hey, why can't i add a maintainer to a tool in toolsadmin? It looks like this, and I don't see an "add" button https://usercontent.irccloud-cdn.com/file/P1SSLc3e/image.png [15:26:33] Urbanecm: please open a phab task [15:27:50] arturo: okay. Is there a tag to use for tools admin issues? [15:28:47] Urbanecm: #striker [15:55:40] Urbanecm: That screenshot looks like the same bug as T272410 [15:55:44] T272410: Fix missing static resource "autocomplete_light" in ToolsAdmin causing broken webpage - https://phabricator.wikimedia.org/T272410 [16:09:39] Thanks bd808 [17:02:20] andrewbogott: hey, for when you have time T269348 [17:02:21] T269348: wikitech database has almost all of its varbinary fields wrong - https://phabricator.wikimedia.org/T269348 [21:11:55] !help I'm trying to restart the web service for the skins tool as php7.3 but I get an error [21:11:55] If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-kanban [21:12:00] https://www.irccloud.com/pastebin/MbNwylCJ/ [21:12:42] bstorm: ^^^ that one is interesting [21:12:51] MacFan4000: ouch. that is a new to me error. [21:13:12] Same [21:13:32] * arturo wonders if etcd is happy [21:14:15] service manifest is empty, but there is a running pod [21:15:06] bstorm: do you want to debug, or should I try wiping out the apparently orphaned deployment, replicaset, and pod? [21:15:17] let me check one thing quick [21:15:46] https://www.irccloud.com/pastebin/88DLgD9L/ [21:16:20] yeah. it sort of looks like it is partially torn down but not completely [21:16:30] Yeah, but why 403? [21:16:39] Go ahead and do wipe and start [21:17:18] !log tools.skins Force deleted partialwebservice deployment [21:17:21] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.skins/SAL [21:17:40] MacFan4000: try starting it up again. [21:18:37] I see a service in there now which is a better sign [21:20:40] https://www.irccloud.com/pastebin/YBDcgl2E/ [21:20:55] "PHP Fatal error: Uncaught Exception: Unable to open file /data/project/skins/public_html/skins/Amethyst/skin.json" but that looks like local config and not kubernetes state realted [21:21:13] yes, ty [21:21:30] though php -v reports 7.2 [21:21:47] looks like its 7.3 for webpages and 7.2 for cli [21:22:19] MacFan4000: where are you running that `php -v` command? You will need to enter a kubernetes shell to get php 7.3 [21:22:32] oh [21:22:52] webservice --backend=kubernetes php7.3 she;; [21:22:59] errr.... shell [21:24:59] The basic rule here is something like: if you are running your webservice using kubernetes then you should also use a matching kubernetes shell when you do things from the cli that use the runtime language (php, python, ruby, java, etc) [21:25:46] this is needed because the bastion servers are have the gird engine compatible runtimes installed which are almost always older versions [21:26:40] As for the 403 error, at least one apiserver is not happy. It's possible that there was a token that wasn't acquired right before another request or some such whatnot.