[02:23:11] A job on the grid won't die with 'qdel -f' .. it is 4302517 .. can anyone help kill it? It is an eventstream script that hung almost exactly to the hour 30 days after it started.. Wonder if there is a timer aborting streams. [09:00:44] !log admin Enabling custom application 'cinder' on pool codfw1dev-cinder to get rid of health warnings [09:00:46] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:07:13] !log admin disabling puppet on cephcloudosd2* (codfw) to do some performance tests [10:07:16] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:50:41] !log admin re-enabling puppet on cephcloudosd2* (codfw) [10:50:44] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [13:43:24] Hi, Can any toolforge admin process https://toolsadmin.wikimedia.org/tools/membership/status/979 now? [13:49:22] Jayprakash12345: done [13:53:38] !log admin disabling puppet on cloudcephosd2* to resume perf tests [13:53:40] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [14:00:16] arturo: Thank you :) [14:35:15] you are welcome [15:06:51] !log admin re-enabling puppet on cloudcephosd2* hosts [15:06:54] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [15:21:42] !log admin Starting upgrade of ceph mon nodes on codfw (T272303) [15:21:45] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [15:21:45] T272303: [ceph] Upgrade to 14.2.16 from 14.2.5 - https://phabricator.wikimedia.org/T272303 [15:35:00] !log admin Upgraded mon sevices on codfw ceph cluster, starting with mgr ones (T272303) [15:35:08] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [15:35:08] T272303: [ceph] Upgrade to 14.2.16 from 14.2.5 - https://phabricator.wikimedia.org/T272303 [15:38:04] !log admin Upgraded mgr sevices on codfw ceph cluster, starting with osd ones (T272303) [15:38:06] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [16:00:34] !log admin Codfw1 ceph cluster uprgaded, will wait until tomorrow to see if there's any instability, but everything looks fine (T272303) [16:00:37] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [16:00:37] T272303: [ceph] Upgrade to 14.2.16 from 14.2.5 - https://phabricator.wikimedia.org/T272303 [21:02:05] hi