[06:15:37] <wikibugs>	 10serviceops, 10Operations, 10Performance-Team (Radar), 10User-jijiki: Ramp up percentage of users on php7.2 to 100% on both API and appserver clusters - https://phabricator.wikimedia.org/T219150 (10jijiki)
[06:15:39] <wikibugs>	 10serviceops, 10Operations, 10Traffic, 10User-jijiki: Allow directing a percentage of API traffic to PHP7 - https://phabricator.wikimedia.org/T219129 (10jijiki) 05Open→03Resolved a:03jijiki @Jdforrester-WMF I am marking this as resolved :D
[06:16:54] <wikibugs>	 10serviceops, 10Operations, 10Traffic, 10User-jijiki: Allow directing a percentage of API traffic to PHP7 - https://phabricator.wikimedia.org/T219129 (10jijiki)
[06:17:51] <wikibugs>	 10serviceops, 10Operations, 10Traffic, 10User-jijiki: Allow directing a percentage of API traffic to PHP7 - https://phabricator.wikimedia.org/T219129 (10jijiki)
[06:19:33] <_joe_>	 jijiki: we need to restart php-fpm across the fleet once puppet has run
[06:19:39] <_joe_>	 can you take care of it?
[06:28:11] <jijiki>	 what time?
[06:28:24] <jijiki>	 I was about to come back in an hour 
[06:28:31] <jijiki>	 is that ok?
[06:32:46] <jijiki>	 I will start in 1,5hrs+ or so, make sure it has run everywhere
[07:05:24] <wikibugs>	 10serviceops, 10Release-Engineering-Team, 10Scap, 10PHP 7.2 support: Enhance MediaWiki deployments for support of php7.x - https://phabricator.wikimedia.org/T224857 (10Joe)
[08:03:24] <wikibugs>	 10serviceops, 10Release-Engineering-Team, 10Scap, 10PHP 7.2 support: Enhance MediaWiki deployments for support of php7.x - https://phabricator.wikimedia.org/T224857 (10Joe) p:05Triage→03High
[08:16:01] <wikibugs>	 10serviceops, 10Release-Engineering-Team, 10Scap, 10PHP 7.2 support: Enhance MediaWiki deployments for support of php7.x - https://phabricator.wikimedia.org/T224857 (10Joe) A smart script would work as follows:  - It first checks its own state. If the server is depooled, restart immediately, return - If th...
[09:27:08] <jijiki>	 _joe_: am I good to go?
[10:18:28] <_joe_>	 jijiki: you were when I asked you to.
[10:22:44] <jijiki>	 ok I am rolling restarting 
[10:28:48] <wikibugs>	 10serviceops, 10Operations, 10Release Pipeline, 10Release-Engineering-Team, and 5 others: Introduce wikidata termbox SSR to kubernetes - https://phabricator.wikimedia.org/T220402 (10WMDE-leszek) Hello @akosiaris, this is a friendly ping from your favourite WMDE customers :) Any news on the deployment front...
[10:51:47] <wikibugs>	 10serviceops, 10Release-Engineering-Team, 10Scap, 10PHP 7.2 support: Enhance MediaWiki deployments for support of php7.x - https://phabricator.wikimedia.org/T224857 (10ArielGlenn) The 'smart script' outlined above seems fine to me for now.  I suppose that on mwdebug we would run a 'dumb script' that would...
[11:03:46] <wikibugs>	 10serviceops, 10Release-Engineering-Team, 10Scap, 10PHP 7.2 support: Enhance MediaWiki deployments for support of php7.x - https://phabricator.wikimedia.org/T224857 (10Joe) >>! In T224857#5229810, @ArielGlenn wrote:  > Before we start redefining how SWATs are done, let's look at how many errors are caught...
[11:05:51] <wikibugs>	 10serviceops, 10Release-Engineering-Team, 10Scap, 10PHP 7.2 support: Enhance MediaWiki deployments for support of php7.x - https://phabricator.wikimedia.org/T224857 (10ArielGlenn) We'll also have the headache of cli-based long-running jobs and their opcache, which would not be flushed by a php-fpm restart.
[11:07:58] <wikibugs>	 10serviceops, 10Release-Engineering-Team, 10Scap, 10PHP 7.2 support: Enhance MediaWiki deployments for support of php7.x - https://phabricator.wikimedia.org/T224857 (10Joe) >>! In T224857#5229851, @ArielGlenn wrote: > We'll also have the headache of cli-based long-running jobs and their opcache, which woul...
[11:23:32] <wikibugs>	 10serviceops, 10Release-Engineering-Team, 10Scap, 10PHP 7.2 support: Enhance MediaWiki deployments for support of php7.x - https://phabricator.wikimedia.org/T224857 (10MoritzMuehlenhoff) > If the server is pooled, wait for a lock on poolcounter (we can tune appropriately the concurrency allowed)  And proba...
[11:54:04] <wikibugs>	 10serviceops, 10Release-Engineering-Team, 10Scap, 10PHP 7.2 support, 10User-jijiki: Enhance MediaWiki deployments for support of php7.x - https://phabricator.wikimedia.org/T224857 (10jijiki)
[13:59:50] <wikibugs>	 10serviceops, 10Operations, 10Release Pipeline, 10Release-Engineering-Team, and 5 others: Introduce kask session storage service to kubernetes - https://phabricator.wikimedia.org/T220401 (10Eevans) >>! In T220401#5228040, @akosiaris wrote: >>>! In T220401#5226623, @Eevans wrote: >>>>! In T220401#5226531, @...
[14:05:55] <wikibugs>	 10serviceops, 10Operations, 10Release Pipeline, 10Release-Engineering-Team, and 5 others: Introduce kask session storage service to kubernetes - https://phabricator.wikimedia.org/T220401 (10akosiaris) >>! In T220401#5230202, @Eevans wrote: >>>! In T220401#5228040, @akosiaris wrote: >>>>! In T220401#5226623...
[14:29:23] <wikibugs>	 10serviceops, 10Operations, 10Kubernetes: Migrate etcd networking cluster to Stretch/Buster - https://phabricator.wikimedia.org/T224577 (10MoritzMuehlenhoff) Actually, this is probably entirely unused, Fabián pointed me to T212934
[14:30:14] <jijiki>	 I can't make the meeting today 
[14:31:53] <fsero>	 Decline It on calendar :)
[14:36:24] <jijiki>	 I think I already have, it doesn't show up 
[14:36:32] <jijiki>	 but thanks for letting me know 
[14:48:32] <fsero>	 2 down from our meeting
[14:48:41] <fsero>	 I don't have anything meaningful to say
[14:48:53] <fsero>	 _joe_: apergos akosiaris  are we keeping it?
[14:49:19] <_joe_>	 ok.
[14:49:43] <apergos>	 I can show up, whatever other folks would like to do
[14:49:47] <_joe_>	 have we filled the etherpad with things we've done in the last week?
[14:49:54] <_joe_>	 err the google doc
[14:50:04] <_joe_>	 if not, please everyone go and fill that
[14:51:44] <apergos>	 the etherpad isn't it?
[14:52:03] <wikibugs>	 10serviceops, 10Release-Engineering-Team, 10Scap, 10PHP 7.2 support, 10User-jijiki: Enhance MediaWiki deployments for support of php7.x - https://phabricator.wikimedia.org/T224857 (10Joe) >>! In T224857#5229898, @MoritzMuehlenhoff wrote: >> If the server is pooled, wait for a lock on poolcounter (we can...
[14:52:12] <_joe_>	 no the google doc for the SRE meeting
[14:52:46] <akosiaris>	 I 've updated both on my side
[14:54:14] <_joe_>	 so do we want to meet? I don't have much besides the goal updates to give you
[14:54:51] <fsero>	 Let's err on yes, if is. Aquick one we go for coffee
[14:56:07] <akosiaris>	 I think we need to decide on stuff for Thursday anyway. Plus the SRE summit slides
[14:56:08] <moritzm>	 effie: there was one Puppet patch that you wanted to merge before the mw reboots start in eqiad (as the reboots would pick up your change conveniently), has that been merged by now?
[15:00:09] <jijiki>	 no it will be done tomorrwo 
[15:00:21] <jijiki>	 are you starting tomorrow?
[15:01:18] <jbond42>	 jijiki: thanks they can wait untill tomorrow, please ping when deployed
[15:01:41] <jijiki>	 great, thank you both !
[15:01:49] <jbond42>	 np
[15:01:53] * jijiki off
[15:17:16] <_joe_>	 oh ok, I might run a few minutes late btw
[15:31:30] <akosiaris>	 meeting time!
[15:31:37] * akosiaris is alone at a google meet
[16:00:42] <_joe_>	 fsero: so if you want to add a secret, first open labs/private
[16:01:26] <_joe_>	 add your secret there under 
[16:01:30] <_joe_>	 https://gerrit.wikimedia.org/r/plugins/gitiles/labs/private/+/refs/heads/master/modules/secret/secrets
[16:01:39] <_joe_>	 of course it should contain fake data
[16:01:43] <_joe_>	 that's a public repo
[16:01:44] <fsero>	 yep _joe_ i know that
[16:01:48] <fsero>	 i think i was lost in translation
[16:01:53] <_joe_>	 I guess so
[16:01:54] <fsero>	 let me explain you the issue
[16:01:58] <_joe_>	 sure
[16:03:31] <fsero>	 so for deploying things using helmfile we need to populate some values files, most of them are public but some services like kask
[16:03:43] <fsero>	 needs to be deploying using some secrets from puppet
[16:03:55] <_joe_>	 ok
[16:04:20] <fsero>	 so alex and i thought that one way to achieve that some writing another values file like service_secrets.yaml and dumping there the needed secrets
[16:04:33] <_joe_>	 right
[16:04:40] <fsero>	 so i need a way to describe in puppet get this hiera value and output it here in this yaml file
[16:07:34] <_joe_>	 I guess something like file { '/etc/helmfile/private/$name.yaml': content => ordered_yaml($contents), } 
[16:07:56] <_joe_>	 or even
[16:08:03] <_joe_>	 given these are secrets right
[16:08:11] <_joe_>	 the whole file coming from the secret
[16:08:13] <_joe_>	 so
[16:08:50] <_joe_>	 file { '/etc/helmfile/private/$name.yaml': content => secret("helmfile/$name.yaml") }
[16:09:33] <fsero>	 ook that could work :)
[16:09:38] <fsero>	 let me make it real on a CR
[16:09:47] <_joe_>	 sure
[16:10:02] <fsero>	 because i like dogfooding i would start with the admin application, which is customizing the cluster
[16:32:51] <wikibugs>	 10serviceops, 10Operations, 10Release Pipeline, 10Release-Engineering-Team, and 5 others: Introduce kask session storage service to kubernetes - https://phabricator.wikimedia.org/T220401 (10Eevans) >>! In T220401#5230212, @akosiaris wrote: >>>! In T220401#5230202, @Eevans wrote: >>>>! In T220401#5228040, @...
[17:31:08] <wikibugs>	 10serviceops, 10Scap, 10Release-Engineering-Team (Watching / External): Deploy scap 3.10.0-1 - https://phabricator.wikimedia.org/T224915 (10thcipriani)
[21:14:55] <wikibugs>	 10serviceops, 10Release-Engineering-Team, 10Scap, 10PHP 7.2 support, 10User-jijiki: Enhance MediaWiki deployments for support of php7.x - https://phabricator.wikimedia.org/T224857 (10thcipriani) What affect have the `opcode_invalidate` calls for specific files via sync-file had? Do we only see this corru...