[06:43:59] <wikibugs>	 (03PS1) 10Legoktm: Rate-limit based on zuul queue size [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/397236
[06:44:12] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Rate-limit based on zuul queue size [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/397236 (owner: 10Legoktm)
[06:44:40] <wikibugs>	 (03PS2) 10Legoktm: Rate-limit based on zuul queue size [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/397236
[06:45:02] <wikibugs>	 (03CR) 10Legoktm: [C: 032] Rate-limit based on zuul queue size [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/397236 (owner: 10Legoktm)
[06:45:17] <wikibugs>	 (03Merged) 10jenkins-bot: Rate-limit based on zuul queue size [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/397236 (owner: 10Legoktm)
[07:07:56] <wikibugs>	 (03CR) 10Legoktm: "In practice this isn't keeping the queue at 5, it's more like 9-12. because it starts jobs and there's a bit of delay before they show up " [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/397236 (owner: 10Legoktm)
[14:42:20] <andrewbogott>	 !log shinken stopping the shinken service on shinken-01 and disabling puppet so it stays off for a while
[14:42:22] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Shinken/SAL
[17:07:12] <bd808>	 !log tools git gc --aggressive on tools-static-11 (T182604)
[17:07:17] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[17:07:18] <stashbot>	 T182604: tools-static is throwing space warnings - https://phabricator.wikimedia.org/T182604
[18:07:15] <andrewbogott>	 !log tools upgrading tools puppetmaster to v4
[18:07:19] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[18:12:24] <andrewbogott>	 !log shinken re-enabling shinken and puppet on shinken-01
[18:12:26] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Shinken/SAL
[19:03:59] <andrewbogott>	 !log deployment-prep upgraded deployment-puppetmaster02 to puppet v4
[19:04:07] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL
[19:21:48] <danilo>	 tools-bastion-03 is slow
[19:26:12] <paladox>	 andrewbogott i see deployment-prep got updated to puppet 4. Can i do the update for git and phabricator project? :)
[19:27:10] <andrewbogott>	 Sure.  It's messy though so best to wait until I can send you directions (I'm on my phone atm)
[19:27:45] <andrewbogott>	 There are a few manual steps needed to keep masters from breaking themselves.
[19:28:00] <paladox>	 ah ok
[19:28:04] <paladox>	 i will wait for you :)
[19:32:48] <bd808>	 !log tools git gc on tools-static-11; --aggressive was killed by system (T182604)
[19:32:54] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[19:32:54] <stashbot>	 T182604: tools-static is throwing space warnings - https://phabricator.wikimedia.org/T182604
[19:34:06] <paladox>	 andrewbogott will you be able to help me when your on your laptop or do we do it some other time please? :)
[20:14:15] <MisterSynergy>	 On toolforge, which python module for mysql databases do we typically use?
[20:16:21] <Zppix>	 I cant think of the name of whats common let me see if i cant find it
[20:17:30] <Zppix>	 bd808: correct me if im wrong but i think its pymdb
[20:18:36] <MisterSynergy>	 I'll try :-)
[20:21:34] <MisterSynergy>	 nah, not available either
[20:21:50] <MisterSynergy>	 do I have to install it first?
[20:29:19] <MisterSynergy>	 ah, found module "mysql"
[20:32:02] <d3r1ck>	 MisterSynergy: I think it should be "oursql"
[20:32:15] <MisterSynergy>	 there is no module oursql available
[20:32:20] <d3r1ck>	 https://wikitech.wikimedia.org/wiki/Help:Toolforge/Database#Python_2
[20:32:26] <d3r1ck>	 That is a link
[20:32:48] <d3r1ck>	 Available for python 2. I have used that 
[20:33:07] <d3r1ck>	 MisterSynergy: Check again, maybe I'm wrong
[20:33:10] <MisterSynergy>	 I'm using python3
[20:33:16] <MisterSynergy>	 maybe that's why?
[20:33:32] <d3r1ck>	 MisterSynergy: That is probably why
[20:33:47] <d3r1ck>	 Can you use a venv and try out Python2?
[20:33:51] <MisterSynergy>	 I'm relatively fresh to python, never really used python2
[20:34:01] <d3r1ck>	 I think bd808 should know more in case there is a module for python3
[20:34:08] <d3r1ck>	 MisterSynergy: I understand!
[20:35:02] <d3r1ck>	 But you can also use this: https://wikitech.wikimedia.org/wiki/User:Legoktm/toolforge_library, MisterSynergy 
[20:35:18] <d3r1ck>	 Using "oursql" uses less memory (as it says)
[20:35:30] <d3r1ck>	 Maybe legoktm's library can work on Python 3?
[20:35:40] <d3r1ck>	 Ahh yes it does
[20:35:44] <MisterSynergy>	 the legoktm-script is not available as well (in python3, for me)
[20:35:47] <d3r1ck>	 MisterSynergy: You are save, use this: https://wikitech.wikimedia.org/wiki/User:Legoktm/toolforge_library
[20:36:25] <d3r1ck>	 MisterSynergy: It's a python 3 library that you have to install
[20:36:33] <d3r1ck>	 Install using "pip"
[20:36:44] <d3r1ck>	 MisterSynergy: pip install toolforge
[20:36:53] <d3r1ck>	 Then import and use in your code
[20:37:03] <d3r1ck>	 Does that help?
[20:37:42] <MisterSynergy>	 -bash: pip: command not found
[20:38:06] <MisterSynergy>	 (using a tool account)
[20:38:16] <zhuyifei1999_>	 MisterSynergy: for python3 use pymysql
[20:38:50] <zhuyifei1999_>	 for pip you need to setup a venv
[20:39:13] <d3r1ck>	 zhuyifei1999_: yes
[20:39:15] <MisterSynergy>	 okay, will have a look what to do. can I install my own modules then?
[20:39:19] <zhuyifei1999_>	 YES
[20:39:19] <d3r1ck>	 MisterSynergy: You don't have pip installed?
[20:39:22] <zhuyifei1999_>	 *yes
[20:39:35] <d3r1ck>	 MisterSynergy: Which OS are you running
[20:39:51] <MisterSynergy>	 I'm on the toolforge console
[20:39:52] <d3r1ck>	 If linux based, say Ubuntu, you can just run "apt-get install python-pip"
[20:40:12] <d3r1ck>	 Then you need to create a venv
[20:40:22] <zhuyifei1999_>	 d3r1ck: you can't apt on toolforge unless you are the gods :P
[20:40:32] <MisterSynergy>	 :-)
[20:40:57] <zhuyifei1999_>	 to create a python3 venv see https://docs.python.org/3/library/venv.html
[20:41:02] <MisterSynergy>	 try to figure out what to do now
[20:41:06] <MisterSynergy>	 thnx for the link
[20:41:19] <zhuyifei1999_>	 are you building a webservice or a bot?
[20:42:08] <MisterSynergy>	 kind of a cron script for daily execution
[20:42:21] <d3r1ck>	 zhuyifei1999_: Sure! Was thinking MisterSynergy was on localhost
[20:42:26] <d3r1ck>	 got it mixed up
[20:42:34] <zhuyifei1999_>	 and to activate your venv just $ source ~/path/to/your/venv/bin/activate
[20:43:18] <zhuyifei1999_>	 if you run it on cron replace the `python` in your command with ~/path/to/your/venv/bin/python
[20:44:03] <d3r1ck>	 zhuyifei1999_: But pip should be installed on toolforge environment right?
[20:44:08] <zhuyifei1999_>	 the venv is not loaded by default on cron
[20:44:13] <MisterSynergy>	 mysql handling is so much easier with PHP :-)
[20:44:20] <zhuyifei1999_>	 d3r1ck: no, not globally
[20:44:28] <d3r1ck>	 Ohh it's not installed globally on bastion
[20:44:32] <d3r1ck>	 Yeah, got it
[20:44:49] <zhuyifei1999_>	 MisterSynergy: sigh, mysqli_real_escape?! there's an fake escape?! :P
[20:44:58] <MisterSynergy>	 no, PDO
[20:45:22] <d3r1ck>	 zhuyifei1999_: So I guess the classic case for MisterSynergy will be to use a venv
[20:45:31] <d3r1ck>	 MisterSynergy: Sounds good?
[20:45:34] <d3r1ck>	 Using a venv?
[20:45:45] <zhuyifei1999_>	 that's how we do it anyways
[20:46:00] <MisterSynergy>	 yes, will now figure out; this venv doc is a little lengthy, but I guess I'll get it done
[20:46:10] <MisterSynergy>	 this was already very useful 
[20:46:37] <zhuyifei1999_>	 28.3.{2,3} is useless in this case
[20:46:58] <zhuyifei1999_>	 (programmatically creating venvs)
[20:49:29] <d3r1ck>	 MisterSynergy: are you logged into toolforge now?
[20:49:36] <MisterSynergy>	 yes
[20:50:08] <d3r1ck>	 Run this: virtualenv -p /usr/bin/python3 <the-name-of-your-venv>
[20:50:36] <zhuyifei1999_>	 ...
[20:50:38] <d3r1ck>	 replace <the-name-of-your-venv> the with appropriate name
[20:50:51] <d3r1ck>	 zhuyifei1999_: correct me if i'm wrong
[20:52:27] <zhuyifei1999_>	 (python 3 has built in support for virtual environments via module `venv`, which docs I've linked to)
[20:52:50] <d3r1ck>	 zhuyifei1999_: okay!
[20:53:21] <zhuyifei1999_>	 I don't know how well the `virtualenv` is going to work with python 3, since that does python 2 by default
[20:55:09] <zhuyifei1999_>	 um, https://packaging.python.org/tutorials/installing-packages/#creating-virtual-environments
[20:55:46] <MisterSynergy>	 okay, it does not work :-)
[20:56:08] <d3r1ck>	 MisterSynergy: the command?
[20:56:17] <andrewbogott>	 !log striker upgrading striker-puppet01 to puppet v4
[20:56:20] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Striker/SAL
[20:56:20] <MisterSynergy>	 "python3 -m venv /path/to/new/virtual/environment" complains that python3-venv package is missing
[20:56:28] <zhuyifei1999_>	 hmm
[20:56:43] <d3r1ck>	 MisterSynergy: then I think we go by zhuyifei1999_ option
[20:56:50] <MisterSynergy>	 there I need apt-get, which I can't do of course
[20:57:00] <d3r1ck>	 MisterSynergy: Not yet :)
[20:57:11] <zhuyifei1999_>	 hmm weird
[20:57:29] <d3r1ck>	 zhuyifei1999_: Yeah, really weird
[20:57:54] <bd808>	 there are a bunch of annoying problems with python3 directly on the bastion servers
[20:58:01] <MisterSynergy>	 maybe I try to use the mysql module?
[20:58:02] <MisterSynergy>	 https://dev.mysql.com/doc/connector-python/en/connector-python-connectargs.html
[20:58:07] <bd808>	 Trusty has some bad packages
[20:58:10] <MisterSynergy>	 that one is at least available
[20:58:28] <bd808>	 python3 works much better on the Kubernetes grid
[20:58:59] <bd808>	 https://wikitech.wikimedia.org/wiki/Help:Toolforge/Web#python_.28Python3_.2B_Kubernetes.29
[20:59:14] <zhuyifei1999_>	 bd808: would it work if the venv is built on k8s and run on grid?
[20:59:29] <bd808>	 possibly...
[20:59:40] <bd808>	 I wouldn't count on it though honestly
[20:59:50] <bd808>	 portability of venvs is hit and miss
[21:00:16] <Zppix>	 bd808: how can i go about updating my existing instance on k8s to py3 from py2 i tried before but i couldnt do it
[21:00:24] * bd808 has to disappear into another meeting
[21:00:28] <zhuyifei1999_>	 it's gonna be madness to hack https://wikitech.wikimedia.org/wiki/Help:Toolforge/Kubernetes#Kubernetes_cronjobs
[21:00:49] <zhuyifei1999_>	 Zppix: so what issue are you encountering?
[21:02:06] <Zppix>	 zhuyifei1999_: its saying that its unable to decode my .yaml which is stupid since i use that .yaml now with no issue
[21:02:36] <zhuyifei1999_>	 MisterSynergy: anyways, if it's possible for you to use python2, oursql is installed globally. otherwise if you insist on python3 and cronjobs, I'm afraid either you'll have to wait for we add some new debian jessie exec instances to the grid
[21:02:47] <zhuyifei1999_>	 or build your own copy of python
[21:03:14] <zhuyifei1999_>	 there's a tool called pyenv that I used to use that can simplify this process a lot
[21:03:16] <MisterSynergy>	 meh okay
[21:03:17] <MisterSynergy>	 :-)
[21:03:42] <d3r1ck>	 MisterSynergy: but either ways, have fun :)
[21:03:48] <zhuyifei1999_>	 Zppix: can you elaborate? like the traceback? the commands?
[21:04:13] <MisterSynergy>	 thnx all!
[21:04:52] <Zppix>	 Not atm
[21:04:57] <Zppix>	 Im on mobile
[21:05:09] <zhuyifei1999_>	 MisterSynergy: np
[21:05:10] <Zppix>	 I was wondering if there was documentation on that
[21:05:13] <d3r1ck>	 MisterSynergy: You are welcome! :)
[21:05:53] <zhuyifei1999_>	 Zppix: well, I don't think I fully understand your issue, so probably can't find the relevant docs
[21:06:17] <Zppix>	 zhuyifei1999_: i need to convert an existing k8s job to python3
[21:06:39] <zhuyifei1999_>	 https://wikitech.wikimedia.org/wiki/Help:Toolforge/Kubernetes#Kubernetes_continuous_jobs <= this type of job?
[21:06:46] <Zppix>	 Yes
[21:07:14] <zhuyifei1999_>	 what's wrong with change container & rebuild venv?
[21:07:28] <Zppix>	 I perfer k8s
[21:07:34] <zhuyifei1999_>	 ?
[21:07:42] <Zppix>	 Wait
[21:07:50] <Zppix>	 Im being brain dead
[21:07:50] <zhuyifei1999_>	 I didn't say to move away from k8s
[21:07:54] <zhuyifei1999_>	 lol
[21:08:16] <andrewbogott>	 paladox: I'm back now… here's the script I'm following for upgrade
[21:08:20] <andrewbogott>	 https://www.irccloud.com/pastebin/kRUSEBBY/
[21:08:25] <andrewbogott>	 (pseudocode obviously)
[21:08:35] <Zppix>	 Because i am not the one to setup this job first i had someone do it for me
[21:09:32] <Zppix>	 Paladox downtime the puppet checks when you do puppet upgrade or tell me before you do it so i can
[21:14:30] <paladox>	 thanks
[21:14:39] <paladox>	 Zppix can you do it please? :)
[21:14:44] <paladox>	 (downtime)
[21:14:53] <Zppix>	 paladox:  one sex
[21:14:56] <Zppix>	 Sec*
[21:15:04] <paladox>	 thanks
[21:15:21] <Zppix>	 paladox: all .git hosts?
[21:15:25] <paladox>	 yes
[21:15:26] <paladox>	 please
[21:16:09] <andrewbogott>	 !log analytics updating puppetmaster p1.analytics.eqiad.wmflabs to puppet 4
[21:16:11] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Analytics/SAL
[21:16:25] <paladox>	 !log git upgrading puppetmaster on puppet-paladox3 to puppet 4
[21:16:26] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL
[21:18:11] <Zppix>	 Paladox done
[21:18:15] <andrewbogott>	 !log automation-framework upgrading puppetmaster on af-puppetmaster02.automation-framework.eqiad.wmflabs to v4
[21:18:16] <paladox>	 thanks :)
[21:18:17] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Automation-framework/SAL
[21:19:28] <paladox>	 andrewbogott it fails for me with
[21:19:29] <paladox>	 The following packages have unmet dependencies:
[21:19:29] <paladox>	  puppet-master-passenger : Depends: puppet (= 4.8.2-5) but 3.8.5-2 is to be installed
[21:19:33] <Zppix>	 paladox: i gave you an hour to do it on downtimed
[21:19:36] <paladox>	 thanks
[21:19:47] <Zppix>	 Ping me if you need more
[21:20:01] <paladox>	 ok
[21:20:06] <andrewbogott>	 paladox: that's what 'it will be noisy' means
[21:20:15] <andrewbogott>	 the next few steps are to untangle that
[21:20:18] <paladox>	 ah
[21:20:22] <paladox>	 thanks
[21:20:26] <paladox>	 sorry for the ping then
[21:21:37] <andrewbogott>	 no problem, those aren't exactly easy-to-follow instructions, just notes I've been jotting down
[21:21:59] <Zppix>	 Mind if i steal those notes andrewbogott ?
[21:22:22] <andrewbogott>	 not at all — paladox or Zppix, if you upgrade anything please note it on https://etherpad.wikimedia.org/p/standalone_masters so I know it's done
[21:22:34] <paladox>	 ah ok thanks :)
[21:23:14] <Zppix>	 Ah i wasnt going to (you dont want me to trust me) i was just going to use those notes to teach myself about puppet related things
[21:27:33] <paladox>	 andrewbogott wondering where do i do cd puppet ?
[21:27:39] <paladox>	 is that /etc/puppet?
[21:27:50] <andrewbogott>	 yes, /etc/puppet
[21:27:51] <andrewbogott>	 sorry
[21:27:54] <andrewbogott>	 c/p fail
[21:28:03] <paladox>	 thanks :)
[21:28:52] <paladox>	 it works :)
[21:29:30] <paladox>	 though i see this warnnings
[21:29:30] <paladox>	 Warning: Setting configtimeout is deprecated. 
[21:29:30] <paladox>	    (at /usr/lib/ruby/vendor_ruby/puppet/settings.rb:1146:in `issue_deprecation_warning')
[21:29:30] <paladox>	    (at /usr/lib/ruby/vendor_ruby/puppet/settings.rb:1146:in `issue_deprecation_warning')
[21:29:39] <andrewbogott>	 yeah, that always happens with 4
[21:29:44] <andrewbogott>	 dead code in the our repo I guess
[21:29:45] <paladox>	 oh
[21:30:27] <Zppix>	 If i spoke puppet id say id cleanup puppet repo but i dont so... :/
[21:31:01] <andrewbogott>	 paladox: If you're getting puppet runs to finish on hosts that use that as a master (including itself if that applies) then you're probably done.
[21:31:17] <paladox>	 ah ok
[21:31:23] <paladox>	 thanks, will run it on some hosts
[21:31:38] <paladox>	 yep works
[21:31:46] <paladox>	 now i can update the clients to puppet 4 :)
[21:37:06] <paladox>	 !log git upgrading puppet client on gerrit-test to puppet 4.
[21:37:08] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL
[21:40:42] <paladox>	 andrewbogott puppet 4 client also works :).
[21:40:53] <paladox>	 following mostly the same steps as https://www.irccloud.com/pastebin/kRUSEBBY/
[21:41:06] <paladox>	 except from we doint need to do the ssl step and doint need to uninstall anything
[21:42:02] <andrewbogott>	 paladox: what is the deal with you changing the projects in that etherpad?  The instances were sorted by what project they were in...
[21:42:09] <andrewbogott>	 or, not sorted, but, categorized
[21:42:12] <paladox>	 they had the wrong projectds
[21:42:17] <paladox>	 you listed some as git
[21:42:25] <paladox>	 which were not in that project
[21:42:39] <andrewbogott>	 "puppet-paladox3.git.eqiad.wmflabs" is obviously in the git project
[21:42:44] <andrewbogott>	 hence the fqdn having .git. in it?
[21:42:49] <paladox>	 yep
[21:42:54] <paladox>	 but some of the other ones arn't
[21:43:26] <paladox>	 like syslog-receiver01.monitoring.eqiad.wmflabs was listed for the phabricator one.
[21:43:30] <paladox>	 and af-puppetmaster02.automation-framework.eqiad.wmflabs  was listed for git
[21:43:30] <andrewbogott>	 so, for instance, 'puppet-phabricator.phabricator.eqiad.wmflabs' is now listed as being in the monitoring project
[21:43:43] <andrewbogott>	 no
[21:43:50] <andrewbogott>	 the indents are ugly because of where it came from
[21:43:59] <paladox>	 af-puppetmaster02.automation-framework.eqiad.wmflabs (done)
[21:43:59] <paladox>	                                 Project: git    
[21:44:08] <andrewbogott>	 but there's a project header and then a list of instances
[21:44:24] <andrewbogott>	 look at the very top of the document
[21:44:49] <paladox>	 oh i see
[21:44:58] <andrewbogott>	 also I guess puppet-paladox3.git.eqiad.wmflabs is in there twice now :)
[21:45:20] <paladox>	 oh
[21:45:46] <paladox>	 fixed now
[21:46:02] <paladox>	 !log git upgrading puppet client on gerrit-test3 to puppet 4.
[21:46:04] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL
[21:46:16] <andrewbogott>	 thanks
[21:46:42] <andrewbogott>	 Does anyone know who 'mholloway-shell' is on irc?
[21:46:55] <paladox>	 mholloway
[21:47:11] <paladox>	 andrewbogott mdholloway
[21:47:23] <mdholloway>	 that would be moe
[21:47:25] <mdholloway>	 *me
[21:47:27] <paladox>	 !log git doing mass upgrades of puppet to puppet4.
[21:47:28] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL
[21:47:38] <andrewbogott>	 hi!  I'm wondering what the story is with 'zim-proto'
[21:47:50] <andrewbogott>	 it looks like it was broken and abandoned quite a while ago, should I just delete it?
[21:48:06] <andrewbogott>	 paladox: I'm going to just wipe this etherpad and start over again, you'll need to re-annotate the (done) instances
[21:48:14] <andrewbogott>	 but please don't rearrange things
[21:48:14] <paladox>	 ok
[21:48:17] <paladox>	 ok
[21:48:40] <Zppix>	 paladox:
[21:48:44] <Zppix>	 I can document the done
[21:48:52] <paladox>	 ok
[21:48:53] <paladox>	 thanks
[21:49:00] <Zppix>	 Im not doing anything lol
[21:49:16] <paladox>	 lol
[21:49:55] <andrewbogott>	 mdholloway: sorry, I failed to ping you — that question about zim-proto.mobile.eqiad.wmflabs was directed to you
[21:50:04] <mdholloway>	 andrewbogott: i thought was fixed. :(  that was a project i was working on that suddenly went 60 to 0 when product reqs changed.  if it's causing problems then i'll just pull down my work into a local repo somewhere and delete it
[21:50:18] <andrewbogott>	 mdholloway: that'd be great, thank you
[21:50:20] <Zppix>	 andrewbogott: ping me when your ready for annotation
[21:50:25] <mdholloway>	 andrewbogott: no prob
[21:50:38] <andrewbogott>	 I mean, you're welcome to fix it instead but broken puppetmasters tend to gum up the works :)
[21:50:53] <andrewbogott>	 Zppix: go ahead, I re-pasted from the puppet class browser
[21:51:08] <Zppix>	 Ok any certain order/syntax you want?
[21:51:43] <andrewbogott>	 Zppix: I'm just trying to mark the upgraded puppetmasters with (done) or (why they aren't done)
[21:51:57] <andrewbogott>	 please do not re-order, they're already a straight cut-and-paste from a query
[21:52:15] <Zppix>	 Okay just making sure :)
[21:53:47] <Zppix>	 andrewbogott: thats all from .git
[21:56:37] <andrewbogott>	 paladox: are you planning to do puppet-phabricator.phabricator.eqiad.wmflabs or shall I?
[21:56:46] <paladox>	 yep /me is :)
[21:56:49] <paladox>	 i can do that now
[21:57:13] <paladox>	 !log phabricator mass upgrading to puppet 4
[21:57:15] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Phabricator/SAL
[21:59:09] <Zppix>	 andrewbogott: is prod going to 4 too or do you know?
[21:59:17] <andrewbogott>	 it already is
[21:59:21] <andrewbogott>	 well, the masters are
[21:59:21] <Zppix>	 Oh
[21:59:27] <andrewbogott>	 the clients will move in a few days
[22:02:24] <paladox>	 andrewbogott puppet-phabricator is done :)
[22:02:51] <andrewbogott>	 great
[22:06:39] <paladox>	 andrewbogott phabricator + git (except from jenkins-slave-01) are now running puppet 4. :)
[22:06:55] <paladox>	 i need fix the puppet repo to get jenkins-slave-01 running due to puppet errors starting today.
[22:07:08] <andrewbogott>	 great, thanks for saving me a few stops :)
[22:07:35] <paladox>	 your welcome :)
[22:09:26] <andrewbogott>	 !log thumbor upgrading puppetmaster.thumbor to puppet v4
[22:09:28] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Thumbor/SAL
[22:10:39] <mdholloway>	 !log mobile deleting zim-proto instance
[22:10:41] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Mobile/SAL
[22:10:57] <andrewbogott>	 thank you mdholloway
[22:11:17] <mdholloway>	 andrewbogott: np! sorry it was causing trouble
[22:16:21] <paladox>	 !log git recreating puppet-paladox3 as puppet-paladox
[22:16:23] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL
[22:16:34] <paladox>	 i need to start fresh with a new puppet repo for jenkins-slave-01
[22:16:46] <paladox>	 due to be creating alot of custom changes that were merged.
[22:16:54] <Zppix>	 Ugh
[22:17:04] <Zppix>	 Your going to make change icinga arent you
[22:17:10] <Zppix>	 Me*
[22:17:27] <paladox>	 yep
[22:18:46] <wikibugs>	 (03Draft1) 10Paladox: Rename puppet-paladox3 to puppet-paladox [labs/icinga2] - 10https://gerrit.wikimedia.org/r/397644
[22:18:48] <wikibugs>	 (03PS2) 10Paladox: Rename puppet-paladox3 to puppet-paladox [labs/icinga2] - 10https://gerrit.wikimedia.org/r/397644
[22:18:56] <wikibugs>	 (03CR) 10Paladox: [C: 04-2] "To be done after the recreation." [labs/icinga2] - 10https://gerrit.wikimedia.org/r/397644 (owner: 10Paladox)
[22:23:21] <wikibugs>	 (03CR) 10Paladox: [V: 032 C: 032] Rename puppet-paladox3 to puppet-paladox [labs/icinga2] - 10https://gerrit.wikimedia.org/r/397644 (owner: 10Paladox)
[22:38:04] <paladox>	 andrewbogott hi, i recreated a puppet master and now im getting these errors
[22:38:05] <paladox>	 Error: /Stage[main]/Packages::Puppetdb_terminus/Package[puppetdb-terminus]/ensure: change from purged to present failed: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install puppetdb-terminus' returned 100: Reading package lists...
[22:38:18] <paladox>	 Im not sure why role::puppetmaster::standalone is trying to install puppetdb
[22:38:25] <andrewbogott>	 paladox: ok — I haven't tried a scratch build yet but that's on my list of things to test
[22:38:41] <paladox>	 stretch?
[22:38:45] <andrewbogott>	 Did you set puppet_major_version on the VM before applying the class?
[22:38:51] <andrewbogott>	 Oh yeah, no idea if this will work on stretch in any case
[22:39:03] <paladox>	 yep
[22:39:43] <paladox>	 ah found it andrewbogott https://github.com/wikimedia/puppet/blob/4478e10716df2698fa925e9892c4598fe4e06aa5/modules/puppetmaster/manifests/init.pp#L77
[22:39:48] <paladox>	 just need to change > to ==
[22:39:58] * paladox makes patch :)
[22:43:25] <paladox>	 andrewbogott https://gerrit.wikimedia.org/r/#/c/397700/
[22:43:58] <paladox>	 the package dosen't seem to exist upstream so im thinking this is a wmf package. But hasent been copy over to stretch's apt repo wmf side.
[23:55:36] <paladox>	 andrewbogott i found when installing puppet 4 on a new puppetmaster. puppet and puppet-master service has to be stopped otherwise puppet fails.