[00:11:49] !log tools Drain + Cordon, Reboot, Uncordon tools-workers-1002-1005 [00:11:53] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [00:28:17] !log tools Drain + Cordon, Reboot, Uncordon tools-workers-1006-1010 [00:28:22] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [00:34:22] !log tools Drain + Cordon, Reboot, Uncordon tools-workers-1011, 1013-1015, 1017 [00:34:26] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [00:47:58] !log tools Drain + Cordon, Reboot, Uncordon tools-workers-1018-1023, 1025-1027 [00:48:03] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [00:59:28] !log tools Cordon and Drain tools-worker-1016 [00:59:32] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [01:06:32] !log tools.zppixbot Created a main bot channel #ZppixBot [01:06:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.zppixbot/SAL [01:26:17] !log tools.zppixbot Restart due to config change [01:26:20] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.zppixbot/SAL [01:26:27] (03Draft2) 10MacFan4000: Update how to get the Bot in your channel [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/397992 [01:28:49] (03CR) 10Zppix: [C: 032] Update how to get the Bot in your channel [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/397992 (owner: 10MacFan4000) [01:28:52] (03Merged) 10jenkins-bot: Update how to get the Bot in your channel [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/397992 (owner: 10MacFan4000) [01:29:59] !log tools.zppixbot Deploying [[Gerrit:397992]] [01:30:01] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.zppixbot/SAL [01:30:20] musikanimal: things looking better now? [01:30:29] yes! [01:30:38] cool [01:30:52] tyty :) [01:31:14] a php5.6 application of mine was also affected, but working great now [01:40:45] musikanimal: there will be a writeup, but the TL;DR is that the networking layer in our k8s cluster freaked out and forgot how to do outbound network connections [01:52:25] bd808: then how was my bot on irc? [01:52:32] Oh [01:52:34] Nevermind [01:52:37] 🤦‍♂️ [10:54:57] (03CR) 1020after4: [C: 031] "I'd +2 this but I don't know how stryker code is deployed." [labs/striker] - 10https://gerrit.wikimedia.org/r/395924 (https://phabricator.wikimedia.org/T182142) (owner: 10Legoktm) [11:03:57] Hello! Where / to whom can I report a potentially security-related issue with toollabs (like, I don’t know how much of an issue it actually is, but I don’t want to blunder :) ) [11:04:21] s/toollabs/toolforge/ [11:06:21] (Not sure whether https://www.mediawiki.org/wiki/Reporting_security_bugs applies) [11:09:20] JeanFred: yes, thanks [11:09:24] that applies [11:11:08] arturo: Cheers, filing a Phab task) [11:11:20] thanks JeanFred :-) [12:33:56] (03PS1) 10Elukey: Add fake secrets for Varnishkafka TLS configuration [labs/private] - 10https://gerrit.wikimedia.org/r/398036 [12:34:21] (03CR) 10Elukey: [V: 032 C: 032] Add fake secrets for Varnishkafka TLS configuration [labs/private] - 10https://gerrit.wikimedia.org/r/398036 (owner: 10Elukey) [14:31:49] (03PS1) 10Elukey: Move hiera filename after a profile rename [labs/private] - 10https://gerrit.wikimedia.org/r/398052 [14:32:17] (03CR) 10Elukey: [V: 032 C: 032] Move hiera filename after a profile rename [labs/private] - 10https://gerrit.wikimedia.org/r/398052 (owner: 10Elukey) [15:01:36] Technical Advice IRC meeting starting in 60 minutes in channel #wikimedia-tech, hosts: @addshore & @Thiemo_WMDE - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [15:01:38] This is the last Technical Advice IRC meeting for 2017! [17:06:18] !log deployment-prep Deploy ORES service b67bba7 [17:06:26] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL [17:19:59] hi all - visiting today after a giant bag of announcements last week at KubeCon. [17:20:06] can anyone say what version of Kubernetes is running here ? [17:20:10] auth is still changing, it seems.. I do not know the details [17:24:38] !log deployment-prep Install aspell-is for ORES [17:24:46] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL [17:25:25] dbb: I see this [17:25:27] Client Version: version.Info{Major:"1", Minor:"4", GitVersion:"v1.4.6+e569a27", GitCommit:"45adb9258e2fcf527b2a495e7a2cdfd3f1cb70b9", GitTreeState:"dirty", BuildDate:"2016-12-23T17:10:28Z", GoVersion:"go1.6.3", Compiler:"gc", Platform:"linux/amd64"} [17:25:30] On toolforge [17:25:46] oh looks like 1.4 then [17:25:55] :) [17:25:55] thx [17:26:37] You're welcome :) [17:37:07] !log tools upgrading puppet packages on all VMs [17:37:10] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [17:37:25] andrewbogott: awesome! :) [17:37:40] * bd808 is the meeting to report status on this [17:41:18] we actually don [17:41:28] don't have an upgrade path for trusty yet, so the effect on tools is minimal [17:42:55] andrewbogott: ah. so trusty will end up being Puppet3 + future parser at least for now? [17:43:14] probably, although herron is looking at backporting something [17:43:25] In theory there's no real difference from the agent's point of view [18:43:01] (03Draft2) 10MacFan4000: Updates to about.php [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/398089 (https://phabricator.wikimedia.org/T182806) [19:19:08] !log quarry Deployed 62676f2 to quarry-main-01 and restarted uwsgi [19:19:11] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Quarry/SAL [20:16:53] (03PS3) 10MacFan4000: Updates to about.php [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/398089 (https://phabricator.wikimedia.org/T182806) [20:22:38] (03PS4) 10Zppix: Updates to about.php [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/398089 (https://phabricator.wikimedia.org/T182806) (owner: 10MacFan4000) [20:22:47] (03CR) 10Zppix: [C: 032] Updates to about.php [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/398089 (https://phabricator.wikimedia.org/T182806) (owner: 10MacFan4000) [20:22:54] (03Merged) 10jenkins-bot: Updates to about.php [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/398089 (https://phabricator.wikimedia.org/T182806) (owner: 10MacFan4000) [21:32:33] (03Draft2) 10Zppix: Add #ZppixBot and fix ##Zppix-Wikipedia configs [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398127 [21:35:25] valhallasw`cloud: if you got a min can you review ^ [21:38:11] (03CR) 10Merlijn van Deen: [C: 032] "If you have some time, there are some cleanup suggestions in the comments." (033 comments) [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398127 (owner: 10Zppix) [21:38:23] (03CR) 10Merlijn van Deen: [C: 032] releng: Cleanup [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/394366 (owner: 10Greg Grossmeier) [21:38:31] (03Merged) 10jenkins-bot: Add #ZppixBot and fix ##Zppix-Wikipedia configs [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398127 (owner: 10Zppix) [21:38:40] (03CR) 10jenkins-bot: Add #ZppixBot and fix ##Zppix-Wikipedia configs [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398127 (owner: 10Zppix) [21:38:47] (03Merged) 10jenkins-bot: releng: Cleanup [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/394366 (owner: 10Greg Grossmeier) [21:38:49] (03CR) 10jenkins-bot: releng: Cleanup [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/394366 (owner: 10Greg Grossmeier) [21:40:17] !log tools.wikibugs Updated channels.yaml to: 0a8c097f134c17a045e51bf6a36ee3d3b46d80c6 Merge "releng: Cleanup" [21:40:20] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wikibugs/SAL [21:41:15] (03Draft2) 10Zppix: Cleanup, Merjin made me do this [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398130 [21:41:30] (03CR) 10jerkins-bot: [V: 04-1] Cleanup, Merjin made me do this [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398130 (owner: 10Zppix) [21:41:43] Love you too jenkins [21:41:57] Zppix: spaces are important! :D [21:42:08] can you add an enter to the ##goat one as well? [21:42:23] I guess [21:42:26] <3 [21:43:11] (03PS3) 10Zppix: Cleanup, Merjin made me do this [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398130 [21:43:28] (03CR) 10jerkins-bot: [V: 04-1] Cleanup, Merjin made me do this [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398130 (owner: 10Zppix) [21:43:36] (03CR) 10Merlijn van Deen: [C: 032] "Thanks!" [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398130 (owner: 10Zppix) [21:43:55] (03CR) 10jerkins-bot: [V: 04-1] Cleanup, Merjin made me do this [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398130 (owner: 10Zppix) [21:43:58] "Merjin made me do this" is a good commit message. Maybe a good way to live one's life even :) [21:43:59] argh [21:44:19] Zppix: it's the spacing in front of "#ZppixBot" [21:44:41] lol [21:44:42] bd808: or hasha r's I DONT KNOW WHAT IM DOING commit msg? [21:44:46] bd808: I wish that would work for my colleagues :-p [21:44:56] valhallasw`cloud: fine i guess ill fix it... xD [21:45:04] Zppix: thanks :-) [21:45:05] valhallasw`cloud: you know I'm still hiring right? ;) [21:45:44] "Yes ill accept a job offer from some person on irc xD" [21:46:02] They've met before ;) [21:46:05] bd808: *grin* Yes, I'm aware :-) [21:46:07] AFK [21:46:12] IRL even [21:46:23] bd808: I am disappoint [21:46:26] THE INTERNET IS REAL LIFE [21:46:35] IRC IS FICTION [21:46:36] Reedy: I'm not sure if we were AFK though [21:46:47] I'm pretty sure there were laptops [21:46:48] Was there beer but no laptops? [21:46:59] probably at some point as well :-) [21:47:03] * Reedy has definitely seen valhallasw`cloud without a laptop [21:47:13] (03PS4) 10Zppix: Cleanup, Merjin made me do this [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398130 [21:47:53] What is this real life you speak of? Is it a game? Where can i buy it? [21:48:04] (03CR) 10Merlijn van Deen: [C: 032] Cleanup, Merjin made me do this [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398130 (owner: 10Zppix) [21:48:28] It's on Steam [21:48:53] sim (game) :) [21:48:56] I should buy a BeerController, otherwise it isn't quite as much fun [21:49:04] https://www.amazon.com/The-Game-of-Life/dp/B00CM2IFT2 [21:49:12] (03Merged) 10jenkins-bot: Cleanup, Merjin made me do this [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398130 (owner: 10Zppix) [21:49:19] (03CR) 10jenkins-bot: Cleanup, Merjin made me do this [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398130 (owner: 10Zppix) [21:49:37] that's expensive for a game https://www.amazon.co.uk/The-Game-of-Life/dp/B00CM2IFT2 :) [21:50:10] valhallasw`cloud: dont forget glass.cup.setliquid == "Beer" and cup.filllevel == 500% [21:50:45] > false [21:51:24] or, alternatively, SyntaxError: invalid synax [21:51:25] +t [21:51:29] Merlijn does wikibugs auto deploy? [21:51:47] Zppix: it should, but only once a new change from phabricator is processed [21:51:57] I meant backend not irc [21:51:59] What's the point of filling it to 500%? [21:52:03] Oh wait [21:52:05] You're wasting 400% of beer [21:52:06] 🤦‍♂️ [21:52:22] Reedy: you hold 400 in ram for later? [21:52:30] !log tools.wikibugs Updated channels.yaml to: 60c37074c081c2cb39915cb41bcd70607c633084 Cleanup, Merjin made me do this [21:52:33] Why would you use a set property for a comparison? [21:52:35] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wikibugs/SAL [21:53:09] Reedy: why would you not use python in cs? [21:53:28] == is a comparison [21:53:53] Set would suggest a function [21:53:56] else it's redundant [21:54:01] you wouldn't write to one property, to read from another [21:54:02] [21:54:21] I don't think functions ever compare equal to strings [21:55:05] in python most everything is an object, there is certainly a function object.. as I understand it [21:55:05] We got an issue valhallasw`cloud [21:55:50] wikibugs: didnt work :/ i did a test task and it failed to join #ZppixBot :/ [21:56:36] Zppix: https://www.youtube.com/watch?v=qCoMklNvyv8 [21:57:23] that tottaly fixed it xD [21:57:55] Zppix: oh. You removed the # [21:58:01] Sorry, missed that in the review [21:58:22] Dear gerrit, what did i do to you? [21:58:25] "ZppixBot" should be "#ZppixBot" [22:00:38] (03Draft2) 10Zppix: I promise I understand how to write code and change configs... it may take me 430 patchsets first. [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398139 [22:02:11] (03CR) 10Merlijn van Deen: [C: 032] I promise I understand how to write code and change configs... it may take me 430 patchsets first. [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398139 (owner: 10Zppix) [22:02:14] Zppix: no worries [22:02:32] *430 patchsets later* [22:02:39] I'm heading off, hopefully this works :-) [22:02:44] (03Merged) 10jenkins-bot: I promise I understand how to write code and change configs... it may take me 430 patchsets first. [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398139 (owner: 10Zppix) [22:02:51] (03CR) 10jenkins-bot: I promise I understand how to write code and change configs... it may take me 430 patchsets first. [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398139 (owner: 10Zppix) [22:04:57] !log tools.wikibugs Updated channels.yaml to: 09f9fc29c13bc37bd7d6ed3a19c04269c45f2f39 I promise I understand how to write code and change configs... it may take me 430 patchsets first. [22:05:01] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wikibugs/SAL [22:11:46] I may of made it worse... [22:16:23] Well imma casually pretend i didnt break anything and hide.... wikibugs maintainers idk what happened now, its just not reporting tool-zppixbot at all [22:18:38] (03Draft2) 10Zppix: If its not working break it more. [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398143 [22:55:32] (03CR) 10MacFan4000: [C: 031] ":P" [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/398143 (owner: 10Zppix) [23:58:52] madhuvishy set the topic: Wikimedia Cloud Services (wikitech.wikimedia.org) | Use !help to find assistance | Status: OK|WikiReplicas DNS switchover done (T142807) | Create a phab task if you don’t get your problem resolved in chat! | IRC log: https://wm-bot.wmflabs.org/logs/%23wikimedia-cloud/ | Code of Conduct: https://www.mediawiki.org/wiki/CoC | see also: #wikimedia-cloud-feed | on call: !help or andrewbogott [23:58:54] T142807: Migrate all users to new Wiki Replica cluster and decommission old hardware - https://phabricator.wikimedia.org/T142807 [23:59:43] he he something happened [23:59:54] yeah. that was weird :) [23:59:55] andrew's nick isn't complete though