[02:45:54] PROBLEM - Puppet errors on tools-webgrid-generic-1401 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [03:25:53] RECOVERY - Puppet errors on tools-webgrid-generic-1401 is OK: OK: Less than 1.00% above the threshold [0.0] [05:29:41] 10Labs, 10DBA: Prepare and check storage layer for atjwiki - https://phabricator.wikimedia.org/T167715#3350575 (10Marostegui) Hi, I have sanitized this wiki on sanitarium and sanitarium2 and checked that it sanitized labs servers. #cloud-services-team can you guys go ahead and create the views? [06:12:40] 10Labs, 10DBA, 10Patch-For-Review: Add and sanitize s2, s4, s5, s6 and s7 to sanitarium2 and new labsdb hosts - https://phabricator.wikimedia.org/T153743#3350594 (10Marostegui) #cloud-services-team feel free to create the views for dewiki and wikidatawiki on the labsdb1009, 1010 and 1011 Thanks! [06:52:49] PROBLEM - Puppet errors on tools-exec-1429 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [07:27:48] RECOVERY - Puppet errors on tools-exec-1429 is OK: OK: Less than 1.00% above the threshold [0.0] [09:30:38] 10Labs, 10DBA, 10Patch-For-Review: Add and sanitize s2, s4, s5, s6 and s7 to sanitarium2 and new labsdb hosts - https://phabricator.wikimedia.org/T153743#3350858 (10JAllemandou) Yay ! New wikis ! Thanks @Marostegui and teams :) [09:37:18] 10Labs: Need support on hosting an RStudio Shiny Server on a Labs instance behind a proxy - https://phabricator.wikimedia.org/T167702#3350865 (10zhuyifei1999) No problem ;) [10:01:59] can someone check permission on ~ilario/replica.my.cnf ? [10:02:17] it has gid 12094 / Unknown [14:44:52] 10Labs, 10Tool-Labs: Elasticsearch credential request for wmde-uca-test - https://phabricator.wikimedia.org/T167971#3351540 (10gabriel-wmde) [14:51:19] 10Labs, 10DBA, 10cloud-services-team, 10wikitech.wikimedia.org: move wikitech and labstestwiki to s3 (needs discussion) - https://phabricator.wikimedia.org/T167973#3351613 (10jcrespo) [15:13:37] 10Labs, 10DBA, 10cloud-services-team, 10wikitech.wikimedia.org: move wikitech and labstestwiki to s3 (needs discussion) - https://phabricator.wikimedia.org/T167973#3351678 (10jcrespo) Something oauth from horizon seem to be the largest blocker, what do you know about that? How would that fit with the main... [15:19:49] 10Labs, 10DBA, 10cloud-services-team, 10wikitech.wikimedia.org: move wikitech and labstestwiki to s3 (needs discussion) - https://phabricator.wikimedia.org/T167973#3351594 (10bd808) >>! In T167973#3351678, @jcrespo wrote: > Something oauth from horizon seem to be the largest blocker, what do you know about... [15:23:25] 10Labs, 10DBA, 10cloud-services-team, 10wikitech.wikimedia.org: move wikitech and labstestwiki to s3 (needs discussion) - https://phabricator.wikimedia.org/T167973#3351594 (10Andrew) I am pretty sure that this is fine. I would like to be present and alert during the switchover, though, in case I'm forgett... [15:24:56] 10Labs, 10DBA, 10cloud-services-team, 10wikitech.wikimedia.org: move wikitech and labstestwiki to s3 (needs discussion) - https://phabricator.wikimedia.org/T167973#3351725 (10jcrespo) That- which is a really good thing for separation of concerns (Thank you!)- would mean that the generic grants would work (... [15:27:26] silly question: when I do "webservice --backend=kubernetes python shell," the containers &c that that create only persist until I exit the shell, right? [15:27:32] I'm not leaking things all over the place if I do that repeatedly? [15:28:38] andrewbogott: you basically get 'exec shell' there so when you exist it kills teh pod iiuc [15:28:44] exist == exit [15:28:49] great [15:33:56] yeah. it spins up a new container and then tears down after [15:34:51] 10Labs: Need support on hosting an RStudio Shiny Server on a Labs instance behind a proxy - https://phabricator.wikimedia.org/T167702#3341596 (10Addshore) Indeed, thanks @zhuyifei1999 ! :) [16:03:38] 10Labs, 10Labs-Infrastructure, 10Operations, 10netops, 10ops-codfw: codfw: labtestpuppetmaster2001 switch port configuration - https://phabricator.wikimedia.org/T167321#3324750 (10ayounsi) The switch was showing "Carrier transitions" errors on that interface and no inbound traffic. We tried changing the... [17:00:54] 10Tool-Labs-tools-Xtools, 10Community-Tech, 10Epic: Epic: Rewrite Xtools: RfX Vote Calculator - https://phabricator.wikimedia.org/T165710#3352099 (10Matthewrbowker) a:03Matthewrbowker I will be handling this while I'm away at E616. [17:01:25] 10Tool-Labs-tools-Xtools, 10Community-Tech, 10Epic: Epic: Rewrite Xtools: RfX Analysis - https://phabricator.wikimedia.org/T165709#3352106 (10Matthewrbowker) I will be handling this while I'm away at E616. [17:02:18] I'm getting "Error: Duplicate RecordSet" creating a web proxy. I had "discovery-beta.wmflabs.org" set to an instance that I deleted but forgot to delete that web proxy. deleting the instance has hidden the proxy but apparently not deleted it [17:02:54] should I file a bug in phabricator? [17:04:41] bearloga: yes, please [17:08:29] Nemo_bis: I see -r-------- 1 ilario 12094 52 May 30 08:12 replica.my.cnf, which looks right to me [17:14:48] 10Labs: Need support on hosting an RStudio Shiny Server on a Labs instance behind a proxy - https://phabricator.wikimedia.org/T167702#3341596 (10mpopov) BTW, now that T161354 is done, Ops/Puppet has a Shiny Server module: https://github.com/wikimedia/puppet/tree/production/modules/shiny_server For example, we a... [17:17:28] 10Labs, 10Labs-Infrastructure, 10Operations, 10ops-eqiad: rack/setup/install labstore100[67].wikimedia.org - https://phabricator.wikimedia.org/T167984#3352141 (10RobH) [17:19:36] ^ so i could use confirmation on the two new labstore boxes being ok to be in same vlan as the existing labstore boxes [17:19:50] just maing sure no refactoring is going on with these new ones that make them differ on networking =] [17:19:53] making even [17:22:48] 10Labs: Horizon bug: hidden web proxy after deleting instance - https://phabricator.wikimedia.org/T167985#3352179 (10mpopov) [17:23:09] chasemp: can you ack/nack robh's "confirmation on the two new labstore boxes being ok to be in same vlan as the existing labstore boxes" question on T167984 ? [17:23:09] T167984: rack/setup/install labstore100[67].wikimedia.org - https://phabricator.wikimedia.org/T167984 [17:23:25] heh, i pinged him in another channel i figured he was afk or busy =] [17:26:42] robh: :) I would give you an answer but I have no idea [17:26:42] i *think* these two are going to be setup differently [17:26:54] will defer to chase on specifics though [17:27:34] 10Labs, 10Labs-Infrastructure, 10Operations, 10ops-eqiad: rack/setup/install labstore100[67].wikimedia.org - https://phabricator.wikimedia.org/T167984#3352201 (10RobH) a:05Cmjohnson>03chasemp [17:27:47] no worries, i assigned to him [17:27:47] 10Labs, 10Labs-Infrastructure, 10Operations, 10ops-eqiad: rack/setup/install labstore100[67].wikimedia.org - https://phabricator.wikimedia.org/T167984#3352141 (10RobH) Racking proposal: existing labstore systems use the vlan-labs-support1, so these have to be racked in rows A and C, as those rows have that... [17:27:51] he can comment ans assign back to chris [17:28:07] cool, thanks robh :) [17:29:43] madhuvishy: really? but his files are usually in the wikidev group, not an unknown group [17:29:57] (thanks for looking) [17:30:22] Nemo_bis: we set special permissions on the replica files so users can't modify them [17:30:28] the dangling group is weird but with 0200 perms it really doesn't matter [17:30:36] or delete them [17:36:05] 10Labs: Horizon bug: hidden web proxy after deleting instance - https://phabricator.wikimedia.org/T167985#3352259 (10mpopov) [17:40:19] 10Labs: Need support on hosting an RStudio Shiny Server on a Labs instance behind a proxy - https://phabricator.wikimedia.org/T167702#3352295 (10GoranSMilovanovic) @mpopov Perhaps at some point we could have RStudio Server running from the production machines? Just sayin'... :) [17:53:11] bearloga: I'll try to look at your proxy problem this afternoon. I'm wondering if the existing proxy is attached to another project. I'll poke around [17:54:29] bd808: thank you! :) when i created a new instance of same name as old one, horizon auto-applied the roles the old one had so I wonder if there's an issue of settings not being deleted when they should [17:54:53] bd808: hence why the proxy exists in horizon's mind but not in the interface [17:56:04] madhuvishy: ah ok [17:56:14] bd808: Did you see my ranting yesterday about ldap? I couldn't alter the CN for that person we're renaming [17:56:16] but his problem is that he gets access denied [17:56:23] Can you do the first two steps and I'll just handle gerrit? [17:56:31] when trying to connect to the databases like "sql metawiki_p" or any other method [17:57:25] bearloga: that puppet settings stuff sounds like a different problem. the proxies not being cleaned up on delete is a known issue already. We have a bug for it somewhere [17:58:40] RainbowSprinkles: I didn't see your rants but yeah I can do the LDAP bits. I almost did on Tuesday but I wasn't sure if having things half done would be a problem or not. [17:59:16] 10Labs, 10Labs-Infrastructure, 10Operations, 10ops-eqiad: rack/setup/install labstore100[67].wikimedia.org - https://phabricator.wikimedia.org/T167984#3352375 (10chasemp) a:05chasemp>03RobH Note from irc: these are closer in function to the old dataset boxes rather than existing labstores. They need t... [17:59:29] Not a huge problem [18:00:26] 10Labs: Horizon bug: hidden web proxy after deleting instance - https://phabricator.wikimedia.org/T167985#3352380 (10chasemp) I think possibly @andrew just fixed this but maybe it wouldn't have effected historical artifacts. [18:00:37] Nemo_bis: that looks like a different problem than the file permissions actually [18:01:14] yeah, guess so; I was trying to rule out any obvious failure :) [18:01:40] madhuvishy: I think the db permissions loop may be stuck again. User ilario's creds give "Access denied for user 'u12094'@'10.68.16.44' (using password: YES)" [18:01:42] (I didn't know about the gid practice so I thought he could have set the wrong gid by mistake) [18:01:43] 10Labs, 10Labs-Infrastructure, 10Operations, 10ops-eqiad: rack/setup/install labstore100[67].wikimedia.org - https://phabricator.wikimedia.org/T167984#3352386 (10RobH) a:05RobH>03Cmjohnson [18:02:12] madhuvishy: do we have a wiki page on the fix that you have been doing? [18:13:33] bd808: yeah I think so [18:13:39] I'll look in a minute [18:16:57] !log services-testbed Reduced RAM quota to 10240 to finish T163375 [18:17:02] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Services-testbed/SAL [18:17:02] T163375: Request increased quota for services-testbed labs project - https://phabricator.wikimedia.org/T163375 [18:17:30] 10Labs, 10Tracking: Existing Labs project quota increase requests (Tracking) - https://phabricator.wikimedia.org/T140904#3352505 (10bd808) [18:17:33] 10Labs, 10Cassandra, 10Services (blocked), 10User-bd808, 10cloud-services-team (Kanban): Request increased quota for services-testbed labs project - https://phabricator.wikimedia.org/T163375#3352504 (10bd808) 05Open>03Resolved [18:25:39] bd808: this user is the one tripping the script up [18:25:46] 12094 [18:25:47] 10Labs: Horizon bug: hidden web proxy after deleting instance - https://phabricator.wikimedia.org/T167985#3352179 (10bd808) I dumped a list of all the known proxies using a script I have on silver. A grep of that dump doesn't show any matches for `discovery-beta`. The dump matches the list shown at https://tools... [18:26:08] also page is https://wikitech.wikimedia.org/wiki/Portal:Tool_Labs/Admin#Debugging_bad_mysql_credentials [18:26:16] 10Labs, 10Horizon, 10User-bd808, 10cloud-services-team (Kanban): Horizon bug: hidden web proxy after deleting instance - https://phabricator.wikimedia.org/T167985#3352565 (10bd808) a:03bd808 [18:30:27] 10Labs, 10Horizon, 10User-bd808, 10cloud-services-team (Kanban): Horizon bug: hidden web proxy after deleting instance - https://phabricator.wikimedia.org/T167985#3352600 (10mpopov) I just tried it again and I'm still getting the same error. I also tried it after logging out and logging back in (might as w... [18:31:03] bd808: /etc/dbusers.yaml in either of the labstore boxes [18:31:08] 1004/5 [18:31:14] I fixed this though [18:31:28] Nemo_bis: the credentials should work now [18:32:33] thanks madhuvishy [18:38:11] PROBLEM - Puppet errors on tools-docker-registry-01 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [18:45:22] The tools-docker-registry-01 puppet failure looks to be related to an attempt to refactor ssl cert stuff. Its being looked into for similar prod impacts [18:45:31] it's a puppet bug [18:45:36] fixed by restarting the puppetmaster [18:45:54] shall I do the same for the labs ones? [18:47:39] paravoid: I jsut did for tools. seems to have fixed it [18:48:22] PROBLEM - Puppet errors on tools-exec-1402 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [18:48:46] PROBLEM - Puppet errors on tools-exec-1429 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [18:48:53] for similar puppetmaster things in the past we shot an email to labs-announce to let anyone who has a puppetmaster know what's up [18:49:21] I think it only affects things using real ssl certs so shouldn't bother anyone else [18:49:49] ah, probably [18:50:00] if it broke everything we would have seen a lot more noise here [18:52:31] PROBLEM - Puppet errors on tools-k8s-master-01 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [18:52:41] yeah, bd808 is correct [18:52:45] PROBLEM - Puppet errors on tools-exec-1425 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [18:58:10] RECOVERY - Puppet errors on tools-docker-registry-01 is OK: OK: Less than 1.00% above the threshold [0.0] [19:00:43] thanks, paravoid, for the fix [19:03:35] 10Labs, 10Tool-Labs: provide a more strict robots.txt at Tool Labs - https://phabricator.wikimedia.org/T127206#3352704 (10Framawiki) [19:27:28] RECOVERY - Puppet errors on tools-k8s-master-01 is OK: OK: Less than 1.00% above the threshold [0.0] [19:27:44] RECOVERY - Puppet errors on tools-exec-1425 is OK: OK: Less than 1.00% above the threshold [0.0] [19:28:20] RECOVERY - Puppet errors on tools-exec-1402 is OK: OK: Less than 1.00% above the threshold [0.0] [19:28:48] RECOVERY - Puppet errors on tools-exec-1429 is OK: OK: Less than 1.00% above the threshold [0.0] [19:39:55] madhuvishy: thanks, will let Ilario know [20:18:25] (03PS1) 10Paladox: Initial import of icinga2 puppet repo [labs/icinga2] - 10https://gerrit.wikimedia.org/r/359243 [20:19:10] (03CR) 10Paladox: [V: 032 C: 032] Initial import of icinga2 puppet repo [labs/icinga2] - 10https://gerrit.wikimedia.org/r/359243 (owner: 10Paladox) [20:33:54] valhallasw`cloud: hey wikibugs still isnt notifying wikimedia-ai about the phab tasks in its config is there a reason? [20:39:48] Zppix: uh, probably [20:40:07] valhallasw`cloud: can we fix it please [20:42:39] if you have an example bug, possibly. [20:42:52] it's probably just a misconfigured matcher [20:43:09] T167830 should notify #wikimedia-ai due the scoring-team project [20:43:11] T167830: Extend icinga check to catch 500 errors like those of the 20170613 incident - https://phabricator.wikimedia.org/T167830 [20:43:18] valhallasw`cloud: ^ [20:45:55] Zppix it's because it is not in channels.yam [20:45:57] yaml [20:47:01] (03Draft1) 10Paladox: Insert the description of the change. [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/359271 [20:47:04] (03PS2) 10Paladox: Add channel wikimedia-ai for project scoring-team [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/359271 [20:47:06] Zppix ^^ [20:48:17] ah, found the project [20:48:21] i was going to say yes it is [20:49:53] (03Abandoned) 10Paladox: Add channel wikimedia-ai for project scoring-team [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/359271 (owner: 10Paladox) [20:55:07] Zppix: as far as I can see wikibugs is configured to report that to @wikimedia-ai [20:55:23] * Zppix facepalms [20:55:35] can you do a merge and deploy if i fix that quickly valhallasw`cloud [20:55:49] #wikimedia-ai [20:55:51] not @ [20:55:58] ik [20:57:56] but channels.yaml on-site is still in an old state. Hmmmm [20:58:18] valhallasw`cloud: i cant even see it in gerrit [20:58:27] yeah, git was in a weird state. git reset --hard && git pull should help [20:58:36] you can't see /what/ in gerrit [20:58:52] (03PS1) 10Merlijn van Deen: Use pretty-formatting for dumping channel config [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/359306 [20:58:53] (03PS1) 10Merlijn van Deen: Fix ##Zppix-Wikipedia configuration [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/359307 [20:58:56] (03PS1) 10Merlijn van Deen: Add basic tag testing script [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/359308 [20:59:10] (03CR) 10Merlijn van Deen: [C: 032] Use pretty-formatting for dumping channel config [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/359306 (owner: 10Merlijn van Deen) [20:59:19] (03CR) 10Merlijn van Deen: [C: 032] Fix ##Zppix-Wikipedia configuration [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/359307 (owner: 10Merlijn van Deen) [20:59:20] the wikimedia-ai config [20:59:26] (03CR) 10Merlijn van Deen: [C: 032] Add basic tag testing script [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/359308 (owner: 10Merlijn van Deen) [20:59:52] the wikimedia-ai is # not @ thats weird [20:59:58] !log tools.wikibugs Updated channels.yaml to: e144c880704f5e766af3f6da0fe285ed345eeba9 Merge "Report contributions to AdvancedSearch to wikimedia-de-tech channel" [21:00:56] (03Draft1) 10Zppix: Fix typo for wikimedia-ai bug tracking [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/359302 [21:01:03] (03Abandoned) 10Zppix: Fix typo for wikimedia-ai bug tracking [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/359302 (owner: 10Zppix) [21:02:12] (03Merged) 10jenkins-bot: Use pretty-formatting for dumping channel config [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/359306 (owner: 10Merlijn van Deen) [21:02:19] (03CR) 10jenkins-bot: Use pretty-formatting for dumping channel config [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/359306 (owner: 10Merlijn van Deen) [21:02:38] (03Merged) 10jenkins-bot: Fix ##Zppix-Wikipedia configuration [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/359307 (owner: 10Merlijn van Deen) [21:02:40] (03Merged) 10jenkins-bot: Add basic tag testing script [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/359308 (owner: 10Merlijn van Deen) [21:02:44] (03CR) 10jenkins-bot: Fix ##Zppix-Wikipedia configuration [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/359307 (owner: 10Merlijn van Deen) [21:02:46] (03CR) 10jenkins-bot: Add basic tag testing script [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/359308 (owner: 10Merlijn van Deen) [21:05:19] it works now valhallasw`cloud thanks [21:56:44] 10Labs, 10Labs-Infrastructure: Horizon puppet roles not cleared when instance is deleted - https://phabricator.wikimedia.org/T147878#3353253 (10Andrew) a:03Andrew [22:13:28] 10Labs, 10Labs-Infrastructure, 10cloud-services-team (Kanban): Horizon puppet roles not cleared when instance is deleted - https://phabricator.wikimedia.org/T147878#3353306 (10bd808) [22:19:08] 10Labs, 10DBA, 10Patch-For-Review: Add and sanitize s2, s4, s5, s6 and s7 to sanitarium2 and new labsdb hosts - https://phabricator.wikimedia.org/T153743#3353325 (10bd808) [22:19:10] 10Labs, 10User-bd808, 10cloud-services-team (Kanban): setup dewiki and wikidatawiki on the labsdb1009, 1010 and 1011 - https://phabricator.wikimedia.org/T168021#3353312 (10bd808) [22:21:42] halfak: 'wc monthly_wp10_enwiki.tsv' is using pretty much all the IO on the bastion — can you do it on the grid instead? [22:24:41] andrewbogott: if your session is responsive enough to do it, please just kill it [22:24:49] trying [22:24:50] I can't even do anything [22:25:41] halfak: I killed your job [22:26:54] 10Labs, 10User-bd808, 10cloud-services-team (Kanban): setup dewiki and wikidatawiki on the labsdb1009, 1010 and 1011 - https://phabricator.wikimedia.org/T168021#3353353 (10bd808) ``` bd808@labsdb1009:~$ sudo /usr/local/sbin/maintain-views --databases dewiki Traceback (most recent call last): File "/usr/loc... [22:28:10] 10Labs, 10User-bd808, 10cloud-services-team (Kanban): setup dewiki and wikidatawiki on the labsdb1009, 1010 and 1011 - https://phabricator.wikimedia.org/T168021#3353368 (10bd808) [22:30:25] 10Labs, 10DBA, 10User-bd808, 10cloud-services-team (Kanban): setup dewiki and wikidatawiki on the labsdb1009, 1010 and 1011 - https://phabricator.wikimedia.org/T168021#3353371 (10bd808) @Marostegui can you do the magic needed to fix the "Access denied for user 'maintainviews'@'localhost' to database 'dewik... [22:32:17] 10Labs, 10DBA: Prepare and check storage layer for atjwiki - https://phabricator.wikimedia.org/T167715#3341927 (10bd808) @Marostegui need some help still: `pymysql.err.OperationalError: (1044, "Access denied for user 'maintainviews'@'localhost' to database 'atjwiki_p'")`. That's from labsdb1009 but I imagine t... [22:32:51] 10Labs, 10DBA, 10User-bd808, 10cloud-services-team (Kanban): Prepare and check storage layer for atjwiki - https://phabricator.wikimedia.org/T167715#3353377 (10bd808) a:03bd808 [22:35:00] 10Labs, 10DBA, 10User-bd808, 10cloud-services-team (Kanban): setup dewiki and wikidatawiki on the labsdb1009, 1010 and 1011 - https://phabricator.wikimedia.org/T168021#3353312 (10jcrespo) I have run on labsdb1009: ``` GRANT SELECT, SHOW VIEW ON `dewiki\_p`.* to labsdbuser; GRANT SELECT, SHOW VIEW ON `wikid... [22:37:18] (03Draft1) 10Paladox: Migrate host ores-web-05.ores.eqiad.wmflabs from director to public view in repo [labs/icinga2] - 10https://gerrit.wikimedia.org/r/359357 [22:37:20] (03PS2) 10Paladox: Migrate host ores-web-05.ores.eqiad.wmflabs from director to public view in repo [labs/icinga2] - 10https://gerrit.wikimedia.org/r/359357 [22:37:32] (03CR) 10Paladox: [V: 032 C: 032] Migrate host ores-web-05.ores.eqiad.wmflabs from director to public view in repo [labs/icinga2] - 10https://gerrit.wikimedia.org/r/359357 (owner: 10Paladox) [22:40:27] !log wikilabels staging wikilabels-wmflabs-deploy:e856afa [22:40:29] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikilabels/SAL [22:41:56] !log wikilabels deploying wikilabels-wmflabs-deploy:e856afa [22:41:58] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikilabels/SAL [22:42:03] <3 stashbot [22:44:58] 10Labs, 10DBA, 10User-bd808, 10cloud-services-team (Kanban): setup dewiki and wikidatawiki on the labsdb1009, 1010 and 1011 - https://phabricator.wikimedia.org/T168021#3353391 (10jcrespo) So we have a problem with the script-- the script has enough privileges to create the database, but only after the data... [22:45:57] (03Draft1) 10Paladox: Migrate host puppet-paladox3.git.eqiad.wmflabs from director to public view in repo [labs/icinga2] - 10https://gerrit.wikimedia.org/r/359358 [22:45:59] (03PS2) 10Paladox: Migrate host puppet-paladox3.git.eqiad.wmflabs from director to public view in repo [labs/icinga2] - 10https://gerrit.wikimedia.org/r/359358 [22:46:01] (03CR) 10Paladox: [V: 032 C: 032] Migrate host puppet-paladox3.git.eqiad.wmflabs from director to public view in repo [labs/icinga2] - 10https://gerrit.wikimedia.org/r/359358 (owner: 10Paladox) [22:49:50] 10Labs, 10DBA, 10User-bd808, 10cloud-services-team (Kanban): setup dewiki and wikidatawiki on the labsdb1009, 1010 and 1011 - https://phabricator.wikimedia.org/T168021#3353398 (10bd808) >>! In T168021#3353391, @jcrespo wrote: > Not sure how to fix the loop. It looks like the script expects to create the D... [23:14:14] 10Labs, 10DBA, 10User-bd808, 10cloud-services-team (Kanban): setup dewiki and wikidatawiki on the labsdb1009, 1010 and 1011 - https://phabricator.wikimedia.org/T168021#3353464 (10bd808) a:05bd808>03jcrespo @jcrespo and I debugged this a bit on irc and found that a grant for `wikidatawiki%` worked to al... [23:22:17] 10Labs, 10DBA, 10User-bd808, 10cloud-services-team (Kanban): setup dewiki and wikidatawiki on the labsdb1009, 1010 and 1011 - https://phabricator.wikimedia.org/T168021#3353482 (10jcrespo) I used `%wik%\_p` but `%\_p` doesn't work either. [23:33:08] 10Striker: Enhance workflow for tool labs membership requests - https://phabricator.wikimedia.org/T168027#3353519 (10bd808) [23:39:29] Hello all. "Wikiwide" is registered at wikitech, but does not show up at https://wikitech.wikimedia.org/w/index.php?title=Special:NovaServiceGroup&action=managemembers&projectname=tools&servicegroupname=tools.gpy for a few days already -- why? [23:42:56] gry: because that user is not a member of the tools project [23:43:25] bd808, how do they become a member? It is my friend, I would like them to have this access. [23:44:06] gry: they need to fill out https://toolsadmin.wikimedia.org/tools/membership/apply [23:44:27] that is step #2 here -- https://wikitech.wikimedia.org/wiki/Help:Getting_Started#Tools_Users [23:45:09] bd808: Wanna do steps 1 & 2 now? https://phabricator.wikimedia.org/T165624 [23:45:11] And I'll do 3 [23:45:16] And we can finally forget this task [23:45:32] RainbowSprinkles: oh yeah. let me find the right window to do that in [23:46:11] bd808: ok. (For the record, I find the help pages at Wikitech quite lengthy and counter-intuitive. I would be glad to rewrite them, but my knowledge is so shallow that I don't.) -- I appreciate your guidance in small steps. [23:46:56] gry: we are trying to make them better and would welcome edits, but I understand that we still have a long way to go [23:47:24] there is hope though! make the docs better is a team goal for the coming fiscal year (july-June) [23:48:09] One would wish it stayed a goal for eternity, with one hour a day spent improving docs on all teams. [23:48:30] Although, bd808, it would be very cool if you finished that one day -- then I would translate it to Russian. [23:49:05] :) docs are never done but yes someday having translations would be nice as well [23:53:14] bd808: Ready when you are [23:53:34] RainbowSprinkles: I almost have the commands figured out [23:55:04] modify-ldap-user was my friend [23:55:10] (this whole process took 5 minutes before) [23:55:25] yeah we need a replacement script [23:55:32] my ldif is wrong... [23:57:37] 10Labs, 10Gerrit, 10wikitech.wikimedia.org: Request to rename LegoFan4000 to MacFan4000 on WikiTech - https://phabricator.wikimedia.org/T165624#3353564 (10bd808) ``` $ ldapmodify -v -D 'uid=novaadmin,ou=people,dc=wikimedia,dc=org' -W -f MacFan4000.ldif ldap_initialize( ) Enter LDAP Password: replac... [23:57:41] RainbowSprinkles: I think I got it ^ [23:58:16] I don't see a MacFan4000 in LDAP [23:58:24] Oh yeah [23:58:24] Nvm [23:58:34] His uid doesn't change [23:58:40] sn & cn are. uid is still legofan4000 [23:59:09] we could change the uid too I think. there are no ssh keys so shouldn't be an local files anywhere [23:59:32] I'd need to lookup how to change the dn... [23:59:50] Ok, gerrit part done