[00:21:21] 10Cloud-Services, 10Operations, 10Patch-For-Review, 10Tracking: overhaul labstore setup [tracking] - https://phabricator.wikimedia.org/T126083#3463424 (10madhuvishy) [00:21:23] 10Cloud-Services, 10Operations, 10Tracking: Cleanup tools nfs share on labstore1004/5 - https://phabricator.wikimedia.org/T156982#3463421 (10madhuvishy) 05Open>03Resolved a:03madhuvishy This was done. Let's open a different task if we plan to do a clean up in the future. [00:21:46] 10Cloud-Services, 10cloud-services-team (Kanban), 10Operations, 10Patch-For-Review: Reimage labstore1001 and labstore1002 for DRBD storage setup - https://phabricator.wikimedia.org/T158196#3463427 (10madhuvishy) [00:21:48] 10Cloud-Services, 10Operations: Move labstore1002 and labstore1002-array1 and labstore1002-array2 to different rack (currently in C3) - https://phabricator.wikimedia.org/T158913#3463425 (10madhuvishy) 05Open>03Resolved a:03madhuvishy [00:22:46] 10Cloud-Services, 10cloud-services-team (Kanban), 10Operations: Investigate alternative RAID strategies for labstore1001/2 - https://phabricator.wikimedia.org/T162090#3463428 (10madhuvishy) Update: I have reimaged labstore1001 and labstore1002 with RAID 50 for the external shelf storage. [00:28:28] 10Cloud-Services: Better monitoring for labstore backup crons - https://phabricator.wikimedia.org/T171394#3463450 (10madhuvishy) [00:42:09] PROBLEM - Puppet errors on tools-exec-1410 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [01:05:33] PROBLEM - Puppet errors on tools-exec-1417 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [01:22:11] RECOVERY - Puppet errors on tools-exec-1410 is OK: OK: Less than 1.00% above the threshold [0.0] [02:24:58] PROBLEM - Puppet errors on tools-exec-1437 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [02:37:40] 10cloud-services-team (FY2017-18), 10Datasets-General-or-Unknown, 10Goal: Begin migrating customer-facing Dumps endpoints to Cloud Services - https://phabricator.wikimedia.org/T168486#3463490 (10madhuvishy) Notes from hangout chat with Ariel: * We should keep the relative file structure for dumps the same s... [02:39:27] 10cloud-services-team (Kanban), 10Project-Admins, 10User-bd808: Rename and update Cloud Services Phabricator projects - https://phabricator.wikimedia.org/T167244#3463491 (10mmodell) It shouldn't be too difficult to rename them in phab while retaining the old git urls for compatability. [02:47:49] 10Cloud-Services, 10cloud-services-team (Kanban), 10Operations: labstore systemd state Icinga alarms - https://phabricator.wikimedia.org/T151322#3463492 (10madhuvishy) Labstore1002 has been reimaged - these failures don't get reported anymore. I'll reimage 2001 in the upcoming week. [03:00:00] RECOVERY - Puppet errors on tools-exec-1437 is OK: OK: Less than 1.00% above the threshold [0.0] [03:10:34] RECOVERY - Puppet errors on tools-exec-1417 is OK: OK: Less than 1.00% above the threshold [0.0] [03:43:03] PROBLEM - Puppet errors on tools-exec-1428 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [04:08:01] RECOVERY - Puppet errors on tools-exec-1428 is OK: OK: Less than 1.00% above the threshold [0.0] [06:33:56] PROBLEM - Puppet errors on tools-webgrid-lighttpd-1422 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [07:08:57] RECOVERY - Puppet errors on tools-webgrid-lighttpd-1422 is OK: OK: Less than 1.00% above the threshold [0.0] [09:23:03] PROBLEM - Puppet errors on tools-exec-1430 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [09:58:02] RECOVERY - Puppet errors on tools-exec-1430 is OK: OK: Less than 1.00% above the threshold [0.0] [12:20:57] PROBLEM - Puppet errors on tools-exec-1437 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [13:00:57] RECOVERY - Puppet errors on tools-exec-1437 is OK: OK: Less than 1.00% above the threshold [0.0] [14:52:05] 10Quarry, 10utfnormal: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463759 (10IKhitron) [15:07:32] 10Quarry, 10utfnormal: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463759 (10zhuyifei1999) > please create one more that is wiki-compatible What do you mean by "wiki-compatible"? [15:08:11] 10Quarry: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463778 (10zhuyifei1999) [15:10:08] 10Quarry: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463779 (10IKhitron) Hi and thank you for the answer. Exactly as I say. When we get the results, they are unreadable, because of the type of encoding you support, that is not compatible with wiki content. [15:24:50] 10Quarry: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463781 (10zhuyifei1999) My test (here `` is a line feed character followed by a carriage return character): # https://quarry.wmflabs.org/query/20457 Download > CSV got a file named `quarry-20457-untitled-run192644... [15:33:23] 10Quarry: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463784 (10IKhitron) Sure, @zhuyifei1999, thanks. {F8820303} {F8820304} [15:36:44] 10Quarry: Quarry should remember my login - https://phabricator.wikimedia.org/T164390#3231927 (10zhuyifei1999) Cause: The HTTP response header for cookies on quarry is: ``` Set-Cookie: session=REDACTED; HttpOnly; Path=/ ``` It does not specify an expiry and as a result it expires [[https://stackoverflow.com/q/4... [15:41:57] 10Quarry: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463790 (10IKhitron) Btw, two things: * The format you support is "UTF-8 without BOM", the needed format is "UTF-8". * I opened your file in Excel, it's unreadable. {F8820325} [15:50:14] 10Quarry: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463791 (10zhuyifei1999) ``` $ diff new-quarry-2157-hewiki-unexisting-templates-run192641.csv quarry-2157-hewiki-unexisting-templates-run192641.csv 1c1 < page_namespace,page_title,tl_title --- > page_namespace,page_title,tl_... [15:51:51] 10Quarry: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463792 (10IKhitron) Great. Can you add such a format, pleeeese? [15:52:11] 10Quarry: Make downloading wiki-compatible - https://phabricator.wikimedia.org/T171404#3463793 (10zhuyifei1999) Just making sure before I upload a patch: does the option `Excel (UTF-16 CSV)` work? [15:53:44] 10Quarry: Make UTF-8 downloading excel-compatible - https://phabricator.wikimedia.org/T171404#3463794 (10zhuyifei1999) [15:53:48] 10Quarry: Make UTF-8 downloading excel-compatible - https://phabricator.wikimedia.org/T171404#3463795 (10IKhitron) Thank you! No, it doesn't, it looks the same as in the screenshot I gave you. [16:13:10] 10Quarry: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463806 (10zhuyifei1999) [16:13:13] 10Quarry: Make UTF-8 downloading excel-compatible - https://phabricator.wikimedia.org/T171404#3463808 (10zhuyifei1999) [16:21:54] 10Quarry: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463810 (10zhuyifei1999) a:03zhuyifei1999 I cannot think of a clean way to hack a BOM into the response, or cleanly set the response encoding in the generator. Will add a [[https://github.com/jmcnamara/Xlsx... [16:23:57] 10Quarry: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463812 (10IKhitron) Wierd. There is no way to append three characters string to the file at start? [16:24:06] x from -databases -> hopefully a quick question, is there a dump of the labs replica centralauth_p db to run local queries on? If not, how large is the db, can I run mysqldump? [16:39:56] 10Quarry: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463825 (10zhuyifei1999) >>! In T76126#3463812, @IKhitron wrote: > Wierd. There is no way to append three characters string to the file at start? The response is constructed from a [[https://github.com/wikim... [16:41:46] 10Quarry: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463827 (10IKhitron) And you can't catch the file after the generator? Curiouser and curiouser. [16:46:10] PROBLEM - Puppet errors on tools-worker-1005 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [16:46:47] 10Quarry: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463828 (10zhuyifei1999) And regarding why not unconditionally add BOM: >>! In T76126#800971, @yuvipanda wrote: > Hmm, so perhaps we just need to output a BOM. But that makes me feel all kinds of weird for U... [16:49:43] 10Quarry: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463831 (10IKhitron) So this why I asked you to add this format, not replace. For me it always worked, so you don't remove anything, there will be at least the same functionality. But you are he boss. [17:26:11] RECOVERY - Puppet errors on tools-worker-1005 is OK: OK: Less than 1.00% above the threshold [0.0] [17:28:18] 10Quarry, 10Patch-For-Review: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463879 (10zhuyifei1999) ^ Will test, right now I'm downloading the vagrant box. [18:56:24] 10Quarry, 10Patch-For-Review: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463890 (10zhuyifei1999) Test with `SELECT "首页" AS page_title;` and latest patch I got: {F8821412} [18:59:33] 10Quarry, 10Patch-For-Review: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#3463891 (10IKhitron) Looks nice. I don't know why, but it is opened by 7-Zip, not Excel. I hope it's phabticator problem, not Quarry's. [19:14:23] zhuyifei1999_: ^ nice! :-) [19:14:53] thanks [21:53:18] PROBLEM - Puppet errors on tools-exec-1407 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [22:29:02] 10Cloud-VPS (Project-requests): Request creation of openipmap labs project - https://phabricator.wikimedia.org/T166671#3464211 (10Pintoch) 05Open>03Resolved a:03Pintoch @akosiaris It works like a charm, thanks a lot! [22:29:05] 10Cloud-Services, 10Tracking, 10User-bd808: [DO NOT USE] New Labs project requests (tracking) [superseded by #cloud-vps-project-requests] - https://phabricator.wikimedia.org/T76375#3464214 (10Pintoch) [22:33:18] RECOVERY - Puppet errors on tools-exec-1407 is OK: OK: Less than 1.00% above the threshold [0.0] [22:36:13] 10cloud-services-team (Kanban), 10Project-Admins, 10User-bd808: Rename and update Cloud Services Phabricator projects - https://phabricator.wikimedia.org/T167244#3464221 (10bd808) >>! In T167244#3462797, @MarcoAurelio wrote: > @bd808 Do we plan to migrate/change repository names on Phabricator, Gerrit and Gi... [22:45:12] 10cloud-services-team (Kanban), 10Project-Admins, 10User-bd808: Rename and update Cloud Services Phabricator projects - https://phabricator.wikimedia.org/T167244#3464232 (10MarcoAurelio) I don't mind its current naming, it was just a question of whether it was planned to rename them to r-tool-stewardbots as... [22:49:48] Cyberpower678: hey, sorry I was very AFK most of the weekend. Could you open a phabricator task showing the config/code you tried to use for db-based sessions? I'll make some time to look at this week and see if we can find a good solution. [22:57:08] (03Draft2) 10Quiddity: Add 3 more tags to design channel [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/367338 [23:00:42] (03PS3) 10Quiddity: Add 3 more tags to design channel [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/367338 [23:03:41] (03PS4) 10Quiddity: Add 3 more tags to design channel [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/367338 [23:11:35] quiddity is using gerrit :D [23:11:57] he will be fixing all the bugs soon :) [23:24:17] 10wikitech.wikimedia.org, 10LDAP: Request for username rename on Wikitech - https://phabricator.wikimedia.org/T171417#3464278 (10D3r1ck01) [23:24:30] 10Cloud-VPS (Project-requests): Request creation of openipmap labs project - https://phabricator.wikimedia.org/T166671#3464290 (10bd808) [23:26:01] 10wikitech.wikimedia.org, 10LDAP: Request for username rename on Wikitech - https://phabricator.wikimedia.org/T171417#3464291 (10D3r1ck01) [23:26:17] 10wikitech.wikimedia.org, 10LDAP: Request rename of "Alangi derick" to "Alangi Derick" on wikitech/LDAP/Gerrit - https://phabricator.wikimedia.org/T171417#3464292 (10bd808) [23:29:00] 10wikitech.wikimedia.org, 10LDAP: Request rename of "Alangi derick" to "Alangi Derick" on wikitech/LDAP/Gerrit - https://phabricator.wikimedia.org/T171417#3464295 (10D3r1ck01) @bd808, thanks for the adjustment on the task. [23:29:50] d3r1ck: :) it just makes things a bit easier to see on the workboards if the titles are not generic [23:34:56] 10Data-Services, 10Operations, 10Tracking: overhaul labstore setup [tracking] - https://phabricator.wikimedia.org/T126083#3464301 (10bd808) [23:36:54] bd808: Ok [23:37:16] bd808: Okay! Sure. Thanks so much [23:37:49] bd808: Is it possible to change the shell name too? from "d3r1ck01" to "d3r1ck"? [23:37:55] 10Data-Services: Better monitoring for labstore backup crons - https://phabricator.wikimedia.org/T171394#3464306 (10bd808) [23:37:57] 10Data-Services, 10Operations: Convert labstore cluster configuration to hiera and profiles - https://phabricator.wikimedia.org/T161835#3464307 (10bd808) [23:38:01] 10Data-Services, 10cloud-services-team (Kanban), 10Operations: Undo special tools-home and tools-project share definitions for NFS - https://phabricator.wikimedia.org/T161834#3464308 (10bd808) [23:38:04] 10Data-Services, 10cloud-services-team (Kanban), 10Patch-For-Review: Issues in enabling NFS for new projects (was 'adding project to nfs-mounts.yaml does not create directories') - https://phabricator.wikimedia.org/T158883#3464309 (10bd808) [23:38:09] 10Data-Services, 10cloud-services-team (Kanban), 10Operations, 10Patch-For-Review: Reimage labstore1001 and labstore1002 for DRBD storage setup - https://phabricator.wikimedia.org/T158196#3464310 (10bd808) [23:38:11] 10Cloud-VPS, 10Data-Services: Soft mount NFS for almost (all) projects that still have NFS - https://phabricator.wikimedia.org/T127559#3464311 (10bd808) [23:38:14] 10Data-Services, 10Operations: evaluate possibility for nscd use with useldap - https://phabricator.wikimedia.org/T124991#3464312 (10bd808) [23:38:18] 10Data-Services, 10Toolforge: Prevent overly-large log files - https://phabricator.wikimedia.org/T122508#3464313 (10bd808) [23:39:10] d3r1ck: not easily. you already have a "D3r1ck" account that holds that uid [23:39:45] It would require us disabling that other account [23:40:24] if that account has been used in Cloud VPS projects then it gets trickier [23:40:49] bd808: FYI https://github.com/cyberpower678/Cyberbot_II/blob/test/IABot/www/Includes/DB2.php#L321 [23:41:10] and https://github.com/cyberpower678/Cyberbot_II/blob/test/IABot/www/Includes/OAuth.php#L91 [23:41:16] bd808: you know when I was just starting, I didn't really know much so I was messing up. But now that I know some stuffs I am doing, I am beginning to see the mess up I did :( [23:41:53] bd808: If it's possible, I would really love the "d3r1ck" deleted completely (if possible) and udpate the "d3r1ck01" to "d3r1ck" [23:42:11] d3r1ck: write it up on the task :) [23:42:15] But history of d3r1ck01 should not be lost :) [23:42:20] Chad and I can look [23:42:25] bd808: Another task? [23:42:31] no, the same one [23:42:34] Okay! [23:45:22] 10wikitech.wikimedia.org, 10LDAP: Request rename of "Alangi derick" to "Alangi Derick" on wikitech/LDAP/Gerrit - https://phabricator.wikimedia.org/T171417#3464317 (10D3r1ck01) [23:45:34] bd808: I just edited the task [23:46:15] Hopefully, when these changes are made successfully, I am up and running full time. :) [23:47:46] bd808: do you mind using the ticket https://phabricator.wikimedia.org/T170849? [23:48:17] Cyberpower678: not at all. that seems like a good place to keep the discussion going [23:52:46] 10wikitech.wikimedia.org, 10LDAP: Request rename of "Alangi derick" to "Alangi Derick" on wikitech/LDAP/Gerrit - https://phabricator.wikimedia.org/T171417#3464319 (10bd808) The "d3r1ck" shell name (LDAP `uid`) currently belongs to the LDAP user "D3r1ck" which was also created by @D3r1ck01. We had this discussi...