[00:06:45] 10Toolforge, 10cloud-services-team (Kanban), 10Patch-For-Review, 10User-bd808: Update `sql` command to use new wiki replica servers - https://phabricator.wikimedia.org/T176688#3641537 (10bd808) Announced on labs-l: https://lists.wikimedia.org/pipermail/labs-l/2017-September/005081.html [00:13:46] PROBLEM - Puppet errors on tools-exec-1438 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [00:57:42] PROBLEM - Puppet errors on tools-exec-1408 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [00:59:27] 10Cloud-VPS (Project-requests): Request creation of IIAB VPS project - https://phabricator.wikimedia.org/T176926#3641585 (10Doc_James) [01:03:24] 10Cloud-VPS (Project-requests): Request creation of IIAB VPS project - https://phabricator.wikimedia.org/T176926#3641597 (10Doc_James) An example of what it will look like is here http://iiab.me/medbox/ This is running on Tim Moody's home machine. Due to potential volume of traffic need it on something with more... [01:12:26] 10Cloud-VPS (Project-requests): Request creation of IIAB VPS project - https://phabricator.wikimedia.org/T176926#3641585 (10Tim-moody) This project requires a VPS because it will have to permit access to a number of ports. We also use ansible to install the underlying software for the Internet in a Box server an... [01:18:43] RECOVERY - Puppet errors on tools-exec-1438 is OK: OK: Less than 1.00% above the threshold [0.0] [01:42:44] RECOVERY - Puppet errors on tools-exec-1408 is OK: OK: Less than 1.00% above the threshold [0.0] [01:50:59] PROBLEM - Puppet errors on tools-exec-1425 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [02:30:58] RECOVERY - Puppet errors on tools-exec-1425 is OK: OK: Less than 1.00% above the threshold [0.0] [02:44:43] PROBLEM - Puppet errors on tools-exec-1438 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [03:19:45] RECOVERY - Puppet errors on tools-exec-1438 is OK: OK: Less than 1.00% above the threshold [0.0] [03:40:46] PROBLEM - Puppet errors on tools-exec-1438 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [03:43:48] (03PS132) 10Ricordisamoa: Initial commit [labs/tools/wikidata-slicer] - 10https://gerrit.wikimedia.org/r/241296 [03:47:09] (03CR) 10Ricordisamoa: [C: 04-2] "PS132 removes useless eslint-disable comment" [labs/tools/wikidata-slicer] - 10https://gerrit.wikimedia.org/r/241296 (owner: 10Ricordisamoa) [04:03:11] PROBLEM - Puppet errors on tools-exec-1418 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [04:18:13] RECOVERY - Puppet errors on tools-exec-1418 is OK: OK: Less than 1.00% above the threshold [0.0] [04:20:43] RECOVERY - Puppet errors on tools-exec-1438 is OK: OK: Less than 1.00% above the threshold [0.0] [04:28:48] 10Tool-Pageviews: Add hi.wikivoyage to Pageviews Tool - https://phabricator.wikimedia.org/T176929#3641693 (10Jayprakash12345) [04:31:35] 10Tool-Pageviews, 10Hindi-Sites: Add hi.wikivoyage to Pageviews Tool - https://phabricator.wikimedia.org/T176929#3641706 (10Jayprakash12345) [04:31:36] (03PS133) 10Ricordisamoa: Initial commit [labs/tools/wikidata-slicer] - 10https://gerrit.wikimedia.org/r/241296 [04:38:01] (03CR) 10Ricordisamoa: [C: 04-2] "PS133 fixes some JSDoc issues" [labs/tools/wikidata-slicer] - 10https://gerrit.wikimedia.org/r/241296 (owner: 10Ricordisamoa) [04:41:44] PROBLEM - Puppet errors on tools-exec-1438 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [04:42:15] 10Tool-Pageviews, 10Hindi-Sites: Add hi.wikivoyage to Pageviews Tool - https://phabricator.wikimedia.org/T176929#3641710 (10MusikAnimal) 05Open>03Resolved a:03MusikAnimal Done: * http://tools.wmflabs.org/pageviews/?project=hi.wikivoyage.org * http://tools.wmflabs.org/siteviews/?sites=hi.wikivoyage.org|hi... [04:43:42] 10Tool-Pageviews, 10Hindi-Sites: Add hi.wikivoyage to Pageviews Tool - https://phabricator.wikimedia.org/T176929#3641714 (10Jayprakash12345) Thanks, It is working [05:21:44] RECOVERY - Puppet errors on tools-exec-1438 is OK: OK: Less than 1.00% above the threshold [0.0] [05:42:43] PROBLEM - Puppet errors on tools-exec-1438 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [05:45:23] 10Cloud-Services, 10cloud-services-team (Kanban), 10DBA: Prepare and check storage layer for hi.wikivoyage - https://phabricator.wikimedia.org/T173027#3641756 (10Marostegui) 05Open>03Resolved a:03Marostegui In order to get this over with - I have run myself: ``` maintain-views --databases hiwikivoyage... [06:17:44] RECOVERY - Puppet errors on tools-exec-1438 is OK: OK: Less than 1.00% above the threshold [0.0] [06:40:45] PROBLEM - Puppet errors on tools-exec-1427 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [07:00:53] PROBLEM - Puppet errors on tools-exec-1428 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [07:20:46] RECOVERY - Puppet errors on tools-exec-1427 is OK: OK: Less than 1.00% above the threshold [0.0] [07:40:52] RECOVERY - Puppet errors on tools-exec-1428 is OK: OK: Less than 1.00% above the threshold [0.0] [07:43:45] PROBLEM - Puppet errors on tools-exec-1438 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [09:18:45] RECOVERY - Puppet errors on tools-exec-1438 is OK: OK: Less than 1.00% above the threshold [0.0] [09:21:43] 10cloud-services-team (Kanban), 10Operations, 10Operations-Software-Development, 10Goal, 10Technical-Debt: Remove salt master (and related packages) from labcontrol1001 - https://phabricator.wikimedia.org/T176632#3642038 (10MoritzMuehlenhoff) 05Open>03Resolved a:03MoritzMuehlenhoff Salt keys have b... [09:39:44] PROBLEM - Puppet errors on tools-exec-1438 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [10:49:47] RECOVERY - Puppet errors on tools-exec-1438 is OK: OK: Less than 1.00% above the threshold [0.0] [11:09:03] 10Tool-stewardbots, 10Need-volunteer, 10WorkType-Maintenance: Outdated MySQL handling for hat-web-tool@stewardbots - https://phabricator.wikimedia.org/T156545#3642326 (10MarcoAurelio) @bd808 My bad. Please see T176578. I already changed the servers there but it needs some sql tweaks too I'm not confident eno... [11:09:05] (03PS1) 10Jean-Frédéric: Add `base` paramter to French in French (fr-fr) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381192 [11:09:40] 10Tool-stewardbots: hat-web-tool/projects: listing incorrect number of users on some projects (not listening to ug_expiry) - https://phabricator.wikimedia.org/T176578#3630217 (10MarcoAurelio) [11:09:42] 10Tool-stewardbots, 10Need-volunteer, 10WorkType-Maintenance: Outdated MySQL handling for hat-web-tool@stewardbots - https://phabricator.wikimedia.org/T156545#3642328 (10MarcoAurelio) [11:10:20] 10Tool-stewardbots, 10Need-volunteer, 10WorkType-Maintenance: Outdated MySQL handling for hat-web-tool@stewardbots - https://phabricator.wikimedia.org/T156545#2979205 (10MarcoAurelio) [11:10:22] 10Tool-stewardbots: hat-web-tool/projects: listing incorrect number of users on some projects (not listening to ug_expiry) - https://phabricator.wikimedia.org/T176578#3630217 (10MarcoAurelio) [11:10:33] (03PS2) 10Jean-Frédéric: Add `base` parameter for France in French (fr-fr) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381192 [11:12:36] 10Tool-stewardbots: hat-web-tool/projects: listing incorrect number of users on some projects (not listening to ug_expiry) - https://phabricator.wikimedia.org/T176578#3642337 (10MarcoAurelio) [11:15:36] (03PS3) 10Jean-Frédéric: Add `base` parameter for France in French (fr_fr) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381192 [11:15:43] PROBLEM - Puppet errors on tools-exec-1438 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [11:45:45] RECOVERY - Puppet errors on tools-exec-1438 is OK: OK: Less than 1.00% above the threshold [0.0] [12:01:14] I requested a toolforge account about a week ago and haven't heard anything. Request is at https://toolsadmin.wikimedia.org/tools/membership/status/110 [12:01:31] Not sure if I used the right process, or if things are just slow [13:38:09] (03PS1) 10Lokal Profil: Add unmapped field for am_hy [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381215 [13:44:57] (03CR) 10Jean-Frédéric: [C: 032] Add unmapped field for am_hy [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381215 (owner: 10Lokal Profil) [13:49:09] (03Merged) 10jenkins-bot: Add unmapped field for am_hy [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381215 (owner: 10Lokal Profil) [13:53:10] (03CR) 10jenkins-bot: Add unmapped field for am_hy [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381215 (owner: 10Lokal Profil) [14:21:33] (03PS1) 10Elukey: Add fake druid passwords [labs/private] - 10https://gerrit.wikimedia.org/r/381220 [14:21:48] (03CR) 10Elukey: [V: 032 C: 032] Add fake druid passwords [labs/private] - 10https://gerrit.wikimedia.org/r/381220 (owner: 10Elukey) [14:39:10] (03PS1) 10Elukey: Fix typo in druid private properties [labs/private] - 10https://gerrit.wikimedia.org/r/381226 [14:39:24] (03CR) 10Elukey: [V: 032 C: 032] Fix typo in druid private properties [labs/private] - 10https://gerrit.wikimedia.org/r/381226 (owner: 10Elukey) [14:52:29] 10Cloud-Services, 10Operations, 10Traffic, 10Puppet, 10Technical-Debt: Convert all of our site.pp/roles to the role/profile paradigm - https://phabricator.wikimedia.org/T159412#3643099 (10ema) p:05Triage>03Normal [14:52:43] 10Cloud-Services, 10Operations, 10Traffic, 10Puppet, 10Technical-Debt: Uniform cluster nomenclature across puppet - https://phabricator.wikimedia.org/T159411#3643100 (10ema) p:05Triage>03Normal [15:07:33] (03CR) 10Lokal Profil: [C: 031] "one typo otherwise ok to merge" (031 comment) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381192 (owner: 10Jean-Frédéric) [15:29:13] 10Data-Services: Service name aliases in *.{analytics,web}.db.svc.eqiad.wmflabs missing for non-wiki databases - https://phabricator.wikimedia.org/T176978#3643233 (10bd808) [15:32:34] 10Toolforge, 10Wiki-Loves-Monuments-Database: Toolforge tool.heritage webservice keeps crashing - https://phabricator.wikimedia.org/T176110#3643262 (10Lokal_Profil) @JeanFred Is it the categorization job which made the DB sad today? [15:45:50] 10Data-Services: Service name aliases in *.{analytics,web}.db.svc.eqiad.wmflabs missing for non-wiki databases - https://phabricator.wikimedia.org/T176978#3643344 (10bd808) Is centralauth in s7 the only database like this? [15:48:09] 10Toolforge, 10Wiki-Loves-Monuments-Database: Toolforge tool.heritage webservice keeps crashing - https://phabricator.wikimedia.org/T176110#3643363 (10JeanFred) >>! In T176110#3643262, @Lokal_Profil wrote: > @JeanFred Is it the categorization job which made the DB sad today? I filed T176982 for the underlying... [15:52:17] (03PS4) 10Jean-Frédéric: Add `base` parameter for France in French (fr_fr) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381192 [16:11:19] 10Data-Services: Service name aliases in *.{analytics,web}.db.svc.eqiad.wmflabs missing for non-wiki databases - https://phabricator.wikimedia.org/T176978#3643518 (10bd808) >>! In T176978#3643344, @bd808 wrote: > Is centralauth in s7 the only database like this? ``` (u3518@centralauth.labsdb) [information_schem... [17:25:05] PROBLEM - Puppet errors on tools-exec-1413 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [17:43:46] https://www.mediawiki.org/wiki/Manual_talk:Pywikibot/PAWS#Cannot_start_server_.28error_500.29_again not sure who can look into that [17:52:20] 10cloud-services-team (FY2017-18), 10Goal, 10Patch-For-Review, 10User-bd808: Perform core Cloud Services rebranding - https://phabricator.wikimedia.org/T168480#3643969 (10RobH) [17:55:17] 10Cloud-Services, 10Wikimedia-Mailing-lists, 10Patch-For-Review: Create cloud mailman list and archive labs-l list - https://phabricator.wikimedia.org/T175190#3643981 (10RobH) * create new list * export listing of old lists members, mass subscribe to new list with welcome message outlined with @bd808 * disab... [18:00:02] RECOVERY - Puppet errors on tools-exec-1413 is OK: OK: Less than 1.00% above the threshold [0.0] [18:40:47] 10Cloud-Services, 10Wikimedia-Mailing-lists, 10Patch-For-Review: Create cloud mailman list and archive labs-l list - https://phabricator.wikimedia.org/T175190#3585613 (10Nemo_bis) Thanks. If I'm not mistaken, the individual preferences for the list were not migrated (I had delivery disabled on labs-l, but en... [18:51:50] 10Cloud-Services, 10Wikimedia-Mailing-lists, 10Patch-For-Review: Create cloud mailman list and archive labs-l list - https://phabricator.wikimedia.org/T175190#3644208 (10bd808) >>! In T175190#3644147, @Nemo_bis wrote: > Thanks. If I'm not mistaken, the individual preferences for the list were not migrated (I... [18:55:40] 10Cloud-Services, 10Wikimedia-Mailing-lists, 10Patch-For-Review: Create cloud mailman list and archive labs-l list - https://phabricator.wikimedia.org/T175190#3644221 (10Nemo_bis) I see 54 digested members and several with delivery disabled at https://lists.wikimedia.org/mailman/roster/cloud , so I think it... [19:06:59] I have to submit the microtask assigned. I am done writing the text file containing explaination of script. But, not able to use git commands for pushing the code on gerrit. [19:11:29] Mridu: not able to use git commands for pushing the code on gerrit. <= why not? [19:13:15] The folder in which I have my text file saved is not a git repository :/ [19:14:55] Mridu: do you have a clone of the git repository somewhere? [19:15:14] you can copy the file there and then do the rest of the git operations [19:16:29] bd808: clone of the git repository somewhere. As in the tools-webservice folder? [19:16:46] yes [19:17:08] there is also https://tools.wmflabs.org/gerrit-patch-uploader/ but better to learn the git/git-review commands [19:17:19] part of this microtask is to help you get used to using git and the related tools [19:17:29] heh :) fair [19:18:17] bd808, mutante, zhuyifei1999 : Thanks, yes will do :) [19:33:38] PROBLEM - Puppet errors on tools-webgrid-generic-1404 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [19:51:01] Have pushed the file. But, I am seeing some red patches. Are those for removing the whitespaces? [19:54:10] https://gerrit.wikimedia.org/r/#/c/381296/1/Outreachy-task.mridub.txt [19:54:18] (03PS21) 10MarcoAurelio: Update composer.json to use MW_CodeSniffer and fix detected issues [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/380355 (https://phabricator.wikimedia.org/T176635) [19:55:39] bd808: I'm about to merge https://gerrit.wikimedia.org/r/#/c/380355/ -- any concerns? [20:08:36] RECOVERY - Puppet errors on tools-webgrid-generic-1404 is OK: OK: Less than 1.00% above the threshold [0.0] [20:32:52] tabbycat: no concerns from me. that's your stuff :) [20:33:27] bd808: well, we both are mantainers there :) I don't want to break anything, although I can revert if that happens [20:33:38] any way to test that before merging? [20:33:55] I'm a maintainer because y'all added me. I haven ever really touched this stuff [20:34:14] I think I was going to help with an irc bot at some point but the time never materilized [20:34:32] I'll merge. If stuff breaks, I'll create a revert commit [20:34:41] it's a tool after all [20:37:56] PROBLEM - Puppet errors on tools-worker-1020 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [20:39:49] (03CR) 10MarcoAurelio: [C: 032] Update composer.json to use MW_CodeSniffer and fix detected issues [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/380355 (https://phabricator.wikimedia.org/T176635) (owner: 10MarcoAurelio) [20:39:58] lets break the site :P [20:41:43] (03Merged) 10jenkins-bot: Update composer.json to use MW_CodeSniffer and fix detected issues [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/380355 (https://phabricator.wikimedia.org/T176635) (owner: 10MarcoAurelio) [20:43:44] !log tools.stewardbots Updated stewardbots to e16525b [20:43:47] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stewardbots/SAL [20:44:23] well bd808 it seems everything is working :D [20:44:52] \o/ [20:45:20] !log tools.stewardbots Updated stewardbots to e16525b - T176635 [20:45:22] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stewardbots/SAL [20:45:22] T176635: Update composer.json to use MediaWiki CodeSniffer and fix detected issues - https://phabricator.wikimedia.org/T176635 [20:46:02] 10Tool-stewardbots, 10User-MarcoAurelio: Update composer.json to use MediaWiki CodeSniffer and fix detected issues - https://phabricator.wikimedia.org/T176635#3644684 (10MarcoAurelio) 05Open>03Resolved p:05Triage>03Normal a:03MarcoAurelio [20:46:58] I now have to make those tools listen to ug_expiry [20:47:02] grr [20:47:10] 10cloud-services-team (FY2017-18), 10Goal, 10Patch-For-Review, 10User-bd808: Perform core Cloud Services rebranding - https://phabricator.wikimedia.org/T168480#3644692 (10bd808) [20:47:12] 10Cloud-Services, 10Wikimedia-Mailing-lists, 10Patch-For-Review: Create cloud mailman list and archive labs-l list - https://phabricator.wikimedia.org/T175190#3644691 (10bd808) 05Open>03Resolved [20:48:56] (03PS1) 10Rush: hiera keys for pdns_server in openstack deployments [labs/private] - 10https://gerrit.wikimedia.org/r/381345 [20:49:30] 10cloud-services-team (FY2017-18), 10Goal, 10Patch-For-Review, 10User-bd808: Perform core Cloud Services rebranding - https://phabricator.wikimedia.org/T168480#3644696 (10bd808) [20:49:58] (03CR) 10Rush: [V: 032 C: 032] hiera keys for pdns_server in openstack deployments [labs/private] - 10https://gerrit.wikimedia.org/r/381345 (owner: 10Rush) [20:57:20] 10Toolforge, 10Outreachy (Round-15): Outreachy - webservice microtask for Mridu_Bhatnagar - https://phabricator.wikimedia.org/T176018#3644722 (10Mridu_Bhatnagar) [21:12:59] RECOVERY - Puppet errors on tools-worker-1020 is OK: OK: Less than 1.00% above the threshold [0.0] [21:17:04] Nemo_bis, Nikerabbit, I'm cleaning up salt in various places and I note that the ttm-server project has a local saltmaster. Do you have thoughts about what I should do about that? (It's almost certainly broken since we've been purging salt elsewhere for a few days now) [21:21:11] (03CR) 10Lokal Profil: [C: 032] Add `base` parameter for France in French (fr_fr) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381192 (owner: 10Jean-Frédéric) [21:23:21] (03Merged) 10jenkins-bot: Add `base` parameter for France in French (fr_fr) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381192 (owner: 10Jean-Frédéric) [21:25:19] !log paws server docker restart on paws-node-1002; disk is full and docker is holding open a lot of deleted files [21:25:21] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [21:25:36] (03CR) 10jenkins-bot: Add `base` parameter for France in French (fr_fr) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381192 (owner: 10Jean-Frédéric) [22:03:12] (03PS1) 10Lokal Profil: Fix incorrect mapping in am_hy [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381361 (https://phabricator.wikimedia.org/T176991) [22:31:53] (03PS1) 10Lokal Profil: Add unmapped field for al_sq [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381364 [22:54:33] (03PS2) 10Lokal Profil: Add unmapped fields for al_sq [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381364 [23:15:55] 10Data-Services, 10cloud-services-team (Kanban), 10User-bd808: Service name aliases in *.{analytics,web}.db.svc.eqiad.wmflabs missing for non-wiki databases - https://phabricator.wikimedia.org/T176978#3645030 (10bd808) 05Open>03Resolved a:03bd808 ``` $ sql -vv --cluster=analytics centralauth Looking up... [23:19:36] 10cloud-services-team, 10Community-Tech, 10DBA, 10Security: create production ip_changes table for RangeContributions - https://phabricator.wikimedia.org/T173891#3645038 (10MaxSem) [23:25:27] (03CR) 10Jean-Frédéric: [C: 032] Add unmapped fields for al_sq [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381364 (owner: 10Lokal Profil) [23:25:52] (03CR) 10Jean-Frédéric: [C: 032] Fix incorrect mapping in am_hy [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381361 (https://phabricator.wikimedia.org/T176991) (owner: 10Lokal Profil) [23:26:53] (03Merged) 10jenkins-bot: Add unmapped fields for al_sq [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381364 (owner: 10Lokal Profil) [23:27:16] (03Merged) 10jenkins-bot: Fix incorrect mapping in am_hy [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381361 (https://phabricator.wikimedia.org/T176991) (owner: 10Lokal Profil) [23:28:12] 10cloud-services-team, 10Community-Tech, 10DBA, 10Security: Create core ip_changes view for replicas - https://phabricator.wikimedia.org/T173891#3645059 (10MusikAnimal) [23:28:17] (03CR) 10jenkins-bot: Add unmapped fields for al_sq [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381364 (owner: 10Lokal Profil) [23:28:42] !log tools.heritage Deploy latest from Git master: a95cf25, 65e95f8, 199f01b (T176118), 54a71d9 (T176991) [23:28:48] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.heritage/SAL [23:28:48] T176991: Armenia harvest partially broken - https://phabricator.wikimedia.org/T176991 [23:28:48] T176118: [al-sq] Base class for Albania - https://phabricator.wikimedia.org/T176118 [23:29:25] 10cloud-services-team, 10Community-Tech, 10DBA, 10Security: Create core ip_changes view for replicas - https://phabricator.wikimedia.org/T173891#3543452 (10MusikAnimal) The table is now live and populated on all wikis, so I've repurposed this ticket for creating the replicas view. Hope that is OK. Any upda... [23:29:27] (03CR) 10jenkins-bot: Fix incorrect mapping in am_hy [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/381361 (https://phabricator.wikimedia.org/T176991) (owner: 10Lokal Profil)