[03:56:23] (03PS188) 10Ricordisamoa: Initial commit [labs/tools/wikidata-slicer] - 10https://gerrit.wikimedia.org/r/241296 [04:06:02] (03CR) 10Ricordisamoa: [C: 04-2] "PS188 moves data extraction from DragHelper to Section" [labs/tools/wikidata-slicer] - 10https://gerrit.wikimedia.org/r/241296 (owner: 10Ricordisamoa) [04:09:47] (03PS189) 10Ricordisamoa: Initial commit [labs/tools/wikidata-slicer] - 10https://gerrit.wikimedia.org/r/241296 [04:20:47] (03CR) 10Ricordisamoa: [C: 04-2] "PS189 updates ESLint from ~4.10.0 to ~4.11.0" [labs/tools/wikidata-slicer] - 10https://gerrit.wikimedia.org/r/241296 (owner: 10Ricordisamoa) [04:23:07] (03PS190) 10Ricordisamoa: Initial commit [labs/tools/wikidata-slicer] - 10https://gerrit.wikimedia.org/r/241296 [04:27:38] (03CR) 10Ricordisamoa: [C: 04-2] "PS190 updates rollup from 0.50.0 to 0.51.3, rollup-plugin-buble from 0.16.0 to 0.17.0" [labs/tools/wikidata-slicer] - 10https://gerrit.wikimedia.org/r/241296 (owner: 10Ricordisamoa) [08:48:16] !help any staff active in here? [08:48:16] Cullen328_: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team [08:49:47] We should unblock every single user in Wikipedia and wikimedia [10:04:12] hey! :-) [17:10:18] Hi, does an DB admin is available here? [17:11:10] I was accessing DB p50380g50494_data on 'enwiki.labsdb'... but this DB seems not available anymore.. so the Wikipedia EN WP1 bot is dead since November 1st [17:11:34] things seems partially available at c1.labsdb... but not all tables seem to be here. [17:12:04] Kelson: https://lists.wikimedia.org/pipermail/cloud/2017-November/000085.html [17:15:08] valhallasw`cloud: ok, so what should I change.. It seems I simply do not have access to c3.labsdb! [17:16:50] valhallasw`cloud: enwiki.analytics.db.svc.eqiad.wmflabs and enwiki.web.db.svc.eqiad.wmflabs give me an access_denied [17:17:23] Kelson: that could be because you're using ancient p50380g50494 credentials [17:17:55] the replica.my.cnf files that used those were replaced a long time ago, but the user accounts were kept in case the configuration data was used somewhere else [17:18:10] it's quite likely that these deprecated accounts were not created on the new database servers [17:18:40] but s3.labsdb (=labsdb1003.eqiad.wmnet) should still work with the old credentials I think? [17:18:47] valhallasw`cloud: ok, indeed looks like? How should I proceed to get new credential to access both my db and WP mirrors? [17:19:00] mysql -h labsdb1003.eqiad.wmnet works for me [17:19:37] the p50380g50494_data database is on labsdb1001.eqiad.wmnet, though [17:20:11] so you can get it from there, and copy it to labsdb, which is the supported and backed up location for user databases [17:21:59] valhallasw`cloud: thx, let check first if labsdb1001.eqiad.wmnet is OK [17:22:18] valhallasw`cloud: is labsdb1001.eqiad.wmnet = c3.wmflabs ? [17:22:44] c1 = labsdb1001, c3 = labsdb1003 I think [17:23:17] valhallasw`cloud: ok, but C1 is done... looks like I have acces, but looks like not all the data are here. [17:23:58] (03PS1) 10Legoktm: Add labs/tools/stewardbots [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/390663 (https://phabricator.wikimedia.org/T180282) [17:24:08] Kelson: that could be due to the hard drive crash [17:24:59] (03CR) 10Legoktm: [C: 032] Add labs/tools/stewardbots [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/390663 (https://phabricator.wikimedia.org/T180282) (owner: 10Legoktm) [17:25:14] (03Merged) 10jenkins-bot: Add labs/tools/stewardbots [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/390663 (https://phabricator.wikimedia.org/T180282) (owner: 10Legoktm) [17:27:13] (03PS1) 10Legoktm: Only auto +2 in mediawiki/ repos [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/390664 [17:27:16] valhallasw`cloud: so, you mean we face here a data lost? [17:27:26] could very well be, yes. [17:27:27] (03CR) 10Legoktm: [C: 032] Only auto +2 in mediawiki/ repos [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/390664 (owner: 10Legoktm) [17:27:41] (03Merged) 10jenkins-bot: Only auto +2 in mediawiki/ repos [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/390664 (owner: 10Legoktm) [17:27:45] (03CR) 10Legoktm: [C: 032] Improve "composer fix" setting [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/388858 (owner: 10Legoktm) [17:27:59] (03Merged) 10jenkins-bot: Improve "composer fix" setting [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/388858 (owner: 10Legoktm) [17:42:44] valhallasw`cloud: It seems that my database is somehow not attached neither to me or any tool name. Do you know how to fix that? [17:42:52] in what sense? [17:43:08] valhallasw`cloud: here https://tools.wmflabs.org/tool-db-usage/. The db is listed on c1.... [17:43:25] valhallasw`cloud: but is marked as UNKNOWN [17:43:38] Kelson: yes, because it's an old account [17:43:56] all the g*p* mapping on that page were manually added [17:44:57] valhallasw`cloud: how can I update this mapping? [17:45:16] Kelson: you can send a pull request, but that mapping has nothing to do with access rights [17:45:34] you need the password for the p50380g50494 account [17:48:16] although given that the project only seems to use it to map namespaces, you might be better off just getting that data from the api [17:49:32] valhallasw`cloud: ok.. I have to admin that I really barely follow what you explain to me. [17:50:01] valhallasw`cloud: I have to leave now... just how somehow that the data will be migrated to the new DB backend... and then I can find a way to access them [17:50:18] valhallasw`cloud: thx for you help [17:50:52] Kelson: given that the tool could access the tables at some point, the username/password to do so should be somewhere [18:19:04] valhallasw`cloud: so, I'm back [18:19:37] Kelson: from what I can see, the enwp10 project user has access to that database, so you should be able to make a dump of it [18:19:40] valhallasw`cloud: do you know where is the new replica.my.cnf for .analytics.db.svc.eqiad.wmflabs? Do I need to require one specific to me? [18:19:49] valhallasw`cloud: I have access [18:19:55] you cannot create new tables on those servers [18:20:25] user tables can only be created on toolsdb [18:20:29] valhallasw`cloud: the point now is (1) do I have all the data (2) how to migrate things to tools.labsdb [18:20:50] (3) have access to the .analytics.db.svc.eqiad.wmflabs [18:21:05] the username/password in replica.my.cnf -- at least when it's a sXXXXX username, should give you access to all the servers [18:21:14] valhallasw`cloud: I need both access to the copy of the wiki DBs and have my own tables [18:21:53] That's not possible on the new database servers. You'll have to make connections to two databases in your code. [18:22:22] valhallasw`cloud: yes [18:22:29] ok (3) is good :) [18:23:06] valhallasw`cloud: so you mean, for (2), I just need to create the table (redump with mysqldump) into tools.labsdb? [18:23:13] yes [18:23:20] valhallasw`cloud: ok... [18:24:23] mysqldump --defaults-file=replica.my.cnf -h c1.labsdb p50380g50494_data, or something along those [18:25:00] valhallasw`cloud: have already backuped things.... not at the "upload stage" [18:25:40] mysql --defaults-file=replica.my.cnf -h c1.labsdb sXXXXX_data < dump.sql, then? [18:28:02] valhallasw`cloud: hmmm, not on c1 [18:28:16] valhallasw`cloud: I need to reupload to tools.db.svc.eqiad.wmflabs IMO?! [18:28:25] Yes, you're right [18:28:51] valhallasw`cloud: ERROR 1049 (42000): Unknown database 's51114_data' [18:52:52] Kelson: run create database s51114_data; in mysql --defaults-file=replica.my.cnf -h c1.labsdb [18:56:12] valhallasw`cloud: oh... I'm tired. [18:56:19] valhallasw`cloud: sounds on the right way now [18:56:27] it's a bit confusing that it's a seperate step [18:56:54] valhallasw`cloud: yes, and in fact I'm not used of so much freedom [18:57:02] valhallasw`cloud: I have created s51114_enwp10 [18:57:42] valhallasw`cloud: If data upload works well, I will still have to modify the bot... [18:57:50] >_> I keep using c1.labsdb where I mean tools.db.svc. etc [18:57:56] right [19:00:26] valhallasw`cloud: I had translated ;)