[09:26:36] Hey folks! I have some new ORES article quality tables on euwiki [09:26:48] And I'd like to have them show up in labsdb. They aren't yet. Does something need to be kicked? [09:26:53] * halfak makes a task. [09:28:19] yeah I think tables are whitelisted [09:36:47] zhuyifei1999_, we have the exact same tables whitelisted on other wikis. [09:36:51] Does that matter? [09:37:05] um dunno [09:38:31] Gotcha. no worries. [09:38:36] * halfak continues towards a task. [09:38:36] I think the whitelists is in a yaml, and to apply the yaml someone might have to run some script that actually generates the views [09:38:48] aha! That makes sense. [09:38:54] not too sure about the procedure [09:39:00] Can't have a view of a table until it exists. [09:39:11] :) [10:31:55] zhuyifei1999_, https://phabricator.wikimedia.org/T199987 [10:32:15] I'm not sure if I tagged that correctly. Please feel free to edit or suggest anything I missed. [10:32:31] Also chasemp, is this something you could help me get into the backlog? [10:38:03] Off hand I will say views are only created for tables that exist at the time of a maintain-viewa run, I will look today at a few things [11:06:21] chasemp, gotcha. So I guess I'm requesting a "maintain-views" run then :) [11:21:28] halfak: I had a minute so I got into it, see if things are better when you get a chance [11:21:33] * chasemp wanders off to find lunch [12:50:51] hi hi! [12:51:02] Anyone have any idea how to permenently set swap off on a cloud VPS? :D [12:51:12] What I just tried didn't seem to cut the mustard [12:51:20] https://www.irccloud.com/pastebin/WT6SkTZx/ [13:14:50] addshore: I would guess that Puppet is going to fight against some of those changes... maybe we need to create a "swapoff" role? [13:15:09] there might be something like that hidden in toolforge roles somewhere... [13:22:00] bd808: ack [13:29:04] addshore: at the underlying compute node we seem to use -- labs_lvm::swap -- to enable swap. I can't find a swapoff version (`git grep swapoff` only hits on the lvm module we imported from upstream somewhere) [13:32:27] bd808: thanks! [13:34:15] bd808: best route forward then is perhaps to make some swap off role? [13:35:20] I wonder how the current labs k8s cluster gets around this? or if it just ignores the fact that swap is on [13:36:05] addshore: I think that may be the right thing to do, yes. I would probably `sudo puppet agent --disable 'testing swapoff'`, then work on figuring out the changes needed, then turn that into a puppet role. And yeah... I was wondering about the TOOLFORGE k8s cluster setup too. [13:36:22] * bd808 is not subtle in correcting the made up name addshore used [14:22:49] (: [14:30:02] (03CR) 10D3r1ck01: [V: 032] Implemented image download as a small script [labs/tools/Commons-twitter-bot] - 10https://gerrit.wikimedia.org/r/437067 (https://phabricator.wikimedia.org/T190163) (owner: 10Rosalieper) [21:39:34] (03PS1) 10Lokal Profil: Batch entry of sparql results into database [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/446977 (https://phabricator.wikimedia.org/T172691) [21:41:04] (03CR) 10jerkins-bot: [V: 04-1] Batch entry of sparql results into database [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/446977 (https://phabricator.wikimedia.org/T172691) (owner: 10Lokal Profil) [21:51:48] (03PS2) 10Lokal Profil: Batch entry of sparql results into database [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/446977 (https://phabricator.wikimedia.org/T172691) [21:55:29] (03PS3) 10Lokal Profil: Investigate harvest of large wikidata dataset [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/375529 (https://phabricator.wikimedia.org/T172691) [21:58:34] (03PS4) 10Lokal Profil: Investigate harvest of large wikidata dataset [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/375529 (https://phabricator.wikimedia.org/T172691) [22:06:51] (03CR) 10Jean-Frédéric: [C: 031] "Looks great − batch inserts make a lot of sense. Just one comment on a possibly more concise way to chunk the query results." (031 comment) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/446977 (https://phabricator.wikimedia.org/T172691) (owner: 10Lokal Profil) [22:08:51] (03CR) 10Lokal Profil: "This can be tested in docker-compose using the nl-wd_nl dataset and if checking out If7dc163282f5fa7a4fdd6d42f4255aaeec602d98 with the se-" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/446977 (https://phabricator.wikimedia.org/T172691) (owner: 10Lokal Profil) [22:25:44] (03PS3) 10Lokal Profil: Batch entry of sparql results into database [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/446977 (https://phabricator.wikimedia.org/T172691) [22:27:39] (03CR) 10Lokal Profil: ">" (031 comment) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/446977 (https://phabricator.wikimedia.org/T172691) (owner: 10Lokal Profil) [22:33:57] (03PS1) 10Lokal Profil: Linter pass for update_database [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/446986 [22:35:15] (03CR) 10jerkins-bot: [V: 04-1] Linter pass for update_database [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/446986 (owner: 10Lokal Profil) [22:44:16] (03CR) 10Jean-Frédéric: [C: 032] Batch entry of sparql results into database [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/446977 (https://phabricator.wikimedia.org/T172691) (owner: 10Lokal Profil) [22:56:05] (03Merged) 10jenkins-bot: Batch entry of sparql results into database [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/446977 (https://phabricator.wikimedia.org/T172691) (owner: 10Lokal Profil) [22:57:12] (03CR) 10jenkins-bot: Batch entry of sparql results into database [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/446977 (https://phabricator.wikimedia.org/T172691) (owner: 10Lokal Profil)