[00:28:50] !log tools added nfs.* to ignored_fs_types for the prometheus::node_exporter params in project hiera T252260 [00:28:54] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [00:28:55] T252260: Try out removing the nfs client probes from the node exporter on VMs - https://phabricator.wikimedia.org/T252260 [12:48:46] !log tools.paws installed travis hook [12:48:49] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.paws/SAL [12:49:55] !log tools.paws triggering travis build [12:49:56] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.paws/SAL [12:52:05] !log tools.paws nope that doesn't work, lacks variables from old repo [12:52:07] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.paws/SAL [13:04:29] !log tools.paws `chicocvenancio@tools-paws-master-01:~/paws$ git pull` [13:04:31] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.paws/SAL [13:31:51] !log tools.paws `root@tools-paws-master-01:/home/chicocvenancio/paws# git pull && ./build.py deploy prod` T252290 [13:31:55] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.paws/SAL [13:31:55] T252290: Update Pywikibot to the most recent version - https://phabricator.wikimedia.org/T252290 [13:45:32] is it possible to run queries that take more than an hour to run? [15:14:40] !log tools.indic-wscontest Strip the whitespace around usre admin (T252281) [15:14:43] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.indic-wscontest/SAL [15:14:43] T252281: indic-wscontest: few stats pages have no "edit" button. - https://phabricator.wikimedia.org/T252281 [15:16:26] Betacommand: right now, no. We had hardware/software problems with one wiki replica server and had to lower the timeout on the analytics replicas because of the load on the remaining 2 servers. The server that had issues is being reloaded with data now. (T249188) [15:16:26] T249188: Reimage labsdb1011 to Buster and 10.4 - https://phabricator.wikimedia.org/T249188 [16:18:08] Lots and lots of hack-at-home activity happening over in the #wmhack channel. All of my blues about not being in Tirana this weekend are melting away. :) More info at https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2020/Remote_Hackathon [16:19:39] Hi everybody [16:20:27] I'm having some trouble with cron. I cannot run my robot every night as I did before [16:20:58] var-log-messages displays some wird error I cannot understand [16:21:45] Is it possible the whole cron for tools is not working? [16:21:51] thanks in advance [16:53:30] !log admin rebuilding cloudcontrol2001-dev and 2003-dev with buster for T252121 [16:53:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [16:53:34] T252121: Rebuild cloudcontrol hosts with Debian buster - https://phabricator.wikimedia.org/T252121 [18:56:27] darn. paucabot left before I saw that question. I wish I knew what tool so I could check the logs for them. [19:40:49] !log tools.lexeme-forms deployed b4780fa832 (drag’n’drop unmatched forms in edit mode) [19:40:52] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-forms/SAL [19:45:17] Looks like they have only one tool, https://admin.toolforge.org/admin/tool/rebot [19:54:46] thanks AntiComposite. I'll try to peek at their logs in a bit [20:17:05] I will let you know when I see paucabot and I will deliver that message to them [20:17:05] @notify paucabot https://wikitech.wikimedia.org/wiki/User_talk:Paucabot#Your_cronjob_problem_reported_on_irc_2020-05-09 [21:01:23] Is there a guide how to use OAuth on tools.wmflabs.org/? [21:04:49] acagastya: there are a few. One is https://wikitech.wikimedia.org/wiki/Help:Toolforge/My_first_Flask_OAuth_tool [21:05:11] Thank you bd808. I will have a look. [21:05:14] for OAuth basics there is also https://www.mediawiki.org/wiki/OAuth/For_Developers [21:05:59] Phew, there is one with NodeJS too. [21:06:32] Thank you! [21:06:36] sure! [21:07:09] If you run into problems with the nodejs tutorial ask questions. srish_aka_tux wrote that one initially [21:08:11] acagastya: also, I would recommend using `webservice --canonical` for any new tools you are building with OAuth. More info at https://wikitech.wikimedia.org/wiki/News/Toolforge.org [21:08:59] that will save you the hassle of updating things in a few weeks/months when we make $TOOL.toolforge.org the default naming scheme [21:09:49] Okay, I will keep that in my mind. Though I don't have any idea as a newbie what it is supposed to be. [21:12:37] * bd808 needs to fold the new stuff that webservice does into the main documentation [21:32:50] bd808: toolforge does not have MongoDB, right? [21:37:46] acagastya: nope [21:44:26] unfortunately Toolforge is not web scale. ;) [21:45:36] acagastya: there is an elasticsearch cluster that could be used for some types of json blob storage/retrieval. Info at https://wikitech.wikimedia.org/wiki/Help:Toolforge/Elasticsearch [21:58:08] What about redis? [22:25:19] acagastya: yes, there is a redis service available -- https://wikitech.wikimedia.org/wiki/Help:Toolforge/Redis_for_Toolforge [22:26:03] Ah, that is great! [22:26:05] Thanks. [22:48:17] I see on the mailing list people are talking about why replica DBs don't allow creation of tables by users and it makes sense but can anybody explain why temporary tables aren't allowed either? [22:50:06] leloiandudu: I know that was discussed. Let me see if I can find the real answer in an old phab task before I make something up. :) [22:53:42] leloiandudu: T179628 has a lot of discussion of that topi, including the DBA team's rationale for not allowing it. [22:53:43] T179628: Consider granting `CREATE TEMPORARY TABLES` to labsdbuser - https://phabricator.wikimedia.org/T179628 [22:53:54] thank you! [22:54:20] I think the TL;DR is that it messes with replication in MariaDB [23:02:06] bd808: thank you. what's my best option then? I have a tool that builds a tree of categories (all parent categories for articles in a certain category) and what I used to do before is to load the whole category tree from the replica and filter it afterwards. but now the number of categories in ruwiki is so huge the query times out. So it would make [23:02:06] sense to do the filtering in the database instead. But the current installed version of MariaDB doesn't support recursive CTEs and temporary tables are not allowed either. I don't see any way of building recursive parent categories anymore. [23:40:36] !log tools.indic-wscontest Added points table of contributions (T251922) [23:40:40] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.indic-wscontest/SAL [23:40:40] T251922: Indic-wscontest: Neet out put table like that image - https://phabricator.wikimedia.org/T251922 [23:49:07] leloiandudu: hmmm... no perfect ideas off the top of my head. I keep thinking there is some tool running in Cloud VPS that does fancy things with categories, but I can't remember what it is. [23:51:44] bd808 well, there is https://petscan.wmflabs.org, but I don't think it can help me [23:56:50] I guess the only option I have is to query each level separately from the app until I reach the top of the tree, which will take longer and create more load on the server than a CTE/temp table... [23:57:11] leloiandudu: have you tried using the Action API to fetch the categories? [23:57:37] almost anything that can happen using an api is better than using the replicas directly [23:57:44] bd808 it's going to be the same - repeatedly calling the API to go one level up [23:59:20] yes. but software can do that :) and it will honestly be faster than the replicas to get each batch. and the api already does pagination to keep things from getting overloaded for each chunk