[02:15:49] <AntiComposite>	 https://grafana-labs.wikimedia.org/dashboard/db/labs-project-board?var-project=tools&var-server=All&panelId=20&fullscreen&orgId=1
[02:16:07] * AntiComposite wonders how many tools run at midnight UTC
[07:48:32] <legoktm>	 probably a lot that are on @daily crons
[07:48:45] <legoktm>	 you can totally see the @hourly spikes too
[13:41:52] <jeh>	 !log tools Set icingia downtime for toolschecker labs showmount T229448
[13:41:56] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[13:41:58] <stashbot>	 T229448: showmount not working on labstore1004 - https://phabricator.wikimedia.org/T229448
[16:48:15] <wm-bot>	 !log tools.lexeme-senses <lucaswerkmeister> deployed b5ebc18d3e (fix SPARQLWrapper usage)
[16:48:18] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-senses/SAL
[17:02:42] <jeh>	 !log openstack increase wikidata-query cpu quota T230247
[17:02:45] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Openstack/SAL
[17:02:45] <stashbot>	 T230247: Increase VCPU quota for wikidata-query project - https://phabricator.wikimedia.org/T230247
[19:03:22] <halfak>	 o/ zhuyifei1999_  You around? 
[19:03:31] <zhuyifei1999_>	 yeah
[19:03:37] <halfak>	 I'm working on doing some archeology in quarry's DB. 
[19:03:53] <halfak>	 Can you remind me which host to connect to in order to run some queries directly?
[19:04:14] <zhuyifei1999_>	 quarry-db-01.quarry.eqiad.wmflabs
[19:04:15] <halfak>	 (I think I accidentally overwrote an important query, so I want to look back for an old query run)
[19:04:17] <halfak>	 Thanks
[19:04:23] <zhuyifei1999_>	 np
[19:11:42] <halfak>	 I FOUND IT!
[19:11:44] <halfak>	 Mwahahaha!
[19:12:01] <halfak>	 No DB can resist my archaeological prowess 
[19:14:49] <zhuyifei1999_>	 lol
[21:51:21] <MaxSem>	 Hey, can I get some help with https://phabricator.wikimedia.org/T229551 please?
[21:52:11] <MaxSem>	 Why would virtualenv not see packages on grid nodes while everything works on the bastion?
[21:55:16] <jeh>	 Hi MaxSem How are you launching the grid job?
[22:00:37] <bstorm_>	 !log tools truncated exim paniclog on tools-sgecron-01 because it was being spammy
[22:00:39] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[22:09:26] <MaxSem>	 jeh, via cron, e.g. 09 00 * * 1 /usr/bin/jsub -N cron-tools.database-reports-2 -quiet /data/project/database-reports/reports/database-reports/venv/bin/python /data/project/database-reports/reports/database-reports/main.py en forgotten_articles
[22:19:42] <bstorm_>	 MaxSem provided a possible idea to toy with in the ticket
[22:20:00] <bstorm_>	 I don't know if that will help or not.
[22:20:57] <MaxSem>	 Thanks, looking into this
[22:27:12] <bstorm_>	 !log tools.cdnjs truncated the log files -- they were getting long
[22:27:15] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cdnjs/SAL