[12:46:25] !log tools deploy changes to tools-prometheus to account for the new k8s cluster (T237643) [12:46:33] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [12:46:33] T237643: toolforge: new k8s: figure out metrics / observability - https://phabricator.wikimedia.org/T237643 [13:49:23] !log tools re-create nginx-ingress pod due to deployment template refresh (T237643) [13:49:27] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [13:49:27] T237643: toolforge: new k8s: figure out metrics / observability - https://phabricator.wikimedia.org/T237643 [17:02:35] I was testing a fork of https://tools.wmflabs.org/afdstats at https://tools.wmflabs.org/ahechtbot , and it was working fine 10 days ago, but now I am getting a python error when I import MySQLdb: "No module named MySQLdb". I haven't changed my lighttpd or tool configuration since then, so what would have changed? [17:02:35] https://tools.wmflabs.org/ahechtbot/afdstats.py?name=Ahecht for an example [17:06:52] mySQLdb seems to be installed at /usr/lib/python2.7/dist-packages [18:18:38] ahecht: can you check again? it looks like it's working now [18:52:06] phamhi: Looks like it's working again. According to the logs, someone restarted my webservice twice since i posted that, so that may have fixed the issue. [18:52:16] yah that was me [18:52:45] thanks [19:25:16] !log wikiloop create project with project admins xinbenlv and zzn_google T237297 [19:25:19] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikiloop/SAL [19:25:21] T237297: Request creation of WikiLoop VPS project - https://phabricator.wikimedia.org/T237297 [19:35:09] !log bishopfox create project with project admins danbishopfox, danbishopfox2, mfrostbfox, mfrostbfox1 T238222 [19:35:12] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Bishopfox/SAL [19:35:12] T238222: Request creation of BishopFox VPS project - https://phabricator.wikimedia.org/T238222 [20:16:09] !log openstack cleanup novastats dnsleaks left over from cloudvirt1024 stress tests [20:16:10] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Openstack/SAL [21:36:51] !log sentry deleting all instances as per notes on https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#In_use_sentry [21:36:52] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Sentry/SAL [21:44:22] Heya, why do we use Python 3.5 on Toolforge? My pywikibot scripts need 3.6 or higher. [21:46:52] Because that's what's supported in Debian Stretch [21:48:08] Ah :( [21:50:06] DutchTina[m]: there's been some recent work on that, if you run `webservice --help` you can view the available versions [21:50:33] if you're using the kubernetes backend you can run `webservice --backend=kubernetes python3.7` [21:51:41] ooh nice [21:55:20] Hmm [21:55:26] I don't think there's a (good) way to do grid-like jobs on k8s at the moment though, so there's not a ton of benifit to me atm [21:58:16] So I just need to rebuild my script to make it compatible with 3.5 [22:01:46] If it's a continuous task, you could run it on kubernetes. If it's something you're running via cron, rewriting for 3.5 and using the grid is the only decent option at the moment. [22:03:46] Yeah I'm running via cron so rewriting is the only option. Thanks anyway :)