[09:56:46] (03CR) 10MarcoAurelio: "recheck" [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423713 (https://phabricator.wikimedia.org/T174287) (owner: 10Rxy) [09:58:00] (03CR) 10MarcoAurelio: "My python is scarce. I'd prefer if somebody with better python knowledge could review instead." [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423713 (https://phabricator.wikimedia.org/T174287) (owner: 10Rxy) [11:56:56] !log rcm Xenon: Package updates [11:56:57] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Rcm/SAL [11:57:00] !log rcm Tin: Package updates [11:57:01] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Rcm/SAL [14:38:30] (03CR) 10Zhuyifei1999: "CR on the python parts. No comment on functionality." (034 comments) [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423713 (https://phabricator.wikimedia.org/T174287) (owner: 10Rxy) [14:45:35] Who's on call for the cloud team? [14:46:34] i think bd808 [14:46:43] according to the notice in -admin [14:47:03] eddiegp: Bryan is on call, but !help here will alert the oncall person [14:47:36] we are trying to get folks out of the habit of pinging a single person :) [14:47:42] And me, sometimes I'll be able to help... [14:48:00] Well I'm trying to find out who to pm for a security-related question I don't want to discuss in a public channel ;) [14:48:22] eddiegp: you can always pm me for those kinds of things [14:56:23] Technical Advice IRC meeting starting in 5 minutes in channel #wikimedia-tech, hosts: @amir1 & @Lucas_WMDE - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [15:46:33] hi [15:46:39] this https://tools.wmflabs.org/nagf/?project=git seems to be failing [15:48:01] several projects are giving 404 there [15:48:07] yeh [15:48:30] and ones that work, (doin't throw 404) and having blank images [15:48:41] from the console for the integration project i get this [15:48:43] https://graphite-labs.wikimedia.org/render/?title=integration-slave-docker-1003+Network+packets+last+day&width=800&height=250&from=-1day&hideLegend=false&uniqueLegend=true&target=alias%28integration.integration-slave-docker-1003.network.eth0.rx_packets%2C%22Packets+received%22%29&target=alias%28integration.integration-slave-docker-1003.network.eth0.tx_packets%2C%22Packets+sent%22%29 [15:49:09] makes sense [15:49:28] * chicocvenancio was waiting on graphite-labs [15:49:50] does this have a task yet, paladox ? [15:49:57] nope [15:54:16] im on https://tools.wmflabs.org/nagf/?project=cvn [15:54:19] and it still loading [15:54:22] 1.3+ mins now [15:54:32] (the css loaded, but it's still trying to load the graphs) [15:55:19] some of the metrics that were giving me a 502 started working again, we're looking into it [15:55:30] thanks [15:55:43] * bd808 guesses that something is slamming the graphite collector [16:14:06] paladox: I see a load/io spike in the monitor server, is all working better now? [16:14:33] arturo hi, yes some projects have started working again, though some show as project missing still [16:14:35] like git [16:14:52] arturo: that is in nagf [16:16:15] paladox: maybe see the stats in graphite-labs for the moment? [16:16:21] yep [16:16:23] i can :) [20:12:37] !log deployment-prep Try dsh scap config for ORES [20:12:41] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL [21:24:29] !log deployment-prep Roll back beta ORES [21:24:32] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL