[02:24:17] https://tools.wmflabs.org/admin/tools appears to have gone boom, error ID ii3tboir-1be439ac [03:28:54] !log tools Fixed rebase conflict in labs/private on tools-puppetmaster-01 [03:28:56] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [03:32:53] !log tools.admin Hotfixed hard coded reference to defunct tools-proxy-01 server [03:32:53] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.admin/SAL [03:33:08] AntiComposite: thanks. Show be sort of fixed now [03:33:12] *Should be [03:36:50] Sort of is better than not :) Thanks [04:44:12] !log tools.admin Updated to bd6ce0f (Update URL for proxy server) [04:44:13] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.admin/SAL [09:45:35] !log tools T213418 delete tools-docker-builder-05 and tools-docker-registry-01 [09:45:38] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [09:45:38] T213418: Toolforge: move docker nodes from eqiad to eqiad1 - https://phabricator.wikimedia.org/T213418 [09:46:15] !log tools T213418 delete tools-docker-registry-02 [09:46:17] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [09:51:48] !log admin T214299 failover cloudnet1004 to cloudnet1003 [09:51:51] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [09:51:51] T214299: cloudvps: neutron: upgrade jessie -> stretch - https://phabricator.wikimedia.org/T214299 [10:03:55] !log admin T214299 reimage cloudnet1004 to debian stretch [10:03:58] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:03:58] T214299: cloudvps: neutron: upgrade jessie -> stretch - https://phabricator.wikimedia.org/T214299 [11:09:32] !log tools T213421 delete tools-services-01/02 [11:09:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [11:09:35] T213421: Toolforge: move services nodes from eqiad to eqiad1 - https://phabricator.wikimedia.org/T213421 [11:50:33] !log admin T213925 modify subnet cloud-instances-transport1-b-eqiad1 to avoid floating IP allocations from here [11:50:36] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [11:50:36] T213925: CloudVPS: neutron allocates floating IPs from new transport network 208.80.155.88/29 - https://phabricator.wikimedia.org/T213925 [17:07:46] Hello. "Owner" of the php script is my account and "Group" — tool account. "Owner" of the .ini file is my account and "Group" — tool account. Owner and Group have a full permissions (770). But "Permission denied" during read .ini via php. What could be the problem? Sorry for my English. [17:10:59] Iluvatar_: hmmmm... hard to say from that description. It sounds like your permissions are correct, but obviously there is something wrong. [18:34:31] !log paws firing up paws-proxy-02 for T214613 [18:34:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [18:34:34] T214613: Move paws-proxy-01 to eqiad1-r - https://phabricator.wikimedia.org/T214613 [19:11:01] !log paws moved config, ready to receive traffic on paws-proxy-02 T214613 [19:11:04] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [19:11:04] T214613: Move paws-proxy-01 to eqiad1-r - https://phabricator.wikimedia.org/T214613 [19:20:38] !log paws shutting down paws-proxy-01 [19:20:39] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [23:46:24] I'm trying to debug a Dashboard bug related to the data we're pulling from the labs replica DB... [23:46:51] Here's a user whose edits came via the Dashboard, and got tagged as such: https://en.wikipedia.org/wiki/Special:Contributions/Gwilliams06 [23:47:31] The tag here is "OAuth CID: 1232" - https://en.wikipedia.org/w/index.php?title=Special:RecentChanges&tagfilter=OAuth+CID%3A+1232 [23:48:50] Here's an older query with the different CID, which corresponds to the query run by the endpoint we use to make these queries: https://quarry.wmflabs.org/query/13506 [23:49:24] And here it is modified just to use the new CID and point to a different user and timeframe, the above user whose contribs I linked: https://quarry.wmflabs.org/query/32907 [23:49:53] So the idea is that the SQL is going to mark edits that match the CID as 'system: true' [23:50:04] and it works for that older query, but not the newer one... [23:50:08] and I have no idea why. [23:50:34] Is there a change that happened affecting how change tags get stored? [23:50:56] Or a change in what change tags get replicated on labs? [23:51:22] Or any other ideas about what I'm missing? [23:51:50] Here's the relevant code that is actually executing that the query: https://github.com/WikiEducationFoundation/WikiEduDashboardTools/blob/master/public_html/revisions.php [23:56:37] * chicocvenancio doesn't play much with replicas [23:57:08] but https://quarry.wmflabs.org/query/32908 [23:57:45] and https://quarry.wmflabs.org/query/32909 [23:58:15] so yeah, the tags are there on the old edits and not the newer ones [23:58:27] hmm... [23:59:00] ahhh [23:59:31] apparently ct_tag is obsolete [23:59:32] https://www.mediawiki.org/wiki/Manual:Change_tag_table