[00:26:48] (03PS1) 10Faidon Liambotis: tor: add an additional relay instance [puppet] - 10https://gerrit.wikimedia.org/r/399972 [00:31:36] \o/ [00:47:57] sweet:) [03:04:57] (03CR) 10KartikMistry: [C: 031] labs: Fix language code on deploymentwiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/399867 (owner: 10Catrope) [03:25:16] PROBLEM - MariaDB Slave Lag: s1 on dbstore1002 is CRITICAL: CRITICAL slave_sql_lag Replication lag: 810.95 seconds [03:53:16] RECOVERY - MariaDB Slave Lag: s1 on dbstore1002 is OK: OK slave_sql_lag Replication lag: 213.68 seconds [08:01:32] (03PS2) 10ArielGlenn: permit use of 7zip compressed files for prefetch [dumps] - 10https://gerrit.wikimedia.org/r/399753 (https://phabricator.wikimedia.org/T179267) [08:02:46] PROBLEM - Host releases1001 is DOWN: PING CRITICAL - Packet loss = 58%, RTA = 9912.51 ms [08:03:26] PROBLEM - Host chlorine is DOWN: PING CRITICAL - Packet loss = 100% [08:03:56] RECOVERY - Host chlorine is UP: PING OK - Packet loss = 0%, RTA = 1.22 ms [08:04:06] RECOVERY - Host releases1001 is UP: PING OK - Packet loss = 0%, RTA = 2.33 ms [09:13:26] PROBLEM - HHVM rendering on mw2125 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:14:16] RECOVERY - HHVM rendering on mw2125 is OK: HTTP OK: HTTP/1.1 200 OK - 74386 bytes in 0.309 second response time [09:40:27] PROBLEM - HHVM rendering on mw2127 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:41:17] RECOVERY - HHVM rendering on mw2127 is OK: HTTP OK: HTTP/1.1 200 OK - 74386 bytes in 0.307 second response time [11:59:34] (03CR) 10Addshore: [C: 04-1] Fix wgContentLanguage on deployment.wikimedia.beta (031 comment) [mediawiki-config] - 10https://gerrit.wikimedia.org/r/399698 (https://phabricator.wikimedia.org/T183499) (owner: 10Gergő Tisza) [12:00:57] (03PS2) 10Addshore: Fix wgContentLanguage on deployment.wikimedia.beta [mediawiki-config] - 10https://gerrit.wikimedia.org/r/399698 (https://phabricator.wikimedia.org/T183499) (owner: 10Gergő Tisza) [12:02:48] (03PS1) 10Addshore: Re Enable AdvancedSearch on deployment.wikimedia.beta [mediawiki-config] - 10https://gerrit.wikimedia.org/r/399981 (https://phabricator.wikimedia.org/T183500) [12:04:04] (03Abandoned) 10Addshore: labs: Fix language code on deploymentwiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/399867 (owner: 10Catrope) [12:05:00] (03CR) 10Addshore: [C: 032] Fix wgContentLanguage on deployment.wikimedia.beta [mediawiki-config] - 10https://gerrit.wikimedia.org/r/399698 (https://phabricator.wikimedia.org/T183499) (owner: 10Gergő Tisza) [12:05:39] (03PS1) 10MarcoAurelio: Setup some namespace aliases for eswiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/399982 (https://phabricator.wikimedia.org/T183612) [12:09:44] (03Merged) 10jenkins-bot: Fix wgContentLanguage on deployment.wikimedia.beta [mediawiki-config] - 10https://gerrit.wikimedia.org/r/399698 (https://phabricator.wikimedia.org/T183499) (owner: 10Gergő Tisza) [12:09:56] (03CR) 10jenkins-bot: Fix wgContentLanguage on deployment.wikimedia.beta [mediawiki-config] - 10https://gerrit.wikimedia.org/r/399698 (https://phabricator.wikimedia.org/T183499) (owner: 10Gergő Tisza) [12:10:16] *waits for scap on beta* [12:15:20] looks good [12:20:15] !log addshore@tin Synchronized wmf-config/InitialiseSettings-labs.php: BETA ONLY T183499 [[gerrit:399698|Fix wgContentLanguage on deployment.wikimedia.beta]] (duration: 00m 52s) [12:20:28] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [12:20:29] T183499: Fix wgContentLanguage on deployment.wikimedia.beta - https://phabricator.wikimedia.org/T183499 [12:21:21] (03PS2) 10Addshore: Re Enable AdvancedSearch on deployment.wikimedia.beta [mediawiki-config] - 10https://gerrit.wikimedia.org/r/399981 (https://phabricator.wikimedia.org/T183500) [12:21:25] (03CR) 10Addshore: [C: 032] Re Enable AdvancedSearch on deployment.wikimedia.beta [mediawiki-config] - 10https://gerrit.wikimedia.org/r/399981 (https://phabricator.wikimedia.org/T183500) (owner: 10Addshore) [12:23:44] (03Merged) 10jenkins-bot: Re Enable AdvancedSearch on deployment.wikimedia.beta [mediawiki-config] - 10https://gerrit.wikimedia.org/r/399981 (https://phabricator.wikimedia.org/T183500) (owner: 10Addshore) [12:23:54] (03CR) 10jenkins-bot: Re Enable AdvancedSearch on deployment.wikimedia.beta [mediawiki-config] - 10https://gerrit.wikimedia.org/r/399981 (https://phabricator.wikimedia.org/T183500) (owner: 10Addshore) [12:23:59] * addshore watched beta scap again [12:24:04] *watches* [12:26:01] (03CR) 10Urbanecm: [C: 04-1] Setup some namespace aliases for eswiki (031 comment) [mediawiki-config] - 10https://gerrit.wikimedia.org/r/399982 (https://phabricator.wikimedia.org/T183612) (owner: 10MarcoAurelio) [12:30:16] !log addshore@tin Synchronized wmf-config/InitialiseSettings-labs.php: BETA ONLY T183500 [[gerrit:399981|Re Enable AdvancedSearch on deployment.wikimedia.beta]] (duration: 00m 51s) [12:30:27] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [12:30:28] T183500: Re Enable AdvancedSearch on deployment.wikimedia.beta - https://phabricator.wikimedia.org/T183500 [12:43:27] PROBLEM - HHVM rendering on mw2207 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:44:17] RECOVERY - HHVM rendering on mw2207 is OK: HTTP OK: HTTP/1.1 200 OK - 74386 bytes in 0.309 second response time [13:00:30] 10Operations, 10Goal, 10User-Elukey, 10User-fgiunchedi: Export Prometheus-compatible JVM metrics from JVMs in production - https://phabricator.wikimedia.org/T177197#3650154 (10demon) For gerrit: https://gerrit.googlesource.com/plugins/metrics-reporter-jmx/ -- but doesn't seem very...robust? [15:31:41] (03PS2) 10MarcoAurelio: Setup some namespace aliases for eswiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/399982 (https://phabricator.wikimedia.org/T183612) [18:09:21] (03CR) 10Gergő Tisza: Fix wgContentLanguage on deployment.wikimedia.beta (031 comment) [mediawiki-config] - 10https://gerrit.wikimedia.org/r/399698 (https://phabricator.wikimedia.org/T183499) (owner: 10Gergő Tisza) [18:11:17] 10Operations, 10Analytics, 10Research, 10Traffic, and 5 others: Referrer policy for browsers which only support the old spec - https://phabricator.wikimedia.org/T180921#3859187 (10Tgr) Tested in current Chrome and it behaves as expected. @Nuria: who would be the best person to answer BBlack's first question? [20:06:22] 10Puppet, 10MediaWiki-Vagrant, 10MediaWiki-extensions-SendGrid, 10Patch-For-Review: Create a MW-Vagrant role for SendGrid extension - https://phabricator.wikimedia.org/T183571#3859271 (10D3r1ck01) Tested on an instance running MW-Vagrant on Cloud VPS. Everything is working. Updated documentation to include... [20:40:03] 10Puppet, 10MediaWiki-Vagrant, 10MediaWiki-extensions-SendGrid, 10Patch-For-Review: Create a MW-Vagrant role for SendGrid extension - https://phabricator.wikimedia.org/T183571#3859275 (10D3r1ck01) 05Open>03Resolved [20:50:23] 10Operations, 10Wikimedia-Mailing-lists: Emails send by subscribers don't arrive on the mailing list Moderators-nl - https://phabricator.wikimedia.org/T181906#3806226 (10Ciell) I received the message send by herron and by you Magere Hein. This is strange, can it please be solved?