[00:02:15] (03CR) 10Dzahn: [C: 04-1] "but the part inside is "if > precise" which is "everything" now." [puppet] - 10https://gerrit.wikimedia.org/r/352278 (owner: 10Paladox) [00:02:49] (03PS2) 10Madhuvishy: gridengine: Cleanup old scripts, tracker and collector [puppet] - 10https://gerrit.wikimedia.org/r/352294 (https://phabricator.wikimedia.org/T162955) [00:03:00] (03PS1) 10Catrope: Tweak ORES thresholds for enwiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/352297 (https://phabricator.wikimedia.org/T164621) [00:03:05] (03CR) 10Dzahn: [C: 04-1] "we want to ensure we do _not_ get that package installed on anything is the purpose here" [puppet] - 10https://gerrit.wikimedia.org/r/352278 (owner: 10Paladox) [00:04:58] RoanKattouw: What are these "recall_at_precision(min_precision=0.99" strings as opposed to being 0, 1 or 0.99 as actual floats? [00:05:20] https://ores.wikimedia.org/v2/scores/enwiki/damaging?model_info=test_stats [00:05:34] (Ooh, apparently Firefox has a shiny new way of rendering JSON, it's just slow to load) [00:23:57] (03PS3) 10Madhuvishy: gridengine: Cleanup old scripts, tracker and collector [puppet] - 10https://gerrit.wikimedia.org/r/352294 (https://phabricator.wikimedia.org/T162955) [00:25:02] (03CR) 10jerkins-bot: [V: 04-1] gridengine: Cleanup old scripts, tracker and collector [puppet] - 10https://gerrit.wikimedia.org/r/352294 (https://phabricator.wikimedia.org/T162955) (owner: 10Madhuvishy) [00:28:55] (03PS4) 10Madhuvishy: gridengine: Cleanup old scripts, tracker and collector [puppet] - 10https://gerrit.wikimedia.org/r/352294 (https://phabricator.wikimedia.org/T162955) [00:43:37] (03PS1) 10Madhuvishy: gridengine: Follow up - delete old maintenance scripts and tracker/collector puppet code [puppet] - 10https://gerrit.wikimedia.org/r/352301 (https://phabricator.wikimedia.org/T162955) [00:58:28] (03PS1) 10Krinkle: webperf: Decom asset-check service [puppet] - 10https://gerrit.wikimedia.org/r/352302 (https://phabricator.wikimedia.org/T164419) [00:58:47] (03PS2) 10Krinkle: webperf: Decom asset-check service [puppet] - 10https://gerrit.wikimedia.org/r/352302 (https://phabricator.wikimedia.org/T164419) [01:32:49] (03PS2) 10Madhuvishy: gridengine: Follow up - delete old maintenance scripts and tracker/collector puppet code [puppet] - 10https://gerrit.wikimedia.org/r/352301 (https://phabricator.wikimedia.org/T162955) [01:51:12] [02:24:08] !log l10nupdate@tin scap sync-l10n completed (1.29.0-wmf.21) (duration: 07m 38s) [02:24:17] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [02:27:13] PROBLEM - MariaDB Slave Lag: s5 on dbstore2002 is CRITICAL: CRITICAL slave_sql_lag Replication lag: 605.98 seconds [02:30:11] !log l10nupdate@tin ResourceLoader cache refresh completed at Sat May 6 02:30:10 UTC 2017 (duration 6m 2s) [02:30:18] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [02:43:13] RECOVERY - MariaDB Slave Lag: s5 on dbstore2002 is OK: OK slave_sql_lag Replication lag: 136.20 seconds [03:32:23] PROBLEM - MariaDB Slave Lag: s1 on dbstore1002 is CRITICAL: CRITICAL slave_sql_lag Replication lag: 649.82 seconds [03:39:23] RECOVERY - MariaDB Slave Lag: s1 on dbstore1002 is OK: OK slave_sql_lag Replication lag: 140.07 seconds [05:43:02] (03PS3) 10Madhuvishy: gridengine: Follow up - delete old maintenance scripts and tracker/collector puppet code [puppet] - 10https://gerrit.wikimedia.org/r/352301 (https://phabricator.wikimedia.org/T162955) [10:10:30] (03CR) 10Paladox: "> we want to ensure we do _not_ get that package installed on" [puppet] - 10https://gerrit.wikimedia.org/r/352278 (owner: 10Paladox) [10:14:34] (03CR) 10Reedy: [C: 04-1] "You can remove the check, but the package entry needs to stay" [puppet] - 10https://gerrit.wikimedia.org/r/352278 (owner: 10Paladox) [10:14:49] (03CR) 10Paladox: "> You can remove the check, but the package entry needs to stay" [puppet] - 10https://gerrit.wikimedia.org/r/352278 (owner: 10Paladox) [10:15:11] (03PS3) 10Paladox: base::standard_packages: Remove ubuntu precise check [puppet] - 10https://gerrit.wikimedia.org/r/352278 [10:23:12] (03CR) 10Paladox: nagios_common: test contact template with private/hiera lookup (031 comment) [puppet] - 10https://gerrit.wikimedia.org/r/352269 (owner: 10Dzahn) [12:29:55] 06Operations, 10Wikimedia-SVG-rendering: Incorrect text positioning in SVG rasterization (scale/transform; font-size; kerning) - https://phabricator.wikimedia.org/T36947#3240843 (10Perhelion) >>! In T36947#3240231, @Glrx wrote: > I don't know if it is relevant, but the //Bosch Composition.svg// text was stroke... [14:15:33] PROBLEM - Eqiad HTTP 5xx reqs/min on graphite1001 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [1000.0] [14:16:23] PROBLEM - Esams HTTP 5xx reqs/min on graphite1001 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [1000.0] [14:16:33] PROBLEM - Codfw HTTP 5xx reqs/min on graphite1001 is CRITICAL: CRITICAL: 11.11% of data above the critical threshold [1000.0] [14:17:14] PROBLEM - Ulsfo HTTP 5xx reqs/min on graphite1001 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [1000.0] [14:17:33] RECOVERY - Codfw HTTP 5xx reqs/min on graphite1001 is OK: OK: Less than 1.00% above the threshold [250.0] [14:17:53] PROBLEM - Text HTTP 5xx reqs/min on graphite1001 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [1000.0] [14:21:34] PROBLEM - Codfw HTTP 5xx reqs/min on graphite1001 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [1000.0] [14:25:23] RECOVERY - Esams HTTP 5xx reqs/min on graphite1001 is OK: OK: Less than 1.00% above the threshold [250.0] [14:25:33] RECOVERY - Eqiad HTTP 5xx reqs/min on graphite1001 is OK: OK: Less than 1.00% above the threshold [250.0] [14:25:33] RECOVERY - Codfw HTTP 5xx reqs/min on graphite1001 is OK: OK: Less than 1.00% above the threshold [250.0] [14:25:53] RECOVERY - Text HTTP 5xx reqs/min on graphite1001 is OK: OK: Less than 1.00% above the threshold [250.0] [14:26:13] RECOVERY - Ulsfo HTTP 5xx reqs/min on graphite1001 is OK: OK: Less than 1.00% above the threshold [250.0] [14:27:40] 06Operations, 10Wikimedia-SVG-rendering: Incorrect text positioning in SVG rasterization (scale/transform; font-size; kerning) - https://phabricator.wikimedia.org/T36947#3240883 (10Glrx) Ooops, you are right. The text is not stroked. [15:30:35] (03CR) 10Reedy: [C: 04-1] base::standard_packages: Remove ubuntu precise check (031 comment) [puppet] - 10https://gerrit.wikimedia.org/r/352278 (owner: 10Paladox) [15:53:27] (03PS4) 10Paladox: base::standard_packages: Remove ubuntu precise check [puppet] - 10https://gerrit.wikimedia.org/r/352278 [15:53:41] (03CR) 10Paladox: base::standard_packages: Remove ubuntu precise check (031 comment) [puppet] - 10https://gerrit.wikimedia.org/r/352278 (owner: 10Paladox) [19:22:24] 06Operations: Unblock EPFL IP addresses for access to IRC - https://phabricator.wikimedia.org/T164651#3240991 (10leila) [19:34:22] 06Operations: Unblock EPFL IP addresses for access to IRC - https://phabricator.wikimedia.org/T164651#3240991 (10Legoktm) Are these Wikimedia IRC channels on irc.freenode.net or irc.wikimedia.org? [20:05:26] 06Operations: Unblock EPFL IP addresses for access to IRC - https://phabricator.wikimedia.org/T164651#3240991 (10tizianopiccardi) The problem is on irc.freenode.net: [21:24:15] tizianop sets mode +Zi [21:24:21] Message(474): #wikimedia-labs Cannot join channel (+b) - you are banned [21:24:21] Message(474): #wik... [21:07:03] 06Operations: Unblock EPFL IP addresses for access to IRC - https://phabricator.wikimedia.org/T164651#3240991 (10DatGuy) Not sure if this should have a phab ticket. Nevertheless, what is your full mask (x!y@z)? [21:25:13] 06Operations: Unblock EPFL IP addresses for access to IRC - https://phabricator.wikimedia.org/T164651#3241061 (10tizianopiccardi) ~tizianop@tsf-452-wpa-3-252.epfl.ch but all the mask *@*.epfl.ch seems banned. Thanks