[00:21:19] (03PS1) 10Alex Monk: Set VisualEditorSingleEditTabSwitchTime to correct dates [mediawiki-config] - 10https://gerrit.wikimedia.org/r/275270 [00:30:46] 6Operations, 10Traffic, 10domains: Register nlwikipedia.org to prevent squatting - https://phabricator.wikimedia.org/T128968#2091529 (10Trijnstel) Good suggestion... But: there are 700-800 projects. If the WMF would register this domain, then they probably should do the same for dewikipedia.org, frwikipedia.... [01:10:02] PROBLEM - puppet last run on mw2007 is CRITICAL: CRITICAL: puppet fail [01:36:23] RECOVERY - puppet last run on mw2007 is OK: OK: Puppet is currently enabled, last run 34 seconds ago with 0 failures [02:09:41] PROBLEM - Text HTTP 5xx reqs/min on graphite1001 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [1000.0] [02:10:12] PROBLEM - Eqiad HTTP 5xx reqs/min on graphite1001 is CRITICAL: CRITICAL: 37.50% of data above the critical threshold [1000.0] [02:17:43] 6Operations, 6Performance-Team, 10scap, 7HHVM, 10Scap3 (Scap3-MediaWiki-MVP): Make scap able to depool/repool servers via the conftool API - https://phabricator.wikimedia.org/T104352#2092092 (10mmodell) [02:17:46] 6Operations, 6Release-Engineering-Team, 10scap, 10Scap3 (Scap3-MediaWiki-MVP): Depool proxies temporarily while scap is ongoing to avoid taxing those nodes - https://phabricator.wikimedia.org/T125629#2092091 (10mmodell) [02:19:43] RECOVERY - Text HTTP 5xx reqs/min on graphite1001 is OK: OK: Less than 1.00% above the threshold [250.0] [02:20:12] RECOVERY - Eqiad HTTP 5xx reqs/min on graphite1001 is OK: OK: Less than 1.00% above the threshold [250.0] [02:33:04] !log mwdeploy@tin sync-l10n completed (1.27.0-wmf.15) (duration: 15m 10s) [02:33:11] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [02:41:06] !log l10nupdate@tin ResourceLoader cache refresh completed at Sun Mar 6 02:41:06 UTC 2016 (duration 8m 2s) [02:41:11] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [03:16:26] 6Operations, 7HHVM, 13Patch-For-Review: Rise in "parent, LightProcess exiting" fatals - https://phabricator.wikimedia.org/T124956#1970973 (10ori) These aren't actually fatals. When HHVM is configured to have a nonzero number of LightProcess workers (pre-forked subprocesses it creates on startup to make shell... [03:16:48] 6Operations, 7HHVM, 13Patch-For-Review: Rise in "parent, LightProcess exiting" fatals - https://phabricator.wikimedia.org/T124956#2092153 (10ori) 5Open>3Invalid [03:34:53] PROBLEM - puppet last run on es2007 is CRITICAL: CRITICAL: Puppet has 1 failures [03:35:21] PROBLEM - puppet last run on mw2038 is CRITICAL: CRITICAL: Puppet has 1 failures [03:35:31] PROBLEM - puppet last run on mw1192 is CRITICAL: CRITICAL: Puppet has 2 failures [03:36:03] PROBLEM - puppet last run on mw1216 is CRITICAL: CRITICAL: Puppet has 1 failures [03:37:47] 6Operations, 10Traffic, 10Wikimedia-General-or-Unknown: Support Varnish backend selection via X-Wikimedia-Debug header - https://phabricator.wikimedia.org/T129000#2092182 (10ori) [03:43:45] 6Operations, 10Traffic, 10Wikimedia-General-or-Unknown: Dynamic backend selection via X-Wikimedia-Debug header - https://phabricator.wikimedia.org/T129000#2092196 (10ori) [03:53:12] PROBLEM - puppet last run on mw1011 is CRITICAL: CRITICAL: Puppet has 1 failures [04:01:21] RECOVERY - puppet last run on mw1216 is OK: OK: Puppet is currently enabled, last run 15 seconds ago with 0 failures [04:02:02] RECOVERY - puppet last run on es2007 is OK: OK: Puppet is currently enabled, last run 59 seconds ago with 0 failures [04:02:22] RECOVERY - puppet last run on mw2038 is OK: OK: Puppet is currently enabled, last run 9 seconds ago with 0 failures [04:02:31] RECOVERY - puppet last run on mw1192 is OK: OK: Puppet is currently enabled, last run 36 seconds ago with 0 failures [04:04:31] PROBLEM - puppet last run on mw2177 is CRITICAL: CRITICAL: Puppet has 1 failures [04:18:23] RECOVERY - puppet last run on mw1011 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [04:29:33] RECOVERY - puppet last run on mw2177 is OK: OK: Puppet is currently enabled, last run 14 seconds ago with 0 failures [04:46:52] PROBLEM - Incoming network saturation on labstore1003 is CRITICAL: CRITICAL: 32.00% of data above the critical threshold [100000000.0] [05:04:10] 6Operations, 6Performance-Team, 10Traffic: Support HTTP/2 - https://phabricator.wikimedia.org/T96848#2092243 (10ori) I think it's going to be easier and probably more reliable to determine HTTP/2 support by inferring it from the user-agent string, which can be done offline on the analytics cluster. [05:28:12] PROBLEM - Incoming network saturation on labstore1003 is CRITICAL: CRITICAL: 43.48% of data above the critical threshold [100000000.0] [05:39:12] RECOVERY - Incoming network saturation on labstore1003 is OK: OK: Less than 10.00% above the threshold [75000000.0] [05:43:43] (03PS2) 10Andrew Bogott: Monkeypatch Horizon to simplify the instance-creation panel. [puppet] - 10https://gerrit.wikimedia.org/r/275156 [05:46:21] (03PS3) 10Andrew Bogott: Monkeypatch Horizon to simplify the instance-creation panel. [puppet] - 10https://gerrit.wikimedia.org/r/275156 [05:49:17] (03CR) 10Andrew Bogott: [C: 032] Monkeypatch Horizon to simplify the instance-creation panel. [puppet] - 10https://gerrit.wikimedia.org/r/275156 (owner: 10Andrew Bogott) [05:58:48] 6Operations, 10Traffic, 10Wikimedia-General-or-Unknown: Dynamic backend selection via X-Wikimedia-Debug header - https://phabricator.wikimedia.org/T129000#2092260 (10ori) [06:30:11] PROBLEM - puppet last run on cp3017 is CRITICAL: CRITICAL: Puppet has 1 failures [06:30:22] PROBLEM - puppet last run on db1067 is CRITICAL: CRITICAL: puppet fail [06:31:11] PROBLEM - puppet last run on mw1170 is CRITICAL: CRITICAL: Puppet has 1 failures [06:31:12] PROBLEM - puppet last run on mw2129 is CRITICAL: CRITICAL: Puppet has 1 failures [06:31:24] PROBLEM - puppet last run on ms-be1010 is CRITICAL: CRITICAL: Puppet has 1 failures [06:31:51] PROBLEM - puppet last run on mw2145 is CRITICAL: CRITICAL: Puppet has 1 failures [06:31:52] PROBLEM - puppet last run on mw2158 is CRITICAL: CRITICAL: Puppet has 1 failures [06:32:11] PROBLEM - puppet last run on mw2126 is CRITICAL: CRITICAL: Puppet has 1 failures [06:32:51] PROBLEM - puppet last run on mw1119 is CRITICAL: CRITICAL: Puppet has 1 failures [06:34:11] PROBLEM - puppet last run on mw2095 is CRITICAL: CRITICAL: Puppet has 1 failures [06:53:08] 6Operations, 10Traffic, 10Wikimedia-General-or-Unknown: Ganeti VM for X-Wikimedia-Debug proxy - https://phabricator.wikimedia.org/T129003#2092263 (10ori) [06:56:13] RECOVERY - puppet last run on mw1119 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [06:56:22] RECOVERY - puppet last run on mw1170 is OK: OK: Puppet is currently enabled, last run 35 seconds ago with 0 failures [06:56:52] 6Operations, 10Wikimedia-General-or-Unknown, 10hardware-requests: Ganeti VM for X-Wikimedia-Debug proxy - https://phabricator.wikimedia.org/T129003#2092278 (10ori) [06:57:03] RECOVERY - puppet last run on mw2145 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:57:12] RECOVERY - puppet last run on mw2158 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [06:57:21] RECOVERY - puppet last run on cp3017 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures [06:57:23] RECOVERY - puppet last run on db1067 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:57:27] 6Operations, 10Wikimedia-General-or-Unknown: Dynamic backend selection via X-Wikimedia-Debug header - https://phabricator.wikimedia.org/T129000#2092279 (10ori) [06:57:31] RECOVERY - puppet last run on mw2126 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:58:22] RECOVERY - puppet last run on mw2129 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:58:23] RECOVERY - puppet last run on ms-be1010 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:59:31] RECOVERY - puppet last run on mw2095 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:50:42] PROBLEM - Host mw2027 is DOWN: PING CRITICAL - Packet loss = 100% [07:51:12] RECOVERY - Host mw2027 is UP: PING OK - Packet loss = 0%, RTA = 36.28 ms [08:17:42] PROBLEM - Disk space on alsafi is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [08:18:11] PROBLEM - salt-minion processes on alsafi is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [08:18:22] PROBLEM - configured eth on alsafi is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [08:18:32] PROBLEM - RAID on alsafi is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [08:18:43] PROBLEM - DPKG on alsafi is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [08:19:03] PROBLEM - puppet last run on alsafi is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [08:19:03] PROBLEM - Check size of conntrack table on alsafi is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [08:19:12] PROBLEM - dhclient process on alsafi is CRITICAL: CHECK_NRPE: Socket timeout after 10 seconds. [08:31:09] 6Operations, 10Wikimedia-Mailing-lists: Change configuration of research-newsletter list - https://phabricator.wikimedia.org/T128817#2092345 (10Tbayer) 5Open>3Resolved a:3Tbayer PS: Changes made: On https://lists.wikimedia.org/mailman/admin/research-newsletter/privacy/sender , I changed the "Action to t... [08:33:39] 6Operations, 10Wikimedia-General-or-Unknown, 10hardware-requests: 2 Ganeti VMs for X-Wikimedia-Debug proxy - https://phabricator.wikimedia.org/T129003#2092348 (10ori) [08:35:54] (03CR) 10Smalyshev: Add caching headers for nginx (031 comment) [puppet] - 10https://gerrit.wikimedia.org/r/274864 (https://phabricator.wikimedia.org/T126730) (owner: 10Smalyshev) [08:45:30] 6Operations, 10Dumps-Generation, 6Labs, 10wikitech.wikimedia.org: Provide dumps of wikitech.wikimedia.org - https://phabricator.wikimedia.org/T54170#2092355 (10ArielGlenn) [08:45:32] 6Operations, 10Datasets-General-or-Unknown, 10Dumps-Generation, 6Labs, and 2 others: copy wikitech dumps to dumps server ? - https://phabricator.wikimedia.org/T128680#2092353 (10ArielGlenn) 5Open>3Resolved Run worked fine, closing. [08:51:12] 6Operations, 10ops-eqiad: ms1001 bad disk - https://phabricator.wikimedia.org/T129008#2092369 (10ArielGlenn) [08:54:22] 6Operations, 10ops-eqiad: ms1001 bad disk - https://phabricator.wikimedia.org/T129008#2092382 (10ArielGlenn) If this needs downtime, we have to schedule it (though I don't have to announce it); it just needs a small amount of prep work. [09:02:02] PROBLEM - SSH on alsafi is CRITICAL: Server answer [09:03:51] RECOVERY - SSH on alsafi is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u1 (protocol 2.0) [09:45:21] PROBLEM - NTP on alsafi is CRITICAL: NTP CRITICAL: No response from NTP server [10:01:22] PROBLEM - SSH on alsafi is CRITICAL: Server answer [10:03:12] RECOVERY - SSH on alsafi is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u1 (protocol 2.0) [10:21:54] (03PS3) 1020after4: Add a deployment source for phabricator deployment from tin/mira [puppet] - 10https://gerrit.wikimedia.org/r/274502 (https://phabricator.wikimedia.org/T114363) [10:25:45] (03PS8) 1020after4: Parameterize the git_server variable in global scap.cfg [puppet] - 10https://gerrit.wikimedia.org/r/272947 (https://phabricator.wikimedia.org/T126259) [10:44:32] PROBLEM - SSH on alsafi is CRITICAL: Server answer [10:45:25] <_joe_> !log rebooting alsafi [10:45:30] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log, Master [10:46:31] RECOVERY - salt-minion processes on alsafi is OK: PROCS OK: 1 process with regex args ^/usr/bin/python /usr/bin/salt-minion [10:46:41] RECOVERY - configured eth on alsafi is OK: OK - interfaces up [10:46:42] RECOVERY - RAID on alsafi is OK: OK: no RAID installed [10:47:21] RECOVERY - DPKG on alsafi is OK: All packages OK [10:47:22] RECOVERY - Check size of conntrack table on alsafi is OK: OK: nf_conntrack is 0 % full [10:47:22] RECOVERY - dhclient process on alsafi is OK: PROCS OK: 0 processes with command name dhclient [10:47:22] RECOVERY - puppet last run on alsafi is OK: OK: Puppet is currently enabled, last run 14 seconds ago with 0 failures [10:47:42] RECOVERY - Disk space on alsafi is OK: DISK OK [10:48:02] RECOVERY - SSH on alsafi is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u1 (protocol 2.0) [11:06:32] RECOVERY - NTP on alsafi is OK: NTP OK: Offset -0.003006219864 secs [11:29:27] 6Operations, 10Traffic, 10domains: Register nlwikipedia.org to prevent squatting - https://phabricator.wikimedia.org/T128968#2092587 (10Peachey88) Per the point that @Trijnstel has pointed out, it's not a wise thing going for because of all the projects and language variants we have. In additional there is... [12:35:52] (03PS1) 10Odder: Modify wgImportSources for plwikisource [mediawiki-config] - 10https://gerrit.wikimedia.org/r/275275 (https://phabricator.wikimedia.org/T129015) [13:07:42] PROBLEM - puppet last run on mw2169 is CRITICAL: CRITICAL: Puppet has 1 failures [13:33:22] RECOVERY - puppet last run on mw2169 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [14:58:32] 6Operations, 10ops-esams, 10Traffic, 13Patch-For-Review: esams cache cluster re-arrangements, early 2016 - https://phabricator.wikimedia.org/T125485#2092878 (10BBlack) [15:06:38] 6Operations, 10Traffic: cache_misc's misc_fetch_large_objects has issues - https://phabricator.wikimedia.org/T128813#2092881 (10BBlack) So to re-state some of the summary, the reverse dependency chain is: 1. misc_fetch_large_objects causes unnecessary hit-for-pass on "large" objects, where the definition of "... [15:30:16] (03PS1) 10MarcoAurelio: Permissions configuration changes for gl.wikipedia [mediawiki-config] - 10https://gerrit.wikimedia.org/r/275285 (https://phabricator.wikimedia.org/T128948) [15:41:42] PROBLEM - puppet last run on labvirt1001 is CRITICAL: CRITICAL: Puppet has 2 failures [15:43:02] (03PS1) 10MarcoAurelio: Modify throttle settings for frwiki and cawiki due to Workshop [mediawiki-config] - 10https://gerrit.wikimedia.org/r/275287 (https://phabricator.wikimedia.org/T129018) [15:43:17] Hi anyone around? I need someone to review https://gerrit.wikimedia.org/r/#/c/274166/ it looks quite bad in production see https://en.wikipedia.org/w/index.php?title=Help:Displaying_a_formula&oldid=708601342#Chemistry [15:45:46] (03PS2) 10MarcoAurelio: Modify throttle settings for frwiki and cawiki due to Workshop [mediawiki-config] - 10https://gerrit.wikimedia.org/r/275287 (https://phabricator.wikimedia.org/T129018) [15:47:05] (03CR) 10Samtar: [C: 031] Permissions configuration changes for gl.wikipedia [mediawiki-config] - 10https://gerrit.wikimedia.org/r/275285 (https://phabricator.wikimedia.org/T128948) (owner: 10MarcoAurelio) [16:08:22] RECOVERY - puppet last run on labvirt1001 is OK: OK: Puppet is currently enabled, last run 34 seconds ago with 0 failures [16:13:56] (03PS1) 10MarcoAurelio: Enabling Translation extension on AffCom (chapcomwiki) [mediawiki-config] - 10https://gerrit.wikimedia.org/r/275289 (https://phabricator.wikimedia.org/T66122) [16:40:11] (03PS2) 10MarcoAurelio: Enabling Translation extension on AffCom (chapcomwiki) [mediawiki-config] - 10https://gerrit.wikimedia.org/r/275289 (https://phabricator.wikimedia.org/T66122) [16:42:56] (03PS3) 10MarcoAurelio: 1Enabling Translation extension on AffCom (chapcomwiki) [mediawiki-config] - 10https://gerrit.wikimedia.org/r/275289 (https://phabricator.wikimedia.org/T66122) [16:45:55] (03PS4) 10MarcoAurelio: Enabling Translation extension on AffCom (chapcomwiki) [mediawiki-config] - 10https://gerrit.wikimedia.org/r/275289 (https://phabricator.wikimedia.org/T66122) [16:53:29] (03PS4) 1020after4: Add a deployment source & target class for phabricator [puppet] - 10https://gerrit.wikimedia.org/r/274502 (https://phabricator.wikimedia.org/T114363) [16:54:27] (03CR) 1020after4: [C: 031] Add a deployment source & target class for phabricator [puppet] - 10https://gerrit.wikimedia.org/r/274502 (https://phabricator.wikimedia.org/T114363) (owner: 1020after4) [16:54:46] (03CR) 10jenkins-bot: [V: 04-1] Add a deployment source & target class for phabricator [puppet] - 10https://gerrit.wikimedia.org/r/274502 (https://phabricator.wikimedia.org/T114363) (owner: 1020after4) [16:57:06] (03PS5) 1020after4: Add a deployment source & target class for phabricator [puppet] - 10https://gerrit.wikimedia.org/r/274502 (https://phabricator.wikimedia.org/T114363) [17:01:19] (03PS6) 1020after4: Add a deployment source & target class for phabricator [puppet] - 10https://gerrit.wikimedia.org/r/274502 (https://phabricator.wikimedia.org/T114363) [17:08:30] 6Operations, 10Traffic, 10domains: Register nlwikipedia.org to prevent squatting - https://phabricator.wikimedia.org/T128968#2093044 (10Multichill) This task is about registering nlwikipedia.org, not about 700 other projects. That's a slippery slope argument and incorrect. Because we register nlwikipedia.org... [17:22:11] PROBLEM - Kafka Broker Replica Max Lag on kafka1014 is CRITICAL: CRITICAL: 65.22% of data above the critical threshold [5000000.0] [17:22:25] 6Operations, 10Traffic, 10domains: Register nlwikipedia.org to prevent squatting - https://phabricator.wikimedia.org/T128968#2091529 (10Krenair) If the other domains are not registered, why should nlwikipedia.org be? [17:37:11] RECOVERY - Kafka Broker Replica Max Lag on kafka1014 is OK: OK: Less than 50.00% above the threshold [1000000.0] [17:39:13] PROBLEM - MariaDB Slave Lag: s1 on db2034 is CRITICAL: CRITICAL slave_sql_lag Replication lag: 313.42 seconds [17:41:03] RECOVERY - MariaDB Slave Lag: s1 on db2034 is OK: OK slave_sql_lag Replication lag: 13.74 seconds [17:42:51] 6Operations, 10Traffic, 10domains: Register nlwikipedia.org to prevent squatting - https://phabricator.wikimedia.org/T128968#2091529 (10BBlack) There's no direct causality, but we should at least strive to do whatever we do for rational, consistent reasons. If the reasons for registering nlwikipedia.org are... [19:27:58] (03PS1) 10Gergő Tisza: Disable wgUseFilePatrol in huwiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/275299 [19:47:56] (03CR) 10JanZerebecki: "The caching part looks good. Removing my -1 as I don't know if it is worth spending more time on the buffering in practice, see my inline " (031 comment) [puppet] - 10https://gerrit.wikimedia.org/r/274864 (https://phabricator.wikimedia.org/T126730) (owner: 10Smalyshev) [20:04:53] (03PS1) 10Tim Landscheidt: Tools: Remove obsolete comment [puppet] - 10https://gerrit.wikimedia.org/r/275302 [20:45:46] 6Operations, 6Performance-Team, 10Traffic: Support HTTP/2 - https://phabricator.wikimedia.org/T96848#2093203 (10Krinkle) >>! In T96848#2092243, @ori wrote: > I think it's going to be easier and probably more reliable to determine HTTP/2 support by inferring it from the user-agent string, which can be done of... [20:50:05] ostriches: ori: Hm.. we got rid of a lot of function-level profiling. But that makes commits like https://gerrit.wikimedia.org/r/#/c/275111/ really ugly. [20:50:23] Please tell me we don't need to make those kinds of unconditional whole-function wrapping time measures. [20:52:42] Krinkle: yeah, I agree. That one is temporary; AFAIK MaxSem just wants to know if a change he intends to make has a substantial impact on performance. [20:53:07] the X-Wikimedia-Debug thing I'm working on should make profiling easier, I hope [20:53:16] (https://phabricator.wikimedia.org/T129000) [21:01:15] (03PS1) 10Ori.livneh: Add debug_proxy module, for X-Wikimedia-Debug request routing [puppet] - 10https://gerrit.wikimedia.org/r/275307 (https://phabricator.wikimedia.org/T129000) [21:06:01] PROBLEM - Host mw2212 is DOWN: PING CRITICAL - Packet loss = 100% [21:06:11] 6Operations, 10Wikimedia-General-or-Unknown, 13Patch-For-Review: Dynamic backend selection via X-Wikimedia-Debug header - https://phabricator.wikimedia.org/T129000#2093229 (10ori) This would also solve the problem of debug logging and profiling. mw1017 is configured to enable all log channels, which can be v... [21:21:15] (03CR) 10Luke081515: [C: 031] Modify wgImportSources for plwikisource [mediawiki-config] - 10https://gerrit.wikimedia.org/r/275275 (https://phabricator.wikimedia.org/T129015) (owner: 10Odder) [21:21:30] (03PS2) 10Luke081515: Modify wgImportSources for plwikisource [mediawiki-config] - 10https://gerrit.wikimedia.org/r/275275 (https://phabricator.wikimedia.org/T129015) (owner: 10Odder) [21:25:01] (03CR) 10Luke081515: [C: 031] Permissions configuration changes for gl.wikipedia [mediawiki-config] - 10https://gerrit.wikimedia.org/r/275285 (https://phabricator.wikimedia.org/T128948) (owner: 10MarcoAurelio) [21:50:02] PROBLEM - High load average on labstore1001 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [24.0] [21:53:32] RECOVERY - High load average on labstore1001 is OK: OK: Less than 50.00% above the threshold [16.0] [22:09:12] PROBLEM - puppet last run on cp3014 is CRITICAL: CRITICAL: puppet fail [22:37:12] RECOVERY - puppet last run on cp3014 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:43:15] Hello, which is the version of the official git installed on gerrit (real git is a dependency of git gc) ? is it a version below 2.7.1 ? (ᴄᴠᴇ‑2016‑2324 which enable server side remote code execution) [23:16:33] ytrezq: Gerrit uses JGit [23:57:58] MatmaRex execept for garbage collection. [23:58:00] Hello, which is the version of the official git installed on gerrit (real git is a dependency of git gc) ? is it a version below 2.7.1 ? (ᴄᴠᴇ‑2016‑2324 which enable server side remote code execution)