[03:58:33] RECOVERY - High lag on wdqs1004 is OK: (C)3600 ge (W)1200 ge 1177 https://grafana.wikimedia.org/dashboard/db/wikidata-query-service?orgId=1&panelId=8&fullscreen [04:15:43] RECOVERY - High lag on wdqs1005 is OK: (C)3600 ge (W)1200 ge 1165 https://grafana.wikimedia.org/dashboard/db/wikidata-query-service?orgId=1&panelId=8&fullscreen [08:02:36] * reosarevok sighs at https://www.wikidata.org/w/index.php?title=Q60&action=history [08:02:40] More Spanish vandalism, yay [11:51:38] :( [11:52:08] reosarevok: In case you or someone else want to improve the situation... https://phabricator.wikimedia.org/T207648, https://phabricator.wikimedia.org/T207651 [18:04:50] sigh sigh https://www.wikidata.org/w/index.php?title=Q40615&action=history [18:05:28] abian: maybe description editing via mobile should be disabled on protected pages. [18:05:51] sjoerddebruin: you mean he's not "the f*cking boss"? [18:06:02] que? [18:06:03] :P [18:19:14] is that page even protected? [18:19:17] it doesn't look like it [18:21:04] nikki: it's not that intense yet... [18:28:44] PROBLEM - Check systemd state on wdqs1010 is CRITICAL: CRITICAL - degraded: The system is operational but one or more units failed. [19:13:24] RECOVERY - Check systemd state on wdqs1010 is OK: OK - running: The system is fully operational [19:33:35] Hey, sjoerddebruin, thanks for noticing! :) [19:33:48] I'll see [19:34:03] RECOVERY - High lag on wdqs1003 is OK: (C)3600 ge (W)1200 ge 643 https://grafana.wikimedia.org/dashboard/db/wikidata-query-service?orgId=1&panelId=8&fullscreen [19:38:40] https://www.wikidata.org/wiki/Wikidata:WikiProject_Counter-Vandalism/plot1 :| [19:39:05] Mass-marking two "users" now who contributed quite a lot via IP [20:03:44] PROBLEM - Check systemd state on wdqs1010 is CRITICAL: CRITICAL - degraded: The system is operational but one or more units failed. [20:05:54] RECOVERY - Check systemd state on wdqs1010 is OK: OK - running: The system is fully operational [20:41:07] can anyone think of a reason why there would be lock wait timeouts from Wikibase\SqlIdGenerator::generateNewId [20:41:29] any recent change which causes us to call this more than before? [22:20:43] twentyafterfour: is that happening? [22:20:56] *goes to grab laptop* [22:31:46] addshore: yeah [22:40:33] twentyafterfour: it doesn't look like anything to worry about [22:44:41] addshore: ok, thanks!