[05:23:48] <icinga-wm>	 PROBLEM - Check systemd state on wdqs2002 is CRITICAL: CRITICAL - degraded: The system is operational but one or more units failed. https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[06:06:48] <wmchat-bridge>	 [mattermost] <ladsgroup> kiwi_21: I'm around
[06:06:54] <wmchat-bridge>	 [mattermost] <ladsgroup> how can I help?
[06:07:01] <wmchat-bridge>	 [mattermost] <ladsgroup> (Sorry, just woke up)
[06:12:42] <icinga-wm>	 RECOVERY - Check systemd state on wdqs2002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[06:18:36] <icinga-wm>	 PROBLEM - Check systemd state on wdqs2002 is CRITICAL: CRITICAL - degraded: The system is operational but one or more units failed. https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[06:41:52] <icinga-wm>	 RECOVERY - Check systemd state on wdqs2002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[06:47:32] <icinga-wm>	 PROBLEM - Check systemd state on wdqs2002 is CRITICAL: CRITICAL - degraded: The system is operational but one or more units failed. https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[07:12:22] <icinga-wm>	 RECOVERY - Check systemd state on wdqs2002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[07:13:15] <wmchat-bridge>	 [mattermost] <ladsgroup> you're kidding me right?
[07:18:06] <icinga-wm>	 PROBLEM - Check systemd state on wdqs2002 is CRITICAL: CRITICAL - degraded: The system is operational but one or more units failed. https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[07:36:50] <icinga-wm>	 PROBLEM - WDQS high update lag on wdqs2002 is CRITICAL: 1.285e+05 ge 4.32e+04 https://wikitech.wikimedia.org/wiki/Wikidata_query_service/Runbook%23Update_lag https://grafana.wikimedia.org/dashboard/db/wikidata-query-service?orgId=1&panelId=8&fullscreen
[07:36:58] <icinga-wm>	 RECOVERY - Query Service HTTP Port on wdqs2002 is OK: HTTP OK: HTTP/1.1 200 OK - 448 bytes in 0.022 second response time https://wikitech.wikimedia.org/wiki/Wikidata_query_service
[07:37:12] <icinga-wm>	 RECOVERY - Check systemd state on wdqs2002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[07:43:18] <icinga-wm>	 ACKNOWLEDGEMENT - WDQS high update lag on wdqs2002 is CRITICAL: 1.274e+05 ge 4.32e+04 Gehel depooled while catching up on lag https://wikitech.wikimedia.org/wiki/Wikidata_query_service/Runbook%23Update_lag https://grafana.wikimedia.org/dashboard/db/wikidata-query-service?orgId=1&panelId=8&fullscreen
[14:26:31] <icinga-wm>	 RECOVERY - WDQS high update lag on wdqs2002 is OK: (C)4.32e+04 ge (W)2.16e+04 ge 2.148e+04 https://wikitech.wikimedia.org/wiki/Wikidata_query_service/Runbook%23Update_lag https://grafana.wikimedia.org/dashboard/db/wikidata-query-service?orgId=1&panelId=8&fullscreen
[14:28:27] <gehel>	 !log pooling wdqs2002 - catched up on lag
[14:28:28] <stashbot>	 gehel: Not expecting to hear !log here
[20:30:41] <wm-bot>	 Change on 12meta.wikimedia.org a page Wikidata was modified, changed by DannyS712 link https://meta.wikimedia.org/w/index.php?diff=20466111 edit summary: [-117] translation cleanup
[21:16:00] <wmchat-bridge>	 [mattermost] <মাহির২৫৬> For at least some language codes, I believe that some action on T44396 can be taken (see my comment at the end of that ticket).
[21:16:01] <stashbot>	 T44396: duplicate/invalid language codes - https://phabricator.wikimedia.org/T44396