[00:09:43] RECOVERY - Check systemd state on wdqs1009 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [10:53:32] PROBLEM - WDQS high update lag on wdqs1009 is CRITICAL: 2.902e+04 ge 3600 https://wikitech.wikimedia.org/wiki/Wikidata_query_service/Runbook%23Update_lag https://grafana.wikimedia.org/dashboard/db/wikidata-query-service?orgId=1&panelId=8&fullscreen [11:27:58] 2.902e+04 ge 3600 ha [11:30:10] that’s just 29k (seconds), isn’t it? so ca 8h? [11:31:35] (`units` first yelled at me that 29k seconds doesn’t convert to time – it needs to be 29 kseconds, 29k seconds means 29 times Boltzmann constant times seconds :D ) [20:43:25] Weird… I added a note about a well-known and documented story about infedility a few years back and it seems to be gone… [20:44:26] The children from a fling has become more known than himself, but the family refuse to accept them. [23:41:43] RECOVERY - WDQS high update lag on wdqs1009 is OK: (C)3600 ge (W)1200 ge 1161 https://wikitech.wikimedia.org/wiki/Wikidata_query_service/Runbook%23Update_lag https://grafana.wikimedia.org/dashboard/db/wikidata-query-service?orgId=1&panelId=8&fullscreen