[03:22:16] <icinga-wm>	 PROBLEM - WDQS SPARQL on wdqs1012 is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Wikidata_query_service/Runbook
[03:24:50] <icinga-wm>	 RECOVERY - WDQS SPARQL on wdqs1012 is OK: HTTP OK: HTTP/1.1 200 OK - 691 bytes in 8.552 second response time https://wikitech.wikimedia.org/wiki/Wikidata_query_service/Runbook
[03:33:34] <icinga-wm>	 PROBLEM - WDQS SPARQL on wdqs1012 is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Wikidata_query_service/Runbook
[09:03:40] <icinga-wm>	 RECOVERY - WDQS SPARQL on wdqs1012 is OK: HTTP OK: HTTP/1.1 200 OK - 689 bytes in 1.069 second response time https://wikitech.wikimedia.org/wiki/Wikidata_query_service/Runbook
[09:05:28] <icinga-wm>	 RECOVERY - WDQS SPARQL on wdqs1005 is OK: HTTP OK: HTTP/1.1 200 OK - 688 bytes in 1.058 second response time https://wikitech.wikimedia.org/wiki/Wikidata_query_service/Runbook
[10:00:30] <icinga-wm>	 PROBLEM - Check systemd state on wdqs1005 is CRITICAL: CRITICAL - degraded: The system is operational but one or more units failed. https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[10:07:54] <icinga-wm>	 RECOVERY - Check systemd state on wdqs1005 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[10:08:32] <icinga-wm>	 PROBLEM - WDQS high update lag on wdqs1005 is CRITICAL: 1.556e+05 ge 4.32e+04 https://wikitech.wikimedia.org/wiki/Wikidata_query_service/Runbook%23Update_lag https://grafana.wikimedia.org/dashboard/db/wikidata-query-service?orgId=1&panelId=8&fullscreen
[19:46:08] <ningu>	 hi, so I'm still having unexplained issues with WikibaseCirrusSearch (elasticsearch)
[19:46:23] <ningu>	 if I run maintenance/Saneitize.php it shows that none of the pages are indexed
[19:46:55] <ningu>	 I tried forcing a reindex with maintenance/ForceSearchIndex.php and it outputs as if it's reindexing everything but it doesn't seem to stick
[19:47:00] <ningu>	 any idea what's going on?
[19:47:43] <ningu>	 DumpIndex.php also shows it's empty
[20:12:17] <icinga-wm>	 PROBLEM - Disk space on wdqs1009 is CRITICAL: DISK CRITICAL - free space: /srv 37733 MB (3% inode=99%): https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space https://grafana.wikimedia.org/dashboard/db/host-overview?var-server=wdqs1009&var-datasource=eqiad+prometheus/ops
[20:16:42] <perry>	 Oh that sounds not super lovely
[20:18:41] <perry>	 Sounds like it's time to download more hard drive! That's what lvextend does, right? </s>
[20:52:39] <icinga-wm>	 RECOVERY - Disk space on wdqs1009 is OK: DISK OK https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space https://grafana.wikimedia.org/dashboard/db/host-overview?var-server=wdqs1009&var-datasource=eqiad+prometheus/ops
[23:22:58] <john65>	 can I report a user(s) for repeated ignoring solid evidence about a particular discussion?
[23:44:52] <Reedy>	 Yeah, you'd probably be better using https://www.wikidata.org/wiki/Wikidata:Administrators%27_noticeboard though