[03:26:27] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 688 [04:00:27] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [04:08:28] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 359 [04:10:28] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [09:24:22] Hello JulianLeeeee! If you have any questions feel free to ask and someone should answer soon. [12:05:52] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_32 [+0/-0/±1] 13https://git.io/fjs81 [12:05:53] [02miraheze/mediawiki] 07paladox 03cc06a16 - Update News [13:26:39] * Hispano76 saluda [14:39:24] !log upgrade icingaweb2 to 2.6.3 on misc1 [14:39:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [16:27:00] Why does this map appear like this? https://mediateca.miraheze.org/wiki/Archivo:Localizaci%C3%B3n_del_Valle_de_M%C3%A9xico_(Segundo_Imperio_Mexicano).svg [16:27:01] Title: [ Archivo:Localización del Valle de México (Segundo Imperio Mexicano).svg - Mediateca Wiki ] - mediateca.miraheze.org [16:31:08] Hispano76 you probaley want to use inkscape as the svg converter on https://mediateca.miraheze.org/wiki/Especial:ManageWikiSettings#mw-section-media [16:31:09] Title: [ Gestionar opciones adicionales de un wiki - Mediateca Wiki ] - mediateca.miraheze.org [16:31:17] then reupload the image. [16:33:34] oh, ok. Thanks paladox :) [18:28:44] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±7] 13https://git.io/fjsgB [18:28:46] [02miraheze/ManageWiki] 07translatewiki 03c6f67eb - Localisation updates from https://translatewiki.net. [18:28:47] [02miraheze/WikiDiscover] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjsgR [18:28:49] [02miraheze/WikiDiscover] 07translatewiki 0336705ed - Localisation updates from https://translatewiki.net. [18:28:50] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjsg0 [18:28:52] [02miraheze/MirahezeMagic] 07translatewiki 0332ca414 - Localisation updates from https://translatewiki.net. [20:01:37] paladox: no work https://mediateca.miraheze.org/wiki/Archivo:Localizaci%C3%B3n_de_Yucat%C3%A1n_(Segundo_Imperio_Mexicano).svg [20:01:38] Title: [ Archivo:Localización de Yucatán (Segundo Imperio Mexicano).svg - Mediateca Wiki ] - mediateca.miraheze.org [20:01:48] enable inskape [20:06:24] (503) [20:07:14] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [20:07:25] PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [20:07:25] PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [20:07:26] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [20:08:00] I assume 503 is a known issue? [20:08:04] PROBLEM - cp4 HTTP 4xx/5xx ERROR Rate on cp4 is CRITICAL: CRITICAL - NGINX Error Rate is 62% [20:08:09] PROBLEM - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is CRITICAL: CRITICAL - NGINX Error Rate is 83% [20:08:09] PROBLEM - misc2 HTTPS on misc2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:08:12] revi Hispano76 hi [20:08:14] yup [20:08:22] im investigating [20:08:35] !log restarting php-fpm on mw1 [20:08:37] thx [20:08:53] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [20:09:03] thanks [20:09:06] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [20:09:24] PROBLEM - misc2 Puppet on misc2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [20:09:41] hmm php-fpm is stalled when restarting [20:10:05] PROBLEM - cp4 HTTP 4xx/5xx ERROR Rate on cp4 is WARNING: WARNING - NGINX Error Rate is 48% [20:10:07] RECOVERY - misc2 HTTPS on misc2 is OK: HTTP OK: HTTP/1.1 200 OK - 41137 bytes in 1.411 second response time [20:11:01] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 8 minutes ago with 0 failures [20:11:14] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [20:11:21] RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 8 minutes ago with 0 failures [20:11:24] revi Hispano76 things should be returning to normal now. [20:11:25] RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy [20:11:25] RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy [20:11:26] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy [20:11:51] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is CRITICAL: CRITICAL - NGINX Error Rate is 65% [20:12:05] RECOVERY - cp4 HTTP 4xx/5xx ERROR Rate on cp4 is OK: OK - NGINX Error Rate is 7% [20:12:09] RECOVERY - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is OK: OK - NGINX Error Rate is 1% [20:12:53] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [20:13:47] https://mediateca.miraheze.org/wiki/Archivo:Regi%C3%B3n_Economica_Sur_(Segundo_Imperio_Mexicano).svg no work, enable Inskacep [20:13:48] Title: [ Archivo:Región Economica Sur (Segundo Imperio Mexicano).svg - Mediateca Wiki ] - mediateca.miraheze.org [20:13:51] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 2% [20:15:12] ah [20:15:17] Hispano76 i think i know why [20:16:33] Hispano76 try now. (in one minute) [20:22:06] paladox: Work!! https://mediateca.miraheze.org/wiki/Archivo:Mapa_electoral_de_las_elecciones_presidenciales_de_M%C3%A9xico_de_2018_(Segundo_Imperio_Mexicano).svg Thanks :) [20:22:07] Title: [ Archivo:Mapa electoral de las elecciones presidenciales de México de 2018 (Segundo Imperio Mexicano).svg - Mediateca Wiki ] - mediateca.miraheze.org [20:22:25] your welcome :) [21:13:41] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 2 backends are down. mw2 mw3 [21:14:06] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 55% [21:14:40] Hello Ahmeto! If you have any questions feel free to ask and someone should answer soon. [21:15:36] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy [21:15:46] I want the rest of all pages from both reverse crappy games and reverse terrible tv shows because it's extremely laughter than chingrish! [21:16:02] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 22% [21:53:53] Hello Ahmeto_Fihhhters! If you have any questions feel free to ask and someone should answer soon. [21:55:17] I want the rest of all both reverse crappy games and reverse terrible tv shows pages and full version of restored pages on both sites because its more laughter than chinglish texts in vulgar! [22:31:27] wonder what's going on with that