[01:43:32] PROBLEM - cp6 Varnish Backends on cp6 is CRITICAL: 1 backends are down. mw7 [01:43:34] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 1 backends are down. mw7 [01:43:49] PROBLEM - cp8 Varnish Backends on cp8 is CRITICAL: 1 backends are down. mw7 [01:44:03] PROBLEM - cp7 Stunnel Http for mw6 on cp7 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [01:44:22] PROBLEM - cp3 Stunnel Http for mw6 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [01:48:24] RECOVERY - cp6 Varnish Backends on cp6 is OK: All 11 backends are healthy [01:48:58] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 3 datacenters are down: 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 2607:5300:205:200::17f6/cpweb [01:50:41] PROBLEM - mw2 MediaWiki Rendering on mw2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:51:44] PROBLEM - cp7 Varnish Backends on cp7 is CRITICAL: 1 backends are down. mw7 [01:52:43] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 9 backends are healthy [01:52:48] RECOVERY - cp8 Varnish Backends on cp8 is OK: All 11 backends are healthy [01:53:04] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [01:53:04] RECOVERY - cp7 Stunnel Http for mw6 on cp7 is OK: HTTP OK: HTTP/1.1 200 OK - 15316 bytes in 0.005 second response time [01:53:14] RECOVERY - cp3 Stunnel Http for mw6 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15330 bytes in 1.093 second response time [01:54:20] RECOVERY - mw2 MediaWiki Rendering on mw2 is OK: HTTP OK: HTTP/1.1 200 OK - 18681 bytes in 0.841 second response time [01:54:51] RECOVERY - cp7 Varnish Backends on cp7 is OK: All 11 backends are healthy [02:06:50] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2647 MB (10% inode=93%); [02:19:39] PROBLEM - cp7 Varnish Backends on cp7 is CRITICAL: 1 backends are down. mw4 [02:20:46] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 51.161.32.127/cpweb [02:20:46] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 51.161.32.127/cpweb [02:27:51] RECOVERY - cp7 Varnish Backends on cp7 is OK: All 11 backends are healthy [02:28:58] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [02:29:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [06:16:11] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JvMYo [06:16:12] [02miraheze/ssl] 07Reception123 0319a5d13 - add wiki.warframestat.us cert [06:21:47] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JvMYD [06:21:48] [02miraheze/ssl] 07Reception123 031c84af2 - add wiki.shaazzz.ir cert [06:25:07] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvMYy [06:25:09] [02miraheze/services] 07MirahezeSSLBot 03721c65c - BOT: Updating services config for wikis [06:27:29] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 3473 MB (14% inode=93%); [06:32:33] Reception123: can you look at https://meta.miraheze.org/wiki/Special:Contributions/WickyHoney [06:32:36] [ User contributions for WickyHoney - Miraheze Meta ] - meta.miraheze.org [06:33:14] I’m not convinced his interactions between him and Zirukurt01 are constructive [06:37:17] !log reception@jobrunner1:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --no-local-users --username-prefix "import" --wiki pikminfanonwiki /home/reception/pikminfanon.xml [06:37:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [06:37:26] RhinosF1: hi, yes [10:00:08] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvMnX [10:00:09] [02miraheze/services] 07MirahezeSSLBot 0397d6c90 - BOT: Updating services config for wikis [14:18:04] PROBLEM - mon1 Puppet on mon1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 6 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[php7.3-apcu] [14:24:50] RECOVERY - mon1 Puppet on mon1 is OK: OK: Puppet is currently enabled, last run 3 minutes ago with 0 failures [16:15:18] [02DataDump] 07paladox edited pull request 03#3: Redesign DataDump - 13https://git.io/JvIMk [16:38:11] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JvM2k [16:38:12] [02miraheze/mediawiki] 07paladox 03b0145d4 - Update LinkSuggest [16:52:45] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 5 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [16:54:06] paladox: do you know where the interwiki is set for global rename logs [16:54:28] I presume meta, but not 100% sure [16:55:08] paladox: I meant in config because :m: looks weird in irc cloud as it conflicts with an emoji code [16:55:20] so mh:meta: would be cleaner [16:55:57] Nope [16:56:50] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [17:48:47] PROBLEM - cp6 Stunnel Http for mw5 on cp6 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [17:53:08] RECOVERY - cp6 Stunnel Http for mw5 on cp6 is OK: HTTP OK: HTTP/1.1 200 OK - 15330 bytes in 0.145 second response time [18:08:25] Reception123: https://phabricator.miraheze.org/T5318 No se puede cambiar la licencia a la versión 3.0 que ellos quieren [18:08:25] [ ⚓ T5318 Change copyright license on wikilexicon.miraheze.org ] - phabricator.miraheze.org [18:08:45] Reception123: Tiene que ser en GitHub, lo he hecho pero no lo han aprobado [18:09:25] Reception123: E n ManageWiki sólo se pueden los CC de la versión 4.0 y algunas excepciones especificas [18:55:13] PROBLEM - mw3 MediaWiki Rendering on mw3 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:55:53] hispano76: whats up? [18:59:20] RECOVERY - mw3 MediaWiki Rendering on mw3 is OK: HTTP OK: HTTP/1.1 200 OK - 18695 bytes in 0.633 second response time [19:04:44] RhinosF1: In summary, the Wikilexicon community does not want version 4.0 of the Creative Commons CC BY SA license. And they can't do it on ManageWiki because there's no such option https://prnt.sc/rjtq3c for example. He wanted to know Reception123 opinion. [19:04:45] [ Screenshot by Lightshot ] - prnt.sc [19:05:16] hispano76: which license would they like? [19:05:57] CC BY SA 3.0 https://github.com/miraheze/mw-config/pull/2942/files RhinosF1 [19:05:59] PROBLEM - mw2 MediaWiki Rendering on mw2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:07:40] hispano76: i’ll speak with the board [19:07:56] hum, ok RhinosF1 [19:08:42] hispano76: someone needs to check that the license complies with certain conditions [19:09:44] RECOVERY - mw2 MediaWiki Rendering on mw2 is OK: HTTP OK: HTTP/1.1 200 OK - 18695 bytes in 0.569 second response time [19:10:48] Oh, right. I understand RhinosF1 [19:13:02] hispano76: it was previously removed so there’s a chance it will be a no. Legally, it should be okay. [19:51:54] PROBLEM - test1 MediaWiki Rendering on test1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:55:30] RECOVERY - test1 MediaWiki Rendering on test1 is OK: HTTP OK: HTTP/1.1 200 OK - 18682 bytes in 0.630 second response time [20:05:29] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvM6a [20:05:31] [02miraheze/puppet] 07paladox 036849371 - puppetdb: Increase command_processing_threads to 4 [20:06:02] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvM6w [20:06:03] [02miraheze/puppet] 07paladox 0312934ef - Update init.pp [20:08:37] !log upgrade puppetdb, puppetserver and puppet-agent on puppet2 [20:08:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:17:54] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvMit [20:17:55] [02miraheze/puppet] 07paladox 036060f94 - Update init.pp [20:20:34] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvMiZ [20:20:35] [02miraheze/puppet] 07paladox 03eb3dd5f - Update init.pp [20:23:50] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvMi4 [20:23:52] [02miraheze/puppet] 07paladox 037b07b75 - Update init.pp [20:30:39] PROBLEM - cp8 Puppet on cp8 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [20:31:20] PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 13 failures. Last run 9 minutes ago with 13 failures. Failed resources (up to 3 shown) [20:34:26] RECOVERY - cp8 Puppet on cp8 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [20:34:55] RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [20:53:37] [02DataDump] 07paladox closed pull request 03#3: Redesign DataDump - 13https://git.io/JvIMk [20:53:38] [02miraheze/DataDump] 07paladox pushed 031 commit to 03master [+2/-1/±8] 13https://git.io/JvMPR [20:53:40] [02miraheze/DataDump] 07paladox 038da9eff - Redesign DataDump (#3) New features: * Redesigns to use a table (simplifies the desgn) * No longer uses the jobrunner for DataDump deletions, it dosen't take long to delete a file/remove entry from db. * Adds new db size field. * To delete a dump, a link is provided to delete it. * There is now one view, to see all dumps. Bug: T5095 Bug: T4909 Bug: T5285 [20:53:41] [02miraheze/DataDump] 07paladox deleted branch 03paladox-patch-1 [20:53:43] [02DataDump] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/fhhKV [20:54:16] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JvMPu [20:54:17] [02miraheze/mediawiki] 07paladox 03a6152c3 - Update DataDump [20:56:21] [02miraheze/DataDump] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvMPi [20:56:22] [02miraheze/DataDump] 07paladox 0367a0a92 - Update patch-dumps_size.sql [20:56:52] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JvMPS [20:56:54] [02miraheze/mediawiki] 07paladox 034f65b8f - Update DataDump [20:57:49] [02miraheze/DataDump] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvMPd [20:57:51] [02miraheze/DataDump] 07paladox 038c8d0cb - fix syntax [20:58:15] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JvMPb [20:58:16] [02miraheze/mediawiki] 07paladox 0338d3452 - Update DataDump [21:03:10] !log running lc on mw* and test2 and jobrunner1 [21:03:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [21:07:19] [02miraheze/DataDump] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvMXr [21:07:21] [02miraheze/DataDump] 07paladox 03c648cbe - capitalise [21:40:15] [02miraheze/DataDump] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvMM0 [21:40:16] [02miraheze/DataDump] 07paladox 0346baab5 - Use !$result rather then < 1 [21:42:38] [02miraheze/DataDump] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvMMz [21:42:39] [02miraheze/DataDump] 07paladox 03f8938de - Include stderr in jobs [21:45:35] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JvMM6 [21:45:37] [02miraheze/mediawiki] 07paladox 03fde6310 - Update DataDump [21:50:00] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 6 minutes ago with 2 failures. Failed resources (up to 3 shown) [21:52:01] PROBLEM - cp8 Puppet on cp8 is CRITICAL: CRITICAL: Puppet has 74 failures. Last run 8 minutes ago with 74 failures. Failed resources (up to 3 shown) [21:52:33] PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 13 failures. Last run 8 minutes ago with 13 failures. Failed resources (up to 3 shown) [21:52:50] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 5 failures. Last run 9 minutes ago with 5 failures. Failed resources (up to 3 shown) [21:54:00] PROBLEM - cp3 Puppet on cp3 is CRITICAL: CRITICAL: Puppet has 35 failures. Last run 7 minutes ago with 35 failures. Failed resources (up to 3 shown): File[wiki.ciptamedia.org],File[wiki.ciptamedia.org_private],File[athenapedia.org],File[athenapedia.org_private] [21:54:09] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 22 seconds ago with 0 failures [21:55:32] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvMDc [21:55:34] [02miraheze/mw-config] 07paladox 031ff9c46 - Add logging for ManageWiki [21:55:42] RECOVERY - cp8 Puppet on cp8 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:56:02] RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:56:41] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [21:57:36] RECOVERY - cp3 Puppet on cp3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:00:36] [02miraheze/DataDump] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvMDz [22:00:37] [02miraheze/DataDump] 07paladox 03e6a1948 - Add dumps_size to getQueryInfo [22:01:43] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JvMDK [22:01:44] [02miraheze/mediawiki] 07paladox 03c640a47 - Update DataDump [22:04:08] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvMDQ [22:04:09] [02miraheze/puppet] 07paladox 030bb35eb - Update init.pp