[00:00:45] hi everyone [00:00:47] Examknow: 2019-09-26 - 05:37:45UTC tell Examknow Read the request comments section of wiki requests please [01:34:07] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.38, 1.84, 1.40 [01:42:34] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 1.19, 1.47, 1.40 [06:26:24] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 2993 MB (12% inode=94%); [08:09:15] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [08:09:19] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [08:10:18] PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 1 backends are down. mw2 [08:11:53] PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 1 backends are down. mw3 [08:13:56] RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy [08:15:00] RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy [08:15:58] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [08:16:04] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [09:02:52] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeZU1 [09:02:54] [02miraheze/puppet] 07paladox 03743b3f3 - Twee php-fpm slightly [09:04:28] !log depool mw1 [09:04:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [09:05:57] !log apt-get upgrade - mw1 [09:06:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [09:07:49] !log repool mw1 [09:07:51] !log depool mw2 [09:07:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [09:07:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [09:11:51] !log repool mw2 [09:11:55] !log depool mw3 [09:11:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [09:12:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [09:13:47] !log repool mw3 [09:13:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [09:15:03] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [09:26:21] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [09:28:35] !log apt-get upgrade - misc2 [09:28:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [09:33:24] !log apt-get upgrade - misc4 [09:33:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [09:36:42] PROBLEM - misc4 Current Load on misc4 is CRITICAL: CRITICAL - load average: 4.53, 3.63, 2.52 [09:38:09] !log reboot misc4 - high cpu [09:38:10] PROBLEM - misc2 Puppet on misc2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [09:38:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [09:41:43] RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [09:42:47] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeZTX [09:42:48] [02miraheze/puppet] 07paladox 03d89698e - Update masters.pp [09:45:55] PROBLEM - misc4 Current Load on misc4 is WARNING: WARNING - load average: 1.95, 3.48, 1.88 [09:48:41] RECOVERY - misc4 Current Load on misc4 is OK: OK - load average: 2.05, 2.76, 1.84 [09:55:41] PROBLEM - misc4 Current Load on misc4 is WARNING: WARNING - load average: 3.76, 3.76, 2.64 [10:01:24] PROBLEM - misc4 Current Load on misc4 is CRITICAL: CRITICAL - load average: 4.02, 3.81, 2.99 [10:04:06] PROBLEM - misc4 Current Load on misc4 is WARNING: WARNING - load average: 3.98, 3.94, 3.17 [10:06:48] RECOVERY - misc4 Current Load on misc4 is OK: OK - load average: 1.06, 3.02, 2.96 [11:16:39] PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Package[php7.2-apcu],Package[php7.2-redis] [11:25:05] RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [12:55:29] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeZYl [12:55:31] [02miraheze/puppet] 07paladox 03e5854a6 - Remove gluster from mediawiki [12:57:10] !log apt-get upgrade - puppet1 [12:57:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [13:04:04] PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:04:04] PROBLEM - lizardfs5 Puppet on lizardfs5 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:04:14] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:04:26] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:04:35] PROBLEM - db5 Puppet on db5 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:04:58] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:05:07] PROBLEM - bacula1 Puppet on bacula1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:05:08] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:05:09] PROBLEM - glusterfs1 Puppet on glusterfs1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:05:25] PROBLEM - misc4 Puppet on misc4 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:06:24] PROBLEM - misc3 Puppet on misc3 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:06:25] PROBLEM - cp3 Puppet on cp3 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:06:27] PROBLEM - misc2 Puppet on misc2 is CRITICAL: CRITICAL: Puppet has 8 failures. Last run 4 minutes ago with 8 failures. Failed resources (up to 3 shown) [13:06:27] PROBLEM - db4 Puppet on db4 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:06:27] PROBLEM - lizardfs4 Puppet on lizardfs4 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:06:29] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:06:33] PROBLEM - glusterfs2 Puppet on glusterfs2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:06:34] PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:06:34] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:07:02] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 57 seconds ago with 0 failures [13:12:07] [02puppet] 07paladox created branch 03paladox-patch-4 - 13https://git.io/vbiAS [13:12:08] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JeZYD [13:12:10] [02miraheze/puppet] 07paladox 03b7dd1a6 - Reduce timeout to 150 for php-fpm and 140 for nginx [13:12:11] [02puppet] 07paladox opened pull request 03#1091: Reduce timeout to 150 for php-fpm and 140 for nginx - 13https://git.io/JeZYy [13:12:48] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JeZYH [13:12:49] [02miraheze/puppet] 07paladox 03faf56d4 - Update mediawiki.conf [13:12:51] [02puppet] 07paladox synchronize pull request 03#1091: Reduce timeout to 150 for php-fpm and 140 for nginx - 13https://git.io/JeZYy [13:13:09] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JeZYQ [13:13:10] [02miraheze/puppet] 07paladox 037963e43 - Update mediawiki-includes.conf.erb [13:13:12] [02puppet] 07paladox synchronize pull request 03#1091: Reduce timeout to 150 for php-fpm and 140 for nginx - 13https://git.io/JeZYy [13:13:53] RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures [13:14:01] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JeZY7 [13:14:02] [02miraheze/puppet] 07paladox 03de10aca - Update nginx.conf [13:14:04] [02puppet] 07paladox synchronize pull request 03#1091: Reduce timeout to 150 for php-fpm and 140 for nginx - 13https://git.io/JeZYy [13:14:40] RECOVERY - misc3 Puppet on misc3 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures [13:14:40] [02puppet] 07paladox synchronize pull request 03#1091: Reduce timeout to 150 for php-fpm and 140 for nginx - 13https://git.io/JeZYy [13:14:41] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JeZY5 [13:14:43] [02miraheze/puppet] 07paladox 03426e501 - Update mediawiki-includes.conf.erb [13:14:49] RECOVERY - db4 Puppet on db4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:14:54] RECOVERY - lizardfs4 Puppet on lizardfs4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:14:54] RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:14:55] RECOVERY - glusterfs2 Puppet on glusterfs2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:14:56] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 4 seconds ago with 0 failures [13:14:58] RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 56 seconds ago with 0 failures [13:15:12] RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 47 seconds ago with 0 failures [13:15:14] RECOVERY - lizardfs5 Puppet on lizardfs5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:15:31] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JeZYN [13:15:33] [02miraheze/puppet] 07paladox 03f928d2c - Update icinga2.conf [13:15:34] [02puppet] 07paladox synchronize pull request 03#1091: Reduce timeout to 150 for php-fpm and 140 for nginx - 13https://git.io/JeZYy [13:15:44] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:15:52] RECOVERY - db5 Puppet on db5 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [13:16:09] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JeZYh [13:16:10] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [13:16:10] [02miraheze/puppet] 07paladox 03449772c - Update phabricator.miraheze.org.conf [13:16:11] RECOVERY - glusterfs1 Puppet on glusterfs1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [13:16:12] [02puppet] 07paladox synchronize pull request 03#1091: Reduce timeout to 150 for php-fpm and 140 for nginx - 13https://git.io/JeZYy [13:16:12] RECOVERY - bacula1 Puppet on bacula1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [13:16:12] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:16:27] [02puppet] 07paladox synchronize pull request 03#1091: Reduce timeout to 150 for php-fpm and 140 for nginx - 13https://git.io/JeZYy [13:16:29] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JeZOe [13:16:30] [02miraheze/puppet] 07paladox 0316d1c3b - Update icinga2.conf [13:16:40] [02puppet] 07paladox synchronize pull request 03#1091: Reduce timeout to 150 for php-fpm and 140 for nginx - 13https://git.io/JeZYy [13:16:42] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JeZOv [13:16:43] [02miraheze/puppet] 07paladox 03aa0656b - Update nginx.conf [13:17:24] RECOVERY - cp3 Puppet on cp3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:17:32] [02puppet] 07paladox synchronize pull request 03#1091: Reduce timeout to 150 for php-fpm and 140 for nginx - 13https://git.io/JeZYy [13:17:33] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JeZOf [13:17:35] [02miraheze/puppet] 07paladox 03d23a547 - Update mediawiki-includes.conf.erb [13:17:39] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [13:21:43] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeZOk [13:21:44] [02miraheze/puppet] 07paladox 03d76b359 - Update mediawiki-includes.conf.erb [13:22:19] [02miraheze/puppet] 07paladox pushed 032 commits to 03paladox-patch-4 [+0/-0/±2] 13https://git.io/JeZOL [13:22:20] [02miraheze/puppet] 07paladox 039740496 - Merge branch 'master' into paladox-patch-4 [13:22:22] [02puppet] 07paladox synchronize pull request 03#1091: Reduce timeout to 150 for php-fpm and 140 for nginx - 13https://git.io/JeZYy [13:23:22] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JeZOq [13:23:23] [02miraheze/puppet] 07paladox 03023b37d - Update phab.miraheze.wiki.conf [13:23:25] [02puppet] 07paladox synchronize pull request 03#1091: Reduce timeout to 150 for php-fpm and 140 for nginx - 13https://git.io/JeZYy [13:24:44] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JeZOO [13:24:46] [02miraheze/puppet] 07paladox 031f9a0d7 - Update mediawiki.conf [13:24:47] [02puppet] 07paladox synchronize pull request 03#1091: Reduce timeout to 150 for php-fpm and 140 for nginx - 13https://git.io/JeZYy [13:46:41] PROBLEM - cp2 Stunnel Http for mw2 on cp2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [13:48:25] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 1 datacenter is down: 2a00:d880:5:8ea::ebc7/cpweb [13:49:49] RECOVERY - cp2 Stunnel Http for mw2 on cp2 is OK: HTTP OK: HTTP/1.1 200 OK - 24592 bytes in 5.092 second response time [13:51:46] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [14:26:31] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2645 MB (10% inode=94%); [15:00:43] PROBLEM - wiki.mxlinuxusers.de - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.mxlinuxusers.de' expires in 15 day(s) (Sun 13 Oct 2019 02:55:22 PM GMT +0000). [15:00:59] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeZsu [15:01:00] [02miraheze/ssl] 07MirahezeSSLBot 03af79d0b - Bot: Update SSL cert for wiki.mxlinuxusers.de [15:03:36] RECOVERY - wiki.mxlinuxusers.de - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mxlinuxusers.de' will expire on Thu 26 Dec 2019 02:00:52 PM GMT +0000. [15:15:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeZs1 [15:15:12] [02miraheze/services] 07MirahezeSSLBot 0385563c7 - BOT: Updating services config for wikis [15:37:30] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 9.37, 8.14, 5.77 [15:38:19] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 10.67, 8.62, 6.99 [15:41:18] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 4.55, 7.06, 6.69 [15:43:28] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 4.94, 7.01, 6.14 [15:44:02] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 3.99, 5.80, 6.27 [15:46:14] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.45, 5.87, 5.83 [18:10:38] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [18:10:39] PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [18:11:10] PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [18:11:12] that's not lizardfs [18:11:32] but should recover [18:12:11] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 1 backends are down. mw2 [18:16:13] paladox: thx [18:16:47] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [18:17:44] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [18:17:45] RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy [18:18:03] RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy [18:19:05] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy [18:19:17] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [19:37:08] how many wikis do you have as of today? [19:38:18] [02mediawiki] 07The-Voidwalker opened pull request 03#126: update CW and MW - 13https://git.io/JeZCz [19:39:16] probably around 3121 [19:39:56] based off counter we have on main page, which may or may not be accurate [19:40:16] ok.. thanks. that means something changed in the setup [19:40:26] i have this script that gets the number of miraheze wikis [19:40:35] and it gets only 2048 [19:40:42] used to work in the past [19:40:44] might be public wikis only [19:40:57] hmm.. this kind of breakage happened before [19:41:40] ok, currently it is fetching updates for 2047 and is at around 550. gotta wait for that [19:41:55] then find out why the private ones are skipped again [19:42:06] but maybe it is supposed to be only public ones [19:42:20] because a private wiki would not offer stats anyways? [19:42:23] yeah, that number checks out [19:42:40] Reception123: so this is re: https://phabricator.wikimedia.org/T232876 [19:42:41] [ ⚓ T232876 Miraheze wikis not updating on wiki stats ] - phabricator.wikimedia.org [19:42:47] i have a cron job [19:42:55] and if i run the command it finds 2047 [19:43:12] i am not sure now if the problem is just that the cron did not run (dont see why) [19:43:23] or the problem was that it was expected to find more wikis than that [19:43:41] also running it as the same user [19:45:59] do you know how it fetches the list? [19:48:04] # Dzahn - https://phabricator.wikimedia.org/T153930 [19:48:05] # John Lewis - modified for https://phabricator.wikimedia.org/T191245 [19:48:05] [ ⚓ T153930 automatic import of new miraheze wikis ] - phabricator.wikimedia.org [19:48:07] [ ⚓ T191245 switch miraheze imports from Special:SiteMatrix to Special:WikiDiscover ] - phabricator.wikimedia.org [19:48:53] $importurl = "https://meta.miraheze.org/w/api.php?action=wikidiscover&wdstate=public&format=php [19:49:00] $buffer = file_get_contents($importurl); [19:49:47] // Only public wikis are selected in importurl [19:50:20] yeah, so I'd say that number is looking pretty accurate, unless there's something wrong with WikiDiscover [19:50:32] i should have checked the number BEFORE running this [19:50:38] not sure now if resolved [19:50:51] hmm, could have helped :) [19:51:20] yea, or the ticket reporter could have given an example what is actually supposed to be missing :) [19:51:34] mutante: are You using https://meta.miraheze.org/w/api.php?action=wikidiscover&wdstate=public? [19:51:36] [ MediaWiki API result - Miraheze Meta ] - meta.miraheze.org [19:51:56] RhinosF1: yes, 15:48 < mutante> $importurl = "https://meta.miraheze.org/w/api.php?action=wikidiscover&wdstate=public&format=php [19:52:32] mutante: That's not up to date but I'm not sure how out of date [19:52:56] yeah, although I am noticing that there are a few wikis with missing stats on the list [19:53:12] sigh.. last time we changed it TO wikidiscover [19:53:17] so now something new again? [19:53:27] RhinosF1, what do you mean? [19:53:41] Voidwalker: there are wikis missing from there [19:54:15] * mutante bounces bug ticket back to "upstream" :) [19:54:21] how so? [19:54:33] mutante: My bad, ctrl+f failed [19:54:42] heh, ok [19:54:51] Stupid iPhone [19:55:20] oh yea, Apple is a problem [19:55:24] They are all in that list then [19:55:29] ok, thanks [19:55:51] well.. i will have to call this resolved and wait if Reception123 reopens it :) [19:56:51] yeah, without more information it would seem to be [19:57:03] mutante: I'll check wikistats tonight [19:57:20] RhinosF1: cool. thanks. currently update running [19:58:18] the previous version of the update script, that did not use WikiDiscover, it somehow had to get 2 lists and merge them [19:58:30] but this is not the case anymore and we only want public wikis [19:58:33] mutante: Whats the URL to access it again? [19:58:36] unless i have forgotten [19:58:48] Public wikis only seems to make sense [19:58:58] http://wikistats.wmflabs.org/display.php?t=mh [19:58:58] [ WikiStats - List of Miraheze ] - wikistats.wmflabs.org [19:59:33] all those names with "pedia" in it [19:59:45] technically i think that's a trademark issue :p [19:59:57] RhinosF1: ok, thanks again [20:00:13] mutante: That is working perfectly now [20:00:35] except that it is only at 950 of 2047 [20:00:39] right the second [20:00:49] later it should be done [20:01:17] Ah, Ive checked multiple wikis that weren't on before and they are now :) [20:01:25] so there are 2 types of updates [20:01:37] one is fetching the numbers from all wikis in the DB [20:01:45] and the other is fetching the list of wikis itself [20:02:16] when it runs an update for the actual list of wikis.. first it deletes the content of the db.. then it gets the new list.. and then it runs a number update [20:02:26] we have over 3,000+ wikis [20:02:35] paladox: WikiDiscover does not agree :) [20:02:40] oh Voidwalker answered already [20:02:47] ohh, hmm [20:03:20] the real question is what "private" means [20:03:24] [02mediawiki] 07paladox closed pull request 03#126: update CW and MW - 13https://git.io/JeZCz [20:03:26] [02miraheze/mediawiki] 07paladox pushed 032 commits to 03REL1_33 [+0/-0/±4] 13https://git.io/JeZWk [20:03:27] [02miraheze/mediawiki] 07The-Voidwalker 030d11ac1 - update CW and MW [20:03:29] [02miraheze/mediawiki] 07paladox 037451c8e - Merge pull request #126 from The-Voidwalker/REL1_33 update CW and MW [20:03:30] does a private wiki reveal the stats? [20:03:35] thanks paladox [20:03:45] mutante: I'd guess no [20:03:53] mutante it should [20:03:58] is the existence of a private wiki ,, public? [20:04:21] are you listing "this wiki exists" even when you cant login? [20:04:25] Voidwalker your welcome :) [20:04:30] does private even mean you have to login to read it? [20:04:33] you can fetch a list of all private wikis, but you may not be able to view the edits/pages/admincount/etc [20:04:37] or does it only mean you have to login to EDIT it? [20:04:40] yes [20:04:40] https://github.com/miraheze/WikiDiscover/blob/a0d461be9f999871b49aa771c6c3438d9f7bac0f/includes/WikiDiscover.php#L48 [20:04:42] [ WikiDiscover/WikiDiscover.php at a0d461be9f999871b49aa771c6c3438d9f7bac0f · miraheze/WikiDiscover · GitHub ] - github.com [20:04:57] which is called here https://github.com/miraheze/WikiDiscover/blob/master/includes/ApiWikiDiscover.php#L35 [20:04:58] [ WikiDiscover/ApiWikiDiscover.php at master · miraheze/WikiDiscover · GitHub ] - github.com [20:04:58] oh! [20:05:03] well, if i cant get the stats numbers then there is no point having them in the stats table [20:05:07] i wonder if the stats includes deleted wiki's? [20:05:19] mutante: it’s existence is known and main page is public but everything else shouldn’t be [20:05:37] main_page is public? heh, that is even more confusing :) [20:05:40] but alright [20:06:02] reminds me of the similar discussion with wikimedia mailing lists [20:06:03] mutante did you do https://github.com/miraheze/WikiDiscover/blob/master/includes/ApiWikiDiscover.php#L20 ? [20:06:05] [ WikiDiscover/ApiWikiDiscover.php at master · miraheze/WikiDiscover · GitHub ] - github.com [20:06:11] "private" means different things to different people [20:06:18] ohh [20:06:20] i see why [20:06:30] paladox: see import URL i use above [20:06:35] did the code change? [20:07:04] mutante: It removes 'read' from * does a private wiki but uses the read whitelist to make main page and some special pages public [20:07:08] mutante https://meta.miraheze.org/w/api.php?action=wikidiscover&wdstate=all|private [20:07:09] [ MediaWiki API result - Miraheze Meta ] - meta.miraheze.org [20:07:39] though [20:07:40] with https://meta.miraheze.org/w/api.php?action=wikidiscover [20:07:42] [ MediaWiki API result - Miraheze Meta ] - meta.miraheze.org [20:07:45] i get private wikis [20:07:52] I've already confirmed that they are using the API properly [20:08:03] paladox: < mutante> // Only public wikis are selected in importurl [20:08:06] that's a code comment [20:08:15] oh? [20:08:18] importurl? [20:08:47] there is no consenus on what the behaviour SHOULD be :) [20:08:58] i get bug reports but my side is not the one that changed [20:09:27] paladox: can you get stats of any private wiki? [20:09:40] well through that api, ye [20:09:41] *yes [20:09:57] are you blocked from Special:Statistics?action=raw ? [20:10:30] yup [20:10:47] paladox: does it make sense to block one way while leaving the other public? [20:10:55] oh [20:11:04] you ment "statistics" not wikidiscover [20:11:13] yes, i mean stats numbers [20:11:19] can you get them from a "private" wiki? [20:11:34] nope [20:11:37] i doin't think so [20:11:48] well then..i won't try to import them into a stats table [20:11:58] ok [20:11:59] they would only show up with 0 [20:12:03] like failures [20:12:37] yeh [20:12:41] the question is though what you want to achieve [20:13:05] you could either have a list of wikis even when they are not usable [20:13:11] but people could learn they _exist_ [20:13:15] and possibly ask to join them [20:13:34] or you want them to be a complete secret [20:13:42] even the fact they exist [20:13:45] and how many users they have [20:14:10] i guess if you ask each wiki "owner" what private means to them you will get 10 different answers [20:14:44] yeh [20:14:46] also why are these wiki private in the first place [20:14:53] are they just afraid of spam? [20:14:59] or do they actually have private data [20:15:23] hmm, i'm not entirly sure. [20:15:27] my guess is most of them are just saying they dont want to deal with spam [20:15:33] and "no need to make it public" [20:15:39] which kind of sucks :) [20:15:50] nicer to have them default to public unless they have real reasons [20:16:07] but if they DO have real reasons..like private data. or criminal stuff.. then do you want them on the servers [20:16:15] it's complicated (tm) [20:16:18] wikis default to public [20:16:28] unless the requesters ask for it to be private [20:16:47] (that'll be on the request wiki form) [20:16:59] users can also make it private after it being public too [20:17:01] i cant even think of many reasons to run a legit private wiki besides anti-spam isnt working [20:17:27] you should make them pay for being private :) [20:17:33] it's a special service [20:17:59] heh [20:18:05] it's the right line to draw.. public is free.. private costs money [20:18:17] freemium service [20:19:31] What do they have to hide?:) [20:20:00] lol [20:20:23] Hostpitals use our services :) [20:20:53] heh, is that legal? [20:21:02] i would think so? [20:21:02] patient data is under special protection [20:21:22] oh, no personal data like patient stuff is stored on here, at least i doin't think so. [20:21:47] We have everything from gaming to schools to hospitals to song contests [20:21:50] well.. if you give people an "internal" thing to paste stuff on it's usually just a matter of time [20:22:54] NHS uses us :P [20:23:03] send them a bill :) [20:23:07] lolol [20:23:17] they would probably just pay it [20:23:52] i would let the public non-commercial wikis stay free but charge the ones run by governments :P [20:24:01] might solve funding :P [20:24:06] that's what i'm saying [20:24:34] it's reasonable to make a difference between "default public wiki" and "private with your own domain run for government or business" [20:24:47] the latter creates more work [20:25:01] and they have money and are used to paying for services [20:25:09] i wonder how many governments use us :P [20:25:17] and if any other fraction of the UK gov does [20:25:20] where domain like *.gov ? [20:25:33] that would be the funniest [20:25:36] Wait NHS uses us? link? [20:27:32] probably https://nicotinehealthbenefits.miraheze.org/wiki/Main_Page :) [20:27:33] [ HealthBenefitsofNicotineWiki ] - nicotinehealthbenefits.miraheze.org [20:27:50] health benefits of nicotine. lol? [20:28:12] sounds like spammer SEO :) [20:28:31] mutante: doesnt have anything on it [20:29:18] Zppix https://phabricator.miraheze.org/T4350 [20:29:19] [ ⚓ T4350 Cannot set private wiki back to private! ] - phabricator.miraheze.org [20:29:20] yea. maybe it's just about having the domain name [20:29:38] inurl: nicotine + health or so [20:30:31] paladox: i wonder if it's possible to fix acme-setup in labs [20:30:44] mutante hmm? [20:30:48] i just use the old way :) [20:30:58] Warning: /Stage[main]/Profile::Gerrit::Server/Letsencrypt::Cert::Integrated[gerrit]/Exec[acme-setup-acme-gerrit]: Skipping because of failed dependencies [20:31:00] not using the acme service that you have to install [20:31:12] why is it failing? [20:31:16] Warning: /Stage[main]/Httpd/Service[apache2]: Skipping because of failed dependencies [20:31:24] webserver needs a cert? [20:31:24] what's before Warning: /Stage[main]/Profile::Gerrit::Server/Letsencrypt::Cert::Integrated[gerrit]/Exec[acme-setup-acme-gerrit]: Skipping because of failed dependencies? [20:31:37] /usr/local/sbin/acme-setup -i gerrit -s phabricator-09.phabricator.wmflabs.org --key-user root --key-group root' returned 1 instead of one of [0] [20:32:00] Notice: /Stage[main]/Profile::Gerrit::Server/Letsencrypt::Cert::Integrated[gerrit]/Exec[acme-setup-self-gerrit]/returns: x509: Error on line 1 of config file "/tmp/tmpt1QUbW" [20:32:09] paladox: oh.. syntax error ^ ? [20:32:17] syntax?!?! [20:33:27] Notice: /Stage[main]/Profile::Gerrit::Server/Letsencrypt::Cert::Integrated[gerrit]/Exec[acme-setup-self-gerrit]/returns: x509: Error on line 1 of config file "/tmp/tmpt1QUbW" [20:33:36] Command >>/usr/bin/openssl x509 -req -sha256 -out /etc/acme/cert/gerrit.crt -in /etc/acme/csr/gerrit.pem -signkey /etc/acme/key/gerrit.key -extfile /tmp/tmpt1QUbW -extensions v3_req -days 90<< failed, exit code 1 [20:33:50] sorry, it's off-topic here [20:34:02] but that is what i was wondering next [20:34:03] its fine [20:34:32] paladox: speaking of phab.wmflabs.org can you please run apt on those instances the warnings on icinga2 are making it hard to find any possible real issues :P [20:34:41] ok [20:35:02] paladox: that /tmp file simply does not exist :) [20:35:11] folder? [20:35:31] :system library:fopen:No such file or directory:../crypto/bio/bss_file.c:72:fopen('/tmp/tmpt1QUbW','r') [20:35:37] Can't open /tmp/tmpt1QUbW for reading, No such file or directory [20:36:14] i bet [20:36:29] this script needs updating to support buster? [20:36:57] possible [20:37:11] mutante where did you get the script from? [20:37:15] but it would have to be a combination of buster and labs [20:37:24] paladox: i dont know, it's your instance :) [20:37:31]