[00:05:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9qP [00:05:13] [02miraheze/services] 07MirahezeSSLBot 03c31e296 - BOT: Updating services config for wikis [00:10:32] [02puppet] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbiAS [00:10:33] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/fj9qS [00:10:35] [02miraheze/puppet] 07paladox 0393d0660 - Add icinga grants [00:10:36] [02puppet] 07paladox opened pull request 03#1054: Add icinga grants - 13https://git.io/fj9q9 [00:20:46] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/fj9q5 [00:20:47] [02miraheze/puppet] 07paladox 03a7ef580 - Update default-grants.sql.erb [00:20:49] [02puppet] 07paladox synchronize pull request 03#1054: Add icinga grants - 13https://git.io/fj9q9 [00:23:48] [02puppet] 07paladox synchronize pull request 03#1054: Add icinga grants - 13https://git.io/fj9q9 [00:23:50] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/fj9qx [00:23:51] [02miraheze/puppet] 07paladox 038e602a6 - Update config.pp [00:26:20] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/fj9qh [00:26:21] [02miraheze/puppet] 07paladox 037a6a6c8 - Update db.pp [00:26:23] [02puppet] 07paladox synchronize pull request 03#1054: Add icinga grants - 13https://git.io/fj9q9 [00:26:39] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/fj9qj [00:26:40] [02miraheze/puppet] 07paladox 030a22941 - Update config.pp [00:26:42] [02puppet] 07paladox synchronize pull request 03#1054: Add icinga grants - 13https://git.io/fj9q9 [00:31:11] !log REVOKE ALL PRIVILEGES ON *.* FROM 'icinga'@'185.52.1.76'; -db5 [00:31:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:31:16] uh [00:31:22] !log that's for db4 not db5 [00:31:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:32:34] !log REVOKE ALL PRIVILEGES ON *.* FROM 'icinga'@'81.4.109.166'; -db4 [00:32:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:32:54] !log GRANT SELECT, INSERT, UPDATE, DELETE, DROP, CREATE VIEW, INDEX, EXECUTE ON icinga.* TO 'icinga'@'185.52.1.76' IDENTIFIED BY 'xxxx'; -db4 [00:32:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:33:24] PROBLEM - db4 MySQL on db4 is CRITICAL: Access denied for user 'icinga'@'185.52.1.76' (using password: NO) [00:34:33] [02puppet] 07paladox closed pull request 03#1054: Add icinga grants - 13https://git.io/fj9q9 [00:34:35] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/fj9mI [00:34:36] [02miraheze/puppet] 07paladox 036ec2ae6 - Add icinga grants (#1054) * Add icinga grants * Update default-grants.sql.erb * Update config.pp * Update db.pp * Update config.pp [00:34:37] [02puppet] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbiAS [00:34:39] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-2 [00:43:04] RECOVERY - db4 MySQL on db4 is OK: Uptime: 621748 Threads: 70 Questions: 777819852 Slow queries: 28392015 Opens: 57177145 Flush tables: 1 Open tables: 800 Queries per second avg: 1251.021 [00:43:11] RECOVERY - db5 MySQL on db5 is OK: Uptime: 7690 Threads: 10 Questions: 1180 Slow queries: 157 Opens: 18 Flush tables: 1 Open tables: 12 Queries per second avg: 0.153 [00:43:43] !log MariaDB [icinga]> drop table test; -db5 [00:43:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:44:27] Hi! Here is the list of currently open high priority tasks on Phabricator [00:44:34] No updates for 8 days - https://phabricator.miraheze.org/T4569 - Special:Analytics is missing most fields - authored by RhinosF1, assigned to Paladox [00:44:41] No updates for 10 days - https://phabricator.miraheze.org/T4564 - Mediawiki internal error (DB query error) - authored by Kees_Langeveld, assigned to Reception123 [00:44:48] No updates for 16 days - https://phabricator.miraheze.org/T4547 - Fix WikiBase Client - authored by AmandaCath, assigned to None [00:44:54] No updates for 10 days - https://phabricator.miraheze.org/T4260 - Migrate all wikis to elasticsearch - authored by Southparkfan, assigned to None [00:54:36] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:57:54] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9mB [00:57:55] [02miraheze/puppet] 07paladox 03b5e995f - Update ip for mediawiki-internal-db-master-db5.miraheze.org [02:10:13] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9YI [02:10:15] [02miraheze/services] 07MirahezeSSLBot 03ca1ffe4 - BOT: Updating services config for wikis [05:51:47] Morning Reception123 [05:51:58] hi [05:53:42] Reception123: I can’t believe System Operator - got locked and came back As an IP — Do you know who he was a sock of? SPF locked him as abusing multiple accounts [05:54:36] well that's steward stuff [05:55:05] Reception123: yeah true [06:26:43] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 2955 MB (12% inode=94%); [08:10:14] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9s7 [08:10:16] [02miraheze/services] 07MirahezeSSLBot 031cca009 - BOT: Updating services config for wikis [10:16:04] Rhinos are you here? [11:01:10] @GOTILON yes [11:02:11] @GOTILON sort of, why? [12:10:17] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9cd [12:10:19] [02miraheze/services] 07MirahezeSSLBot 03b240348 - BOT: Updating services config for wikis [13:22:43] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2648 MB (10% inode=94%); [13:25:13] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9Cd [13:25:14] [02miraheze/services] 07MirahezeSSLBot 0323bde06 - BOT: Updating services config for wikis [15:00:20] O/ [15:03:56] RhinosF1: pm? [15:08:49] !log revoke usage on *.* from 'icinga'@'185.52.1.76'; -db4 [15:08:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [15:09:29] paladox: inb4 icinga starts yelling at you [15:09:52] heh [15:10:08] !log REVOKE ALL PRIVILEGES ON *.* FROM 'icinga'@'185.52.1.76'; -db4 [15:10:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [15:10:20] Poor icinga [15:10:57] :D [15:28:55] !log root@misc2:/home/paladox# sudo service php7.3-fpm stop - misc2 [15:28:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [15:29:02] !log moving piwik (matomo) db to db5 [15:29:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [15:31:17] PROBLEM - misc2 Puppet on misc2 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 7 minutes ago with 0 failures [15:32:19] PROBLEM - misc2 HTTPS on misc2 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 372 bytes in 0.008 second response time [15:40:15] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj986 [15:40:16] [02miraheze/services] 07MirahezeSSLBot 039755f1c - BOT: Updating services config for wikis [16:20:56] [02puppet] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbiAS [16:20:58] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/fj941 [16:20:59] [02miraheze/puppet] 07paladox 03cda729f - matomo: Switch to db5 [16:21:01] [02puppet] 07paladox opened pull request 03#1055: matomo: Switch to db5 - 13https://git.io/fj94M [16:22:53] [02puppet] 07paladox closed pull request 03#1055: matomo: Switch to db5 - 13https://git.io/fj94M [16:22:54] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj94y [16:22:56] [02miraheze/puppet] 07paladox 038061916 - matomo: Switch to db5 (#1055) [16:22:57] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-2 [16:22:59] [02puppet] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbiAS [16:25:18] RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 31 seconds ago with 0 failures [16:25:28] !log drop piwik on db4 [16:25:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [16:26:19] RECOVERY - misc2 HTTPS on misc2 is OK: HTTP OK: HTTP/1.1 200 OK - 41810 bytes in 0.113 second response time [16:27:20] PROBLEM - db4 Disk Space on db4 is WARNING: DISK WARNING - free space: / 30039 MB (8% inode=96%); [16:28:49] [02puppet] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbiAS [16:28:51] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/fj94N [16:28:52] [02miraheze/puppet] 07paladox 039589b86 - bacula: Add db5 [16:28:54] [02puppet] 07paladox opened pull request 03#1056: bacula: Add db5 - 13https://git.io/fj94A [16:29:18] [02puppet] 07paladox closed pull request 03#1056: bacula: Add db5 - 13https://git.io/fj94A [16:29:19] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj94x [16:29:21] [02miraheze/puppet] 07paladox 033f4885e - bacula: Add db5 (#1056) [16:29:22] [02puppet] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbiAS [16:29:24] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-2 [16:35:41] [02miraheze/IncidentReporting] 07translatewiki pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/fj9Bk [16:35:43] [02miraheze/IncidentReporting] 07translatewiki 03c559bdb - Localisation updates from https://translatewiki.net. [16:35:45] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9BI [16:35:46] [02miraheze/ManageWiki] 07translatewiki 036faf913 - Localisation updates from https://translatewiki.net. [16:39:43] miraheze/IncidentReporting/master/c559bdb - translatewiki.net The build is still failing. https://travis-ci.org/miraheze/IncidentReporting/builds/566565219 [17:39:23] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fj9R3 [17:39:24] [02miraheze/mw-config] 07paladox 03f6620eb - database: Add db5 and set wgCreateWikiDatabaseClusters [17:39:26] [02mw-config] 07paladox created branch 03paladox-patch-3 - 13https://git.io/vbvb3 [17:39:27] [02mw-config] 07paladox opened pull request 03#2713: database: Add db5 and set wgCreateWikiDatabaseClusters - 13https://git.io/fj9Rs [17:40:35] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fj9RG [17:40:36] [02miraheze/mw-config] 07paladox 036ad0ce9 - Update Database.php [17:40:38] [02mw-config] 07paladox synchronize pull request 03#2713: database: Add db5 and set wgCreateWikiDatabaseClusters - 13https://git.io/fj9Rs [17:43:20] [02mw-config] 07Southparkfan reviewed pull request 03#2713 commit - 13https://git.io/fj9RZ [17:43:21] [02mw-config] 07Southparkfan reviewed pull request 03#2713 commit - 13https://git.io/fj9Rn [17:44:19] [02mw-config] 07paladox synchronize pull request 03#2713: database: Add db5 and set wgCreateWikiDatabaseClusters - 13https://git.io/fj9Rs [17:44:20] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fj9Rc [17:44:22] [02miraheze/mw-config] 07paladox 032df1f4c - Update Database.php [17:45:54] [02mw-config] 07paladox synchronize pull request 03#2713: database: Add db5 and set wgCreateWikiDatabaseClusters - 13https://git.io/fj9Rs [17:45:56] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fj9Rl [17:45:57] [02miraheze/mw-config] 07paladox 03bd68b3b - Update LocalSettings.php [17:46:02] [02mw-config] 07paladox reviewed pull request 03#2713 commit - 13https://git.io/fj9R8 [17:46:04] [02mw-config] 07paladox reviewed pull request 03#2713 commit - 13https://git.io/fj9R4 [17:49:20] [02mw-config] 07JohnFLewis commented on pull request 03#2713: database: Add db5 and set wgCreateWikiDatabaseClusters - 13https://git.io/fj9Ra [17:51:37] [02mw-config] 07Southparkfan commented on pull request 03#2713: database: Add db5 and set wgCreateWikiDatabaseClusters - 13https://git.io/fj9Rw [17:51:47] [02mw-config] 07Southparkfan closed pull request 03#2713: database: Add db5 and set wgCreateWikiDatabaseClusters - 13https://git.io/fj9Rs [17:52:24] [02mw-config] 07paladox deleted branch 03paladox-patch-3 - 13https://git.io/vbvb3 [17:52:25] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-3 [17:55:59] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9RP [17:56:00] [02miraheze/mw-config] 07paladox 03d9114bb - Disable wmgUseCirrusSearch for all wikis apart from 7 [17:57:50] !log create searchindex table for metawiki on db4 [17:57:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [17:58:05] !log sudo -u www-data php rebuildtextindex.php --wiki=metawiki - db4 [17:58:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [17:58:37] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9RD [17:58:38] [02miraheze/mw-config] 07paladox 03d255f09 - Unset wmgSearchType and wmgUseCirrusSearch for metawiki [17:59:11] !log create searchindex table for allthetropeswiki on db4 [17:59:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:00:05] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9Ry [18:00:06] [02miraheze/mw-config] 07paladox 0387373f7 - Unset wmgUseCirrusSearch and wmgSearchType for allthetropeswiki [18:00:41] !log sudo -u www-data php rebuildtextindex.php --wiki=allthetropeswiki - db4 [18:00:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:05:34] !log create searchindex table for buswiki on db4 [18:05:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:06:03] !log rebuildtextindex.php being ran on mw1 not db4 [18:06:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:06:31] !log sudo -u www-data php rebuildtextindex.php --wiki=buswiki - mw1 [18:06:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:07:11] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9Rj [18:07:12] [02miraheze/mw-config] 07paladox 034cd45c7 - unset wmgUseCirrusSearch and wmgSearchType for buswiki [18:07:26] !log create searchindex table for isvwiki on db4 [18:07:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:07:45] !log sudo -u www-data php rebuildtextindex.php --wiki= isvwiki - mw1 [18:07:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:08:04] !log sudo -u www-data php rebuildtextindex.php --wiki=isvwiki - mw1 [18:08:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:08:50] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj90e [18:08:51] [02miraheze/mw-config] 07paladox 03aa1022a - Unset wmgUseCirrusSearch and wmgSearchType for isvwiki [18:11:48] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj90v [18:11:50] [02miraheze/mw-config] 07paladox 0335a8f0b - Disable wmgUseCirrusSearch for buswiki [18:11:58] !log create searchindex table for nonsensopediawiki on db4 [18:12:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:12:15] !log sudo -u www-data php rebuildtextindex.php --wiki=nonsensopediawiki - mw1 [18:12:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:12:49] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj90f [18:12:51] [02miraheze/mw-config] 07paladox 03eb7034d - Unset wmgUseCirrusSearch and wmgSearchType for nonsensopediawiki [18:13:13] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj90J [18:13:15] [02miraheze/mw-config] 07paladox 031e02928 - Unset wmgUseCirrusSearch for nonsensopediawiki [18:13:41] !log create searchindex table for pointmanwiki on db4 [18:13:44] !log create searchindex table for test1wiki on db4 [18:13:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:13:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:14:34] !log sudo -u www-data php rebuildtextindex.php --wiki=pointmanwiki - mw1 [18:14:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:14:48] !log sudo -u www-data php rebuildtextindex.php --wiki=test1wiki - mw1 [18:14:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:15:16] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj90T [18:15:18] [02miraheze/mw-config] 07paladox 037d36bb5 - Unset wmgUseCirrusSearch and wmgSearchType for all wikis [18:18:40] !log delete cirrusSearchElasticaWrite from redis [18:18:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:19:20] !log delete cirrusSearchLinksUpdate from redis [18:19:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:19:27] !log delete cirrusSearchLinksUpdatePrioritized from redis [18:19:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:19:50] !log upgrade php on misc2 [18:19:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:25:18] PROBLEM - misc2 Puppet on misc2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:26:04] !log restart jobchron and jobrunner on db5 [18:26:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:26:10] that's mw3 [18:26:11] * paladox fix [18:27:18] RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 18 seconds ago with 0 failures [18:40:55] [02puppet] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbiAS [18:40:56] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/fj90B [18:40:58] [02miraheze/puppet] 07paladox 037528687 - jobrunner: Temporarily remove monitoring for JobQueue It currently does not work and is causing a ton of exceptions in mw3 log. [18:40:59] [02puppet] 07paladox opened pull request 03#1057: jobrunner: Temporarily remove monitoring for JobQueue - 13https://git.io/fj90R [18:43:14] [02puppet] 07paladox closed pull request 03#1057: jobrunner: Temporarily remove monitoring for JobQueue - 13https://git.io/fj90R [18:43:16] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj902 [18:43:17] [02miraheze/puppet] 07paladox 0321c18b9 - jobrunner: Temporarily remove monitoring for JobQueue (#1057) It currently does not work and is causing a ton of exceptions in mw3 log. [18:43:19] [02puppet] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbiAS [18:43:20] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-2 [18:47:43] [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj90r [18:47:44] [02miraheze/MirahezeMagic] 07paladox 0372fb45d - Remove elasticsearch stuff from onCreateWikiCreation [18:48:22] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_33 [+0/-0/±1] 13https://git.io/fj90o [18:48:23] [02miraheze/mediawiki] 07paladox 0381eabb8 - Update MirahezeMagic [19:46:51] Hello Eric! If you have any questions feel free to ask and someone should answer soon. [19:48:06] I'm trying to set up VisualEditor on my newly created MediaWiki page hosted by Miraheze but I get the following error "Error loading data from server: apierror-visualeditor-docserver-http: HTTP 404. Would you like to retry?" [19:48:18] Can anyone help? [19:51:21] Guest30887: Im looking into it now [19:52:42] Thank you [19:53:26] Paladox: See https://phabricator.miraheze.org/T4589 -- it's in services.yaml fine [19:53:27] [ ⚓ T4589 Enable VisualEditor on g12.miraheze.org ] - phabricator.miraheze.org [19:55:17] Paladox: or g12 is listed there so unless it's missing the wiki suffix for some reason and should have it [19:55:34] RhinosF1: what I also find weird is that the wiki is in mobile mode and has no desktop mode? [19:56:11] Reception123: noticed as well [19:56:35] Guest30887: can you give RhinosF1 member access old so I can look closer and mess around [19:56:50] Should be working now [19:57:00] Let me give it a try [19:57:13] it's because puppet is failing on misc4 (which requires a removal of a file before puppet is ran) it's a regression in puppet [19:57:21] paladox: it's not, and also how is it in mobile mode and not in desktop? (at all) [19:57:36] paladox: I'll take care of that [19:57:38] not? [19:57:58] The editor seems to be working now [19:58:01] paladox: yeah, you can't do to desktop mode [19:58:08] Guest30887: Ok, great :) sorry for the inconvenience caused [19:58:44] paladox: https://g12.miraheze.org/wiki/P%C3%A1gina_principal try entering desktop mode [19:58:44] [ G12 ] - g12.miraheze.org [19:58:51] No problem, thank you for your help! [19:59:04] !log removed /etc/aliases on misc4 (puppet bug, refresh) [19:59:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [19:59:42] !log upgrade puppet to 6.7.2 on misc4 (it will fix the regression) [19:59:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:00:03] Reception123 ohh that was you? [20:00:08] i removed the lock file :P [20:00:35] !log upgrade puppet to 6.7.2 on puppet1 (it will fix the regression) [20:00:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:02:35] !log upgrade icingaweb2, php and puppet-agent on misc1 [20:02:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:03:20] paladox: oh ,whoops [20:03:25] paladox: any ideas on the mobile thing though? [20:03:27] really don't get it [20:03:58] RhinosF1: regarding the services.yaml there is no wiki suffix needed [20:04:25] see https://github.com/miraheze/services/blob/master/README.md :P [20:04:26] [ services/README.md at master · miraheze/services · GitHub ] - github.com [20:04:40] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [20:04:42] Reception123 https://g12.miraheze.org/wiki/Especial:ManageWiki/settings#mw-section-styling [20:04:43] [ Erro de permissão - G12 ] - g12.miraheze.org [20:04:51] "MobileFrontend Autodetect Mobile View" is enabled [20:04:55] PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Package[php7.2-apcu],Package[php7.2-redis] [20:04:56] that needs to be disabled [20:05:27] paladox: I guess maybe it was enabled on purpose then... since the user didn't mention that [20:05:31] paladox: but why is that a thing? [20:05:46] wrong person to ask why that setting exists :P [20:05:48] paladox: and tbh "If this is not set, then no device detection will be occur." confuses me too [20:05:54] all i did was move it from ls to mw :D [20:06:01] paladox: we should rather right "If this is set, your wiki will always be in mobile view" [20:06:03] *write [20:06:19] opposed to me doing that? [20:06:37] Reception123: why for some wikis is the wiki suffix dropped? [20:06:54] RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:07:26] https://github.com/wikimedia/mediawiki-extensions-MobileFrontend/search?q=wgMFAutodetectMobileView&unscoped_q=wgMFAutodetectMobileView [20:07:27] [ Search · wgMFAutodetectMobileView · GitHub ] - github.com [20:07:50] RhinosF1: it's not for some, but the other wikis are just called examplewikiwiki (i.e. examplewiki.miraheze.org) [20:07:59] Reception123 https://github.com/wikimedia/mediawiki-extensions-MobileFrontend/blob/fe403bc635a15df9157ba8ceb3b51c53aa9e890f/includes/devices/DeviceDetectorService.php#L23 [20:08:00] [ mediawiki-extensions-MobileFrontend/DeviceDetectorService.php at fe403bc635a15df9157ba8ceb3b51c53aa9e890f · wikimedia/mediawiki-extensions-MobileFrontend · GitHub ] - github.com [20:08:37] paladox: fair point, but their description is really confusing [20:08:46] if I saw that, I'd assume if you do disable it, there is no mobile view at all [20:09:25] "Set this to true to automatically show mobile view depending on people's user-agent." see this really does confuse me because this makes it sound as if if this is disabled and I visit a wiki on mobile, I'd see it in desktop mode [20:09:27] which is not the case [20:09:38] Nope, what the config does is when enabled it'll handle the device detection (though appears to may have broken detection? since i'm using a mac and that's not a mobile?) [20:09:47] otherwise it expects you to do it through the frotend [20:09:51] e.g varnish [20:09:53] Reception123: ah [20:10:19] paladox: oh, I see. but yeah, it's definitely broken since I'm also on a laptop which clearly =! mobile [20:10:27] yeh [20:10:50] paladox: but why do we offer that setting to users if we deal with it through frontend? we should just get rid of that since I can't see any use in users using that if we already have a system in place [20:11:21] Mind doing a pull? [20:11:27] (to remove the config ) [20:11:40] * paladox is renewing m.miraheze.org cert [20:12:19] Paladox: If it's just managewikisettings.php to remove it from I can look in 5 as Id like to get to know the repos well anyway [20:12:33] RhinosF1: sure thing then, I'll leave it to you :) [20:12:36] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 11 seconds ago with 0 failures [20:12:44] You also have to remove it from LS too (and maybe LE (not sure though)) [20:12:52] paladox: no, definitely not from LS! [20:13:01] that would make the default config true and make that setting true for all wikis [20:13:06] which would land us in big trouble [20:13:10] it's unset by default *i think* [20:13:19] paladox: the docs you linked said the opposite [20:13:26] oh [20:13:28] https://github.com/wikimedia/mediawiki-extensions-MobileFrontend/blob/c877d1ff863c5ae30d9048ba90710dad30f0ec4f/README.md#wgmfautodetectmobileview [20:13:28] damn it is [20:13:28] [ mediawiki-extensions-MobileFrontend/README.md at c877d1ff863c5ae30d9048ba90710dad30f0ec4f · wikimedia/mediawiki-extensions-MobileFrontend · GitHub ] - github.com [20:13:30] i'm wrong [20:13:40] RhinosF1: make sure *not* to remove from LS [20:13:48] only ManageWiki [20:14:29] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9uW [20:14:30] [02miraheze/dns] 07paladox 0338c692e - Add acme challenge for m.miraheze.org cert renewal [20:14:49] !log upgrade puppet on ns1 [20:14:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:17:03] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9u4 [20:17:04] [02miraheze/ssl] 07paladox 03cad2df4 - Renew m.miraheze.org ssl certificate [20:17:44] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9uR [20:17:45] [02miraheze/dns] 07paladox 032e8b263 - Remove old acme challenges for m.miraheze.org [20:19:45] [02mw-config] 07RhinosF1 opened pull request 03#2714: Remove MobileFrontendAutoDetect - 13https://git.io/fj9uE [20:20:14] paladox, Reception123: ^ :) [20:20:58] paladox: before I merge, what will happen to wikis who accidentally enabled this? [20:21:19] They will act as if the config is not enabled [20:23:07] !log upgrade a few packages on misc3 [20:23:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:24:15] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Wed 30 Oct 2019 07:16:33 PM GMT +0000. [20:25:02] !log upgrade puppet-agent on db4 [20:25:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:27:34] !log upgrade puppet on mw[123] [20:27:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:30:30] !log upgrade php and puppet on test1 [20:30:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:34:06] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [20:34:23] !log upgrade puppet on lizardfs[123] [20:34:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:36:09] Looks like today is upgrade day [20:36:57] [02mw-config] 07paladox commented on pull request 03#2714: Remove MobileFrontendAutoDetect - 13https://git.io/fj9u5 [20:37:01] [02mw-config] 07paladox closed pull request 03#2714: Remove MobileFrontendAutoDetect - 13https://git.io/fj9uE [20:37:02] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9ud [20:37:04] [02miraheze/mw-config] 07RhinosF1 0364456b8 - Remove MobileFrontendAutoDetect (#2714) per IRC [20:37:37] !log upgrade packages on lizardfs[123] [20:37:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:38:02] paladox: thx, now let's hope it works [20:40:22] !log upgrade packages on cp[234] [20:40:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:42:32] PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [20:43:46] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [20:44:06] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 28 seconds ago with 0 failures [20:47:22] paladox: change live it looks like although https://g12.miraheze.org/wiki/P%C3%A1gina_principal still stuck in mobile [20:47:23] [ G12 ] - g12.miraheze.org [20:47:36] it's desktop for me [20:48:27] paladox: I see https://usercontent.irccloud-cdn.com/file/T7zKc0cv/Screenshot%202019-08-01%20at%2021.48.04.png [20:48:39] clear the cache :) [20:50:21] paladox: nope cleared my cache and tried ?action=purge [20:50:33] does a private tab work? [20:50:50] oh [20:50:52] damn [20:50:58] paladox: nope [20:51:45] !log ban req.http.Host == g12.miraheze.org - cp4 [20:51:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:52:04] paladox: ?? what does that mean [20:52:36] it purges the cache for that wiki [20:53:14] paladox: won't it affect every wiki with the bad setting [20:53:22] nope [20:53:30] and it dosen't seem the cache is the issue either [20:54:32] RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:55:13] paladox: check dev console [20:55:41] ohhh [20:55:45] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:55:46] they made the mobile skin the default [20:55:56] https://www.irccloud.com/pastebin/yhQaJmZO/ [20:55:57] [ Snippet | IRCCloud ] - www.irccloud.com [20:56:05] that's why it works for me [20:56:12] i have timeless set as a global skin for me [20:56:14] in my prefs [20:56:17] Reception123 ^ [20:56:30] paladox: also Visual editor don't like that so we might want to disable VE [20:56:45] Nah, it's fine to keep that. [20:57:29] paladox: k and yeah I just go with default skins [20:58:12] also we can revert your change [20:58:47] hmm, maybe not [21:00:39] paladox: eh, it's still a confusing description [21:01:08] ok, well we already auto detect so config pointless [21:01:16] PROBLEM - espiral.org - Gandi on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:01:39] paladox: yeah, it's a pointless feature anyway as we've said [21:03:10] PROBLEM - espiral.org - Gandi on sslhost is WARNING: WARNING - Certificate 'espiral.org' expires in 22 day(s) (Fri 23 Aug 2019 11:59:59 PM GMT +0000). [21:28:18] PROBLEM - wiki.exnihilolinux.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.exnihilolinux.org' expires in 15 day(s) (Sat 17 Aug 2019 09:25:26 PM GMT +0000). [21:28:32] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9zb [21:28:33] [02miraheze/ssl] 07MirahezeSSLBot 03474a366 - Bot: Update SSL cert for wiki.exnihilolinux.org [21:29:22] PROBLEM - papelor.io - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'papelor.io' expires in 15 day(s) (Sat 17 Aug 2019 09:27:07 PM GMT +0000). [21:29:36] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9zA [21:29:37] [02miraheze/ssl] 07MirahezeSSLBot 034d05143 - Bot: Update SSL cert for papelor.io [21:31:13] PROBLEM - www.lab612.at - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.lab612.at' expires in 15 day(s) (Sat 17 Aug 2019 09:29:09 PM GMT +0000). [21:31:26] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9zh [21:31:28] [02miraheze/ssl] 07MirahezeSSLBot 03652a303 - Bot: Update SSL cert for www.lab612.at [21:33:13] RECOVERY - www.lab612.at - LetsEncrypt on sslhost is OK: OK - Certificate 'www.lab612.at' will expire on Wed 30 Oct 2019 08:31:20 PM GMT +0000. [21:33:18] RECOVERY - papelor.io - LetsEncrypt on sslhost is OK: OK - Certificate 'papelor.io' will expire on Wed 30 Oct 2019 08:29:29 PM GMT +0000. [21:34:09] PROBLEM - www.splat-teams.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.splat-teams.com' expires in 15 day(s) (Sat 17 Aug 2019 09:30:38 PM GMT +0000). [21:34:16] RECOVERY - wiki.exnihilolinux.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.exnihilolinux.org' will expire on Wed 30 Oct 2019 08:28:25 PM GMT +0000. [21:34:23] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9gf [21:34:24] [02miraheze/ssl] 07MirahezeSSLBot 038b89ecd - Bot: Update SSL cert for www.splat-teams.com [21:34:44] PROBLEM - nenawiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'nenawiki.org' expires in 15 day(s) (Sat 17 Aug 2019 09:32:23 PM GMT +0000). [21:34:57] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9gJ [21:34:59] [02miraheze/ssl] 07MirahezeSSLBot 03cab76fa - Bot: Update SSL cert for nenawiki.org [21:36:08] PROBLEM - ndg.nenawiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'nenawiki.org' expires in 15 day(s) (Sat 17 Aug 2019 09:32:23 PM GMT +0000). [21:36:21] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/fj9gk [21:36:23] [02miraheze/ssl] 07MirahezeSSLBot 03c286abf - Bot: Update SSL cert for ndg.nenawiki.org [21:39:44] PROBLEM - sdiy.info - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'sdiy.info' expires in 15 day(s) (Sat 17 Aug 2019 09:37:25 PM GMT +0000). [21:39:58] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj9gt [21:39:59] [02miraheze/ssl] 07MirahezeSSLBot 038bd1301 - Bot: Update SSL cert for sdiy.info [21:40:12] PROBLEM - www.sdiy.info - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'sdiy.info' expires in 15 day(s) (Sat 17 Aug 2019 09:37:25 PM GMT +0000). [21:41:50] PROBLEM - www.programming.red - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'programming.red' expires in 15 day(s) (Sat 17 Aug 2019 09:39:01 PM GMT +0000). [21:42:57]