[00:02:46] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:36] PROBLEM - bacula1 Puppet on bacula1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:48] [02miraheze/landing] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxy9o [00:03:50] [02miraheze/landing] 07paladox 03a5292f2 - Fix model box on mobile [00:04:11] [02miraheze/landing] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxy9K [00:04:12] [02miraheze/landing] 07paladox 03d76677d - Update fontawesome to 5.4.2 [00:11:37] RECOVERY - bacula1 Puppet on bacula1 is OK: OK: Puppet is currently enabled, last run 55 seconds ago with 0 failures [00:12:45] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 33 seconds ago with 0 failures [00:19:10] !log dropping all flaggedrevs tables on wikis that doesn't use flaggedrevs (2892/2915) [00:19:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:19:25] connect to host 107.191.126.23 port 5666: No route to host [00:19:37] PROBLEM - cp2 SSH on cp2 is CRITICAL: connect to address 107.191.126.23 and port 22: No route to host [00:19:49] PROBLEM - misc2 HTTPS on misc2 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 372 bytes in 0.060 second response time [00:20:06] that's looking not so good [00:20:15] PROBLEM - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:20:26] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxyHE [00:20:27] [02miraheze/dns] 07paladox 03e1e4cfa - Depool cp2 Seems ssh is not working to it and also reports of some wikis timing out. [00:20:33] uh [00:20:36] misc2??? [00:20:37] PROBLEM - cp2 Current Load on cp2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:20:39] well that's why [00:20:51] PROBLEM - Host cp2 is DOWN: PING CRITICAL - Packet loss = 100% [00:20:52] cp2 is kinda expected [00:21:10] JohnLewis why? [00:21:21] because there was an email sent Tuesday [00:21:23] !log depooling cp2 [00:21:29] oh [00:21:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:21:35] cp2 is in atlanta? [00:21:37] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb [00:21:39] yes] [00:21:43] ok [00:21:58] and so is ns1 [00:22:09] ok [00:22:26] glad we have misc1 :P [00:22:52] RECOVERY - Host cp2 is UP: PING OK - Packet loss = 0%, RTA = 98.60 ms [00:23:25] RECOVERY - cp2 HTTPS on cp2 is OK: HTTP OK: HTTP/1.1 200 OK - 22748 bytes in 0.608 second response time [00:23:28] RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy [00:23:28] well ns1 is primary [00:23:36] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [00:23:40] RECOVERY - misc2 HTTPS on misc2 is OK: HTTP OK: HTTP/1.1 200 OK - 40789 bytes in 0.145 second response time [00:23:44] RECOVERY - cp2 SSH on cp2 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u4 (protocol 2.0) [00:23:50] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [00:24:06] RECOVERY - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is OK: OK - NGINX Error Rate is 33% [00:24:08] RECOVERY - cp2 Disk Space on cp2 is OK: DISK OK - free space: / 22294 MB (54% inode=99%); [00:24:36] RECOVERY - cp2 Current Load on cp2 is OK: OK - load average: 0.86, 0.51, 0.20 [00:24:43] pa [00:24:50] paladox: ^^ [00:24:57] MacFan4000 yep? [00:25:03] It came back [00:25:09] You can retool now [00:25:16] ok, im waiting a few mins before repooling [00:27:49] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxyH7 [00:27:50] [02miraheze/dns] 07paladox 03c6ad31f - Revert "Depool cp2" This reverts commit e1e4cfa43dab3895f3392592e6b56fbf7dc43fd1. [00:27:55] !log repooling cp2 [00:27:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:31:46] ns1 down [00:31:46] fyi [00:32:14] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:32:28] PROBLEM - ns1 SSH on ns1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:32:36] PROBLEM - ns1 Auth DNS on ns1 is CRITICAL: CRITICAL - Plugin timed out while executing system call [00:32:38] PROBLEM - ns1 Current Load on ns1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:33:42] connect to host 192.184.82.120 port 5666: No route to host [00:33:54] PROBLEM - Host ns1 is DOWN: CRITICAL - Time to live exceeded (192.184.82.120) [00:35:52] RECOVERY - Host ns1 is UP: PING OK - Packet loss = 0%, RTA = 98.18 ms [00:47:20] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxyQb [00:47:21] [02miraheze/mw-config] 07paladox 0329fbbec - Set centralauth-autoaccount in * for var wgManageWikiPermissionsAdditionalRights [00:55:57] !log dropping all flow tables on wikis that doesn't use flow (2842/2915) [00:56:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [01:05:55] [02mw-config] 07The-Voidwalker opened pull request 03#2537: rm, not needed - 13https://git.io/fxy7H [01:07:42] [02mw-config] 07paladox closed pull request 03#2537: rm, not needed - 13https://git.io/fxy7H [01:07:43] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxy75 [01:07:45] [02miraheze/mw-config] 07The-Voidwalker 0391da693 - rm, not needed (#2537) [01:10:32] !log UPDATE mw_permissions SET perm_permissions = REPLACE('perm_permissions', 'centralauth-autoaccount', 'autocreateaccount') WHERE field LIKE '%centralauth-autoaccount%'; on db4 [01:10:34] JohnLewis ^^ [01:10:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [01:12:23] !log UPDATE mw_permissions SET perm_permissions = REPLACE('perm_permissions', 'centralauth-autoaccount', 'autocreateaccount') WHERE perm_permissions LIKE '%centralauth-autoaccount%'; on db4 [01:12:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [01:12:54] select perm_dbname from mw_permissions where perm_permissions like "%centralauth-autoaccount%"; [01:12:55] Empty set (0.08 sec) [01:12:58] woosp wrong channel [01:16:19] !log rm cache files in /mnt/mediawiki/static/cdb/** (to invalidate cache) (they will regenerate) [01:16:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [02:15:48] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb, 172.104.111.8/cpweb, 2400:8902::f03c:91ff:fe07:444e/cpweb [02:15:50] PROBLEM - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is CRITICAL: CRITICAL - NGINX Error Rate is 99% [02:16:30] PROBLEM - cp4 HTTP 4xx/5xx ERROR Rate on cp4 is WARNING: WARNING - NGINX Error Rate is 55% [02:17:49] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [02:17:51] RECOVERY - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is OK: OK - NGINX Error Rate is 5% [02:18:31] RECOVERY - cp4 HTTP 4xx/5xx ERROR Rate on cp4 is OK: OK - NGINX Error Rate is 4% [02:37:07] [02miraheze/mw-config] 07MacFan4000 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxybF [02:37:08] [02miraheze/mw-config] 07MacFan4000 03e896eb1 - Add notice [02:52:33] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxyN1 [02:52:34] [02miraheze/mw-config] 07paladox 03a473a2e - Revert "Add notice" This reverts commit e896eb1aeeb8c8ec0f637ea215bcbbfc6a41e163. Outage over now [03:01:42] !log DELETE FROM global_group_permissions WHERE ggp_permission='centralauth-autoaccount'; on db4 [03:01:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [04:28:35] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 5919 [04:43:29] PROBLEM - cp5 HTTP 4xx/5xx ERROR Rate on cp5 is WARNING: WARNING - NGINX Error Rate is 46% [04:45:29] RECOVERY - cp5 HTTP 4xx/5xx ERROR Rate on cp5 is OK: OK - NGINX Error Rate is 38% [09:24:55] [02miraheze/landing] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxSZW [09:24:56] [02miraheze/landing] 07paladox 0380f2dff - Use fa-gift fa-donation is for pro only (you need a license) [09:31:58] !log sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=nonciclopediawiki on mw1 [09:32:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [09:42:39] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxScg [09:42:41] [02miraheze/mw-config] 07paladox 03367a336 - Set wgCompressRevisions to true for buswiki [09:44:41] !log sudo -u www-data php /srv/mediawiki/w/maint*/storage/compressOld.php buswiki -t gzip --wiki buswiki on mw1 [09:44:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [09:55:26] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxSCn [09:55:27] [02miraheze/mw-config] 07paladox 035b73fd0 - Set wgCompressRevisions to true for openhatchwiki [09:56:01] !log sudo -u www-data php /srv/mediawiki/w/maint*/storage/compressOld.php openhatchwiki -t gzip --wiki openhatchwiki on mw1 [09:56:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [10:13:50] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxSlv [10:13:52] [02miraheze/puppet] 07paladox 038ec59a8 - Set MaxConcurrentChecks to 1 [10:35:38] [02mw-config] 07robkam opened pull request 03#2538: add scruffywiki to exemptions - 13https://git.io/fxS8C [10:38:37] [02mw-config] 07paladox closed pull request 03#2538: add scruffywiki to exemptions - 13https://git.io/fxS8C [10:38:38] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxS81 [10:38:40] [02miraheze/mw-config] 07robkam 03b22adf7 - add scruffywiki to exemptions (#2538) [11:55:29] [02miraheze/landing] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxSzA [11:55:31] [02miraheze/landing] 07paladox 0386d269f - Fix typo [11:58:12] [02miraheze/landing] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxSgI [11:58:14] [02miraheze/landing] 07paladox 030bd73cc - Fix invalid link [11:59:37] [02miraheze/landing] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxSgY [11:59:39] [02miraheze/landing] 07paladox 037fe0e01 - Update some texts in FAQ [12:11:09] [02miraheze/landing] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxS2q [12:11:11] [02miraheze/landing] 07paladox 0365dbd15 - Update index.html [12:36:08] [02miraheze/landing] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxSVu [12:36:10] [02miraheze/landing] 07paladox 0323b4d12 - Update index.html [12:38:52] [02miraheze/landing] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxSV9 [12:38:54] [02miraheze/landing] 07paladox 034656f31 - Update index.html [14:55:24] [02miraheze/WikiDiscover] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxS9h [14:55:25] [02miraheze/WikiDiscover] 07paladox 038fb4962 - Use $wgCreateWikiGlobalWiki instead of hard coding metawiki [14:56:58] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_32 [+0/-0/±2] 13https://git.io/fxSHY [14:57:00] [02miraheze/mediawiki] 07paladox 03cdda0cf - Update CW and WD [15:00:59] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±2] 13https://git.io/fxSHa [15:01:01] [02miraheze/mediawiki] 07paladox 039a2bcb7 - Update CW and WD [15:04:37] !log sudo -u www-data php /srv/mediawiki/w/maint*/rebuildLocalisationCache.php --wiki loginwiki on mw* [15:04:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [15:07:10] [02miraheze/WikiDiscover] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxSQt [15:07:12] [02miraheze/WikiDiscover] 07paladox 039333df3 - Fix using wrong db [15:07:41] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/9a2bcb76d00f...c8326dd72ce9 [15:07:42] Title: [ Comparing 9a2bcb76d00f...c8326dd72ce9 · miraheze/mediawiki · GitHub ] - github.com [15:07:43] [02miraheze/mediawiki] 07paladox 03c8326dd - Update WD [15:09:02] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_32 [+0/-0/±1] 13https://git.io/fxSQn [15:09:03] [02miraheze/mediawiki] 07paladox 03d1a49cb - Update WD [15:18:17] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxS7i [15:18:18] [02miraheze/mw-config] 07paladox 03dfe2a13 - Fix spelling for table [15:25:55] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxS5z [15:25:57] [02miraheze/mw-config] 07paladox 0358d1761 - Copy SocialProfile install sql code to blogpage and userwelcome Since SocialProfile is also loaded when BlogPage is enabled we need this code to go here too. [15:29:01] Paladox: they should be requirements [15:29:11] JohnLewis ah ok [15:29:27] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxS5Q [15:29:28] [02miraheze/mw-config] 07paladox 0363638f4 - Fix sql file not opening [15:29:30] will do that now [15:29:37] so SP MUST be enabled rather than that hackish method [15:30:51] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxS5p [15:30:52] [02miraheze/mw-config] 07paladox 036e2ed78 - Make BlogPage and some other extensions depend on SocialProfile explicitly [15:30:55] JohnLewis ^^ [15:31:21] Yeah [15:48:19] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxSFi [15:48:20] [02miraheze/mw-config] 07paladox 03049c445 - Fix path to usergifts.sql sql [15:57:19] * Wiki1776_ hello [15:58:31] a lot of work? [15:59:21] hi [15:59:58] kind of (but not really *alot* of work) [16:10:32] ok [16:14:58] [02miraheze/landing] 07MacFan4000 pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/fxSAX [16:14:59] [02miraheze/landing] 07MacFan4000 030a83656 - add travis CI [16:16:40] [02miraheze/landing] 07MacFan4000 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxSxU [16:16:41] [02miraheze/landing] 07MacFan4000 03052da00 - oops [16:22:33] [02miraheze/landing] 07MacFan4000 pushed 031 commit to 03master [+1/-1/±0] 13https://git.io/fxSxV [16:22:35] [02miraheze/landing] 07MacFan4000 03e1e5eeb - Rename .travis.yaml to .travis.yml [16:23:13] It will check the html and come back with warnings/errors [16:24:05] miraheze/landing/master/e1e5eeb - MacFan4000 The build failed. https://travis-ci.org/miraheze/landing/builds/446773272 [16:24:33] Expected [16:24:47] There are things that can be fixed [16:26:27] In the html [16:27:34] !m [16:27:36] !m revi [16:27:36] <[d__d]> You're doing good work, revi! [16:27:38] We can also have it ignore certain things if needed [16:27:51] !m is You're doing good work, $1! [16:27:52] <[d__d]> You're doing good work, is You're doing good work, $1!! [16:27:52] Key was added [16:27:56] You are trusted and identified by the name .*@.*[Ww]iki.*\/.* [16:27:56] @whoami [16:27:59] oh k [16:28:07] !m revi [16:28:07] <[d__d]> You're doing good work, revi! [16:28:07] You're doing good work, revi! [16:28:13] douuuuuble pingz [16:28:54] .m revi [16:28:54] You're doing good work, revi! [16:29:12] Just keeping backward compatibility [16:29:26] ! was the original one so... [16:30:01] if you will make an special rule for Zppixbot to recognize !m, that's probably better [16:30:34] I don’t know of a way to do it + I’m not great with python [17:49:19] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_32 [+0/-0/±3] 13https://git.io/fx9ke [17:49:21] [02miraheze/mediawiki] 07paladox 03866a266 - Update QG and SP and VNY [17:54:20] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±3] 13https://git.io/fx9ki [17:54:22] [02miraheze/mediawiki] 07paladox 030365d8a - Update QG and SP and VNY [17:57:38] !log sudo -u www-data php /srv/mediawiki/w/maint*/rebuildLocalisationCache.php --wiki loginwiki on mw* [17:57:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:49:30] Hello [19:00:52] !log dropping all pagetriage tables on wikis that doesn't use pagetriage (2887/2915) [19:00:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [19:02:24] !log UPDATE mw_permissions SET perm_permissions = '["autocreateaccount","createaccount","read","edit","createpage","createtalk", "writeapi","viewmywatchlist","editmywatchlist","viewmyprivateinfo", "editmyprivateinfo","editmyoptions","abusefilter-log","abusefilter-log-detail", "abusefilter-view","autocreateaccount","centralauth-merge", "oathauth-enable"]' WHERE perm_dbname = "utamacrosswiki" and perm_group = "*" and perm_permissions = 'perm_permissio [19:02:25] ns'; [19:02:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [19:13:30] !log dropping all newsletter tables on wikis that doesn't use newsletter (2890/2915) [19:13:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [19:26:08] [02miraheze/ManageWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fx9s6 [19:26:09] [02miraheze/ManageWiki] 07JohnFLewis 03782e6ec - isset not is_null [19:26:43] [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fx9s1 [19:26:44] [02miraheze/mediawiki] 07JohnFLewis 03d3fb758 - update MW [19:27:26] [02miraheze/mediawiki] 07paladox pushed 032 commits to 03REL1_31 [+0/-0/±2] 13https://git.io/fx9s7 [19:27:28] [02miraheze/mediawiki] 07paladox 03b81d2dc - Update PollNY [19:27:29] [02miraheze/mediawiki] 07paladox 0322ae43a - Merge branch 'REL1_31' of github.com:miraheze/mediawiki into REL1_31 [19:28:40] [02miraheze/ManageWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fx9Ge [19:28:42] [02miraheze/ManageWiki] 07JohnFLewis 03ac08369 - reverse logic now [19:29:28] [02miraheze/mediawiki] 07JohnFLewis pushed 032 commits to 03REL1_31 [+0/-0/±2] 13https://git.io/fx9GL [19:29:30] [02miraheze/mediawiki] 07JohnFLewis 032f3bfa6 - update MW [19:29:31] [02miraheze/mediawiki] 07JohnFLewis 03e7a4bfa - Merge branch 'REL1_31' of www.github.com:miraheze/mediawiki into REL1_31 [19:31:15] !log dropping all wikiforum tables on wikis that doesn't use wikiforum (2837/2915) [19:31:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [19:36:09] !log sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=nonciclopediawiki --report=1 nonciclopediawikiacom-20180818-history.xml on mw1 [19:36:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [19:50:14] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fx9nU [19:50:16] [02miraheze/services] 07MirahezeSSLBot 039bfd3de - BOT: Updating services config for wikis [19:51:09] !log dropping all quizgame tables on wikis that doesn't use quizgame (2887/2915) [19:51:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:15:50] !log dropping all comments tables on wikis that doesn't use comments (2815/2915) [20:15:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [21:38:58] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [22:26:40] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/fx9Vk [22:26:42] [02miraheze/dns] 07paladox 03bab40fa - Add stablestate.org to dns per T3730 [22:28:25] [02ssl] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vxP9L [22:28:26] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fx9V3 [22:28:28] [02miraheze/ssl] 07paladox 03f1ebc0a - Add stablestate.org ssl cert [22:28:29] [02ssl] 07paladox opened pull request 03#71: Add stablestate.org ssl cert - 13https://git.io/fx9Vs [22:29:45] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+1/-0/±0] 13https://git.io/fx9VW [22:29:47] [02miraheze/ssl] 07paladox 03996c57b - Create stablestate.org.crt [22:29:48] [02ssl] 07paladox synchronize pull request 03#71: Add stablestate.org ssl cert - 13https://git.io/fx9Vs [22:29:56] [02ssl] 07paladox closed pull request 03#71: Add stablestate.org ssl cert - 13https://git.io/fx9Vs [22:29:57] [02miraheze/ssl] 07paladox deleted branch 03paladox-patch-1 [22:29:59] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/fx9V8 [22:30:00] [02miraheze/ssl] 07paladox 0334486d8 - Add stablestate.org ssl cert (#71) * Add stablestate.org ssl cert * Create stablestate.org.crt [22:30:02] [02ssl] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vxP9L [22:35:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fx9Vy [22:35:14] [02miraheze/services] 07MirahezeSSLBot 03d31f551 - BOT: Updating services config for wikis [23:43:54] PROBLEM - misc2 HTTPS on misc2 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 372 bytes in 0.012 second response time [23:44:02] um [23:45:55] RECOVERY - misc2 HTTPS on misc2 is OK: HTTP OK: HTTP/1.1 200 OK - 40789 bytes in 0.104 second response time