[00:38:07] [02puppet] 07Pix1234 opened pull request 03#1254: Update readme to not mention debian jessie - 13https://git.io/JvBr3 [00:51:28] !log GRANT REPLICATION SLAVE ON *.* TO 'replica'@'%' IDENTIFIED BY 'xxxx'; - db6 [00:51:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:55:49] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvBrS [00:55:51] [02miraheze/puppet] 07paladox 03ff0d13b - Update dbreplication.pp [00:56:30] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvBrQ [00:56:31] [02miraheze/puppet] 07paladox 030ea86b5 - Make db7 a replica [00:58:15] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvBrb [00:58:17] [02miraheze/puppet] 07paladox 0320488ca - Update dbreplication.pp [01:02:02] !log CHANGE MASTER TO MASTER_HOST='db6.miraheze.org', MASTER_USER='replica', MASTER_PASSWORD='xxxx', MASTER_LOG_FILE='mysql-bin.000004', MASTER_LOG_POS=1044075691; - db6 [01:02:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [01:03:07] errr [01:03:07] db7 [01:06:38] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvBoc [01:06:39] [02miraheze/puppet] 07paladox 03be93526 - Update db.pp [01:07:23] \o/ [01:09:27] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-8 [+0/-0/±1] 13https://git.io/JvBo4 [01:09:28] [02miraheze/puppet] 07paladox 03a2831b2 - mariadb: Add replica password to grants [01:09:30] [02puppet] 07paladox created branch 03paladox-patch-8 - 13https://git.io/vbiAS [01:09:31] [02puppet] 07paladox opened pull request 03#1255: mariadb: Add replica password to grants - 13https://git.io/JvBoB [01:09:57] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-8 [+0/-0/±1] 13https://git.io/JvBo0 [01:09:59] [02miraheze/puppet] 07paladox 03dd2fd03 - Update config.pp [01:10:00] [02puppet] 07paladox synchronize pull request 03#1255: mariadb: Add replica password to grants - 13https://git.io/JvBoB [01:12:08] [02puppet] 07paladox closed pull request 03#1255: mariadb: Add replica password to grants - 13https://git.io/JvBoB [01:12:10] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JvBou [01:12:11] [02miraheze/puppet] 07paladox 0361f567d - mariadb: Add replica password to grants (#1255) * mariadb: Add replica password to grants * Update config.pp [01:12:13] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-8 [01:12:14] [02puppet] 07paladox deleted branch 03paladox-patch-8 - 13https://git.io/vbiAS [01:22:14] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvBoD [01:22:16] [02miraheze/dns] 07paladox 03abd0b43 - Add icinga-new with name to mon1 [01:23:40] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvBoQ [01:23:41] [02miraheze/puppet] 07paladox 038195824 - icingaweb2: Add icings-new to nginx [01:25:17] PROBLEM - db7 Puppet on db7 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [01:26:24] PROBLEM - db6 Puppet on db6 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [02:03:20] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JvB6T [02:03:22] [02miraheze/ssl] 07paladox 03cd05159 - Remove interno.guiasdobrasil.com.br Domain not pointing at us. [02:03:23] [02ssl] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vxP9L [02:03:26] [02ssl] 07paladox opened pull request 03#270: Remove interno.guiasdobrasil.com.br - 13https://git.io/JvB6k [02:03:43] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-1/±0] 13https://git.io/JvB6L [02:03:44] [02miraheze/ssl] 07paladox 032dc78af - Delete interno.guiasdobrasil.com.br.crt [02:03:46] [02ssl] 07paladox synchronize pull request 03#270: Remove interno.guiasdobrasil.com.br - 13https://git.io/JvB6k [02:03:51] [02ssl] 07paladox closed pull request 03#270: Remove interno.guiasdobrasil.com.br - 13https://git.io/JvB6k [02:03:52] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-1/±1] 13https://git.io/JvB6t [02:03:54] [02miraheze/ssl] 07paladox 03ee4334e - Remove interno.guiasdobrasil.com.br (#270) * Remove interno.guiasdobrasil.com.br Domain not pointing at us. * Delete interno.guiasdobrasil.com.br.crt [02:03:55] [02ssl] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vxP9L [02:03:57] [02miraheze/ssl] 07paladox deleted branch 03paladox-patch-1 [02:05:08] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvB6O [02:05:10] [02miraheze/puppet] 07paladox 0344ad2cc - Update nrpe.cfg.erb [02:08:20] [02puppet] 07paladox closed pull request 03#1254: Update readme to not mention debian jessie - 13https://git.io/JvBr3 [02:08:22] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvB6G [02:08:23] [02miraheze/puppet] 07Pix1234 036e288eb - Update readme to not mention debian jessie (#1254) * We no longer use jessie * capitalization [02:10:57] RECOVERY - cp7 Stunnel Http for mw6 on cp7 is OK: HTTP OK: HTTP/1.1 200 OK - 15296 bytes in 0.003 second response time [02:11:07] RECOVERY - cp4 Stunnel Http for mw4 on cp4 is OK: HTTP OK: HTTP/1.1 200 OK - 15288 bytes in 0.059 second response time [02:11:16] RECOVERY - cp3 Stunnel Http for mw5 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15288 bytes in 1.513 second response time [02:11:26] RECOVERY - cp6 Stunnel Http for mw4 on cp6 is OK: HTTP OK: HTTP/1.1 200 OK - 15288 bytes in 0.004 second response time [02:11:39] RECOVERY - cp8 Stunnel Http for mw6 on cp8 is OK: HTTP OK: HTTP/1.1 200 OK - 15296 bytes in 0.307 second response time [02:11:42] RECOVERY - cp3 Stunnel Http for mw7 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15288 bytes in 0.746 second response time [02:11:48] RECOVERY - cp8 Stunnel Http for mw7 on cp8 is OK: HTTP OK: HTTP/1.1 200 OK - 15296 bytes in 0.339 second response time [02:11:52] RECOVERY - cp3 Stunnel Http for mw6 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15288 bytes in 0.754 second response time [02:12:04] RECOVERY - cp8 Stunnel Http for mw5 on cp8 is OK: HTTP OK: HTTP/1.1 200 OK - 15288 bytes in 0.308 second response time [02:12:14] RECOVERY - cp7 Stunnel Http for mw7 on cp7 is OK: HTTP OK: HTTP/1.1 200 OK - 15288 bytes in 0.003 second response time [02:12:23] RECOVERY - cp4 Stunnel Http for mw7 on cp4 is OK: HTTP OK: HTTP/1.1 200 OK - 15288 bytes in 0.054 second response time [02:12:27] RECOVERY - cp7 Stunnel Http for mw4 on cp7 is OK: HTTP OK: HTTP/1.1 200 OK - 15288 bytes in 0.005 second response time [02:12:27] RECOVERY - cp6 Stunnel Http for mw6 on cp6 is OK: HTTP OK: HTTP/1.1 200 OK - 15288 bytes in 0.004 second response time [02:12:28] RECOVERY - cp6 Stunnel Http for mw5 on cp6 is OK: HTTP OK: HTTP/1.1 200 OK - 15288 bytes in 0.004 second response time [02:12:36] RECOVERY - cp3 Stunnel Http for mw4 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15288 bytes in 0.747 second response time [02:12:40] RECOVERY - cp4 Stunnel Http for mw5 on cp4 is OK: HTTP OK: HTTP/1.1 200 OK - 15302 bytes in 0.070 second response time [02:12:57] RECOVERY - cp8 Stunnel Http for mw4 on cp8 is OK: HTTP OK: HTTP/1.1 200 OK - 15288 bytes in 0.318 second response time [02:13:00] RECOVERY - cp4 Stunnel Http for mw6 on cp4 is OK: HTTP OK: HTTP/1.1 200 OK - 15296 bytes in 0.054 second response time [02:13:05] RECOVERY - cp6 Stunnel Http for mw7 on cp6 is OK: HTTP OK: HTTP/1.1 200 OK - 15288 bytes in 0.004 second response time [02:13:14] RECOVERY - cp7 Stunnel Http for mw5 on cp7 is OK: HTTP OK: HTTP/1.1 200 OK - 15288 bytes in 0.004 second response time [02:17:02] RECOVERY - db6 Puppet on db6 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:21:07] RECOVERY - db7 Puppet on db7 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [03:02:35] (spam in related chanels so im opping up) [04:40:13] PROBLEM - cp8 Disk Space on cp8 is WARNING: DISK WARNING - free space: / 2114 MB (10% inode=93%); [05:02:25] RECOVERY - cp8 Disk Space on cp8 is OK: DISK OK - free space: / 4088 MB (21% inode=93%); [06:23:44] PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 0.69, 1.83, 1.10 [06:25:38] RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.15, 0.90, 0.88 [06:25:46] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 2689 MB (11% inode=94%); [07:23:44] Reception123: are you around for an import? [07:24:34] and sorry for killing the RC-Bot [07:41:04] * RhinosF1 apologies for the RC spam [08:29:22] RhinosF1: yeah, how large is it though? [08:29:56] and what bot did you kill? [08:30:43] Reception123: #miraheze-feed and it worked with persistence [08:32:51] ok, well it works now [08:33:34] Reception123: yeah, it auto-recovers [10:29:04] [02mw-config] 07RhinosF1 opened pull request 03#2894: add $wgExpensiveParserFunctionLimit - 13https://git.io/JvB7O [10:29:16] Reception123: can you merge? ^ [10:42:22] Hello OPMAN! If you have any questions, feel free to ask and someone should answer soon. [10:43:05] hi OPMAN [10:43:53] The XML database dump, Is just getting "Current pages" XML is okay or is it better to get "Current pages and history", because "current pages" XML is around 340MB whereas "Current pages and history" XML is like 20GB, is there any legal constraints regarding the content attribution. [10:44:07] to import [10:45:18] OPMAN: It is better to get Current Pages and History but if impractical then just include a link back to the page's current revision in the comment field when importing [10:46:58] oh ok and about the images, if i "manually" get 24,000 images, will you guys upload it or should i do it manually [10:47:30] OPMAN: we can upload them if you provide them in a zip archive [10:48:05] nice thank you :] [11:08:33] RhinosF1: not sure if I should and how that affects everything so will wait for a second opinion [11:21:09] Reception123: it just means I can use lua more on meta. WMF have it at 500 [11:26:53] paladox: ? [11:39:35] Yeah but I wonder how it affects resources [11:42:49] Reception123: won’t be much [11:43:03] It’s only on page load of 1 page [13:04:40] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[php7.3-redis] [13:12:43] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 36 seconds ago with 0 failures [14:23:27] RhinosF1 ? [14:23:56] paladox: can you merge my MW-config pr? [14:25:28] RhinosF1 that can go into managewiki under restricted [14:25:41] paladox: I’m mobile [14:25:53] and? [14:26:09] paladox: can’t add it now [14:26:28] ok, i'll wait for you to do it later then. [14:26:37] K [14:26:45] but also you can, i've done things through mobile, github have an inline editor. [14:27:12] Yeah, I’d rather not. I also have my little cousin with me [14:27:22] ok [15:10:45] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2639 MB (10% inode=94%); [15:12:47] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 2661 MB (11% inode=94%); [15:12:51] [02mw-config] 07RhinosF1 synchronize pull request 03#2894: add $wgExpensiveParserFunctionLimit - 13https://git.io/JvB7O [15:15:34] [02mw-config] 07RhinosF1 synchronize pull request 03#2894: add $wgExpensiveParserFunctionLimit - 13https://git.io/JvB7O [15:15:36] paladox: ^ [15:16:21] [02mw-config] 07paladox reviewed pull request 03#2894 commit - 13https://git.io/JvBhs [15:16:23] RhinosF1 ^ [15:18:05] [02mw-config] 07RhinosF1 synchronize pull request 03#2894: add $wgExpensiveParserFunctionLimit - 13https://git.io/JvB7O [15:18:06] paladox: ^ [15:19:24] [02mw-config] 07paladox closed pull request 03#2894: add $wgExpensiveParserFunctionLimit - 13https://git.io/JvB7O [15:19:25] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JvBhB [15:19:27] [02miraheze/mw-config] 07RhinosF1 03fc6f790 - add $wgExpensiveParserFunctionLimit (#2894) * add $wgExpensiveParserFunctionLimit Default = 99 per mw org Metawiki = 150 due to some pages needing more * Update LocalSettings.php * Update ManageWikiSettings.php * Update ManageWikiSettings.php [15:19:47] paladox: can you set it to 107 at least on meta [15:19:52] ok [15:22:55] RhinosF1 done [15:24:37] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki config] [15:24:54] paladox: it's saying it needs 110 now. Can you go to 125 to be safe? [15:25:08] ok [15:25:33] done [15:35:22] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2649 MB (10% inode=94%); [17:28:24] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 3 datacenters are down: 2400:6180:0:d0::403:f001/cpweb, 51.161.32.127/cpweb, 2607:5300:205:200::17f6/cpweb [17:29:03] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 51.161.32.127/cpweb [17:30:21] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [17:31:04] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [17:39:35] this looks interesting: https://phabricator.miraheze.org/T5253 [17:39:37] [ ⚓ T5253 Locking a wiki out of Special pages is permanent ] - phabricator.miraheze.org [17:40:35] Sounds like we need to revert the ns change [17:40:48] Also why the hell would you edit the special ns [17:49:32] Didn't edit special ns, created a new special ns or some BS like that [17:49:47] seems like a possible core bug though, which is interesting [17:50:01] guess they never expected anyone to match the existing special namespace [17:50:09] and something we should probably guard against [18:43:40] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvRTV [18:43:41] [02miraheze/mw-config] 07paladox 0334ff8d9 - Set altversewiki into read only [18:44:25] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/JvRTw [18:44:27] [02miraheze/mw-config] 07paladox 03013b939 - Move altversewiki to use db6 [18:44:28] [02mw-config] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbvb3 [18:44:30] [02mw-config] 07paladox opened pull request 03#2895: Move altversewiki to use db6 - 13https://git.io/JvRTo [18:46:05] [02mw-config] 07paladox closed pull request 03#2895: Move altversewiki to use db6 - 13https://git.io/JvRTo [18:46:07] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvRTP [18:46:08] [02miraheze/mw-config] 07paladox 0341dceb7 - Move altversewiki to use db6 (#2895) [18:46:46] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-2 [18:46:47] [02mw-config] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbvb3 [18:47:10] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvRTX [18:47:11] [02miraheze/mw-config] 07paladox 039b2aeac - Take altversewiki out of read only [20:06:20] PROBLEM - munwiki.info - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'munwiki.info' expires in 15 day(s) (Sat 07 Mar 2020 08:02:27 PM GMT +0000). [20:06:34] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvRIw [20:06:36] [02miraheze/ssl] 07MirahezeSSLBot 03835a868 - Bot: Update SSL cert for munwiki.info [20:14:22] RECOVERY - munwiki.info - LetsEncrypt on sslhost is OK: OK - Certificate 'munwiki.info' will expire on Wed 20 May 2020 07:06:28 PM GMT +0000. [20:38:52] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/JvRLw [20:38:54] [02miraheze/dns] 07paladox 0396c4cb7 - Move proxybot to cp7 [20:38:55] [02dns] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbQXl [20:38:57] [02dns] 07paladox opened pull request 03#136: Move proxybot to cp7 - 13https://git.io/JvRLr [20:39:19] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/JvRLo [20:39:21] [02miraheze/mw-config] 07paladox 032968593 - Move proxybotwiki to db6 [20:39:22] [02mw-config] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbvb3 [20:39:24] [02mw-config] 07paladox opened pull request 03#2896: Move proxybotwiki to db6 - 13https://git.io/JvRLK [20:40:21] [02mw-config] 07paladox closed pull request 03#2896: Move proxybotwiki to db6 - 13https://git.io/JvRLK [20:40:22] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvRLD [20:40:24] [02miraheze/mw-config] 07paladox 03c6ee3a9 - Move proxybotwiki to db6 (#2896) [20:40:25] [02dns] 07paladox closed pull request 03#136: Move proxybot to cp7 - 13https://git.io/JvRLr [20:40:27] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvRLy [20:40:28] [02miraheze/dns] 07paladox 0389f8e27 - Move proxybot to cp7 (#136) [20:41:11] [02dns] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbQXl [20:41:13] [02miraheze/dns] 07paladox deleted branch 03paladox-patch-2 [20:41:14] [02mw-config] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbvb3 [20:41:16] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-2 [20:44:55] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[php7.3-redis] [20:52:55] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 41 seconds ago with 0 failures [22:35:07] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvRYW [22:35:08] [02miraheze/services] 07MirahezeSSLBot 03745cbaf - BOT: Updating services config for wikis [22:55:08] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvRY9 [22:55:09] [02miraheze/services] 07MirahezeSSLBot 031946015 - BOT: Updating services config for wikis [23:05:46] !paladox [23:05:50] hi [23:06:56] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown) [23:13:03] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 36 seconds ago with 0 failures [23:17:49] Alright, so some dude who I suspect to be a troll using sock accounts on Fresh Websites Wiki put a page on "Survivors of the Abortion Holocaust" despite it already being on Rotten Websites Wiki. I marked the page for deletion along with a one-page category because of both being really biased and being of generally poor quality twice, but for both times, two new accounts popped up, undid my edits, and put stuff like "This [23:17:50] category needs to stay Liberals belong on rotten websites as Conservatives belong here" and "This page will stay. Liberals are bad. Who puts the delete thing is a liberal." There are no admins or bureaucrats of the Wiki to contact or alert about it as far as I'm aware. [23:18:19] Sorry it took a long time to respond. Keyboard's acting weird [23:18:39] @Void ^ [23:21:04] link? [23:21:20] nvm, found it in -feed [23:22:22] While I'm at it, I didn't mark the page for deletion because I disagreed with it, but because of it being poorly-written and biased and also being on RWW. I'd like for both pages to at least get deleted and protected. There's also no rules on the Wiki whatsoever [23:23:22] I apologize if I wasted any time [23:25:19] And I also apologize if this is a complete overreaction [23:28:58] Alright, thanks @Void! [23:29:49] 👍