[00:00:17] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYGR
[00:00:19] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot 039227027 - BOT: Updating services config for wikis
[00:12:23] <icinga-miraheze>	 PROBLEM - misc1 APT on misc1 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates).
[00:42:44] <icinga-miraheze>	 PROBLEM - test2 Puppet on test2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 5 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[00:45:17] <icinga-miraheze>	 RECOVERY - test2 Puppet on test2 is OK: OK: Puppet is currently enabled, last run 34 seconds ago with 0 failures
[00:55:28] <SPF|Cloud>	 !log install goaccess on cp3
[00:55:35] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[06:46:13] <icinga-miraheze>	 RECOVERY - misc1 APT on misc1 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[09:05:12] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYEW
[09:05:14] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot 03a31e8d2 - BOT: Updating services config for wikis
[10:18:09] <icinga-miraheze>	 PROBLEM - permanentfuturelab.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[10:20:53] <icinga-miraheze>	 RECOVERY - permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Thu 20 Aug 2020 14:59:34 GMT +0000.
[10:23:14] <MH-Discord>	 <Avengium (Ángel)> Is reception123 here? i wanted to ask something
[11:04:59] <Reception123>	 Yes
[11:11:26] <MH-Discord>	 <Avengium (Ángel)> Hi reception
[11:12:04] <MH-Discord>	 <Avengium (Ángel)> I was thinking about pagedisqus and disqustag.
[11:12:19] <MH-Discord>	 <Avengium (Ángel)> Did you activated disqustag in tuscriaturas wiki?
[11:26:27] <Reception123>	 Yes
[11:41:52] <avengium>	 Reception123 about DisqusTag. Do i have to activate manually the disqus if i have to display comments on a wiki page? What do I have to do to make the comments section visible?
[11:45:10] <Reception123>	 I'm not really sure, RhinosF1 knows more 
[11:45:43] <avengium>	 but RhinosF1 has a red light so maybe he is busy
[11:51:31] <MirahezeBot>	 Hello Cabbo! If you have any questions, feel free to ask and someone should answer soon.
[11:56:12] <Reception123>	 The red thing means someone is opped
[11:56:32] <Reception123>	 But yes he did quit the channel
[12:12:55] <RhinosF1>	 @Avengium: It adds a link to the page
[12:29:15] <Jakeukalane>	 hello
[12:29:36] <Jakeukalane>	 I want to know a few things about central wiki as repository for two wikis in two languages
[12:30:37] <RhinosF1>	 Is this yourcreatures?
[12:30:42] <Jakeukalane>	 yes
[12:30:57] <RhinosF1>	 I sorted that
[12:31:02] <RhinosF1>	 How can I help?
[12:31:16] <Jakeukalane>	 yes, but I want to understand things
[12:31:36] <Jakeukalane>	 First: Is there a way to submit with one name and reference the translation? So for example Tree_Blue.png and Árbol_Azul.png with an alias or something like that? I suppose no
[12:31:59] <Jakeukalane>	 Second: If I want the description showed in different languages how can I do?
[12:32:06] <RhinosF1>	 You use the intercriaturs wiki like I set up for the main page
[12:32:32] <RhinosF1>	 https://intercriaturas.miraheze.org/wiki/Item:Q4
[12:32:33] <MirahezeBot>	 [ Main Page - InterCriaturas ] - intercriaturas.miraheze.org
[12:32:49] <Jakeukalane>	 Yes. I upload Tree_Blue.png to intercriaturas and I have to reference always Tree_Blue.png as that, I think I can't put an alias so I could reference the archive as Árbol_Azul.png
[12:33:02] <Jakeukalane>	 I think is too complicated that, so I don't think is possible
[12:33:05] <RhinosF1>	 Ah I see
[12:33:14] <RhinosF1>	 With the commons file repo
[12:34:02] <RhinosF1>	 .mh intercriaturas File:Arbol_Azul.png
[12:34:03] <MirahezeBot>	 https://intercriaturas.miraheze.org/wiki/File:Arbol_Azul.png
[12:34:15] <Jakeukalane>	 the other thing would be to put a description, so people in yourcreatures see: "The Blue Tree is an ancient tree that lives in..." and tuscriaturas visitors read under the image "El Árbol Azul es un árbol anciano que vive en..."
[12:34:36] <Jakeukalane>	 is just an example, there is not still that file, I didn't want to upload something to have to delete or move it
[12:34:46] <RhinosF1>	 Jakeukalane: go the page on the central repo you want  as an alias and add #REDIRECT [[File:ActualName.png]]
[12:34:54] <RhinosF1>	 Where ActualName is the actual name
[12:34:54] <Jakeukalane>	 oh, great
[12:35:05] <Jakeukalane>	 :D :D
[12:35:14] <RhinosF1>	 And you can use the wikibase item pages to add descriptions in each language
[12:36:17] <RhinosF1>	 I plan to write some help pages for the sub farm multi language setup
[12:36:28] <Jakeukalane>	 I'll try that in a moment, I am not very fluent with wikibase yet
[12:36:43] <Jakeukalane>	 I'll ask you if I can't do it. Thank you
[12:36:46] <RhinosF1>	 I wouldn't worry
[12:39:25] <Jakeukalane>	 for example: I have this: https://intercriaturas.miraheze.org/wiki/File:Sum-sum_gomalasticum_by_Jakeukalane.png
[12:39:26] <MirahezeBot>	 [ File:Sum-sum gomalasticum by Jakeukalane.png - InterCriaturas ] - intercriaturas.miraheze.org
[12:39:42] <Jakeukalane>	 how could edit the wikibase description?
[12:42:13] <RhinosF1>	 https://intercriaturas.miraheze.org/wiki/Special:NewItem
[12:42:14] <MirahezeBot>	 [ Create a new Item - InterCriaturas ] - intercriaturas.miraheze.org
[12:42:43] <RhinosF1>	 Create the item then link it to the page
[12:42:45] <Jakeukalane>	 great
[12:43:25] <RhinosF1>	 Jakeukalane: see https://intercriaturas.miraheze.org/wiki/Item:Q4 as an example
[12:43:26] <MirahezeBot>	 [ Main Page - InterCriaturas ] - intercriaturas.miraheze.org
[12:48:20] <Jakeukalane>	 https://imgur.com/6zEuLNs.png I wrote in the second field Archivo:Sum-sum_gomalasticum_por_Jakeukalane.png the name I want (although I already did a redirect in intercriaturas itself... I am confused
[12:51:04] <RhinosF1>	 Jakeukalane: have you created an item?
[12:51:13] * RhinosF1 has to go in a few mins for an hour
[12:51:31] <Jakeukalane>	 no, I haven't created
[12:51:41] <Jakeukalane>	 in wikibase?, no
[12:51:41] <RhinosF1>	 Create the new item
[12:51:50] <RhinosF1>	 Via Special:NewItem
[12:51:50] <Jakeukalane>	 I just uploaded in intercriaturas
[12:51:55] <RhinosF1>	 Ah
[12:52:13] <RhinosF1>	 I'll walk you through it step by step in about an hour
[12:52:20] <Jakeukalane>	 now it works
[12:52:37] <Jakeukalane>	 I just had to open the link in a new tab instead of click it
[12:52:37] <RhinosF1>	 Ah good!
[12:52:41] <RhinosF1>	 Ah!
[12:53:11] <Jakeukalane>	 (I click it from the file itself)
[12:53:34] <RhinosF1>	 Ok
[13:02:01] <Not-3033>	 [02miraheze/puppet] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYaD
[13:02:02] <Not-3033>	 [02miraheze/puppet] 07Southparkfan 03f061b14 - Install vmtouch on all MediaWiki servers Used for experimenting with caching /srv/mediawiki/w/cache in memory.
[13:04:54] <Jakeukalane>	 (don't worry about this, I'll ask again tomorrow)
[13:05:03] <Jakeukalane>	 (have a nice time)
[13:05:51] <icinga-miraheze>	 PROBLEM - www.permanentfuturelab.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[13:08:26] <icinga-miraheze>	 RECOVERY - www.permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Thu 20 Aug 2020 14:59:34 GMT +0000.
[13:10:38] <icinga-miraheze>	 PROBLEM - cp8 Current Load on cp8 is WARNING: WARNING - load average: 0.64, 1.94, 1.49
[13:13:18] <icinga-miraheze>	 RECOVERY - cp8 Current Load on cp8 is OK: OK - load average: 1.00, 1.53, 1.40
[13:16:36] <SPF|Cloud>	 !log ran 'keys WANCache:*' on rdb2 to clean up expired keys,  see https://grafana.miraheze.org/d/HZGjmu_Zz/redis?orgId=1&from=1594472416500&to=1594473328591&var-instance=rdb2.miraheze.org:9121
[13:16:36] <MirahezeBot>	 [ Grafana ] - grafana.miraheze.org
[13:16:40] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:17:39] <SPF|Cloud>	 ^ running that again, didn't finish the command
[13:44:38] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JJYVw
[13:44:40] <Not-3033>	 [02miraheze/mw-config] 07paladox 03462abdc - Set closed wikis into read only Preparing to migrate them to db12
[13:44:42] <Not-3033>	 [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbvb3
[13:44:43] <Not-3033>	 [02mw-config] 07paladox opened pull request 03#3163: Set closed wikis into read only - 13https://git.io/JJYVr
[13:49:51] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+1/-0/±0] 13https://git.io/JJYwL
[13:49:52] <Not-3033>	 [02miraheze/mw-config] 07paladox 03b464a0b - Create DB12Wikis.php
[13:49:54] <Not-3033>	 [02mw-config] 07paladox synchronize pull request 03#3163: Set closed wikis into read only - 13https://git.io/JJYVr
[13:53:00] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JJYw3
[13:53:01] <Not-3033>	 [02miraheze/mw-config] 07paladox 0384ca938 - Update Database.php
[13:53:03] <Not-3033>	 [02mw-config] 07paladox synchronize pull request 03#3163: Set closed wikis into read only - 13https://git.io/JJYVr
[13:54:11] <Not-3033>	 [02mw-config] 07paladox synchronize pull request 03#3163: Set closed wikis into read only - 13https://git.io/JJYVr
[13:54:13] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JJYwZ
[13:54:14] <Not-3033>	 [02miraheze/mw-config] 07paladox 03fa41876 - Update DB12Wikis.php
[13:56:17] <Not-3033>	 [02mw-config] 07paladox synchronize pull request 03#3163: Set closed wikis into read only - 13https://git.io/JJYVr
[13:56:19] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JJYwc
[13:56:20] <Not-3033>	 [02miraheze/mw-config] 07paladox 03d942c46 - Update Database.php
[14:07:47] <SPF|Cloud>	 !log MariaDB [mhglobal]> update cw_wikis set wiki_dbcluster='c4' where wiki_dbname IN('allthetropeswiki', 'nonciclopediawiki');
[14:07:51] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[14:10:08] <SPF|Cloud>	 !log set wiki_dbcluster to NULL for all wikis
[14:10:13] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[14:10:24] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/JJYwH
[14:10:25] <Not-3033>	 [02miraheze/mw-config] 07paladox 0360c74e2 - Introduce db12
[14:10:27] <Not-3033>	 [02mw-config] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbvb3
[14:10:28] <Not-3033>	 [02mw-config] 07paladox opened pull request 03#3164: Introduce db12 - 13https://git.io/JJYwQ
[14:11:21] <Not-3033>	 [02mw-config] 07paladox closed pull request 03#3164: Introduce db12 - 13https://git.io/JJYwQ
[14:11:23] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYw5
[14:11:24] <Not-3033>	 [02miraheze/mw-config] 07paladox 039c27a15 - Introduce db12 (#3164)
[14:11:26] <Not-3033>	 [02mw-config] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbvb3
[14:11:27] <Not-3033>	 [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-2
[14:12:02] <travis-ci>	 miraheze/mw-config/paladox-patch-2/60c74e2 - paladox The build has errored. https://travis-ci.org/miraheze/mw-config/builds/707165490
[14:12:09] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYwF
[14:12:11] <Not-3033>	 [02miraheze/mw-config] 07paladox 031025d58 - Set test2wiki into read only
[14:19:14] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYrk
[14:19:15] <Not-3033>	 [02miraheze/mw-config] 07paladox 03a9b66d2 - Switch test2 to db12
[14:19:52] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYrL
[14:19:53] <Not-3033>	 [02miraheze/mw-config] 07paladox 034eb3fcb - unset read only for test2wiki
[14:22:08] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 035 commits to 03paladox-patch-1 [+0/-0/±5] 13https://git.io/JJYrq
[14:22:10] <Not-3033>	 [02miraheze/mw-config] 07paladox 03bddc576 - Merge branch 'master' into paladox-patch-1
[14:22:11] <Not-3033>	 [02mw-config] 07paladox synchronize pull request 03#3163: Set closed wikis into read only - 13https://git.io/JJYVr
[14:31:28] <Not-3033>	 [02mw-config] 07paladox synchronize pull request 03#3163: Set closed wikis into read only - 13https://git.io/JJYVr
[14:31:30] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JJYrB
[14:31:31] <Not-3033>	 [02miraheze/mw-config] 07paladox 03d762c3e - Update LocalWiki.php
[14:35:02] <Not-3033>	 [02mw-config] 07paladox synchronize pull request 03#3163: Set closed wikis into read only - 13https://git.io/JJYVr
[14:35:04] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JJYrg
[14:35:05] <Not-3033>	 [02miraheze/mw-config] 07paladox 0397d99da - Update DB12Wikis.php
[14:37:19] <Not-3033>	 [02mw-config] 07paladox closed pull request 03#3163: Set closed wikis into read only - 13https://git.io/JJYVr
[14:37:21] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+1/-0/±2] 13https://git.io/JJYro
[14:37:22] <Not-3033>	 [02miraheze/mw-config] 07paladox 03b0c5ab7 - Set closed wikis into read only (#3163)
[14:37:24] <Not-3033>	 [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbvb3
[14:37:25] <Not-3033>	 [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1
[14:43:22] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYr1
[14:43:23] <Not-3033>	 [02miraheze/mw-config] 07paladox 03951ae31 - Add small site notice for closed wikis being migrated to another db cluster
[14:44:17] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYrM
[14:44:19] <Not-3033>	 [02miraheze/mw-config] 07paladox 03670ab88 - Revert "Add small site notice for closed wikis being migrated to another db cluster" This reverts commit 951ae31ca1b21aef48482fbde63214516f70f9a9.
[14:46:28] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYrS
[14:46:30] <Not-3033>	 [02miraheze/mw-config] 07paladox 03d5d1d84 - Add sitenotice for closed wikis db being migrated
[15:15:39] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYon
[15:15:40] <Not-3033>	 [02miraheze/mw-config] 07paladox 0394256f3 - Remove frikipediawiki from the list
[15:57:18] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYKY
[15:57:19] <Not-3033>	 [02miraheze/mw-config] 07paladox 038fd07f2 - Remove uncyclomirrorwiki
[16:11:08] <SPF|Cloud>	 !log fixed grants for icinga and exporter on db12
[16:11:13] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:14:47] <paladox>	 oh
[16:14:51] <paladox>	 err wrong channel
[16:26:03] <Reception123>	 !log renamed Carp_Universum to Universal_Omega
[16:26:09] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:40:23] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJY6g
[16:40:24] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot 0353e7834 - BOT: Updating services config for wikis
[17:10:21] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYi0
[17:10:23] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot 03839f4e5 - BOT: Updating services config for wikis
[17:13:20] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYi2
[17:13:22] <Not-3033>	 [02miraheze/mw-config] 07paladox 034198755 - Migrate closed wikis to db12
[17:14:22] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JJYiw
[17:14:23] <Not-3033>	 [02miraheze/mw-config] 07paladox 03cbde39e - Take closed wikis out of read only mode
[17:14:25] <Not-3033>	 [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbvb3
[17:14:26] <Not-3033>	 [02mw-config] 07paladox opened pull request 03#3165: Take closed wikis out of read only mode - 13https://git.io/JJYir
[17:15:15] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JJYiK
[17:15:16] <Not-3033>	 [02miraheze/mw-config] 07paladox 033c11826 - Update LocalWiki.php
[17:15:18] <Not-3033>	 [02mw-config] 07paladox synchronize pull request 03#3165: Take closed wikis out of read only mode - 13https://git.io/JJYir
[17:22:37] <Not-3033>	 [02mw-config] 07paladox closed pull request 03#3165: Take closed wikis out of read only mode - 13https://git.io/JJYir
[17:22:38] <Not-3033>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JJYix
[17:22:40] <Not-3033>	 [02miraheze/mw-config] 07paladox 032d3b18d - Take closed wikis out of read only mode (#3165)
[17:22:41] <Not-3033>	 [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbvb3
[17:22:43] <Not-3033>	 [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1
[17:32:43] <revi>	 John: I think you're supposed to create 2020 election page
[17:32:54] <RhinosF1>	 revi: fixed
[17:36:53] <paladox>	 !log dropping all closed wikis on db9 - all migrated to db12
[17:36:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:44:13] <RhinosF1>	 revi: my discord crashes clicking your profile so updating it
[17:44:39] <revi>	 LOL
[17:44:43] <revi>	 cuz it has github? lol
[17:45:06] <RhinosF1>	 revi: i guess so
[17:52:43] <icinga-miraheze>	 PROBLEM - cp8 Current Load on cp8 is CRITICAL: CRITICAL - load average: 2.10, 2.16, 1.52
[17:55:24] <icinga-miraheze>	 RECOVERY - cp8 Current Load on cp8 is OK: OK - load average: 0.76, 1.61, 1.42
[18:01:21] <icinga-miraheze>	 PROBLEM - cp8 Current Load on cp8 is CRITICAL: CRITICAL - load average: 2.07, 1.81, 1.60
[18:01:39] <RhinosF1>	 Can someone look into ^
[18:01:44] <RhinosF1>	 SPF|Cloud paladox
[18:02:41] <paladox>	 seems i/o https://grafana.miraheze.org/d/W9MIkA7iz/miraheze-cluster?viewPanel=283&orgId=1&var-job=node&var-node=cp8.miraheze.org&var-port=9100
[18:02:42] <MirahezeBot>	 [ Grafana ] - grafana.miraheze.org
[18:04:02] <icinga-miraheze>	 RECOVERY - cp8 Current Load on cp8 is OK: OK - load average: 0.67, 1.37, 1.46
[18:04:08] <RhinosF1>	 paladox: is it copable?
[18:04:39] <paladox>	 well if no one is reporting issues, i would say for now, yes.
[18:05:01] <RhinosF1>	 Ack
[18:05:42] <RhinosF1>	 paladox: check discord
[18:07:47] <SPF|Cloud>	 !log set protection for custom variables in icingaweb2
[18:07:51] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:08:41] <paladox>	 !log varnish> ban req.http.Host == dcmultiverse.miraheze.org - cp8
[18:08:46] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:09:09] <RhinosF1>	 ty paladox
[18:09:26] <SPF|Cloud>	 on one server only?
[18:10:43] <SPF|Cloud>	 was db6 properly decom'ed?
[18:10:45] <RhinosF1>	 SPF|Cloud: only us users report the issue
[18:11:08] <paladox>	 SPF|Cloud db6?
[18:11:14] <SPF|Cloud>	 yes
[18:11:23] <SPF|Cloud>	 you logged a decom to SAL four days ago
[18:11:29] <paladox>	 oh, yeh.
[18:11:35] <paladox>	 I removed from puppet too
[18:11:39] <paladox>	 using the clean cert command
[18:11:54] <paladox>	 puppet i think takes a week to expunge it from puppetdb?
[18:13:25] <SPF|Cloud>	 that's a long time
[18:13:38] <SPF|Cloud>	 in the past there was a script to manually clean up these hosts
[18:13:49] <Not-3033>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYXR
[18:13:51] <Not-3033>	 [02miraheze/puppet] 07paladox 03d365fc7 - puppetdb::command_processing_threads: Increase to 2
[18:14:40] <paladox>	 SPF|Cloud i mean, we should create a script that does that yeh (puppetise it)
[18:14:59] <SPF|Cloud>	 or change the default time to something shorter than a week?
[18:15:57] <paladox>	 SPF|Cloud ok, deleted.
[18:16:36] <SPF|Cloud>	 +1
[18:17:01] <paladox>	 https://puppet.com/docs/puppetdb/latest/configure.html#node-ttl
[18:17:02] <MirahezeBot>	 [ Configuring PuppetDB | Puppet.com ] - puppet.com
[18:17:11] <paladox>	 SPF|Cloud what would you think a sane value would be for ^?
[18:18:28] <SPF|Cloud>	 96 hours?
[18:18:28] <paladox>	 oh node-purge-ttl
[18:18:41] <SPF|Cloud>	 and/or include the command you ran on Tech:Puppet
[18:18:44] <paladox>	 https://github.com/miraheze/puppet/blob/d365fc79c06accae7c1a03b6c43094dd1acea7da/modules/puppetdb/manifests/init.pp#L103
[18:18:45] <MirahezeBot>	 [ puppet/init.pp at d365fc79c06accae7c1a03b6c43094dd1acea7da · miraheze/puppet · GitHub ] - github.com
[18:19:01] <paladox>	 i just manually run the drop commands on the postgresql db SPF|Cloud 
[18:19:14] <SPF|Cloud>	 https://puppet.com/docs/puppetdb/latest/maintain_and_tune.html#deactivate-or-expire-decommissioned-nodes would deactivate have done the same?
[18:19:15] <MirahezeBot>	 [ Maintaining and tuning | Puppet.com ] - puppet.com
[18:20:32] <paladox>	 oh, maybe
[18:21:01] <paladox>	 well at least i guess that's why node-purge-ttl was not working
[18:21:02] <SPF|Cloud>	 time to add to Tech:Puppet?
[18:21:05] <paladox>	 yes
[18:22:00] <paladox>	 SPF|Cloud https://meta.miraheze.org/wiki/Tech:Puppet#Removing_puppet_agent_.28server.29_on_the_Puppetserver
[18:22:01] <MirahezeBot>	 [ Tech:Puppet - Miraheze Meta ] - meta.miraheze.org
[18:22:22] <SPF|Cloud>	 +1
[18:24:01] <RhinosF1>	 paladox: https://meta.miraheze.org/w/index.php?diff=113315&oldid=113314&rcid=414643
[18:24:02] <MirahezeBot>	 [ Difference between revisions of "Tech:Puppet" - Miraheze Meta ] - meta.miraheze.org
[18:25:13] <paladox>	 ok
[18:36:25] <Not-3033>	 [02miraheze/puppet] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYXd
[18:36:26] <Not-3033>	 [02miraheze/puppet] 07Southparkfan 03bdaa242 - Set different options for MariaDB icinga monitoring
[18:43:36] <icinga-miraheze>	 PROBLEM - db11 MariaDB on db11 is CRITICAL: Access denied for user 'icinga'@'2001:41d0:800:105a::6' (using password: YES)
[18:43:37] <icinga-miraheze>	 PROBLEM - db9 MariaDB on db9 is CRITICAL: Access denied for user 'icinga'@'2001:41d0:800:105a::6' (using password: YES)
[18:45:01] <Not-3033>	 [02miraheze/puppet] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYXx
[18:45:03] <Not-3033>	 [02miraheze/puppet] 07Southparkfan 03762b4f9 - Reduce frequency of custom domain TLS checks If a certificate is going to expire in 30 days, it doesn't matter if the alert comes a few minutes later. However, this change greatly reduces the load caused by Icinga checks.
[19:06:10] <MH-Discord>	 <MrJaroslavik> Hey, i think GSs role can be without capital letters. What do you think? https://i.nuuls.com/snl5i.png
[19:06:30] <MH-Discord>	 <MrJaroslavik> as per other roles
[19:07:04] <MH-Discord>	 <MrJaroslavik> For standardization
[19:07:35] <RhinosF1>	 hmm
[19:07:56] <RhinosF1>	 I'd say everything else should be capitals
[19:08:12] <RhinosF1>	 That's grammtically wrong as their titles
[19:08:40] <Not-3033>	 [02miraheze/puppet] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJY1a
[19:08:41] <Not-3033>	 [02miraheze/puppet] 07Southparkfan 03a522936 - systemd: restart varnish if failure detected
[19:09:25] <MH-Discord>	 <MrJaroslavik> So everything to capital letters? (e.g. Administrator, Flooder, Steward,...)
[19:13:22] <MH-Discord>	 <MrJaroslavik> This is a member name. On group name it is okay (with caps).
[19:26:04] <Not-3033>	 [02miraheze/CreateWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJY1x
[19:26:06] <Not-3033>	 [02miraheze/CreateWiki] 07JohnFLewis 03c95fbbd - Introduce a combi list for migration
[19:27:19] <Not-3033>	 [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JJY1h
[19:27:21] <Not-3033>	 [02miraheze/mediawiki] 07JohnFLewis 03957053a - update CW
[19:35:45] <Not-3033>	 [02miraheze/puppet] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYMs
[19:35:46] <Not-3033>	 [02miraheze/puppet] 07Southparkfan 0300c56f1 - Fix icinga user grants for mariadb checks
[19:38:12] <MH-Discord>	 <Doug> I wondered about that too, but I don't mind it with capital letters. I've gotten used to it as Global Sysop on the special pages.
[19:38:54] <icinga-miraheze>	 PROBLEM - test2 Puppet on test2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[19:39:12] <icinga-miraheze>	 RECOVERY - db9 MariaDB on db9 is OK: Uptime: 254797 Threads: 44 Questions: 276755379 Slow queries: 8597657 Opens: 15189342 Flush tables: 1 Open tables: 15000 Queries per second avg: 1086.179
[19:39:42] <SPF|Cloud>	 !log db9: clean up old sql users, fix icinga user
[19:39:42] <MH-Discord>	 <Doug> If we change it, though, we should change it to all capital letters globally, otherwise we'll end up in a situation where the roles are capitalized on Meta special pages and not anywhere else.
[19:39:46] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:40:50] <MH-Discord>	 <Doug> I'd probably rather "check user" be changed to "checkuser" or "CheckUser" across all wikis. That one bothers me more. lol
[19:42:47] <Not-3033>	 [02miraheze/puppet] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYMW
[19:42:48] <Not-3033>	 [02miraheze/puppet] 07Southparkfan 03ec252e7 - Disallow global read access for /etc/mysql/miraheze
[19:43:35] <SPF|Cloud>	 !log db11: clean up broken sql user, added icinga user
[19:43:43] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:44:01] <icinga-miraheze>	 RECOVERY - db11 MariaDB on db11 is OK: Uptime: 441218 Threads: 8 Questions: 205657 Slow queries: 21474 Opens: 463 Flush tables: 1 Open tables: 15 Queries per second avg: 0.466
[19:47:46] <SPF|Cloud>	 !log dropped SELECT privilege for exporter@localhost on db9 for testing
[19:47:50] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:53:01] <SPF|Cloud>	 !log dropped SELECT privilege for exporter@localhost on all database server
[19:53:08] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:54:48] <Not-3033>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYMX
[19:54:49] <Not-3033>	 [02miraheze/puppet] 07paladox 035229467 - mariadb: Drop select from exporter grants
[19:55:16] <SPF|Cloud>	 paladox: I was already doing that
[19:55:18] <SPF|Cloud>	 and you forgot one thing :)
[19:55:21] <paladox>	 oh
[19:55:33] <paladox>	 what did i forget
[19:55:45] <Not-3033>	 [02miraheze/puppet] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYMS
[19:55:47] <Not-3033>	 [02miraheze/puppet] 07Southparkfan 036b913f8 - Remove 'WITH GRANT OPTION' for exporter@localhost
[19:56:49] <paladox>	 oh
[20:08:58] <Not-3033>	 [02miraheze/CreateWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JJYDt
[20:09:00] <Not-3033>	 [02miraheze/CreateWiki] 07JohnFLewis 0347e1960 - Rewrite to use new combination database list
[20:17:02] <icinga-miraheze>	 RECOVERY - test2 Puppet on test2 is OK: OK: Puppet is currently enabled, last run 38 seconds ago with 0 failures
[20:19:16] <Not-3033>	 [02miraheze/CreateWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYDV
[20:19:17] <Not-3033>	 [02miraheze/CreateWiki] 07JohnFLewis 03e25b513 - Clean up of artifact
[20:19:47] <Not-3033>	 [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JJYDw
[20:19:49] <Not-3033>	 [02miraheze/mediawiki] 07JohnFLewis 03abbec9b - update CW
[20:27:09] <icinga-miraheze>	 PROBLEM - test2 Puppet on test2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[20:31:13] <icinga-miraheze>	 PROBLEM - test2 Puppet on test2 is WARNING: WARNING: Puppet is currently disabled, message: John, last run 6 minutes ago with 1 failures
[20:35:56] <Not-3033>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JJYDh
[20:35:58] <Not-3033>	 [02miraheze/mediawiki] 07paladox 0361f5266 - Revert "update CW" This reverts commit abbec9b5fe87a97f050212593a5ac4e9cf34577b.
[20:40:17] <paladox>	 !log $cw = new CreateWikiJson( 'loginwiki' ); $cw->resetDatabaseList();
[20:40:31] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:43:15] <MirahezeBot>	 Hello allthetropesisbr! If you have any questions, feel free to ask and someone should answer soon.
[20:44:15] <allthetropesisbr>	 allthetropes is not working, every page other than the main one leads to a 404
[20:46:31] <paladox>	 Hi, should work now.
[20:48:08] <allthetropesisbr>	 what happened?
[20:49:04] <paladox>	 !log rebuild lc on jobrunner1
[20:49:08] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:49:25] <paladox>	 We deployed a change and appears to have not worked exactly how we wanted it to.
[20:57:30] <Not-3033>	 [02miraheze/CreateWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYyr
[20:57:31] <Not-3033>	 [02miraheze/CreateWiki] 07JohnFLewis 036626e9a - Correct variable
[20:58:30] <Not-3033>	 [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JJYyo
[20:58:32] <Not-3033>	 [02miraheze/mediawiki] 07JohnFLewis 03629ff5f - update CW
[21:20:25] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJYSG
[21:20:26] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot 03d781e22 - BOT: Updating services config for wikis
[23:46:50] <icinga-miraheze>	 PROBLEM - cp8 Current Load on cp8 is CRITICAL: CRITICAL - load average: 1.99, 2.02, 1.45
[23:48:52] <icinga-miraheze>	 RECOVERY - cp8 Current Load on cp8 is OK: OK - load average: 1.01, 1.63, 1.37