[00:04:07] <icinga-miraheze>	 PROBLEM - bacula1 Puppet on bacula1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:12:07] <icinga-miraheze>	 RECOVERY - bacula1 Puppet on bacula1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[00:52:20] <icinga-miraheze>	 RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs  
[01:56:18] <Not-a634>	 [02puppet] 07Amanda-Catherine opened pull request 03#850: Remove dead link T3645 - 13https://git.io/fAdb8
[02:01:38] <Not-a634>	 [02puppet] 07JohnFLewis closed pull request 03#850: Remove dead link T3645 - 13https://git.io/fAdb8
[02:01:39] <Not-a634>	 [02miraheze/puppet] 07JohnFLewis pushed 032 commits to 03master [+0/-0/±2] 13https://git.io/fAdb2
[02:01:40] <Not-a634>	 [02miraheze/puppet] 07Amanda-Catherine 0307f6f66 - Remove dead link T3645
[02:01:42] <Not-a634>	 [02miraheze/puppet] 07JohnFLewis 03e0a7910 - Merge pull request #850 from Amanda-Catherine/patch-1 Remove dead link T3645
[02:08:51] <paladox>	 !log sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=starmetalwiki --report=1 user%27s+Wiki%21-20180919040553.xml on mw1 in a screen
[02:08:55] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[02:10:02] <paladox>	 !log sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=besttvshowswiki --report=1 besttvshows938_pages_full.xml on mw1 in a screen
[02:10:13] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[02:16:24] <paladox>	 !log sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=nonciclopediawiki --report=1 nonciclopediawiki09102018.xml on mw1
[02:16:28] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[04:30:19] <icinga-miraheze>	 PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 533  
[04:56:21] <icinga-miraheze>	 RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs  
[05:05:12] <Not-a634>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAdxi
[05:05:13] <Not-a634>	 [02miraheze/services] 07MirahezeSSLBot 03a3286e2 - BOT: Updating services config for wikis
[06:15:13] <Not-a634>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAdhv
[06:15:15] <Not-a634>	 [02miraheze/services] 07MirahezeSSLBot 0363bce85 - BOT: Updating services config for wikis
[12:31:11] <paladox>	 !log started static backup on bacula1 because it seems a job was not run at 12am?
[12:31:16] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[15:32:03] <chauffer>	 hey Reception123, came across miraheze today while looking into wikia, would be happy to help w/servers-related tasks, my experience's all linked from https://simone.sh, including working at Backupsy for about a year :D
[15:37:05] <Wiki-1776>	 Have you read https://meta.miraheze.org/wiki/Contributing ? chauffer 
[15:37:05] <ZppixBot>	 Title: [ Contributing - Miraheze Meta ] - meta.miraheze.org
[15:37:41] <chauffer>	 yes Wiki-1776, which is how i ended up here highlighting reception
[15:38:18] <Wiki-1776>	 ah, ok :) 
[15:46:22] <icinga-miraheze>	 PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 3180  
[15:46:46] <paladox>	 Hi chauffer we would welcome any help :)
[15:46:52] <paladox>	 We welcome all volunteers!
[15:47:15] <chauffer>	 sure, how can i help, though? :D
[15:48:52] <paladox>	 chauffer: you could look through https://phabricator.miraheze.org for tasks to do
[15:48:53] <ZppixBot>	 Title: [ Main Page ] - phabricator.miraheze.org
[15:49:37] <chauffer>	 any particular ones?
[15:50:03] <paladox>	 chauffer: not really :), any ones you can do is a great benefit :)
[15:50:36] <chauffer>	 well i don't have any wikimedia-specific experience, so i cannot really help with that :D
[15:50:52] <chauffer>	 mediawiki*
[15:50:56] <paladox>	 chauffer: you doint need any wikimedia experience :)
[15:51:00] <paladox>	 Ah ok
[15:51:16] <paladox>	 chauffer: johnlewis should be here soon hopefully
[15:51:26] <paladox>	 So he may be able to tell you specifics
[15:51:31] <chauffer>	 sure
[15:59:34] <Cyberpower678>	 paladox: do you have Miraheze dumps similar to WMF dumps?
[16:00:05] <Cyberpower678>	 I've got a companion user who helps me with IABot statistics gathering and he needs dumps.
[16:01:14] <paladox>	 Cyberpower678: nope we doint
[16:01:32] <Cyberpower678>	 Oh well
[16:04:01] <Reguyla_>	 paladox, is that something you would be willing to do?
[16:04:22] <Reguyla_>	 it might be useful for doing some bot work
[16:05:02] <paladox>	 Reguyla_: I would need to speak to John on that one.
[16:05:10] <paladox>	 We have limited space
[16:05:10] <Reguyla_>	 no worries
[16:05:15] <Reguyla_>	 I totally understand
[16:05:18] <paladox>	 Ok :)
[16:12:38] <AmandaCatherine>	 Hello
[16:13:09] <paladox>	 Hi
[16:14:48] <Wiki-1776>	 Hola
[16:38:18] <AmandaCatherine>	 Both icinga and grafana seem to be down
[16:38:43] <AmandaCatherine>	 I keep getting “connection timed out” when trying to load them from the server page on Meta
[16:43:02] <paladox>	 They work for me
[16:44:04] <AmandaCatherine>	 Huh
[16:45:08] <AmandaCatherine>	 You don’t need to be sysadmin in order to access them, do you?
[16:51:27] <Wiki-1776>	 AmandaCatherine: What was the problem with closing the T3633 changes in GitHub?
[16:55:11] <Not-a634>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAFcN
[16:55:13] <Not-a634>	 [02miraheze/services] 07MirahezeSSLBot 033922c81 - BOT: Updating services config for wikis
[16:56:20] <icinga-miraheze>	 RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs  
[17:18:45] <AmandaCatherine>	 Wiki-1776: I accidentally pushed a change that was intended for my personal repo to the fork of the miraheze repo used for that PR
[17:19:25] <AmandaCatherine>	 and therefore the PR ended up with an extra commit that couldn’t be merged, and I don’t think you can delete individual commits from PRa
[17:19:36] <AmandaCatherine>	 s/PRa/PRs
[17:19:36] <ZppixBot>	 AmandaCatherine meant to say: and therefore the PR ended up with an extra commit that couldn’t be merged, and I don’t think you can delete individual commits from PRs
[17:26:08] <AmandaCatherine>	 Dumb connection drops
[17:32:18] <Not-a634>	 [02mw-config] 07Amanda-Catherine opened pull request 03#2483: Re-do #2480 - 13https://git.io/fAFW7
[17:32:36] <AmandaCatherine>	 Wiki-1776 ^
[17:33:20] <travis-ci>	 Amanda-Catherine/mw-config/patch-1/33c9083 - Amanda The build passed. https://travis-ci.com/Amanda-Catherine/mw-config/builds/85666931
[17:33:32] <paladox>	 AmandaCatherine nope, you doin't need to be a sysadmin to access grafana or icinga
[17:34:33] <paladox>	 DC2017 which wiki?
[17:34:41] <paladox>	 And are you on a page / article or a special page?
[17:35:20] <Voidwalker>	 yeh, but you need sysadmin access to continually reset the icinga guest account password
[17:35:26] <Voidwalker>	 :P
[17:35:41] <paladox>	 Voidwalker lol
[17:37:02] <paladox>	 Voidwalker you can log in now.
[17:37:14] <paladox>	 DC2017 i think that's native mw functionaility
[17:38:24] <paladox>	 hmm
[17:38:30] <paladox>	 DC2017 which wiki is this?
[17:39:38] <paladox>	 chauffer these https://github.com/miraheze are our open sourced repos. https://github.com/miraheze/puppet is what we use to help maintain the servers. If you wanted to take a look.
[17:39:39] <ZppixBot>	 Title: [ Miraheze · GitHub ] - github.com
[17:39:40] <ZppixBot>	 Title: [ GitHub - miraheze/puppet: Production Puppet code ] - github.com
[17:39:50] <paladox>	 DC2017 i can view the wiki as im a sysadmin
[17:40:22] <chauffer>	 yep i've seen, paladox
[17:40:27] <paladox>	 ok :)
[17:43:52] <paladox>	 DC2017 i belive it's this extension https://mediawiki.org/wiki/Extension:JSBreadCrumbs
[17:43:53] <ZppixBot>	 Title: [ Extension:JSBreadCrumbs - MediaWiki ] - mediawiki.org
[17:51:34] <paladox>	 your welcome :)
[17:52:04] <paladox>	 AmandaCatherine does https://grafana.miraheze.org/d/W9MIkA7iz/miraheze-cluster?orgId=1 that work?
[17:52:05] <ZppixBot>	 Title: [ Grafana ] - grafana.miraheze.org
[17:52:59] <AmandaCatherine>	 Yes, but I can’t change the drop down menus
[17:53:30] <paladox>	 AmandaCatherine drop down?
[17:53:39] <paladox>	 yeh only admins can change the dashboard
[17:54:09] <AmandaCatherine>	 No, there is a drop down to choose which server to get the data for
[17:54:15] <AmandaCatherine>	 Under “Host”
[17:54:21] <AmandaCatherine>	 But I can’t open that
[17:54:53] <paladox>	 oh
[17:55:06] <paladox>	 AmandaCatherine works for me
[17:55:11] <paladox>	 using private window too
[17:55:21] <AmandaCatherine>	 Huh
[17:58:54] <paladox>	 chauffer we have "https://phabricator.miraheze.org/project/view/2/" but not many tasks to do yet (blocked on things) though if you come up with ideas you can create tasks for them there :)
[17:58:55] <ZppixBot>	 Title: [ Login ] - phabricator.miraheze.org
[18:01:28] <chauffer>	 oh jayvdb is involved? i know him from coala :D
[18:01:40] <chauffer>	 either way, doubt i can do anything there as-is :)
[18:03:00] <paladox>	 oh yeh
[18:22:05] <icinga-miraheze>	 RECOVERY - bacula1 Bacula Static Lizardfs1 on bacula1 is OK: OK: Full, 754423 files, 79.37GB, 2018-09-23 18:21:00 (1.1 minutes ago)  
[18:22:17] <Not-a634>	 [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbiAS
[18:22:18] <Not-a634>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fAF4o
[18:22:20] <Not-a634>	 [02miraheze/puppet] 07paladox 03e58c65a - More fixes to ssl module
[18:22:21] <Not-a634>	 [02puppet] 07paladox opened pull request 03#851: More fixes to ssl module - 13https://git.io/fAF4K
[18:23:13] <Not-a634>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fAF41
[18:23:15] <Not-a634>	 [02miraheze/puppet] 07paladox 030f68a01 - Update certs.pp
[18:23:16] <Not-a634>	 [02puppet] 07paladox synchronize pull request 03#851: More fixes to ssl module - 13https://git.io/fAF4K
[18:24:37] <Not-a634>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fAF4H
[18:24:38] <Not-a634>	 [02miraheze/puppet] 07paladox 0378a41ed - Update wildcard.pp
[18:24:40] <Not-a634>	 [02puppet] 07paladox synchronize pull request 03#851: More fixes to ssl module - 13https://git.io/fAF4K
[18:25:19] <Not-a634>	 [02puppet] 07paladox closed pull request 03#851: More fixes to ssl module - 13https://git.io/fAF4K
[18:25:21] <Not-a634>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fAF4F
[18:25:22] <Not-a634>	 [02miraheze/puppet] 07paladox 0361bb969 - More fixes to ssl module (#851) * More fixes to ssl module * Update certs.pp * Update wildcard.pp
[18:25:24] <Not-a634>	 [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbiAS
[18:25:25] <Not-a634>	 [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1
[18:29:13] <icinga-miraheze>	 PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[18:29:45] <icinga-miraheze>	 PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[18:32:59] <icinga-miraheze>	 PROBLEM - misc3 Puppet on misc3 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[18:33:01] <icinga-miraheze>	 PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[18:33:11] <icinga-miraheze>	 PROBLEM - misc2 Puppet on misc2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[18:33:17] <icinga-miraheze>	 PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[18:33:35] <icinga-miraheze>	 PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[18:33:51] <icinga-miraheze>	 PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[18:33:55] <icinga-miraheze>	 PROBLEM - db4 Puppet on db4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[18:34:03] <icinga-miraheze>	 PROBLEM - misc4 Puppet on misc4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[18:34:15] <icinga-miraheze>	 PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[18:34:23] <icinga-miraheze>	 PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[18:41:14] <icinga-miraheze>	 RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 24 seconds ago with 0 failures  
[18:41:36] <icinga-miraheze>	 RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 18 seconds ago with 0 failures  
[18:41:44] <icinga-miraheze>	 RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 50 seconds ago with 0 failures  
[18:41:52] <icinga-miraheze>	 RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[18:42:16] <icinga-miraheze>	 RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[18:42:24] <icinga-miraheze>	 RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[18:43:00] <icinga-miraheze>	 RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures  
[18:55:49] <Not-a634>	 [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbiAS
[18:55:51] <Not-a634>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fAFRk
[18:55:52] <Not-a634>	 [02miraheze/puppet] 07paladox 034af3649 - Fix ssl module part 2
[18:55:54] <Not-a634>	 [02puppet] 07paladox opened pull request 03#852: Fix ssl module part 2 - 13https://git.io/fAFRI
[18:59:42] <Not-a634>	 [02puppet] 07paladox closed pull request 03#852: Fix ssl module part 2 - 13https://git.io/fAFRI
[18:59:44] <Not-a634>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAFRu
[18:59:45] <Not-a634>	 [02miraheze/puppet] 07paladox 0394b5505 - Fix ssl module part 2 (#852)
[18:59:54] <Not-a634>	 [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1
[18:59:56] <Not-a634>	 [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbiAS
[19:00:59] <icinga-miraheze>	 RECOVERY - misc3 Puppet on misc3 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures  
[19:01:11] <icinga-miraheze>	 RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 17 seconds ago with 0 failures  
[19:01:55] <icinga-miraheze>	 RECOVERY - db4 Puppet on db4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[19:02:03] <icinga-miraheze>	 RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures  
[19:03:17] <icinga-miraheze>	 RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 28 seconds ago with 0 failures  
[19:31:45] <Reception123>	 chauffer: hi. Still here? :)
[19:40:19] <paladox>	 !log sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=starmetalwiki --report=1 user%27s+Wiki%21-20180919040615.xml on mw1 in a screen
[19:40:24] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[20:21:29] <Wiki-1776>	 Hi
[20:29:57] <paladox>	 meta down
[20:30:00] <paladox>	 for some reason
[22:08:58] <AmandaCatherine>	 Err... https://meta.miraheze.org/wiki/Special:CentralAuth/Spaghetti_strap_tank_tops
[22:09:00] <ZppixBot>	 Title: [ Global account information for Spaghetti strap tank tops - Miraheze Meta ] - meta.miraheze.org
[22:09:09] <AmandaCatherine>	 JohnLewis Voidwalker ^
[22:09:25] <Voidwalker>	 aware
[22:09:46] <AmandaCatherine>	 Looks like the sexy girl LTA again
[22:10:03] <AmandaCatherine>	 Matches pattern from other wiki, anyway
[22:11:42] <AmandaCatherine>	 !m Voidwalker
[22:11:42] <[d__d]>	 You're doing good work, Voidwalker!
[22:13:33] <AmandaCatherine>	 Voidwalker: shouldn’t you sign your name when you edit out spam?
[22:14:19] <MacFan4000>	 No need
[22:15:02] <AmandaCatherine>	 Oh, he did it through RequestWikiEdit
[22:15:05] <AmandaCatherine>	 That logs it
[22:15:16] <AmandaCatherine>	 Usually when Reception123 does it there is no log
[22:16:16] <MacFan4000>	 There is, he does it via DB, thus its in the SAL
[22:16:44] <AmandaCatherine>	 SAL?
[22:16:52] <paladox>	 what we log
[22:17:08] <AmandaCatherine>	 Oh, the MirahezeLogbot
[22:17:44] <paladox>	 yep
[22:17:52] <AmandaCatherine>	 Anyway, time for dinner
[22:30:06] <Wiki-1776>	 hmm
[22:58:06] <paladox>	 chauffer maybe you'll like to do https://phabricator.miraheze.org/T3647 ?
[22:58:07] <ZppixBot>	 Title: [ ⚓ T3647 Convert all our python2 scripts to python3 ] - phabricator.miraheze.org
[23:13:17] <Not-a634>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fAFrp
[23:13:18] <Not-a634>	 [02miraheze/puppet] 07paladox 03408e7b6 - Install timidity package on mw* per T3648