[00:01:51] Hmm... looks like a religion-related disruptive (Not sure if it’s outright vandalism or not) [00:01:54] !staff [00:02:01] !Staff [00:02:01] Reception123, Voidwalker, MacFan4000, JohnLewis, SPF|Cloud, labster, PuppyKun somebody needs help from a meta admin [00:02:17] PROBLEM - bacula1 Puppet on bacula1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:15] !m JohnLewis [00:03:15] <[d__d]> You're doing good work, JohnLewis! [00:03:49] PROBLEM - lizardfs1 Puppet on lizardfs1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:55] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:04:32] That is interesting though... never seen a religion vandal before [00:11:50] RECOVERY - lizardfs1 Puppet on lizardfs1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:11:54] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:12:16] RECOVERY - bacula1 Puppet on bacula1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:32:05] Anyway [00:32:09] !night [00:32:09] Good night, sweet dreams and dream of the miraheze servers without errors! [01:00:28] hi [01:00:38] hi [01:45:11] [02mw-config] 07ucronistaw opened pull request 03#2511: [NO approve. Needs revision] Make mediatecawiki a repository for images like commons per Ucronistaw - 13https://git.io/fx3gs [01:45:21] [NO approve. Needs revision] [01:46:04] [02mw-config] 07ucronistaw synchronize pull request 03#2511: [NO approve. Needs revision] Make mediatecawiki a repository for images like commons per Ucronistaw - 13https://git.io/fx3gs [01:48:40] [02mw-config] 07ucronistaw edited pull request 03#2511: [Review] Make mediatecawiki a repository for images like commons per Ucronistaw - 13https://git.io/fx3gs [01:49:31] (if there is no error, you can approve request :) ) [01:53:30] [02mw-config] 07paladox reviewed pull request 03#2511 commit - 13https://git.io/fx3gB [01:56:01] [02mw-config] 07ucronistaw synchronize pull request 03#2511: [Review] Make mediatecawiki a repository for images like commons per Ucronistaw - 13https://git.io/fx3gs [01:56:27] [02mw-config] 07ucronistaw reviewed pull request 03#2511 commit - 13https://git.io/fx3ga [01:57:49] thanks paladox :) [01:58:07] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fx3gP [01:58:09] [02miraheze/mw-config] 07ucronistaw 03f94b782 - [Review] Make mediatecawiki a repository for images like commons per Ucronistaw (#2511) * [Review] Make mediatecawiki a repository for images like commons per Ucronistaw based on #2340 y #2505 * fix * fix per Paladox [01:58:10] [02mw-config] 07paladox closed pull request 03#2511: [Review] Make mediatecawiki a repository for images like commons per Ucronistaw - 13https://git.io/fx3gs [02:43:44] paladox: are you? [02:44:31] Oh, you're gone. Okay. [10:44:39] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [10:51:16] !log sudo -u www-data php importDump.php --wiki tallerwiki /home/macfan/tallerwiki.xml [10:51:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [11:00:40] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 933 [11:36:48] hi [11:38:50] Is this configuration correct? https://prnt.sc/l2v5f1 [11:38:51] Title: [ Screenshot by Lightshot ] - prnt.sc [11:46:57] hello, how long does it take for a wiki to be checked and added? [11:52:39] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [11:56:40] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 447 [12:04:40] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [14:33:19] !log install prometheus-blackbox-exporter on ns1 [14:33:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [14:34:03] hi [14:37:27] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+1/-0/±0] 13https://git.io/fx35m [14:37:28] [02miraheze/puppet] 07paladox 039873b04 - Move varnish::prometheus_exporter to it's own class in prometheus puppet module [14:37:30] [02puppet] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbiAS [14:37:31] [02puppet] 07paladox opened pull request 03#870: Move varnish::prometheus_exporter to it's own class in prometheus pup… - 13https://git.io/fx35O [14:37:41] [02puppet] 07paladox edited pull request 03#870: Move varnish::prometheus_exporter to it's own class in prometheus puppet module - 13https://git.io/fx35O [14:37:47] [02puppet] 07paladox edited pull request 03#870: Move varnish::prometheus_exporter to it's own class in prometheus puppet module - 13https://git.io/fx35O [14:38:18] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/fx35Z [14:38:19] [02miraheze/puppet] 07paladox 03d99a1b5 - Update init.pp [14:38:21] [02puppet] 07paladox synchronize pull request 03#870: Move varnish::prometheus_exporter to it's own class in prometheus puppet module - 13https://git.io/fx35O [14:38:26] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-1/±0] 13https://git.io/fx35c [14:38:27] [02miraheze/puppet] 07paladox 03c31dfb4 - Delete prometheus_exporter.pp [14:38:29] [02puppet] 07paladox synchronize pull request 03#870: Move varnish::prometheus_exporter to it's own class in prometheus puppet module - 13https://git.io/fx35O [14:38:51] [02puppet] 07paladox synchronize pull request 03#870: Move varnish::prometheus_exporter to it's own class in prometheus puppet module - 13https://git.io/fx35O [14:38:52] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/fx35W [14:38:53] [02miraheze/puppet] 07paladox 039d37e4e - Update varnish_prometheus_exporter.pp [14:39:01] [02puppet] 07paladox closed pull request 03#870: Move varnish::prometheus_exporter to it's own class in prometheus puppet module - 13https://git.io/fx35O [14:39:03] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+1/-1/±1] 13https://git.io/fx35l [14:39:04] [02miraheze/puppet] 07paladox 03cc1f478 - Move varnish::prometheus_exporter to it's own class in prometheus puppet module (#870) * Move varnish::prometheus_exporter to it's own class in prometheus puppet module * Update init.pp * Delete prometheus_exporter.pp * Update varnish_prometheus_exporter.pp [14:39:06] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-2 [14:39:07] [02puppet] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbiAS [14:40:30] [02puppet] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbiAS [14:40:31] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+1/-0/±0] 13https://git.io/fx354 [14:40:33] [02miraheze/puppet] 07paladox 03fae307b - Add prometheus::blackbox_exporter [14:40:34] [02puppet] 07paladox opened pull request 03#871: Add prometheus::blackbox_exporter - 13https://git.io/fx35B [14:42:14] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+1/-0/±0] 13https://git.io/fx350 [14:42:15] [02miraheze/puppet] 07paladox 0363a8117 - Create blackbox_exporter.yml.erb [14:42:17] [02puppet] 07paladox synchronize pull request 03#871: Add prometheus::blackbox_exporter - 13https://git.io/fx35B [15:14:16] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/fx3bX [15:14:18] [02miraheze/puppet] 07paladox 039b2f090 - Add prometheus::node_gdnsd to prometheus [15:15:34] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/fx3by [15:15:35] [02miraheze/puppet] 07paladox 038311b4d - Create prometheus-gdnsd-stats [15:17:25] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fx3bd [15:17:26] [02miraheze/puppet] 07paladox 032ecf171 - include prometheus::node_gdnsd in dns puppet module [15:23:07] MacFan4000: thanks :) [15:36:56] PROBLEM - misc2 Puppet on misc2 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 6 minutes ago with 0 failures [15:41:54] PROBLEM - ns1 Puppet on ns1 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 11 minutes ago with 0 failures [15:42:15] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fx3Ac [15:42:17] [02miraheze/puppet] 07paladox 03f7926ee - Update node_gdnsd.pp [15:44:54] RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 46 seconds ago with 0 failures [15:47:55] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [16:10:36] [02puppet] 07paladox created branch 03paladox-patch-3 - 13https://git.io/vbiAS [16:10:38] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fx3xm [16:10:39] [02miraheze/puppet] 07paladox 03cc7b49c - prometheus: Listen on port 9091 too [16:10:41] [02puppet] 07paladox opened pull request 03#872: prometheus: Listen on port 9091 too - 13https://git.io/fx3xY [16:16:54] PROBLEM - misc2 Puppet on misc2 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 6 minutes ago with 0 failures [16:54:55] RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:02:47] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 2818 [17:23:15] [02puppet] 07paladox closed pull request 03#872: prometheus: Listen on port 9091 too - 13https://git.io/fx3xY [17:23:18] [02puppet] 07paladox deleted branch 03paladox-patch-3 - 13https://git.io/vbiAS [17:23:20] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-3 [17:34:41] [02puppet] 07paladox closed pull request 03#871: Add prometheus::blackbox_exporter - 13https://git.io/fx35B [17:34:43] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+2/-0/±0] 13https://git.io/fx3jP [17:34:44] [02miraheze/puppet] 07paladox 0346551e1 - Add prometheus::blackbox_exporter (#871) * Add prometheus::blackbox_exporter * Create blackbox_exporter.yml.erb [17:34:46] [02puppet] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbiAS [17:34:47] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-2 [17:35:34] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fx3jX [17:35:35] [02miraheze/puppet] 07paladox 0328dda41 - Include prometheus::blackbox_exporter on misc2 [17:38:17] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fx3j9 [17:38:19] [02miraheze/puppet] 07paladox 0304178ad - Prometheus listen to port 9115 on misc2 only [18:10:40] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [18:31:05] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxsvS [18:31:07] [02miraheze/puppet] 07paladox 031ceee3c - Update blackbox_exporter.pp [18:50:55] PROBLEM - misc2 Puppet on misc2 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 4 minutes ago with 0 failures [18:52:03] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxsf6 [18:52:04] [02miraheze/puppet] 07paladox 03a5d567d - Update prometheus.yml.erb [18:52:30] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxsfP [18:52:31] [02miraheze/puppet] 07paladox 03f400fd9 - Update blackbox_exporter.yml.erb [19:01:42] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxsJL [19:01:44] [02miraheze/puppet] 07paladox 035cbea4d - Update prometheus.yml.erb [21:02:45] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 5611 [22:26:54] RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures [22:29:28] !log php /srv/mediawiki/w/extensions/CreateWiki/maintenance/deleteWikis.php --wiki=loginwiki --delete paladox on mw1 (deleting wmaucommwiki per https://phabricator.miraheze.org/T3576) [22:29:29] Title: [ Login ] - phabricator.miraheze.org [22:29:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [22:30:14] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxsqR [22:30:16] [02miraheze/services] 07MirahezeSSLBot 030f9893a - BOT: Updating services config for wikis [22:30:52] !log PURGE BINARY LOGS BEFORE '2018-10-06 23:30:00'; on db4 [22:30:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [22:35:02] !log php /srv/mediawiki/w/extensions/CreateWiki/maintenance/deleteWikis.php --wiki=loginwiki --delete paladox (deleting 1cewiki indytechfixwiki kuonsamwiki mwmwiki optimathofficialwikiwiki peopleshararamwiki sovereignwiki wesleycollegewiki) [22:35:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [22:40:13] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fxsq7 [22:40:15] [02miraheze/services] 07MirahezeSSLBot 033a63069 - BOT: Updating services config for wikis [22:58:44] PROBLEM - mw1 Disk Space on mw1 is CRITICAL: DISK CRITICAL - free space: / 6896 MB (8% inode=98%); [23:05:17] !log started xml import for nonciclopediawiki [23:05:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [23:11:21] !log sudo -u www-data php /srv/mediawiki/w/maintenance/importImages.php images --overwrite --wiki=nonciclopediawiki on mw1 [23:11:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [23:22:25] !log sudo -u www-data php /srv/mediawiki/w/maintenance/importImages.php images --overwrite --wiki=nonciclopediawiki --skip-dupes on mw1 [23:22:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master