[00:02:21] MacFan4000: ^ [00:02:40] Huh [00:02:53] I’m going to start the import in a min [00:03:05] PROBLEM - Puppet on db4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:07] PROBLEM - Puppet on cp4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:15] PROBLEM - Puppet on test1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:18] Gc? [00:03:25] PROBLEM - Puppet on misc2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:31] yes [00:03:42] you can always look at the puppet1 on grafana [00:03:52] Ok [00:03:53] PROBLEM - Puppet on swift1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:04:05] PROBLEM - Puppet on bacula1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:04:33] PROBLEM - Puppet on misc3 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:04:35] PROBLEM - Puppet on puppet1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:04:43] PROBLEM - Puppet on misc1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:11:05] RECOVERY - Puppet on db4 is OK: OK: Puppet is currently enabled, last run 11 seconds ago with 0 failures [00:11:15] RECOVERY - Puppet on nfs1 is OK: OK: Puppet is currently enabled, last run 22 seconds ago with 0 failures [00:11:23] RECOVERY - Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 25 seconds ago with 0 failures [00:11:53] RECOVERY - Puppet on swift1 is OK: OK: Puppet is currently enabled, last run 53 seconds ago with 0 failures [00:12:04] PROBLEM - Current Load on nfs1 is CRITICAL: CRITICAL - load average: 4.74, 2.80, 1.25 [00:12:06] RECOVERY - Puppet on bacula1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:12:36] RECOVERY - Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:12:44] RECOVERY - Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:13:04] RECOVERY - Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:14:04] RECOVERY - Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:15:14] RECOVERY - Puppet on test1 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [00:16:04] RECOVERY - Current Load on nfs1 is OK: OK - load average: 1.84, 2.68, 1.56 [00:20:18] !log macfan@mw1:/srv/mediawiki/w/maintenance$ sudo -u www-data php importDump.php --wiki unidoswiki /home/macfan/Unión-20180702215951.xml in a screen [00:20:33] meh, probs unicode [00:21:04] we totally should fix that [00:21:07] JohnLewis do you know python unicode programing? [00:22:06] not really? [00:22:42] SPF|Cloud do you know ^^? [00:23:02] that's what I'm teaching myself now I guess [00:23:15] but this implies Unicode is something the WMF have never come across [00:24:22] hmm it says something about logging to /var/log/adminbot.log [00:24:25] but it does not exist [00:24:56] https://github.com/miraheze/puppet/blob/master/modules/irc/files/logbot/adminlogbot.py#L323 [00:24:56] Title: [ puppet/adminlogbot.py at master · miraheze/puppet · GitHub ] - github.com [00:25:14] ooh ooh simple solution: use UTF-8! [00:26:01] lol [00:26:15] isen't that python3 switch then? [00:26:45] huh? [00:27:02] JohnLewis python3 uses unicode [00:27:07] python 2 i thought dosen't? [00:27:46] JohnLewis should i change https://github.com/miraheze/puppet/blob/master/modules/irc/files/logbot/adminlogbot.py#L301 to use a file [00:27:46] Title: [ puppet/adminlogbot.py at master · miraheze/puppet · GitHub ] - github.com [00:27:49] still have no idea what you mean and how that is relevant to me :P [00:27:52] rather then log to sys [00:28:35] I mean do what you want but it's WMF code :P [00:29:02] oh JohnLewis where is the code in the repo? [00:29:08] for wmf [00:29:34] https://github.com/wikimedia/operations-debs-adminbot [00:29:35] Title: [ GitHub - wikimedia/operations-debs-adminbot: Github mirror of operations/debs/adminbot - our actual code is hosted with Gerrit (please see https://www.mediawiki.org/wiki/Developer_access for contribut ] - github.com [00:29:52] oh! [00:29:59] JohnLewis i guess that's logbot now [00:30:13] i mean stashbot [00:30:42] probsbly [00:30:54] JohnLewis yeh, it is :) [00:31:03] [00:33:08] <+stashbot> Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [00:31:04] Title: [ Server Admin Log - Wikitech ] - wikitech.wikimedia.org [00:31:19] https://github.com/wikimedia/stashbot [00:31:19] Title: [ GitHub - wikimedia/stashbot: This is a mirror from https://gerrit.wikimedia.org. See https://www.mediawiki.org/wiki/Developer_access for contributing. ] - github.com [00:31:21] JohnLewis ^^ [00:31:34] don't really care but k [00:33:30] https://github.com/miraheze/puppet/blob/master/modules/irc/templates/logbot/config.py#L32 says it’s set to join -staff as well but it’s not there, even after inviting it [00:33:31] Title: [ puppet/config.py at master · miraheze/puppet · GitHub ] - github.com [00:33:47] Oh hold on [00:34:58] MacFan4000 see -staff [00:36:49] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fSGGZ [00:36:51] [02miraheze/puppet] 07paladox 036c60bb6 - Bot should not join staff channel [00:44:28] !log learned SA some more, 35/200 messages examined before SA can be fully deployed without issue [00:45:09] logbot awol, john [00:48:26] !log learned SA some more, 35/200 messages examined before SA can be fully deployed without issue [00:48:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:48:46] paladox: for some reason, only having 1 channel causes the logbot to fail to join [00:48:55] which may explain why I left it like that intentionally [00:48:59] oh [00:49:51] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fSGGi [00:49:52] [02miraheze/puppet] 07JohnFLewis 03a6412db - revert previous removal [00:50:33] JohnLewis does it give a error? [00:50:47] freenode forwards it to ##unavailable [00:51:15] meh [00:59:30] [02puppet] 07MacFan4000 opened pull request 03#762: Various config changes - 13https://git.io/fSGGp [01:00:18] [02puppet] 07MacFan4000 synchronize pull request 03#762: Various config changes - 13https://git.io/fSGGp [01:00:53] who really cares at this point [01:01:36] [02puppet] 07JohnFLewis commented on pull request 03#762: Various config changes - 13https://git.io/fSGZe [01:01:37] [02puppet] 07JohnFLewis closed pull request 03#762: Various config changes - 13https://git.io/fSGGp [01:03:53] hi [01:05:46] ih [01:05:50] eb woh [01:07:50] paladox [01:07:56] hi [01:08:01] https://archive.org/details/win3_CasWin1 [01:08:02] Title: [ Castle of the Winds : SaadaSoft : Free Download, Borrow, and Streaming : Internet Archive ] - archive.org [01:08:08] a game older than you [01:08:10] and still playable today [01:08:20] paladox cannot come to the phone right now but please leave a message after the beep [01:08:28] lol jk [01:11:30] ok, so what’s your definition of old school? [01:11:34] Playstation 2? [01:12:53] uh [01:12:56] playstation 1 [01:14:01] lol [01:14:10] try the Sega Mastersystem some time [01:15:18] .weather [01:15:20] Yahoo! Weather - Portland, ME, US: Mostly Sunny, 20°C (68°F), Humidity: 81%, Gentle breeze 4.9m/s (↖) [01:15:42] very humid [01:15:47] .weather [01:15:48] I don't know where you live. Give me a location, like .weather London, or tell me where you live by saying .setlocation London, for example. [01:15:54] .weather porirua [01:15:55] Yahoo! Weather - Porirua, Wellington, NZ: Breezy, 9°C (48°F), Humidity: 72%, Strong breeze 11.2m/s (↑) [01:15:55] .weather NeoBogan [01:15:56] Yahoo! Weather - Nabagan, Cagayan Valley, PH: Mostly Cloudy, 30°C (86°F), Humidity: 67%, Gentle breeze 4.9m/s (↑) [01:16:13] .weather paladox [01:16:13] Yahoo! Weather - London, England, GB: Clear, 18°C (64°F), Humidity: 45%, Moderate breeze 6.3m/s (↙) [01:16:14] damn is it muggy where you are, macboy [01:16:37] 9% more humidity, slower wind speeds, and definately higher temps [01:16:50] lol [01:17:54] now if paladox could stop talking so much crap about the playstation 1 being “old school” (relatively speaking), I think we can fix those issues with your weather maccy [01:18:00] :P [01:18:08] lol [01:18:36] .mangle [01:18:44] MacFan4000: Palladocs said he "laughs" [01:18:59] pallydocs [01:19:04] close to paladin [01:19:09] .mangle [01:19:15] MacFan4000: Neobogan "near Palladina" [01:19:28] Lol [01:21:32] .mangle [01:21:37] MacFan4000: McFan 4000 says: "XD [01:21:54] McFan 4000 [01:23:56] .strangle paladox [01:24:02] .mangle paladox [01:24:03] syntax unkown [01:24:06] NeoBogan: Palladox [01:24:11] >_< [01:24:18] .promote paladox [01:24:29] .mangle NeoBogan [01:24:32] paladox: NeoBogan [01:24:39] haha [01:24:44] .mangle [01:24:48] .mangle the most intelligent human is paladox [01:24:50] paladox: New bow said: "haha" [01:24:56] NeoBogan: The most intelligent person is in heaven [01:24:57] lol [01:25:02] NeoBogan your new bow [01:25:18] * NeoBogan takes his bow off so he can use it to strangle the trailing generation [01:28:34] RECOVERY - MediaWiki Rendering on mw1 is OK: HTTP OK: HTTP/1.1 200 OK - 31003 bytes in 0.175 second response time [01:29:34] RECOVERY - Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [01:29:36] RECOVERY - Varnish Backends on cp5 is OK: All 3 backends are healthy [01:33:53] .mangle [01:34:03] MacFan4000: Pointing to Mirage, he said: "Back on CP5 - Ink well warns: in good health 3 backend" [01:34:15] Lol [01:34:42] I knew it! [01:34:47] miraheze is a mirage! [01:34:52] .mangle [01:34:52] none of this exists!!!! [01:35:00] MacFan4000: Neobogan said: "Mirage is a misunderstanding!" [01:35:00] .mangle [01:35:03] * NeoBogan is finally sane once more [01:35:08] MacFan4000: "Nothing here!" Said Neubogan. [01:35:15] .mangle [01:35:21] MacFan4000: Newobogan says he is still healthy [01:35:23] NeuroBogan? [01:35:26] * NeoBogan likes [01:35:47] * NeuroBogan pets ZppixBot [01:36:08] .tell Zppix thanks to .mangle, I have yet another personality to add to my repoitre of personalities [01:36:09] NeuroBogan: I'll pass that on when Zppix is around. [01:36:14] please do [01:36:20] it’ll confuse him more [01:36:36] * NewoBogan pokes NeuroBogan [01:36:56] .mangle [01:37:03] NewoBogan: Newobogan is "neurobogan poker" [01:37:14] that is so wrong [01:37:21] oh so very wrong [01:37:31] * NeuroBogan brainbleaches MacFan4000 [01:37:31] Lol [01:38:14] * NeuroBogan impales MacFan4000 with paladox’ personality [01:39:37] /me pokes NeuroBogan [01:39:50] lol [01:39:50] nice try [01:40:07] .mangle [01:40:12] ACTION slaps paladox [01:40:15] MacFan4000: NeuroBogan said "good effort" [01:40:25] .mangle [01:40:26] actually I subtly said “epic fail” [01:40:31] MacFan4000: NeuroBogan says: "Active Palladium" [01:40:38] .mangle [01:40:45] well real world palladium _is_ toxic... [01:40:47] MacFan4000: Neurobugan said: "I spoke in a low voice:" an epic failure, [01:41:06] .mangle [01:41:14] MacFan4000: Neiro Bogan: "The real world of palladium is poisonous ..." [01:42:11] !poke is $infobot_nick pokes NeuroBogan [01:42:11] Key was added [01:42:18] !poke [01:42:18] MacFan4000 pokes NeuroBogan [01:42:36] .mangle [01:42:44] MacFan4000: Wm-bot5 says: "MacFan4000 Drinks NeuroBogan" [01:42:52] !poke is $infobot_nick porks MacFan4000 [01:42:53] Sorry, you are not authorized to perform this [01:42:56] >_< [01:43:04] I trust: .*@wikimedia/-revi (2admin), .*@wikipedia/Southparkfan (2admin), .*@miraheze/Labster (2admin), .*@miraheze/Reception123 (2admin), .*@wikipedia/The-Voidwalker (2admin), .*@miraheze/John (2admin), .*@wikimedia/paladox (2admin), .*@wikimedia/MacFan4000 (2admin), .*@miraheze/.* (2trusted), .*@.*[Ww]iki.*\/.* (2trusted), .*@miraheze/NDKilla (2admin), [01:43:04] @trusted [01:43:30] .mangle [01:43:42] ( sorry for pings btw) [01:43:47] MacFan4000: (2 admin) @ miraheze / * * Miraheze / NDKilla (2 admin) @ wiki / Southparkfan (2 admin) @ @ No / palladium (2 admin) @ miraheze / * * [01:44:03] Wat [01:44:30] 21:43 ( sorry for pings btw) [01:45:01] Why does it keep calling me palladium [01:45:10] !poke del [01:45:10] Successfully removed poke [01:45:14] .mangle [01:45:21] I don’t know [01:45:22] MacFan4000: WM-Bot 5 said: "I successfully removed my cheek" [01:45:26] Lol [01:46:16] .mangle [01:46:22] MacFan4000: MacFan4000 said "LOL" [01:46:48] .mangle test test wiki [01:46:55] MacFan4000: Try the wiki test [01:49:29] .mangle Voidwalker [01:49:35] NeuroBogan: Sale on the street is illegal [01:49:44] .mangle NeoBogan [01:49:44] lmao [01:49:47] MacFan4000: NeoBogan [01:49:53] haha you fail [01:49:58] .mangle NeuroBogan [01:50:02] MacFan4000: Neurogon [01:50:08] * NeuroBogan forces MacFan4000 to nickchange to MacFail3000 [01:50:09] Heh there [01:50:21] .mangle [01:50:28] MacFan4000: MacFan4000 says "heh a" [01:52:00] .mangle paladox [01:52:04] MacFan4000: Palladox [01:52:19] .mangle MacFan4000 [01:52:23] MacFan4000: MacFan4000 [01:52:36] .mangle apple macintosh [01:52:40] NeuroBogan: Apple Macintosh [01:52:45] .mangle [01:52:49] .mangle linux [01:52:52] MacFan4000: Neurogan said he was "Apple Macintosh Mangal" [01:52:54] NeuroBogan: Linux [01:53:02] .mangle [01:53:03] .mangle the mangling mangler [01:53:07] MacFan4000: NeuroBogan says that Linux [01:53:08] NeuroBogan: Lost in the confusion [01:53:11] .mangle [01:53:16] lol [01:53:19] MacFan4000: NeuroBogan said that "lack of lack" [01:53:24] .mangle .mangle [01:53:29] MacFan4000: .me [01:53:44] .mangle ZppixBot [01:53:48] MacFan4000: ZppixBot [01:54:17] .mangle [01:54:25] MacFan4000: The McFan 4000 is ZppixBot Mangle, [01:55:28] .priotasks [01:55:29] MacFan4000: There are no high priority open tasks. Nice job! [01:55:50] !nini [01:55:50] Good night, sweet dreams and dream of the miraheze servers without errors! [01:55:52] * NeoBogan doesn’t see paladox at the local pound [01:56:00] .mangle [01:56:08] MacFan4000: Neo-Bogan said: "It does not look like a local palace." [01:56:20] Heh [01:56:23] NeoBogan: what pond? [01:56:31] There’s a pond here [01:56:38] .mangle [01:56:44] If you walk across it your in the us [01:56:44] MacFan4000: Baladok said, "Here is a dam" [01:56:55] Wtf [01:57:01] It called me baledokw [01:57:05] Baledok [01:57:10] .mangle [01:57:12] rofl [01:57:15] MacFan4000: Palad says 'pallet' [01:57:20] as tuesdays go, this one is certainly a little comical [01:57:34] .mangle [01:57:41] MacFan4000: NeoBogan said, "If there Tuesday, which would have been fun [01:58:39] .mangle icinga-miraheze [01:58:42] MacFan4000: ICIS Mirage, [01:59:17] .mangle miraheze [01:59:19] MacFan4000: miraheze [02:05:48] .manglw k1w1 [02:05:58] .mangle k1w1 [02:06:01] MacFan4000: k1w1 [02:17:00] haha [02:57:34] RECOVERY - JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [03:11:34] * NeoBogan ignites a random idler [03:30:00] :o [03:30:06] deltaquad hangs round miraheze? [03:39:34] PROBLEM - JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 5562 [03:48:09] mw3 really is a large employer to have that many jobs queued up... [04:01:36] welcome back... [04:01:42] didn’t expect to see you lurking in here, AmandaNP [04:32:20] NeoBogan: usually im not on but i hop on on occasion [04:32:56] well, greetings nonetheless [04:32:57] how ya be [07:17:34] RECOVERY - JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [09:41:57] [02miraheze/services] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/f9kGn [09:41:58] [02miraheze/services] 07Reception123 033d0617f - add "fictionfoundry" to services [11:24:02] Reception123 MacFan4000 I just pushed a few extension reviews. please handle them [11:27:57] JohnLewis: ok, will try to handle later today [11:28:42] good [11:28:57] because a quick count, I see 16 tasks that realistically we can resolve today [11:29:20] and when we have like 45, that's a massive number [11:29:58] yeah [11:30:39] now reviewing an extension I found a function which will make one of my pieces of code slightly more efficient so I'm going to fix that now :P [11:30:51] Nice :) [11:30:52] JohnLewis: [11:30:54] https://www.irccloud.com/pastebin/xvAZ3R6K/ [11:30:55] Title: [ Snippet | IRCCloud ] - www.irccloud.com [11:31:10] this error is different than what error it would give if I didn't point the NS, right? [11:31:42] uh [11:32:00] the fact it has {0}, {1} and {2} tells me something probably isn't being passed [11:32:07] which domain is this? [11:32:28] reception@mw1:~$ sudo /root/ssl-certificate -g wiki.taotac.org [11:33:01] the issue with astrapedia.ru is NS [11:33:40] The past un has astrapedia.ru and your command has wiki.taotac.org [11:33:56] wiki.taotac.org is behind CloudFlare [11:34:48] and yeah atrapedia.ru is returning no NS [11:34:56] The pastebin is irrelevant to wiki.taotac.org [11:35:32] well, still wiki.taotac.org is behind CloudFlare [11:38:03] Reception123: [11:39:46] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/f9h3C [11:39:47] [02miraheze/puppet] 07JohnFLewis 03708afc1 - rewrite mw-admins sudo rules for updated infra + remove unused rules [11:43:13] [02miraheze/WikiDiscover] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/f9h36 [11:43:14] [02miraheze/WikiDiscover] 07JohnFLewis 03c5bce09 - make code slightly more efficient using array_rand [11:43:24] PROBLEM - Puppet on misc2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Apt_key[Add key: F86AA916A2195E121AEDB11437BBEE3F7AD95B3F from Apt::Source grafana_apt] [11:44:10] [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/f9h3D [11:44:11] [02miraheze/mediawiki] 07JohnFLewis 034107423 - update WD [11:51:25] RECOVERY - Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 41 seconds ago with 0 failures [12:03:25] ok so it's CF [12:13:17] Reception123: you mentioned 2 domains. One needs a dns zone to be added the other is CloudFlare [12:17:10] ok [12:17:21] Just thought the error message was a bit werid and different than it is normally [12:26:21] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/fHZ1f [12:26:23] [02miraheze/dns] 07Reception123 03c0f21b5 - add astrapedia.ru zone [13:22:24] [02miraheze/CreateWiki] 07JohnFLewis pushed 032 commits to 03master [+0/-0/±20] 13https://git.io/fH9VD [13:22:26] [02miraheze/CreateWiki] 07JohnFLewis 03a918f30 - unmark inactive wikis if not inactive [13:22:27] [02miraheze/CreateWiki] 07JohnFLewis 03dc70cab - Merge branch 'master' of github.com:miraheze/createwiki [13:23:54] [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fHHa6 [13:23:55] [02miraheze/mediawiki] 07JohnFLewis 033c627fc - update CW [13:24:17] Reception123: and hopefully now with ^ we can have manageInactiveWikis as a cron running daily or so [13:35:04] JohnLewis: oh, that's really nice :) [13:35:07] More automaticity [13:43:04] PROBLEM - Current Load on misc1 is CRITICAL: CRITICAL - load average: 2.05, 1.66, 1.10 [13:44:21] !log macfan@mw1:/srv/mediawiki/w/extensions/CreateWiki/maintenance$ sudo -u www-data php manageInactiveWikis.php --wiki metawiki --close --warn [13:44:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [13:45:06] RECOVERY - Current Load on misc1 is OK: OK - load average: 1.52, 1.51, 1.11 [13:46:29] MacFan4000: I was already doing that [13:47:12] JohnLewis: you should’ve logged it then [13:47:24] Logging things helps other sysadmins [13:47:30] I should have but when I've just made a change to a script, it's expectable that I'm running it [13:47:38] and when I'm also talking about it [13:53:04] PROBLEM - Current Load on misc1 is CRITICAL: CRITICAL - load average: 2.19, 1.84, 1.37 [13:53:53] MacFan4000: are you still running the script? [13:54:08] because numbers are going up for something I'm cleaning [13:54:11] !log UPDATE cw_wikis SET wiki_inactive=0,wiki_inactive_timestamp=NULL WHERE wiki_inactive = 1 AND wiki_closed = 1; [13:54:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [13:54:40] Yes I am, and it’s almost done [13:54:52] should have cancelled it above [13:54:54] And now it is [13:58:56] also a reason https://platproject.miraheze.org/wiki/Special:RecentChanges [13:58:57] Title: [ Recent changes - Plat Project ] - platproject.miraheze.org [13:59:01] inactive wiki when active [14:29:26] [02miraheze/CreateWiki] 07JohnFLewis pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/fQOyZ [14:29:27] [02miraheze/CreateWiki] 07JohnFLewis 03fab150a - made if inclusive [14:30:25] JohnLewis uh [14:30:26] maintenance/manageInactiveWikis.php.save [14:30:28] lol [14:33:27] [02miraheze/CreateWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fQGPk [14:33:28] [02miraheze/CreateWiki] 07JohnFLewis 0380d740c - made if inclusive [14:33:56] JohnLewis thanks! [14:34:45] [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fQZXy [14:34:47] [02miraheze/mediawiki] 07JohnFLewis 0364f9734 - update CW [14:44:05] [02puppet] 07MacFan4000 opened pull request 03#763: Delete ssl-phabricator.py - 13https://git.io/fQ4H6 [14:45:08] paladox: ^^ [14:45:12] ok [14:45:19] [02puppet] 07paladox closed pull request 03#763: Delete ssl-phabricator.py - 13https://git.io/fQ4H6 [14:45:21] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-1/±0] 13https://git.io/fQBSB [14:45:22] [02miraheze/puppet] 07MacFan4000 03d9fb39b - Delete ssl-phabricator.py (#763) [14:45:28] also that repo has branches that can be removed [14:45:33] PROBLEM - Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [14:45:45] Uh [14:46:08] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fQRsA [14:46:09] [02miraheze/puppet] 07paladox 03a1fe144 - Update init.pp [14:46:35] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fQRGf [14:46:36] [02miraheze/puppet] 07paladox 034d49cf7 - Update commands.cfg [14:46:58] Such as the revert branch or the testing branch [14:47:16] Im not going to touch those branches with out discussing it with who ever created them first [14:47:44] How about paladox-patch-1? [14:48:08] um i guess that was the change JohnLewis closed. SO i can probaley delete that. [14:48:30] [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbiAS [14:48:32] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1 [14:48:38] [02CreateWiki] 07JohnFLewis deleted branch 03REL1_25 - 13https://git.io/vpJTL [14:48:39] [02miraheze/CreateWiki] 07JohnFLewis deleted branch 03REL1_25 [14:48:41] [02CreateWiki] 07JohnFLewis deleted branch 03REL1_27 - 13https://git.io/vpJTL [14:48:42] [02miraheze/CreateWiki] 07JohnFLewis deleted branch 03REL1_27 [14:49:00] [02mw-config] 07JohnFLewis deleted branch 03paladox-patch-1 - 13https://git.io/vbvb3 [14:49:02] [02miraheze/mw-config] 07JohnFLewis deleted branch 03paladox-patch-1 [14:49:12] [02ManageWiki] 07MacFan4000 deleted branch 03paladox-patch-1 - 13https://git.io/vpSns [14:49:13] [02miraheze/ManageWiki] 07MacFan4000 deleted branch 03paladox-patch-1 [14:49:20] [02puppet] 07JohnFLewis deleted branch 03revert-689-patch-31 - 13https://git.io/vbiAS [14:49:20] That said merged [14:49:21] [02miraheze/puppet] 07JohnFLewis deleted branch 03revert-689-patch-31 [14:49:23] [02puppet] 07JohnFLewis deleted branch 03Reception123-patch-1 - 13https://git.io/vbiAS [14:49:24] [02miraheze/puppet] 07JohnFLewis deleted branch 03Reception123-patch-1 [14:49:33] [02puppet] 07JohnFLewis deleted branch 03testing - 13https://git.io/vbiAS [14:49:34] RECOVERY - Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 28 seconds ago with 0 failures [14:49:35] [02miraheze/puppet] 07JohnFLewis deleted branch 03testing [14:50:41] [02miraheze/ssl] 07JohnFLewis deleted branch 03revert-28-patch-9 [14:50:43] [02ssl] 07JohnFLewis deleted branch 03revert-28-patch-9 - 13https://git.io/vxP9L [14:50:44] [02ssl] 07JohnFLewis deleted branch 03T3063 - 13https://git.io/vxP9L [14:50:46] [02miraheze/ssl] 07JohnFLewis deleted branch 03T3063 [14:50:47] [02ssl] 07JohnFLewis deleted branch 03workreviwiki - 13https://git.io/vxP9L [14:50:49] [02miraheze/ssl] 07JohnFLewis deleted branch 03workreviwiki [14:52:06] [02MirahezeMagic] 07MacFan4000 deleted branch 03github_doc - 13https://git.io/fQRGX [14:52:08] [02miraheze/MirahezeMagic] 07MacFan4000 deleted branch 03github_doc [15:14:45] PROBLEM - HTTP 4xx/5xx ERROR Rate on cp4 is UNKNOWN: UNKNOWN - NGINX Error Rate is UNKNOWN [15:16:40] hm, is it not known? [15:18:28] .mangle [15:18:35] MacFan4000: John Lewis said, "Oh, I do not know?" [15:19:00] accurate [15:19:14] Heh [15:26:40] .mangle [15:26:47] MacFan4000: MacFan4000 says "looks" [15:29:06] PROBLEM - JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 5471 [15:29:26] RECOVERY - HTTP 4xx/5xx ERROR Rate on cp4 is OK: OK - NGINX Error Rate is 14% [15:33:24] PROBLEM - Puppet on misc2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Apt_key[Add key: F86AA916A2195E121AEDB11437BBEE3F7AD95B3F from Apt::Source grafana_apt] [15:34:44] [02miraheze/ssl] 07Reception123 pushed 032 commits to 03master [+1/-0/±5] 13https://git.io/fQMcc [15:34:45] [02miraheze/ssl] 07Reception123 03a01cdcd - add astrapedia.ru cert [15:34:47] [02miraheze/ssl] 07Reception123 0360bfcc2 - Merge branch 'master' of https://github.com/miraheze/ssl [15:34:48] Title: [ GitHub - miraheze/ssl: A repository for storing and managing SSL certificates for Miraheze ] - github.com [15:35:31] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/fQMcu [15:35:33] [02miraheze/dns] 07paladox 0330b7d1c - Add docs.websmart.media to dns [15:36:35] paladox: I was able to generate that one without that change [15:36:49] MacFan4000 you need that change. [15:36:52] Its pointed with CNAME I think [15:36:56] it has to be in the dns [15:37:03] So dns isn’t needed [15:37:12] JohnLewis: please confirm [15:37:16] Reception123: [15:39:17] You don’t need a zone when a domain is pointed with CNA!E iirc [15:40:39] hmm [15:40:40] root@ns1:/home/paladox# host 107.191.126.23 [15:40:40] 23.126.191.107.in-addr.arpa domain name pointer cp2.miraheze.org. [15:41:02] docs.websmart.media is an alias for mw-lb.miraheze.org. [15:41:23] Because it’s pointed with CNAME paladox [15:41:27] RECOVERY - Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 39 seconds ago with 0 failures [15:41:33] ok [15:41:44] CNAME pointing means adding mw-lib record [15:41:59] So adding to dns was unnecessary [15:42:03] yep, i know what cname is [15:43:00] NS means we host dns, CNAME means we don’t [15:43:29] So the change should be reverted [15:43:32] i know what NS and CNAME are. [15:44:12] 11:43 So the change should be reverted [15:44:52] MacFan4000 why are you repeating the same thing? I know. I have asked for someone elses oppinion in a pm on weather i should revert it. [15:45:17] Oh ok [15:46:03] also fyi, i do not ignore users messages. I read them then decide weather i need to ask someone elses opinion. [15:48:46] paladox: There is indeed no need for a DNS change for docs.websmart.media, since it is pointed with CNAME [15:48:50] Therefore, the change can be reverted. [15:50:26] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-1/±0] 13https://git.io/fQ58O [15:50:27] [02miraheze/dns] 07paladox 031934a13 - Revert "Add docs.websmart.media to dns" This reverts commit 30b7d1c73d9efbd505383daf53d5162f4c8021dd. [15:50:43] ok [15:54:57] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fQb7a [15:54:58] [02miraheze/mw-config] 07Reception123 03db7883e - add astrapedia.ru custom domain per T3297 resolves T3297 [15:55:24] Reception123 need to add it to the domain whitelist too [15:55:40] oh yeah, whoops [15:56:10] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fQNQH [15:56:11] [02miraheze/mw-config] 07Reception123 033198d42 - add astrapedia.ru to whitelist [15:56:52] MacFan4000 are you still handling https://phabricator.miraheze.org/T3291 ? [15:56:53] Title: [ ⚓ T3291 Custom domain request ] - phabricator.miraheze.org [15:57:16] miraheze/mw-config/master/3198d42 - Reception123 The build was broken. https://travis-ci.org/miraheze/mw-config/builds/399646256 [15:57:36] you forgot a , ! [15:58:17] paladox: urgh.. thanks [15:58:18] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fQxlM [15:58:19] [02miraheze/mw-config] 07Reception123 03c535525 - syntax [15:58:26] Reception123 thanks! [16:01:19] * paladox is going to work on swift now [17:02:58] PROBLEM - Current Load on misc1 is WARNING: WARNING - load average: 1.95, 1.58, 1.15 [17:06:58] RECOVERY - Current Load on misc1 is OK: OK - load average: 1.58, 1.51, 1.20 [17:31:07] RECOVERY - JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [17:39:08] PROBLEM - JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 5752 [19:06:56] .mangle [19:07:41] .help [19:07:52] .accesslevel [19:07:52] The access level for MacFan4000 is Admin. [19:07:58] .help [19:07:58] Hang on, I'm creating a list. [19:08:01] I've posted a list of my commands at https://ptpb.pw/rPh1 - You can see more info about any of these commands by doing .help (e.g. .help time) [19:08:07] .mangle [19:08:12] MacFan4000: McFan (4) said ".help" [19:27:16] PROBLEM - Puppet on test1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [19:35:17] RECOVERY - Puppet on test1 is OK: OK: Puppet is currently enabled, last run 37 seconds ago with 0 failures [19:41:07] RECOVERY - JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [21:23:27] PROBLEM - Puppet on misc2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Apt_key[Add key: F86AA916A2195E121AEDB11437BBEE3F7AD95B3F from Apt::Source grafana_apt] [21:25:08] .mangle [21:25:25] MacFan4000: Mirahez Icinga: Misc2 dolls are very important: important: customers have 1 wall. Last two minutes ago with a mistake. Error source (maximum 3 displayed): Apt_key [Add key: F86AA1616A2195E121AEDB11437BBEE3F7AD95B3F or Apt :: Source graphana_apt] ' [21:26:12] lol [21:31:28] RECOVERY - Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 39 seconds ago with 0 failures [21:31:46] .mangle [21:31:57] MacFan4000: Drugs - Movie 2 is OK: OK: At this point the movie can be done, 0 down 39 seconds before the end [21:33:09] .weather [21:33:11] Yahoo! Weather - Portland, ME, US: Partly Cloudy, 26°C (78°F), Humidity: 76%, Gentle breeze 4.9m/s (↑) [21:33:41] Really hot this week [21:34:05] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+4/-0/±2] 13https://git.io/fdCQB [21:34:06] [02miraheze/puppet] 07paladox 03c1c2a23 - Add SwiftMedia from wmf as a fork for miraheze [21:34:07] JohnLewis ^^ [21:35:46] okay [21:35:57] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fdlnc [21:35:58] [02miraheze/puppet] 07paladox 037d2467d - Add rewrite to pipeline [21:39:14] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fd4pT [21:39:15] [02miraheze/puppet] 07paladox 031023f8c - Swift: Fix paste.filter_factory [21:41:03] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fdRgd [21:41:05] [02miraheze/puppet] 07paladox 032ca5703 - Swift: rewrite.pp fix syntax error [21:41:31] JohnLewis maybe you can review rewrite.pp? [21:41:35] uh [21:41:39] i mean rewrite.pu [21:41:40] py [21:41:59] my pthon knowledge is questionable [21:43:27] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fdEZ7 [21:43:28] [02miraheze/puppet] 07paladox 03b40092f - swift: fix indent in rewrite.py [21:43:44] JohnLewis still always good to have someone review :) [21:44:00] looked good when I looked [21:47:55] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fdgxk [21:47:57] [02miraheze/puppet] 07paladox 0330c6e6c - Add fake thumhost to fix python error [21:48:10] JohnLewis ah great [21:48:18] i just need to fix the 404 section [21:48:29] but will do that later [21:49:17] PROBLEM - Puppet on test1 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 4 minutes ago with 0 failures [22:01:38] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fdKBz [22:01:39] [02miraheze/puppet] 07paladox 0317ae93c - swift: Fix rewrite.py [22:03:47] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fdKBD [22:03:48] [02miraheze/puppet] 07paladox 031e798e8 - swift: remove backend_url_format for now [22:07:06] yay [22:07:07] JohnLewis [22:07:09] yay [22:07:10] yayy [22:07:11] yay [22:07:12] yay [22:07:13] yay [22:07:16] finally got it working [22:07:23] oh [22:07:25] crap [22:07:33] i didn't have the go through proxy mode on [22:07:58] PROBLEM - Puppet on swift1 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 3 minutes ago with 0 failures [22:08:37] risk threat [#miraheze] - paladox - flooding (10 msgs in 20 seconds); [22:08:40] cri [22:08:43] oh [22:08:45] sorry [22:41:16] RECOVERY - Puppet on test1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [22:47:06] PROBLEM - JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 5448 [22:53:17] PROBLEM - Puppet on test1 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 8 minutes ago with 0 failures [23:07:18] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/fFqix [23:07:19] [02miraheze/puppet] 07paladox 03219f200 - Some fixes for swift related things [23:07:58] RECOVERY - Puppet on swift1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [23:09:18] RECOVERY - Puppet on test1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [23:26:41] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/fF3pS [23:26:43] [02miraheze/mw-config] 07paladox 032d658d2 - Switch on swift as default backend [23:27:24] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fFs4N [23:27:25] [02miraheze/puppet] 07paladox 0380dd5a2 - Update common.yaml [23:37:17] PROBLEM - Puppet on test1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki config] [23:41:18] RECOVERY - Puppet on test1 is OK: OK: Puppet is currently enabled, last run 56 seconds ago with 0 failures [23:43:18] PROBLEM - GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 2 datacenters are down: 81.4.109.133/cpweb, 2400:8902::f03c:91ff:fe07:444e/cpweb [23:43:28] PROBLEM - Current Load on swift1 is WARNING: WARNING - load average: 3.53, 3.14, 2.08 [23:43:31] uh [23:43:35] cp4 down? [23:43:40] SPF|Cloud ^^ [23:44:02] mw* are sick [23:44:03] to cp4 [23:44:30] they are recovering [23:45:14] mw3 is sick again [23:45:28] PROBLEM - Current Load on swift1 is CRITICAL: CRITICAL - load average: 4.36, 3.54, 2.35 [23:45:33] why do they keep becomming sick [23:46:08] PROBLEM - GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb, 172.104.111.8/cpweb, 2400:8902::f03c:91ff:fe07:444e/cpweb [23:46:38] PROBLEM - Varnish Backends on cp5 is CRITICAL: 2 backends are down. mw1 mw2 [23:46:52] hmm [23:47:28] PROBLEM - Current Load on swift1 is WARNING: WARNING - load average: 3.71, 3.58, 2.50 [23:49:16] RECOVERY - GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [23:50:08] RECOVERY - GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [23:53:18] PROBLEM - GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb, 172.104.111.8/cpweb, 2400:8902::f03c:91ff:fe07:444e/cpweb [23:54:06] PROBLEM - GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 5 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 81.4.109.133/cpweb, 172.104.111.8/cpweb, 2400:8902::f03c:91ff:fe07:444e/cpweb [23:54:36] RECOVERY - Varnish Backends on cp2 is OK: All 3 backends are healthy [23:56:36] RECOVERY - Varnish Backends on cp4 is OK: All 3 backends are healthy [23:56:38] RECOVERY - Varnish Backends on cp5 is OK: All 3 backends are healthy