[02:36:16] RECOVERY - mail2 IMAP on mail2 is OK: IMAP OK - 0.042 second response time on 51.195.236.253 port 143 [* OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS LOGINDISABLED] Dovecot (Debian) ready.] [02:42:25] PROBLEM - mail2 IMAP on mail2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:59:14] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/Jty4K [06:59:15] [02miraheze/MirahezeMagic] 07Universal-Omega 03c7cf7a9 - Fix Interwiki linking in log summaries [06:59:17] [02MirahezeMagic] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/fQRGX [07:00:22] [02MirahezeMagic] 07Universal-Omega opened pull request 03#208: Fix Interwiki linking in log actions, edit summaries, and page previews (T6222) - 13https://git.io/Jty4X [07:00:28] [02MirahezeMagic] 07Universal-Omega edited pull request 03#208: Fix interwiki linking in log actions, edit summaries, and page previews (T6222) - 13https://git.io/Jty4X [07:00:46] dmehus: ^ [07:01:23] miraheze/MirahezeMagic - Universal-Omega the build passed. [07:01:36] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/Jty4D [07:01:37] [02miraheze/MirahezeMagic] 07Universal-Omega 03da3321c - fix spacing [07:01:39] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#208: Fix interwiki linking in log actions, edit summaries, and page previews (T6222) - 13https://git.io/Jty4X [07:02:33] miraheze/MirahezeMagic - Universal-Omega the build passed. [09:01:01] PROBLEM - ping4 on cp3 is WARNING: PING WARNING - Packet loss = 0%, RTA = 333.30 ms [09:03:02] RECOVERY - ping4 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 249.17 ms [09:39:32] [02MirahezeMagic] 07Universal-Omega closed pull request 03#208: Fix interwiki linking in log actions, edit summaries, and page previews (T6222) - 13https://git.io/Jty4X [09:39:34] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 033 commits to 03master [+0/-0/±3] 13https://git.io/JtygJ [09:39:35] [02miraheze/MirahezeMagic] 07Universal-Omega 03fa521ad - Merge pull request #208 from miraheze/Universal-Omega-patch-1 [09:39:37] [02miraheze/MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [09:39:38] [02MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/fQRGX [09:40:31] miraheze/MirahezeMagic - Universal-Omega the build passed. [09:52:27] PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 280.59 ms [09:54:31] RECOVERY - ping6 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 270.02 ms [13:35:00] Hi, is there possibility to have disabled edit section links and/or TOC on whole wiki without magic words? 😅 [13:39:35] @MrJaroslavik you should be able to via Common.css - see https://www.mediawiki.org/wiki/Manual:Section_editing#Configuration_(Localsettings.php) [13:39:36] [ Manual:Section editing - MediaWiki ] - www.mediawiki.org [13:40:19] @MrJaroslavik and for TOC - https://www.mediawiki.org/wiki/Manual:FAQ#How_can_I_hide_the_table_of_contents.3F [13:40:19] [ Manual:FAQ - MediaWiki ] - www.mediawiki.org [13:40:31] (so both should be able to work with CSS) [13:42:51] Thank you! [13:42:57] no problem [14:28:00] PROBLEM - virus23.uk.to - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for virus23.uk.to could not be found [14:29:43] PROBLEM - duepedia.uk.to - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for duepedia.uk.to could not be found [14:46:46] [02mw-config] 07R4356th opened pull request 03#3732: Use Special:MyLanguage for wgCookieWarningMoreUrl - 13https://git.io/JtyHD [14:47:48] miraheze/mw-config - R4356th the build passed. [15:04:41] [02mw-config] 07dmehus commented on pull request 03#3732: Use Special:MyLanguage for wgCookieWarningMoreUrl - 13https://git.io/JtyQK [15:16:35] PROBLEM - cp10 Current Load on cp10 is CRITICAL: CRITICAL - load average: 4.16, 4.94, 2.48 [15:18:35] PROBLEM - cp10 Current Load on cp10 is WARNING: WARNING - load average: 1.03, 3.48, 2.24 [15:20:35] RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 0.39, 2.42, 2.00 [15:38:46] dmehus: r.e. what you said to Mshinet, that won't be possible unfortunately [15:38:57] as we are a wiki farm and to allow that would be complex and messy [15:39:08] and it's also not recommended to do in either case [15:52:42] .op [15:52:42] Attempting to OP... [16:10:42] [02mw-config] 07Universal-Omega closed pull request 03#3732: Use Special:MyLanguage for wgCookieWarningMoreUrl - 13https://git.io/JtyHD [16:10:44] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jty5H [16:10:46] [02miraheze/mw-config] 07R4356th 034ec3e7d - Use Special:MyLanguage for wgCookieWarningMoreUrl (#3732) [16:11:48] miraheze/mw-config - Universal-Omega the build passed. [16:44:25] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_35 [+0/-0/±2] 13https://git.io/JtydQ [16:44:26] [02miraheze/mediawiki] 07paladox 0332e0a1d - Update ManageWiki and MirahezeMagic [16:46:07] !log rebuild lc on mw* and jobrunner* [16:46:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:48:10] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/Jtydx [16:48:12] [02miraheze/mw-config] 07Universal-Omega 03b8ab7d6 - Remove Special:OAuth from $wgWhitelistRead (done via MirahezeMagic now) [16:48:13] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3 [16:48:15] [02mw-config] 07Universal-Omega opened pull request 03#3733: Remove Special:OAuth from $wgWhitelistRead (done via MirahezeMagic now) - 13https://git.io/Jtydh [16:49:18] miraheze/mw-config - Universal-Omega the build passed. [16:49:40] !log rebuild lc on test3 [16:49:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:49:54] [02mw-config] 07paladox closed pull request 03#3733: Remove Special:OAuth from $wgWhitelistRead (done via MirahezeMagic now) - 13https://git.io/Jtydh [16:49:56] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtyFJ [16:49:57] [02miraheze/mw-config] 07Universal-Omega 03613a428 - Remove Special:OAuth from $wgWhitelistRead (done via MirahezeMagic now) (#3733) [16:49:59] [02mw-config] 07paladox deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3 [16:50:00] [02miraheze/mw-config] 07paladox deleted branch 03Universal-Omega-patch-2 [16:51:23] miraheze/mw-config - paladox the build passed. [16:52:08] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.58, 6.60, 4.37 [16:53:12] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.01, 7.16, 4.76 [16:55:07] paladox, in #miraheze-feed-test, I noticed an issue with your ManageWiki log summary... [16:55:07] ```On test3wiki Paladox Paladox changed group metadata for [[Special:ManageWiki/permissions/content reviewers]]: add rights $4; removed rights $5; added addgroups $6; removed addgroups $7; added removegroups $8; removed removegroups $9; added addgroupstoself Paladox0; removed; https://test3.miraheze.org/wiki/Special:Log/rights``` [16:55:07] ^ It's displaying those variables again. Has that been resolved wherein the actual user rights are now displayed? If not, this should be fixed [16:55:08] [ All public logs - Test3 ] - test3.miraheze.org [16:56:44] yeh i noticed that [16:56:51] Universal_Omega, regarding https://github.com/miraheze/mw-config/compare/4ec3e7d6588d...613a428749e7, I believe Cyberpower678 requested Special:OAuth be globally whitelisted because the IABot needs it to access private wikis. Or have you already added that, via a DB update command, to the private wikis using IABot? [16:56:52] [ Comparing 4ec3e7d6588d...613a428749e7 · miraheze/mw-config · GitHub ] - github.com [16:57:08] the commit mentions it was mvoed to MirahezeMagic [16:57:26] dmehus: I'm aware. I moved it to MirahezeMagic [16:57:32] With everything else. [16:57:41] That's whitelisted [16:57:59] Reception123, yeah that's what I thought :) [16:59:06] Universal_Omega, wow, I'm surprised you managed that. Let me test it. As we expected it to be quite difficult / near impossible, remember? [16:59:50] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.98, 6.24, 4.66 [17:00:31] dmehus: when did we expect it to be impossible [17:00:31] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 22.43, 20.79, 15.82 [17:00:33] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.29, 6.81, 5.05 [17:00:36] dmehus: yeah, I spent 8 hours debuging yesterday and found the issue, still likely won't work on test3 due to something weird there but everything else should. Puppet will run in 2 minutes and will be live within 12 probably [17:00:38] @Universal_Omega, oh okay, yeah MirahezeMagic is fine, though honestly, actually having individual private wikis whitelist that special page might be better actually as then IABot has to be specifically invited by those private wikis [17:00:58] RhinosF1, per private discussions I had with Universal Omega [17:01:08] Ah ok [17:01:13] RhinosF1: I did think it was, originally. But I decided to debug significantly yesterday. [17:01:19] .deop [17:01:23] Cool Universal_Omega [17:01:23] Universal_Omega, oh is that because test3wiki doesn't use MirahezeMagic maybe? [17:01:38] dmehus: no, it's just weird there. [17:01:46] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.44, 3.10, 2.44 [17:01:46] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.43, 6.21, 4.83 [17:01:49] Likely Extension conflict or something. [17:02:31] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.91, 7.05, 5.33 [17:02:32] [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/Jtybs [17:02:33] [02miraheze/ManageWiki] 07paladox 033457dd8 - Don't log if there are errors [17:02:35] [02ManageWiki] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vpSns [17:02:36] [02ManageWiki] 07paladox opened pull request 03#246: Don't log if there are errors - 13https://git.io/JtybG [17:02:43] On test3wiki links don't even appear if using mh prefix unless using 0:mh first. So very weird dmehus. [17:03:34] miraheze/ManageWiki - paladox the build passed. [17:03:41] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.16, 2.74, 2.38 [17:03:42] JohnLewis Universal_Omega ^ [17:04:28] paladox: That looks fine to me. But I'm not 100% sure. [17:04:32] ok [17:04:58] @Universal_Omega, Oh, ok. Looking at the test...https://revi.wiki/w/index.php?title=%EC%82%AC%EC%9A%A9%EC%9E%90:Dmehus/sandbox&diff=3518&oldid=3457 [17:04:58] Interesting fix, it inserts a `0` in front of the MM interwiki prefix [17:05:00] [ "사용자:Dmehus/sandbox"의 두 판 사이의 차이 - ReviNet ] - revi.wiki [17:06:07] * dmehus is happy as now he can link directly to the local election request on a local wiki without having to create an SN thread first :P [17:06:27] RECOVERY - cloud5 Current Load on cloud5 is OK: OK - load average: 16.91, 19.28, 16.78 [17:06:27] Best Phabricator task completion ever. 💯 👍 [17:06:30] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.63, 6.03, 5.40 [17:08:10] dmehus: yep works everywhere but test3. [17:08:57] Universal_Omega, cool. Do you know why it doesn't work on test3 and any clue on how to fix it? [17:09:04] not that it's a huge deal there though [17:09:20] dmehus: none. The behavior now is exactly as it was before. [17:09:59] Universal_Omega, is it because test3 uses a different interwiki table than the global interwiki table on Meta? [17:10:03] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 4.93, 7.74, 7.65 [17:11:01] dmehus: during my debugging yesterday I even went as far successfully porting Fandom's InterwikiDispatcher extension and made it work with CreateWiki before realizing even Fandom's don't work as expected. So completely wasted my time. However I could port part of it to MirahezeMagic method allowing the direct linking to custom domains. What do you think? [17:11:09] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 3.76, 7.07, 7.54 [17:14:03] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 2.28, 4.88, 6.50 [17:15:09] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 2.06, 4.40, 6.34 [17:15:10] PROBLEM - cp3 Puppet on cp3 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [17:21:04] ```08:54 On test3wiki Paladox Paladox changed group metadata for [[Special:ManageWiki/permissions/content reviewers]]: add rights $4; removed rights $5; added addgroups $6; removed addgroups $7; added removegroups $8; removed removegroups $9; added addgroupstoself Paladox0; removed; https://test3.miraheze.org/wiki/Special:Log/rights``` [17:21:04] ^ seems to still be the error, paladox [17:21:05] [ All public logs - Test3 ] - test3.miraheze.org [17:21:20] you've already told me? [17:21:39] paladox, yes, but you did it again, so assumed your fix didn't take? [17:21:47] I didn't do any fix [17:21:53] oh [17:21:54] ok [17:22:19] Universal_Omega, oh wow, that's amazing that you actually ported InterwikiDispatcher [17:23:28] Custom domain interwiki links are a nicety, but not essential. Even existing MirahezeMagic pseudo-interwiki links link to the subdomain.miraheze.org, so it while it would be lovely, I'm not fussed about it. Naleksuh actually prefers the subdomain.miraheze.org links, heh [17:24:06] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtyAv [17:24:08] [02miraheze/puppet] 07paladox 0394ba097 - prometheus: Fix firewall for jmx_exporter [17:24:09] [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbiAS [17:24:11] [02puppet] 07paladox opened pull request 03#1650: prometheus: Fix firewall for jmx_exporter - 13https://git.io/JtyAf [17:25:08] [02puppet] 07paladox closed pull request 03#1650: prometheus: Fix firewall for jmx_exporter - 13https://git.io/JtyAf [17:25:09] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtyAI [17:25:11] [02miraheze/puppet] 07paladox 03d746004 - prometheus: Fix firewall for jmx_exporter (#1650) [17:25:12] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1 [17:25:14] [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbiAS [17:30:07] dmehus: before I realized what InterwikiDispatcher did I ported it yeah. All it seems to do is make Special:InterwikiDispatcher?wiki=subdomain&article=article redirect to it. Which I made work with custom domains and CreateWiki, but Fandom must use its implementation throughout, using it. Even all global interwikis on Fandom redirect to community.fandom.com then you have to use w:c where as it'll go to [17:30:07] community.fandom.com/wiki/c:wikisubdomain. Which means ours are actually better I think. [17:32:01] PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 416.21 ms [17:36:14] RECOVERY - ping6 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 282.72 ms [17:42:40] JohnLewis: who should have flags in #miraheze-feed by the way? [17:42:44] the current ones seem weird [17:44:38] Reception123, yeah, that's weird. I mean MirahezeBots is fine with +V. I'd just give +AFORVefiorstv to JohnLewis, then +ASORVefiorstv to Southparkfan, and +AORVefiorstv to the rest of us [17:46:20] Universal_Omega, yeah, that's what I don't really like about InterwikiDispatcher. I actually prefer your MirahezeMagic fix... just need to figure out why it doesn't work on test3wiki [17:47:10] RECOVERY - cp3 Puppet on cp3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:52:58] [02ManageWiki] 07JohnFLewis commented on pull request 03#246: Don't log if there are errors - 13https://git.io/Jtyp3 [17:57:46] [02ManageWiki] 07dmehus commented on pull request 03#246: Don't log if there are errors - 13https://git.io/Jtypz [18:01:38] Wonders why John sometimes writes like a robot in edit summaries [18:04:03] [02ManageWiki] 07paladox closed pull request 03#246: Don't log if there are errors - 13https://git.io/JtybG [18:04:05] [02ManageWiki] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vpSns [18:04:07] [02miraheze/ManageWiki] 07paladox deleted branch 03paladox-patch-1 [18:07:59] A robot? :? [18:08:20] JohnLewis, I didn't get that either. [18:08:29] I'm usually the robot. [18:08:34] if anyone's a robot [18:09:46] @JohnLewis What I meant by that is that sometimes you write something like "abuse" when you do investigations. I also placed it on the #miraheze-offtopic page instead as it would basically avoid adding irrelevant peanut gallery comments. [18:12:14] darkmatterman450, we all do that, and it's mainly to keep the reasons generic, for protection of privacy-related reasons [18:13:56] @Doug Makes sense. [18:15:02] dmehus: yeah. So do I, but yeah would like to figure out why it doesn't work on test3. [18:17:39] Universal_Omega, ack and yeah [18:41:41] Paladox; can you deal with IMAP on mail2 please? [18:41:50] sure [18:44:57] i can restart it, but seems like the process limit keeps getting hit [18:45:15] and i cannot tell why (as in who's trying to launch so many logins) [18:45:28] !log restart dovecot [18:45:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:45:42] Are they logs paladox ? [18:46:18] Yes that's why i said i cannot tell [18:47:04] RECOVERY - mail2 IMAP on mail2 is OK: IMAP OK - 0.010 second response time on 51.195.236.253 port 143 [* OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS LOGINDISABLED] Dovecot (Debian) ready.] [18:47:32] i see lots of: [18:47:33] 7A08925C50: to=, relay=virtual, delay=298767, delays=298766/0.2/0/0, dsn=4.2.0, status=deferred (delivery failed to mailbox /var/mail/devnull,noreply: file is a symbolic link) [18:47:47] but when i looked before i didn't see that many (the last time this problem happened) [18:47:50] Graylog should be logging it and it’ll be clear around the time it fails [18:51:23] looks like the problem started at 2:42am [18:54:40] I'll brb, dinner [18:59:58] paladox: is it possibly me? I havent removed my mh config on my phone as im trying to save important emails [19:03:24] Zppix, not certain, but if the mailbox was deleted, you shouldn't even be able to retrieve messages as the login won't work, so I'm going to say probably not? [19:03:46] Thats not how mail works [19:03:58] You can have local copies [19:04:17] You just wont be able to pull remote [19:06:01] Zppix, well yes, I know that, but if you didn't save them to your local folder, the messages would still be stored on the server, which can't be accessed (when an account's been deleted). Really depends on whether you copied your messages from the server-side mail folders (synced through IMAP) or not [19:06:50] but if they are local copies, it wouldn't be you anyway, I think, as the messages are stored only on your phone [19:07:12] My ohone would still attempt to pullo [19:08:14] Zppix, oh ok, then it could be if that error is relating to an attempted login. You should probably unselect automatically retreieve messages in that case [19:21:23] I'm back [19:27:27] !log gralog2: curl -XPUT -H 'Content-Type: application/json' -d '{ "index" : { "max_result_window" : 9000000 } }' http://127.0.0.1:9200/_settings [19:27:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:02:48] Universal_Omega PHP Notice: Undefined offset: 2 in /srv/mediawiki/w/extensions/MirahezeMagic/includes/MirahezeMagicHooks.php on line 161 [20:02:59] Paladox: are grafana attributing the issue? [20:03:13] attributing? [20:04:16] paladox: where they found out about the issue [20:04:21] no [20:05:20] paladox: sec researcher asked if they can have any. I've stuck some on ours and wikimedias task but not much we can do for grafana [20:27:05] paladox: looking [20:27:12] thanks! [20:51:22] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JtSTp [20:51:23] [02miraheze/MirahezeMagic] 07Universal-Omega 03c80d04e - Fix undefined index [20:51:25] [02MirahezeMagic] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/fQRGX [20:51:26] [02MirahezeMagic] 07Universal-Omega opened pull request 03#209: Fix undefined index - 13https://git.io/JtSTh [20:51:48] paladox: no problem ^ [20:51:53] thanks! [20:52:25] miraheze/MirahezeMagic - Universal-Omega the build passed. [20:52:53] paladox: no problem. Does that look right to you or would that cause the exact same issue? [20:53:19] Hmm, what if if( $target[0] == '0' && $target[1] = 'mh' ) { equals false [20:53:31] $targetWiki wont exist causing another index error [20:54:09] Then that's why ?? Is used. paladox. But yeah if it is false then that should not be set at all. [20:54:30] ah ok [20:55:12] But then if it is true and [2] does not exist it'd still be undefined just like before, I think, right paladox? [20:55:21] should there be an isset for $target[2]? [20:55:27] yeh [20:55:54] So $target[2] ?? $target[1] then paladox? [20:56:04] yeh [21:00:07] Universal_Omega, paladox, I wonder if it'd be possible to return a redlink if the target wiki doesn't exist? [21:00:44] That's possible but would require db querying and not a priority right now dmehus. [21:02:55] Universal_Omega, yeah, true, just thought about that. [21:04:35] Screenshot from #miraheze-feed 19 February 2021. Anyone know why the little red indicator showing unread messages still displays for #miraheze-feed? These are the same settings for #wikimedia-stewards, where it does not display https://usercontent.irccloud-cdn.com/file/IIZlsXeq/2021-02-19%2013.01.56%20www.irccloud.com%2061f1123b4058.jpg [21:04:52] paladox: what wiki was that error seen on? I want to see a specific example of what could've caused that undefined index actually. [21:05:30] It wouldn't tell me, it was from php-error (so php logged that not mediawiki) [21:05:47] dmehus enable mark as read automatically [21:06:08] Universal_Omega, I did that, but unchecked it as it wasn't doing anything, but I'll try again [21:06:14] maybe I need to refresh my browser? [21:06:31] paladox: oh. Alright then. If I had to guess I'd think test3 only tbh as that is weird there and always has been. [21:06:40] dmehus: maybe. [21:07:12] Universal_Omega, also it's weird that's not checked in #wikimedia-stewards [21:08:59] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JtSkP [21:09:01] [02miraheze/MirahezeMagic] 07Universal-Omega 03b7655d5 - Use isset instead [21:09:02] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#209: Fix undefined index - 13https://git.io/JtSTh [21:09:25] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JtSkD [21:09:26] [02miraheze/MirahezeMagic] 07Universal-Omega 03ef2f8da - Spacing [21:09:28] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#209: Fix undefined index - 13https://git.io/JtSTh [21:10:03] paladox: ^ that's a better solution I think. [21:10:05] miraheze/MirahezeMagic - Universal-Omega the build has errored. [21:10:26] miraheze/MirahezeMagic - Universal-Omega the build has errored. [21:10:31] As if the other 2 or true then not have a 2 index would mean a wiki was not set and just had mh: [21:11:08] [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JtSk7 [21:11:09] [02miraheze/MirahezeMagic] 07paladox 03514d839 - Update MirahezeMagicHooks.php [21:11:11] [02MirahezeMagic] 07paladox synchronize pull request 03#209: Fix undefined index - 13https://git.io/JtSTh [21:11:32] Thank [21:11:39] *thanks [21:12:03] [02MirahezeMagic] 07paladox closed pull request 03#209: Fix undefined index - 13https://git.io/JtSTh [21:12:04] [02miraheze/MirahezeMagic] 07paladox pushed 035 commits to 03master [+0/-0/±5] 13https://git.io/JtSkd [21:12:06] [02miraheze/MirahezeMagic] 07paladox 03d1e2dac - Merge pull request #209 from miraheze/Universal-Omega-patch-1 [21:12:07] [02MirahezeMagic] 07paladox deleted branch 03Universal-Omega-patch-1 - 13https://git.io/fQRGX [21:12:09] [02miraheze/MirahezeMagic] 07paladox deleted branch 03Universal-Omega-patch-1 [21:12:10] miraheze/MirahezeMagic - paladox the build passed. [21:12:36] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JtSkF [21:12:38] [02miraheze/mediawiki] 07paladox 03ac9795f - Update MirahezeMagic [21:13:01] miraheze/MirahezeMagic - paladox the build passed. [21:18:03] paladox: let me know if you still see the notice. Although it's highly unlikely you should. [21:18:09] sure [21:22:01] paladox: did you run puppet already? [21:22:06] yeh [21:22:20] well not exactly puppet, i ran some commands [21:22:24] on puppet3 [21:23:27] paladox: oh then now it doesn't work, my fix. It's weird. Maybe that whole portion if changing wiki index was uneeded?... oh we used the isset on that before the 0 was reset to index 1 causing it to actually not be set. [21:29:12] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JtSI9 [21:29:14] [02miraheze/MirahezeMagic] 07Universal-Omega 031836742 - Fix HtmlPageLinkRendererEnd hook [21:29:15] [02MirahezeMagic] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/fQRGX [21:29:17] [02MirahezeMagic] 07Universal-Omega opened pull request 03#210: Fix HtmlPageLinkRendererEnd hook - 13https://git.io/JtSIQ [21:29:55] paladox: ^ [21:30:18] miraheze/MirahezeMagic - Universal-Omega the build passed. [21:30:29] hmm, will that work? [21:30:36] specifically targetSlice = 2 [21:30:41] *3 [21:31:33] it should work.... oh whoops that targetSlice should also go inside that if. [21:33:28] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JtSIb [21:33:30] [02miraheze/MirahezeMagic] 07Universal-Omega 03f77694f - Fix [21:33:31] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#210: Fix HtmlPageLinkRendererEnd hook - 13https://git.io/JtSIQ [21:34:05] paladox: fixed. It should work but not 100% certain [21:34:14] [02MirahezeMagic] 07paladox closed pull request 03#210: Fix HtmlPageLinkRendererEnd hook - 13https://git.io/JtSIQ [21:34:15] [02miraheze/MirahezeMagic] 07paladox pushed 033 commits to 03master [+0/-0/±3] 13https://git.io/JtSIN [21:34:17] [02miraheze/MirahezeMagic] 07paladox 03718d61f - Merge pull request #210 from miraheze/Universal-Omega-patch-1 [21:34:18] [02MirahezeMagic] 07paladox deleted branch 03Universal-Omega-patch-1 - 13https://git.io/fQRGX [21:34:20] [02miraheze/MirahezeMagic] 07paladox deleted branch 03Universal-Omega-patch-1 [21:34:28] miraheze/MirahezeMagic - Universal-Omega the build passed. [21:34:43] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JtSIx [21:34:44] [02miraheze/mediawiki] 07paladox 03e3dd7c1 - Update MirahezeMagic [21:35:13] miraheze/MirahezeMagic - paladox the build passed. [21:35:31] deployed [21:36:00] paladox: that was a quick deploy... it works. Thanks! [21:43:03] PROBLEM - ping6 on dbbackup2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 149.91 ms [21:43:37] PROBLEM - ping6 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 148.33 ms [21:44:08] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 152.34 ms [21:44:32] dmehus: interestingly, on test3 the interwiki links work in logs if you do `[[0:test1:test|test2]]` and on pages with `[[0:mh:test5:test4|test]]` but that's only on test3. [21:44:48] paladox: any ideas on that? ^ [21:44:56] nope [21:48:54] @paladox and dmehus: oh, I know why. Interlanguage prefix is conflicting. [21:51:34] Universal_Omega, it was working before when I tested it, though. Or is this the test3 interwiki table and test3 problem? [21:51:51] PROBLEM - ping6 on dbbackup1 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 148.37 ms [21:52:00] Test3 dmehus [21:52:08] Why does test3 not use the global interwiki table on Meta? Surely we can have it use the same global interwiki table [21:52:17] I deleted mh interwiki from it. [21:52:27] Universal_Omega, yeah, but is this the test3-specific problem you're trying to resolve? [21:52:33] Yes. [21:52:48] I fixed the other issue with a change breaking it everywhere again. [21:53:05] Yes, I get that, but longer term, it doesn't make sense for test3wiki to use a separate interwiki table. It should use standard global interwiki table + any local interwiki table links [21:53:24] not sure what the second issue was as I saw no issue [21:53:55] PROBLEM - ping6 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 150.05 ms [21:54:06] dmehus the second one was quickly resolved. [21:54:23] And test3 does use global interwiki I think plus a ton of local stuff. [21:56:02] dmehus: it works on test3 now. [21:56:45] Universal_Omega, oh ok. It used to use global interwiki except when paladox updated test3wiki to MW 1.35, he installed a separate interwiki table [21:56:48] Let me look [21:56:51] maybe he fixed it [21:58:02] Universal_Omega, seems that he fixed it. Is there a way we can get test3wiki's local interwiki table, though, and batch delete all those duplicate interwiki prefixes? [21:58:55] Same with the interlanguage prefixes. We don't need all those included in there, lol [21:59:15] Test3 is all messed up... when the capital links thing was changed it messed stuff up. And yeah I think we should just clear them all out, dmehus. [21:59:41] Main Page is being hard redirected now. [22:00:28] Universal_Omega Yeah...arguably we could just reset test3's database to the default database any new wiki gets. Nothing to keep actually [22:00:55] paladox: ^ thoughts on that? [22:01:14] except not sure if that would mess up users that have attached their accounts already to test3wiki. We'd have to adjust for that [22:01:15] sure [22:02:09] RECOVERY - ping6 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 117.52 ms [22:02:13] paladox: I support doing that tbh. Test3 is beyond fixing right now dmehus so I think we need to. It's so far messed up with the capital links thing now so far messing stuff up with hard redirects. [22:02:51] ok [22:03:19] RECOVERY - ping6 on dbbackup2 is OK: PING OK - Packet loss = 0%, RTA = 102.89 ms [22:04:03] Also paladox I think removing the capital links setting from ManageWiki, or maybe restricting it would be best, as it can seemingly cause alot of damage. [22:04:21] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 106.67 ms [22:04:25] ok, if you want to restrict it go ahead :) [22:04:33] though also maybe add a warning too [22:05:25] Yeah. I'll do that for now paladox. I'll leave it unrestricted with the warning, if it causes to many issues we can restrict, I think. [22:07:15] Although maybe just remove the maintenance script run from it and it'll be fine. [22:08:00] Universal_Omega: what issue did it cause? [22:08:24] Causing hard redirects if it's turned back off RhinosF1. See test3 mainpage for example. [22:09:11] Universal_Omega: oh [22:09:26] I mean it shouldn't be turned on and off repeatedly [22:10:13] RhinosF1: Yeah. I'm not sure why it was turned on, I think Reception123 was testing something. But I think we should just reset test3 to fix it there. [22:11:16] Tbh things should only be restricted for technical reasons, if an extension is technically sane but only in certain circs, then it should be coded in a requirements. If the circs are ‘people shouldn’t enable it wildly’ can’t really prevent it and to restrict a functionally working extension just because it might not be what people want when they enable it == we should make all exts restricted on the same logic [22:14:37] JohnLewis: great point, and one I totally support. I'll just remove the maintenance script from it and add a warning to the help message for it, if that sounds alright? But the issue with this particular one is irreversible changes it makes (as long as the script is set to run on it anyways) [22:18:42] If it’s doing something irreversible by default, then that’s probably bad so yeah feel free [22:20:49] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JtStM [22:20:50] [02miraheze/mw-config] 07Universal-Omega 03777783a - Remove script run from wgCapitalLinks; add warning [22:20:52] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3 [22:20:53] [02mw-config] 07Universal-Omega opened pull request 03#3734: Remove script run from wgCapitalLinks; add warning - 13https://git.io/JtStD [22:21:54] miraheze/mw-config - Universal-Omega the build passed. [22:26:29] [02mw-config] 07Universal-Omega closed pull request 03#3734: Remove script run from wgCapitalLinks; add warning - 13https://git.io/JtStD [22:26:31] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtSqf [22:26:32] [02miraheze/mw-config] 07Universal-Omega 03155942e - Remove script run from wgCapitalLinks; add warning (#3734) [22:26:34] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3 [22:26:35] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [22:27:28] miraheze/mw-config - Universal-Omega the build passed. [22:28:56] JohnLewis, do you know if the local interwiki and interlanguage table prefixes are stored in each wiki's database? If so, do you know the name of the database table(s) for local interwiki and interlanguage prefixes? [22:29:50] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtSqs [22:29:52] [02miraheze/mw-config] 07Universal-Omega 039518488 - Add warning for wgCapitalLinkOverrides [22:30:49] miraheze/mw-config - Universal-Omega the build passed. [22:34:56] dmehus: it's local each. Global interwikis are stored on metawikis database I believe. Could be wrong though. [22:38:04] SPF|Cloud are you around? [22:38:46] Universal_Omega, yeah I know the Meta one is stored in the `metawiki` database, but I guess I just wondered if the local ones were stored locally, but that seems kind of silly for me to ask that if the global ones are stored in `metawiki`. If I can find the right database table, can we clear test3wiki's local interwiki and interlanguage prefixes that are duplicated to global? [22:44:58] paladox: any ideas why my log fix broke normal linking in logs? Now linking normally like [[Main Page]] in logs goes to https://mh.miraheze.org/wiki/? I just realized that and am now looking into it, just wondered if you knew. [22:44:59] [ Wiki not Found ] - mh.miraheze.org [22:45:13] nope [22:48:35] JohnLewis: do you have any ideas? I'm not sure how that's even possible.. mh was never once user in wikilink, nor was it ever directly set to that in the code. [22:52:09] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JtSmf [22:52:11] [02miraheze/MirahezeMagic] 07Universal-Omega 0348b221c - Fix normal wiki linking in logs [22:52:12] [02MirahezeMagic] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/fQRGX [22:52:14] [02MirahezeMagic] 07Universal-Omega opened pull request 03#211: Fix normal wiki linking in logs - 13https://git.io/JtSmJ [22:53:08] miraheze/MirahezeMagic - Universal-Omega the build passed. [22:53:12] Oh. paladox: ^ although I'm not 100% sure that'll make interwiki linking in logs work anymore again, though. [22:53:38] [02MirahezeMagic] 07paladox closed pull request 03#211: Fix normal wiki linking in logs - 13https://git.io/JtSmJ [22:53:39] [02miraheze/MirahezeMagic] 07paladox pushed 032 commits to 03master [+0/-0/±2] 13https://git.io/JtSmL [22:53:41] [02miraheze/MirahezeMagic] 07paladox 0353667eb - Merge pull request #211 from miraheze/Universal-Omega-patch-1 [22:53:42] [02miraheze/MirahezeMagic] 07paladox deleted branch 03Universal-Omega-patch-1 [22:53:44] [02MirahezeMagic] 07paladox deleted branch 03Universal-Omega-patch-1 - 13https://git.io/fQRGX [22:54:06] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JtSmt [22:54:08] [02miraheze/mediawiki] 07paladox 03d5e7366 - Update MirahezeMagic [22:54:35] deployed [22:54:39] miraheze/MirahezeMagic - paladox the build passed. [22:56:38] paladox: yeah that broke logs again when interwiki linking...this seems to be no-win... [22:56:48] ok [22:57:19] i guess leave it for now, and when your able to i guess you can try and do a fix on test3 [22:57:41] or even i guess we'll have to remove it if it doesn't work [23:00:19] paladox: I have an idea but yeah won't merge until I test it. [23:00:27] ok [23:01:01] We should try clearing out the `iw_links` table in `test3wiki`. Not sure it'll resolve the issue, but it might [23:09:42] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JtSmM [23:09:43] [02miraheze/MirahezeMagic] 07Universal-Omega 033916f9d - Fix interwiki links again, and significantly simplify [23:09:45] [02MirahezeMagic] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/fQRGX [23:09:46] [02MirahezeMagic] 07Universal-Omega opened pull request 03#212: Fix interwiki links again, and significantly simplify - 13https://git.io/JtSmD [23:10:48] miraheze/MirahezeMagic - Universal-Omega the build passed. [23:28:05] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtSYo [23:28:06] [02miraheze/puppet] 07paladox 033d2dc11 - puppet3: Increase puppetdb::command_processing_threads to 4 [23:29:54] !log ALTER TABLE /*_*/poll_question ADD COLUMN poll_actor bigint unsigned NOT NULL AFTER poll_page_id; on crappygameswiki [23:29:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:31:11] !log CREATE INDEX /*i*/poll_actor ON /*_*/poll_question (poll_actor); on crappygameswiki [23:31:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:31:40] you'll need to run a script for that Universal_Omega [23:31:50] !log ALTER TABLE /*_*/poll_user_vote ADD COLUMN pv_actor bigint unsigned NOT NULL AFTER pv_pc_id; on crappygameswiki [23:31:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:32:24] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtSYA [23:32:26] [02miraheze/puppet] 07paladox 03c48a0ba - puppetserver: Export metrics to prometheus [23:32:27] [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbiAS [23:32:29] [02puppet] 07paladox opened pull request 03#1651: puppetserver: Export metrics to prometheus - 13https://git.io/JtSYx [23:32:29] !log CREATE INDEX /*i*/pv_actor ON /*_*/poll_user_vote (pv_actor); on crappygameswiki [23:32:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:33:21] paladox: I know, migrateOldPollNYUserColumnsToActor.php [23:34:27] PROBLEM - cp10 Current Load on cp10 is CRITICAL: CRITICAL - load average: 12.05, 8.48, 3.71 [23:35:01] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtSOf [23:35:02] [02miraheze/puppet] 07paladox 0303d9e92 - Update puppetserver.pp [23:35:04] [02puppet] 07paladox synchronize pull request 03#1651: puppetserver: Export metrics to prometheus - 13https://git.io/JtSYx [23:35:07] !log universalomega@jobrunner3:/srv/mediawiki/w/extensions/PollNY/maintenance$ sudo -u www-data php migrateOldPollNYUserColumnsToActor.php --wiki=crappygameswiki [23:35:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:35:14] PROBLEM - hololive.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for hololive.wiki could not be found [23:35:51] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtSOT [23:35:53] [02miraheze/puppet] 07paladox 03a8250db - Update init.pp [23:35:54] [02puppet] 07paladox synchronize pull request 03#1651: puppetserver: Export metrics to prometheus - 13https://git.io/JtSYx [23:37:34] [02MirahezeMagic] 07Universal-Omega closed pull request 03#212: Fix interwiki links again, and significantly simplify - 13https://git.io/JtSmD [23:37:36] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 032 commits to 03master [+0/-0/±2] 13https://git.io/JtSOt [23:37:37] [02miraheze/MirahezeMagic] 07Universal-Omega 03598170a - Merge pull request #212 from miraheze/Universal-Omega-patch-1 [23:37:39] [02miraheze/MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [23:37:40] [02MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/fQRGX [23:38:37] miraheze/MirahezeMagic - Universal-Omega the build passed. [23:38:38] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtSOs [23:38:39] [02miraheze/puppet] 07paladox 03b7a4afc - Update puppetserver.pp [23:38:41] [02puppet] 07paladox synchronize pull request 03#1651: puppetserver: Export metrics to prometheus - 13https://git.io/JtSYx [23:39:16] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtSO8 [23:39:18] [02miraheze/puppet] 07paladox 03b889c1f - Update init.pp [23:39:19] [02puppet] 07paladox synchronize pull request 03#1651: puppetserver: Export metrics to prometheus - 13https://git.io/JtSYx [23:39:52] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+1/-1/±0] 13https://git.io/JtSO0 [23:39:53] [02miraheze/puppet] 07paladox 03054fa44 - Rename modules/puppetdb/files/jvm_prometheus_puppetdb_jmx_exporter.yaml to modules/role/files/puppetserver/jvm_prometheus_puppetserver_jmx_exporter.yaml [23:39:55] [02puppet] 07paladox synchronize pull request 03#1651: puppetserver: Export metrics to prometheus - 13https://git.io/JtSYx [23:40:24] RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 0.61, 2.95, 2.69 [23:40:59] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JtSOa [23:41:00] [02miraheze/mediawiki] 07Universal-Omega 03051d1c2 - Update MirahezeMagic [23:41:54] RECOVERY - hololive.wiki - reverse DNS on sslhost is OK: rDNS OK - hololive.wiki reverse DNS resolves to cp10.miraheze.org [23:50:22] paladox: interwiki links in logging now fixed. I changed it so it just simply uses array_shift instead of all the other hacks. Much more simpler now and fully works. [23:50:30] great! [23:52:46] [02ManageWiki] 07Universal-Omega closed pull request 03#245: update content model on the content table; fix moving page back to original namespace - 13https://git.io/Jta44 [23:52:47] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtS3I [23:52:49] [02miraheze/ManageWiki] 07Universal-Omega 03e6932f3 - update content model on the content table; fix moving page back to original namespace (#245) [23:52:50] [02miraheze/ManageWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [23:52:52] [02ManageWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vpSns [23:53:42] miraheze/ManageWiki - Universal-Omega the build passed. [23:56:32] PROBLEM - gluster4 Puppet on gluster4 is CRITICAL: CRITICAL: Puppet has 14 failures. Last run 2 minutes ago with 14 failures. Failed resources (up to 3 shown)