[01:35:41] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtNa3 [01:35:42] [02miraheze/puppet] 07paladox 035e334e3 - graylog: upgrade mongodb to 4.4.4 [01:37:21] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtNaG [01:37:23] [02miraheze/puppet] 07paladox 03ae19df0 - graylog: upgrade elasticsearch to 7.11.1 [01:38:55] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtNal [01:38:56] [02miraheze/puppet] 07paladox 03e53509d - graylog: upgrade graylog to 4.0.5 [02:11:56] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtNwS [02:11:58] [02miraheze/ssl] 07paladox 033a1eab7 - Move redirecting allthetropes.miraheze.org to allthetropes.org to the ssl repo [02:11:59] [02ssl] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vxP9L [02:12:02] [02ssl] 07paladox opened pull request 03#392: Move redirecting allthetropes.miraheze.org to allthetropes.org to the ssl repo - 13https://git.io/JtNwH [02:12:20] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtNwN [02:12:22] [02miraheze/puppet] 07paladox 03827a5b9 - Move redirecting allthetropes.miraheze.org to allthetropes.org to the ssl repo [02:12:24] [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbiAS [02:12:26] [02puppet] 07paladox opened pull request 03#1666: Move redirecting allthetropes.miraheze.org to allthetropes.org to the ssl repo - 13https://git.io/JtNwx [02:13:34] [02ssl] 07paladox closed pull request 03#392: Move redirecting allthetropes.miraheze.org to allthetropes.org to the ssl repo - 13https://git.io/JtNwH [02:13:35] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtNrU [02:13:37] [02miraheze/ssl] 07paladox 03f2ba3b8 - Move redirecting allthetropes.miraheze.org to allthetropes.org to the ssl repo (#392) [02:13:38] [02miraheze/ssl] 07paladox deleted branch 03paladox-patch-1 [02:13:40] [02ssl] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vxP9L [02:13:44] [02puppet] 07paladox closed pull request 03#1666: Move redirecting allthetropes.miraheze.org to allthetropes.org to the ssl repo - 13https://git.io/JtNwx [02:13:45] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtNrT [02:13:47] [02miraheze/puppet] 07paladox 0349a2419 - Move redirecting allthetropes.miraheze.org to allthetropes.org to the ssl repo (#1666) [02:13:48] [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbiAS [02:13:50] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1 [02:45:11] PROBLEM - test3 Puppet on test3 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 11 minutes ago with 0 failures [03:04:20] PROBLEM - jobrunner4 Current Load on jobrunner4 is CRITICAL: CRITICAL - load average: 6.72, 5.37, 3.95 [03:12:20] PROBLEM - jobrunner4 Current Load on jobrunner4 is WARNING: WARNING - load average: 5.17, 5.69, 4.74 [03:14:43] RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 5 seconds ago with 0 failures [03:18:20] RECOVERY - jobrunner4 Current Load on jobrunner4 is OK: OK - load average: 4.14, 4.89, 4.71 [03:46:05] PROBLEM - jobrunner3 Current Load on jobrunner3 is WARNING: WARNING - load average: 5.24, 4.51, 3.37 [03:48:03] RECOVERY - jobrunner3 Current Load on jobrunner3 is OK: OK - load average: 4.94, 4.64, 3.56 [06:36:06] !log reception@jobrunner3:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=besttvshowswiki --r "[[phab:T6891|Requested]]" /home/reception/Best_TV_Shows_Wiki.txt [06:36:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:37:03] !log reception@jobrunner3:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=crappygameswiki --r "[[phab:T6891|Requested]]" /home/reception/Crappy_Games_Wiki.txt [08:37:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:31:23] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JtN5z [10:31:24] [02miraheze/ssl] 07Reception123 03ec850fb - add wiki.caker18.com cert [12:46:22] !log reception@jobrunner3:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=greatestmovieswiki --r "[[phab:T6891|Requested]]" /home/reception/Greatest_Movies_Wiki.txt [12:46:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:50:58] !log reception@jobrunner3:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=loathsomecharacterswiki --r "[[phab:T6891|Requested]]" /home/reception/Loathsome_Characters_Wiki.txt [13:51:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:21:02] [02puppet] 07RhinosF1 opened pull request 03#1667: adminlog: maintain text above the first header - 13https://git.io/JtAJV [14:21:44] [02puppet] 07RhinosF1 edited pull request 03#1667: adminlog: maintain text above the first header - 13https://git.io/JtAJV [14:22:21] [02puppet] 07RhinosF1 commented on pull request 03#1664: Have MirahezeLogbot insert {{TOC right}} on every edit - 13https://git.io/JtAJr [14:25:45] paladox: will you review the puppet PRs #1665 and #1667 [14:26:02] dmehus: I opened a fix for {{TOCRIGHT}} [14:26:42] [02puppet] 07paladox closed pull request 03#1667: adminlog: maintain text above the first header - 13https://git.io/JtAJV [14:26:44] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtAJd [14:26:45] [02miraheze/puppet] 07RhinosF1 034f0171c - adminlog: maintain text above the first header (#1667) [14:28:16] !log test [14:28:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:28:45] RhinosF1, ty 🙂 [14:29:01] paladox: I tested locally but you'll only see the difference when it's a new day [14:29:13] ok [14:29:48] [02puppet] 07paladox closed pull request 03#1665: Wrap SAL entries with - 13https://git.io/JtNIC [14:29:49] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtAUf [14:29:51] [02miraheze/puppet] 07Universal-Omega 031067681 - Wrap SAL entries with (#1665) [14:30:01] I replaced page.save with print() so it went to my terminal [14:30:35] You'll see a bunch of requests in logs that have logbot and then my username in the UA getting page text [14:30:58] !log test [14:31:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:31:39] [02puppet] 07dmehus commented on pull request 03#1665: Wrap SAL entries with - 13https://git.io/JtAUI [14:32:07] [02puppet] 07dmehus edited a comment on pull request 03#1665: Wrap SAL entries with - 13https://git.io/JtAUI [14:32:21] [02puppet] 07dmehus edited a comment on pull request 03#1665: Wrap SAL entries with - 13https://git.io/JtAUI [14:34:10] [02puppet] 07RhinosF1 commented on pull request 03#1665: Wrap SAL entries with - 13https://git.io/JtAUW [14:34:38] @Doug: %s is weird [14:34:45] It's not a variable [14:34:53] It shows where a variable goes [14:36:44] @Doug: see bot alerts channel [14:37:57] RhinosF1, okay. So as long as won't be wrapped around the log entries themselves, I'm fine with that; otherwise, we should revert [14:39:13] @Doug: it's the actual log entry that's what I said [14:40:20] [02puppet] 07dmehus commented on pull request 03#1665: Wrap SAL entries with - 13https://git.io/JtAUD [14:40:49] RhinosF1, replied on the task [14:40:59] Ok [14:52:46] !log reception@jobrunner3:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=rottenwebsiteswiki --r "[[phab:T6891|Requested]]" /home/reception/Rotten_Websites_Wiki.txt [14:52:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:54:45] !log reception@jobrunner3:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=terribletvshowswiki --r "[[phab:T6891|Requested]]" /home/reception/Terrible_TV_Shows_Wiki.txt [14:54:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:22:18] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtAIq [15:22:19] [02miraheze/puppet] 07paladox 03994f7d1 - nginx: Automate setting set_real_ip_from [15:22:21] [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbiAS [15:22:22] [02puppet] 07paladox opened pull request 03#1668: nginx: Automate setting set_real_ip_from - 13https://git.io/JtAIm [15:22:44] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtAI3 [15:22:46] [02miraheze/puppet] 07paladox 0361b6efc - Update nginx.conf.erb [15:22:47] [02puppet] 07paladox synchronize pull request 03#1668: nginx: Automate setting set_real_ip_from - 13https://git.io/JtAIm [15:27:14] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtAIw [15:27:15] [02miraheze/puppet] 07paladox 031b8f4c7 - Update init.pp [15:27:17] [02puppet] 07paladox synchronize pull request 03#1668: nginx: Automate setting set_real_ip_from - 13https://git.io/JtAIm [15:28:01] [02puppet] 07paladox closed pull request 03#1668: nginx: Automate setting set_real_ip_from - 13https://git.io/JtAIm [15:28:02] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JtAIP [15:28:04] [02miraheze/puppet] 07paladox 03be4eb0d - nginx: Automate setting set_real_ip_from (#1668) [15:28:05] [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbiAS [15:28:07] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1 [15:32:32] PROBLEM - test3 Puppet on test3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 1 minute ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-server-syntax] [15:33:39] PROBLEM - phab2 Puppet on phab2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-server-syntax] [15:33:49] PROBLEM - graylog2 Puppet on graylog2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-server-syntax] [15:34:11] paladox, is that related to your nginx commit above? [15:34:18] yes [15:34:25] okay [15:34:31] RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 14 seconds ago with 0 failures [15:35:45] PROBLEM - mw10 Puppet on mw10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-server-syntax] [15:36:00] PROBLEM - mw8 Puppet on mw8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-server-syntax] [15:36:11] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtALZ [15:36:13] [02miraheze/puppet] 07paladox 03d642c0c - nginx: Fix template [15:36:24] PROBLEM - jobrunner3 Puppet on jobrunner3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-server-syntax] [15:37:21] PROBLEM - mw11 Puppet on mw11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-server-syntax] [15:37:28] PROBLEM - jobrunner4 Puppet on jobrunner4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-server-syntax] [15:37:41] PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-server-syntax] [15:37:45] RECOVERY - mw10 Puppet on mw10 is OK: OK: Puppet is currently enabled, last run 5 seconds ago with 0 failures [15:37:59] RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [15:39:19] RECOVERY - mw11 Puppet on mw11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:39:40] RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:44:26] RECOVERY - jobrunner3 Puppet on jobrunner3 is OK: OK: Puppet is currently enabled, last run 12 seconds ago with 0 failures [15:45:27] RECOVERY - jobrunner4 Puppet on jobrunner4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:55:34] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtAtx [15:55:35] [02miraheze/puppet] 07paladox 03ec00171 - mediawiki: Change thumbnail check so it does not do it for every file [15:55:37] [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbiAS [15:55:38] [02puppet] 07paladox opened pull request 03#1669: mediawiki: Change thumbnail check so it does not do it for every file - 13https://git.io/JtAtp [15:57:08] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtAqe [15:57:10] [02miraheze/puppet] 07paladox 03701004a - Update mediawiki.conf.erb [15:57:11] [02puppet] 07paladox synchronize pull request 03#1669: mediawiki: Change thumbnail check so it does not do it for every file - 13https://git.io/JtAtp [16:01:37] RECOVERY - phab2 Puppet on phab2 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures [16:01:49] RECOVERY - graylog2 Puppet on graylog2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [16:02:32] PROBLEM - test3 Puppet on test3 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 4 minutes ago with 0 failures [16:20:53] PROBLEM - mail2 IMAP on mail2 is CRITICAL: No data received from host [16:22:48] RECOVERY - mail2 IMAP on mail2 is OK: IMAP OK - 0.005 second response time on 51.195.236.253 port 143 [* OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS LOGINDISABLED] Dovecot (Debian) ready.] [16:24:57] [02puppet] 07paladox closed pull request 03#1669: mediawiki: Change thumbnail check so it does not do it for every file - 13https://git.io/JtAtp [16:24:59] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtAmA [16:25:00] [02miraheze/puppet] 07paladox 0332fe34e - mediawiki: Change thumbnail check so it does not do it for every file (#1669) [16:25:02] [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbiAS [16:25:03] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1 [16:27:05] PROBLEM - mail2 IMAP on mail2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:29:33] !log reception@jobrunner3:/srv/mediawiki/w/extensions/CentralAuth/maintenance$ sudo -u www-data php createLocalAccount.php --wiki robotiawiki Robotia [16:29:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:30:48] !log reception@jobrunner3:/srv/mediawiki/w/extensions/CreateWiki/maintenance$ sudo -u www-data php populateMainPage.php --wiki robotiawiki [16:30:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:33:06] RECOVERY - mail2 IMAP on mail2 is OK: IMAP OK - 0.010 second response time on 51.195.236.253 port 143 [* OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS LOGINDISABLED] Dovecot (Debian) ready.] [16:41:28] [02MirahezeMagic] 07paladox reviewed pull request 03#214 commit - 13https://git.io/JtAOZ [16:44:50] paladox: any idea what's up with this error that seems to be clogging logs? [16:44:51] `Duplicate get(): "robotiawiki:matomo:id" fetched 2 times` [16:45:13] well its saying duplicate but i thought i reduced the log level [16:45:17] (it's also happening with meta, this was just an example as I was trying to look why CW failed) [16:45:48] its spam, its not an error fyi [16:47:07] paladox: oh, but why is it happening? [16:47:19] as it says "duplicate get" [16:47:36] *->get() [16:48:31] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtAO9 [16:48:33] [02miraheze/mw-config] 07paladox 035d7865d - Change memcached logger to only log at error [16:49:22] paladox: https://graylog.miraheze.org/messages/graylog_103/e49a8c70-78f0-11eb-b65f-0200001a24a4 also happened which could be the reason why the requestor was never created on the wiki [16:49:33] miraheze/mw-config - paladox the build passed. [16:50:01] request created on the wiki? [16:50:20] MariaDB [(none)]> use robotiawiki; [16:50:20] ERROR 1049 (42000): Unknown database 'robotiawiki' [16:50:48] paladox: well there was https://meta.miraheze.org/wiki/Special:RequestWikiQueue/16872 and then the wiki was created but the requestor wasn't and neither was the main page [16:50:49] [ Wiki requests queue - Miraheze Meta ] - meta.miraheze.org [16:51:25] Is there an extra step that didn't get manually done? [16:52:07] well there must've been an issue after the wiki itself was created that caused the rest of the process (requestor + Main Page) to stop [16:52:11] was this wiki existed before? [16:52:12] root@jobrunner4:/srv/mediawiki/w/cache# ls -lah robotiawiki.json [16:52:12] -rw-r--r-- 1 www-data www-data 7.6K Feb 27 11:42 robotiawiki.json [16:52:17] so it could be the cache? [16:53:24] I don't think it existed before but not fully sure [16:54:02] I don't think it existed before but let me check RWQ [16:54:23] https://graylog.miraheze.org/messages/graylog_103/e49bec01-78f0-11eb-b65f-0200001a24a4 [16:55:13] Reception123 and paladox, https://meta.miraheze.org/wiki/Special:RequestWikiQueue?dbname=robotiawiki&requester=&status=*, nope [16:55:14] [ Wiki requests queue - Miraheze Meta ] - meta.miraheze.org [16:55:15] well it takes 2 requests for cache to be updated (take effect). The first request is not gurenteed to have everything set so exceptions could happen. [16:55:32] (this is only if the cache file does not exist) [16:56:13] * dmehus wonders if Reception123 is as confused as he is about what paladox means [16:58:39] yeah, not very sure [17:00:53] what's that wikidbname.json file for in the cache folder? [17:02:38] PROBLEM - mail2 IMAP on mail2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:03:51] stores cached info for the wiki so its not always hitting the db, causing high load [17:04:20] though doesn't look like that should be the issue in the creating of the wiki [17:04:24] so i dunno why [17:04:32] *it happens [17:05:58] [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtA3d [17:05:59] [02miraheze/CreateWiki] 07paladox 03c2a41ca - Add missing clusterSize default [17:06:01] [02CreateWiki] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vpJTL [17:06:02] [02CreateWiki] 07paladox opened pull request 03#192: Add missing clusterSize default - 13https://git.io/JtA3F [17:06:59] miraheze/CreateWiki - paladox the build passed. [17:07:16] [02CreateWiki] 07paladox closed pull request 03#192: Add missing clusterSize default - 13https://git.io/JtA3F [17:07:18] [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtA3A [17:07:19] [02miraheze/CreateWiki] 07paladox 03c102bce - Add missing clusterSize default (#192) [17:07:21] [02CreateWiki] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vpJTL [17:07:22] [02miraheze/CreateWiki] 07paladox deleted branch 03paladox-patch-1 [17:08:13] miraheze/CreateWiki - paladox the build passed. [17:11:38] [02puppet] 07Universal-Omega opened pull request 03#1670: Revert "Wrap SAL entries with " - 13https://git.io/JtAsk [17:11:50] Universal_Omega, ty :) [17:12:28] dmehus: no problem. [17:12:35] Omega, can't you and RhinosF1 merge commits to the Puppet repo, or is that because you don't have shell access on those servers? [17:12:49] dmehus: we can't [17:12:53] ah, right [17:12:58] yeah, makes sense [17:13:18] paladox: do you mind merging that? [17:13:18] [02puppet] 07paladox closed pull request 03#1670: Revert "Wrap SAL entries with " - 13https://git.io/JtAsk [17:13:20] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtAs0 [17:13:21] [02miraheze/puppet] 07Universal-Omega 03bbde455 - Revert "Wrap SAL entries with (#1665)" (#1670) [17:13:24] thanks paladox [17:13:26] Thanks! [17:22:48] dmehus: we can't merge to puppet as it affects everywhere but we don't have access to mon1 anyway [17:23:05] Although you could make puppet updates auto restart logbot [17:24:34] RhinosF1, ah [17:24:49] dmehus: although puppet says it does actually auto restart it [17:24:57] and that'd be cool if Puppet could autorestart MirahezeLogbot actually [17:25:02] oh [17:25:14] So maybe paladox was just running puppet and not manually doing it [17:25:22] ah [17:27:32] dmehus: where puppet has lines like https://github.com/miraheze/puppet/blob/master/modules/irc/manifests/irclogbot.pp#L29 that means reload/restart [17:27:32] [ puppet/irclogbot.pp at master · miraheze/puppet · GitHub ] - github.com [17:28:25] RhinosF1, ah, right. That makes sense, and `logbot` is the name of the service [17:28:57] dmehus: yep [17:29:33] I wonder what Void-bot uses for the CVT action log, mind you, maybe the CVT action log is using __NOTOC__ [17:30:35] Oh wait, nvm. That was for a different issue, which you resolved [17:45:13] * RhinosF1 wishes Microsoft would get back re https://www.microsoft.com/en-us/PhotoDNA/CloudService [17:45:13] [ PhotoDNA Cloud Service | Microsoft ] - www.microsoft.com [17:49:55] RECOVERY - mail2 IMAP on mail2 is OK: IMAP OK - 0.014 second response time on 51.195.236.253 port 143 [* OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS LOGINDISABLED] Dovecot (Debian) ready.] [18:01:11] RhinosF1, have you tried e-mailing them again? [18:15:09] PROBLEM - mail2 IMAP on mail2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:21:11] dmehus: I did just before posting that [18:22:06] RhinosF1, ack and that's good [18:35:29] RECOVERY - mail2 IMAP on mail2 is OK: IMAP OK - 0.011 second response time on 51.195.236.253 port 143 [* OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS LOGINDISABLED] Dovecot (Debian) ready.] [18:43:31] PROBLEM - mail2 IMAP on mail2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:53:48] RECOVERY - mail2 IMAP on mail2 is OK: IMAP OK - 7.194 second response time on 51.195.236.253 port 143 [* OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS LOGINDISABLED] Dovecot (Debian) ready.] [19:02:59] PROBLEM - mail2 IMAP on mail2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:05:30] PROBLEM - test3 APT on test3 is CRITICAL: APT CRITICAL: 32 packages available for upgrade (1 critical updates). [19:54:48] Universal_Omega: what does https://phabricator.wikimedia.org/T275334#6855841 mean for ManageWiki? [19:54:49] [ ⚓ T275334 Changing user groups from $wgExtensionFunctions no longer works reliably ] - phabricator.wikimedia.org [20:11:01] RhinosF1: ManageWiki shouldn't be effected with that, that I know of. I could be misunderstanding the task though. Let me read more. [20:12:13] Universal_Omega: ack [20:12:22] Yeah from what I understand, managewiki should be completely unaffected. [20:20:22] RhinosF1: I'm not entirely sure, but to my knowledge it should remain unaffected. Was that 1.36? If so, which 1.36 wmf, do you know? I know ManageWiki works on 1.36 because I already tested it on 1.36.0-wmf.21 is the highest I've tested on. I will test later on 1.36.0-wmf.26 [20:20:57] Universal_Omega: I'm not sure when I started beyond 1.36 [20:22:33] RhinosF1: OK, I'll test on the 1.36.0-wmf-xx (latest version) sometime next month. [20:31:12] PROBLEM - test3 MediaWiki Rendering on test3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 344 bytes in 3.803 second response time [20:46:52] [02miraheze/MatomoAnalytics] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtA0C [20:46:53] [02miraheze/MatomoAnalytics] 07paladox 037f76735 - MatomoAnalytics: Cache get within getSiteID [20:46:55] [02MatomoAnalytics] 07paladox created branch 03paladox-patch-1 - 13https://git.io/fN4LT [20:46:56] [02MatomoAnalytics] 07paladox opened pull request 03#36: MatomoAnalytics: Cache get within getSiteID - 13https://git.io/JtA0W [20:47:48] [02miraheze/MatomoAnalytics] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtA0E [20:47:50] [02miraheze/MatomoAnalytics] 07paladox 037b8cb6f - Update MatomoAnalytics.php [20:47:51] [02MatomoAnalytics] 07paladox synchronize pull request 03#36: MatomoAnalytics: Cache get within getSiteID - 13https://git.io/JtA0W [20:47:52] miraheze/MatomoAnalytics - paladox the build passed. [20:48:52] miraheze/MatomoAnalytics - paladox the build passed. [20:49:01] RECOVERY - test3 MediaWiki Rendering on test3 is OK: HTTP OK: HTTP/1.1 200 OK - 20749 bytes in 0.360 second response time [22:22:33] RECOVERY - mail2 IMAP on mail2 is OK: IMAP OK - 0.006 second response time on 51.195.236.253 port 143 [* OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS LOGINDISABLED] Dovecot (Debian) ready.] [22:48:43] PROBLEM - mail2 IMAP on mail2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:40:04] [02miraheze/MatomoAnalytics] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/JtAw0 [23:40:06] [02miraheze/MatomoAnalytics] 07paladox 03309c9cb - MatomoAnalytics::getSiteID: Fix default value for when wiki isn't found [23:40:07] [02MatomoAnalytics] 07paladox created branch 03paladox-patch-2 - 13https://git.io/fN4LT [23:40:09] [02MatomoAnalytics] 07paladox opened pull request 03#37: MatomoAnalytics::getSiteID: Fix default value for when wiki isn't found - 13https://git.io/JtAwE [23:40:55] [02miraheze/MatomoAnalytics] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/JtAw2 [23:40:57] [02miraheze/MatomoAnalytics] 07paladox 03b51219e - Update CHANGELOG [23:40:58] [02MatomoAnalytics] 07paladox synchronize pull request 03#37: MatomoAnalytics::getSiteID: Fix default value for when wiki isn't found - 13https://git.io/JtAwE [23:41:09] miraheze/MatomoAnalytics - paladox the build passed. [23:41:13] [02miraheze/MatomoAnalytics] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/JtAwV [23:41:15] [02miraheze/MatomoAnalytics] 07paladox 0331facdb - Update extension.json [23:41:16] [02MatomoAnalytics] 07paladox synchronize pull request 03#37: MatomoAnalytics::getSiteID: Fix default value for when wiki isn't found - 13https://git.io/JtAwE [23:41:53] [02MatomoAnalytics] 07paladox closed pull request 03#37: MatomoAnalytics::getSiteID: Fix default value for when wiki isn't found - 13https://git.io/JtAwE [23:41:54] miraheze/MatomoAnalytics - paladox the build passed. [23:41:54] [02miraheze/MatomoAnalytics] 07paladox pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/JtAw6 [23:41:56] [02miraheze/MatomoAnalytics] 07paladox 038c745df - MatomoAnalytics::getSiteID: Fix default value for when wiki isn't found (#37) [23:41:57] [02MatomoAnalytics] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/fN4LT [23:41:59] [02miraheze/MatomoAnalytics] 07paladox deleted branch 03paladox-patch-2 [23:42:09] miraheze/MatomoAnalytics - paladox the build passed. [23:42:50] miraheze/MatomoAnalytics - paladox the build passed. [23:43:03] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JtAw1 [23:43:04] [02miraheze/mediawiki] 07paladox 03a041d6f - Update MatomoAnalytics [23:43:27] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JtAwM [23:43:29] [02miraheze/mediawiki] 07paladox 03c4fe318 - Update CreateWiki [23:44:29] oh i have to apply schema [23:44:52] paladox: was the intent of that MatomoAnalytics fix to change default site ID from 0 to 1? [23:45:11] yeh [23:45:38] Ah, right. Thanks! [23:45:56] paladox: Also yeah, for CreateWiki, it's why I didn't update yet, I was going to though. [23:46:07] i'm going to apply it now [23:46:37] paladox: I was actually just going to wait for 2 more days when dependabot runs, but now is fine also. Thanks! [23:48:12] !log db11: MariaDB [mhglobal]> ALTER TABLE /*$wgDBprefix*/cw_wikis ADD COLUMN cw_bio TINYINT UNSIGNED NOT NULL DEFAULT '0'; [23:48:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:48:26] paladox: Oh wait, was the patch file forgot in the CW changes? Unless I missed it, it looks like John forgot to make one, or was it not needed? [23:48:32] And thanks for doing that. [23:48:39] yeh, John didn't add a patch file [23:48:58] Would you like me to? [23:51:26] Yes please [23:51:27] also [23:51:34] https://github.com/Miraheze/CreateWiki/compare/06a282b3f47500159a16de8aef26b4442803f14a...c102bcea8df39274106c6b441c6556a4cad35ab7#diff-eae0ed68e7a72ff2942f1c6f3cf7bf4cfef53572c68194794b12fc48d0eb7b48R233 [23:51:35] [ Comparing 06a282b3f47500159a16de8aef26b4442803f14a...c102bcea8df39274106c6b441c6556a4cad35ab7 · miraheze/CreateWiki · GitHub ] - github.com [23:51:42] not sure if that will spam logs [23:51:51] because what if existing requests don't have purpose? [23:53:04] Universal_Omega ^ [23:53:10] !log rebuild lc on mw* and jobrunner* [23:53:18] paladox: well for one that "purpose" should be localised at the very least. As for if that will spam logs, good question. [23:53:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:54:24] I don't think it will paladox, but not certain. It should only affect new requests I think. [23:54:36] ok, thanks! [23:56:03] No problem, paladox! [23:56:25] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.27, 5.26, 3.85 [23:57:12] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.28, 6.40, 4.50 [23:58:10] paladox: I think the 2 new configs also need set though. [23:58:23] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.45, 5.59, 4.14 [23:58:49] CreateWikiPurposes is an array [23:59:07] so needs an list, so i'm letting who ever wants it to set it as i don't know what to put :) [23:59:25] CreateWikiShowBiographicalOption only needs a true or false [23:59:32] So if you want to set it feel free :)