[00:03:23] PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:07:12] [02MirahezeMagic] 07paladox created branch 03paladox-patch-1 - 13https://git.io/fQRGX [00:07:13] [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fNrkh [00:07:15] [02miraheze/MirahezeMagic] 07paladox 0376e6075 - Update extension.json [00:07:16] [02MirahezeMagic] 07paladox opened pull request 03#48: Update extension.json - 13https://git.io/fNrkj [00:08:36] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNrIv [00:08:38] [02miraheze/puppet] 07paladox 03170ba8c - Fix syntax [00:08:59] [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fNrIJ [00:09:01] [02miraheze/MirahezeMagic] 07paladox 038b7d06f - Update MirahezeMagicHooks.php [00:09:02] [02MirahezeMagic] 07paladox synchronize pull request 03#48: Update extension.json - 13https://git.io/fNrkj [00:09:13] [02MirahezeMagic] 07paladox closed pull request 03#48: Update extension.json - 13https://git.io/fNrkj [00:09:14] [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fNrIT [00:09:16] [02miraheze/MirahezeMagic] 07paladox 0301b8f30 - Update extension.json (#48) * Update extension.json * Update MirahezeMagicHooks.php [00:09:45] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fNrII [00:09:47] [02miraheze/mediawiki] 07paladox 032bc2b47 - Update MirahezeMagic [00:10:58] [02miraheze/MirahezeMagic] 07paladox deleted branch 03paladox-patch-1 [00:11:00] [02MirahezeMagic] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/fQRGX [00:11:20] RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [00:13:44] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 2866 [00:23:08] [02CreateWiki] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vpJTL [00:23:10] [02miraheze/CreateWiki] 07paladox deleted branch 03paladox-patch-1 [00:25:04] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNrLk [00:25:06] [02miraheze/puppet] 07paladox 039d86d47 - Update cron.pp [00:25:29] [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNrLL [00:25:31] [02miraheze/MirahezeMagic] 07paladox 03f53f562 - Using puppet to run this script instead [00:26:01] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fNrLq [00:26:02] [02miraheze/mediawiki] 07paladox 03024bacc - Update MirahezeMagic [00:29:29] Oh, I forgot to mention that they have not enabled the VisualEditor in Mexicopediawiki and Tallercentralwiki. I had been distracted by the subject of Namespaces. [00:29:30] only need to enable it in ManageWikiExtensions* [00:32:47] done [00:32:56] thanks :) [00:34:05] [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNrLa [00:34:07] [02miraheze/MirahezeMagic] 07paladox 0348388a8 - Update addWikiToServices.php [00:34:42] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fNrLr [00:34:44] [02miraheze/mediawiki] 07paladox 03411105d - Update MirahezeMagic [00:35:23] PROBLEM - db4 Current Load on db4 is CRITICAL: CRITICAL - load average: 8.95, 5.80, 3.28 [00:37:49] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNrLX [00:37:50] [02miraheze/puppet] 07paladox 036dc4d0f - Update cron.pp [00:39:11] So if I remember correctly, if I want to make my wiki so that anonymous users can’t read it but any registered user can, I cannot just set $wgGroupPermissions[‘*’][‘read’]=false [00:39:19] Correct? [00:42:13] uh [00:42:15] db4 load problems [00:42:18] 15 [00:42:19] wow [00:42:52] uh what is causing this load.... [00:44:16] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNrtI [00:44:18] [02miraheze/puppet] 07paladox 038714633 - Update cron.pp [00:46:18] !log depool mw3 [00:46:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:46:32] !log reboot mw3 [00:46:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:49:10] HTTP CRITICAL - Unable to open TCP socket [00:49:11] !log repool mw3 [00:49:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:49:37] !log depool mw2 [00:49:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:49:46] !log reboot mw2 [00:49:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:50:33] PROBLEM - cp5 Varnish Backends on cp5 is CRITICAL: 1 backends are down. mw2 [00:50:35] PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 1 backends are down. mw2 [00:51:03] that's not helping with the db load [00:51:08] im going to have to restart [00:51:11] RECOVERY - mw3 HTTP on mw3 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 459 bytes in 0.049 second response time [00:52:21] !log repool mw2 [00:52:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:52:39] !log depool and reboot mw1 [00:52:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:53:14] loads going down on db4 [00:53:17] since rebooting mw1 [00:54:05] PROBLEM - cp5 Current Load on cp5 is CRITICAL: CRITICAL - load average: 1.10, 2.05, 1.02 [00:54:07] PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 1 backends are down. mw1 [00:55:09] PROBLEM - mw1 SSH on mw1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:55:31] PROBLEM - mw1 php7.2-fpm on mw1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:55:49] connect to host 185.52.1.75 port 5666: Connection refused [00:56:05] RECOVERY - cp5 Current Load on cp5 is OK: OK - load average: 0.48, 1.66, 1.01 [00:56:09] HTTP CRITICAL - Unable to open TCP socket [00:57:05] RECOVERY - mw1 SSH on mw1 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u3 (protocol 2.0) [00:57:27] RECOVERY - mw1 php7.2-fpm on mw1 is OK: PROCS OK: 5 processes with command name 'php-fpm7.2' [00:57:45] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 38 seconds ago with 0 failures [00:57:53] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 0.19, 0.07, 0.02 [00:57:59] RECOVERY - mw1 Disk Space on mw1 is OK: DISK OK - free space: / 41778 MB (54% inode=99%); [00:58:07] RECOVERY - cp4 Varnish Backends on cp4 is OK: All 3 backends are healthy [00:58:08] AmandaCatherine crisis adverted now! [00:58:13] RECOVERY - mw1 HTTP on mw1 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 459 bytes in 0.012 second response time [00:58:21] paladox: good :) [00:58:33] RECOVERY - cp5 Varnish Backends on cp5 is OK: All 3 backends are healthy [00:58:35] RECOVERY - cp2 Varnish Backends on cp2 is OK: All 3 backends are healthy [00:58:41] [02mw-config] 07Amanda-Catherine opened pull request 03#2327: Make weatherwiki private for only unregistered users - 13https://git.io/fNrto [00:59:03] AmandaCatherine would you like me to merge ^^? [00:59:13] Yes please paladox [00:59:46] ok [00:59:53] [02mw-config] 07paladox closed pull request 03#2327: Make weatherwiki private for only unregistered users - 13https://git.io/fNrto [00:59:55] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fNrt6 [00:59:56] [02miraheze/mw-config] 07Amanda-Catherine 03db0177a - Make weatherwiki private for only unregistered users (#2327) * Update LocalWiki.php * Update LocalSettings.php [01:00:15] Now let’s see if I did the config right [01:03:23] PROBLEM - db4 Current Load on db4 is WARNING: WARNING - load average: 1.61, 3.40, 7.25 [01:03:38] uh [01:03:43] wait [01:03:45] ah [01:03:47] ok [01:03:48] nvm [01:05:23] RECOVERY - db4 Current Load on db4 is OK: OK - load average: 1.53, 2.80, 6.56 [01:05:36] Hmm.. almost right [01:05:48] Except that the user group still can’t read pages like they should be able to [01:06:02] * AmandaCatherine files a Phab ticket [01:12:40] https://phabricator.miraheze.org/T3438 [01:12:41] Title: [ ⚓ T3438 Making Weather Wiki private for only unregistered users ] - phabricator.miraheze.org [01:21:43] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [01:28:19] [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNrq5 [01:28:21] [02miraheze/MirahezeMagic] 07paladox 03c74f305 - Update addWikiToServices.php [01:28:54] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fNrqF [01:28:56] [02miraheze/mediawiki] 07paladox 03f083261 - Update MirahezeMagic [01:34:28] PROBLEM - cp5 Current Load on cp5 is CRITICAL: CRITICAL - load average: 2.27, 1.89, 0.94 [01:35:12] uh [01:35:16] why is cp5 load high [01:35:42] What is cp? [01:35:45] Another server? [01:36:17] !log reboot cp5 [01:36:23] AmandaCatherine it's our cache servers [01:36:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [01:36:29] Ok [01:36:34] so that you will have the best performance [01:36:42] without it, sites will load slowly [01:36:45] the wmf use it [01:36:49] (varnish) [01:36:54] Hello u1dzer027! If you have any questions feel free to ask and someone should answer soon. [01:36:57] Ah [01:36:58] With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ [01:36:59] Title: [ William “nenolod” Pitcock website ] - williampitcock.com [01:37:01] I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ [01:37:02] Title: [ Bryan Østergaard (kloeri) - Freenode head of infrastructure, Senior IT Infrastructure Specialist at Nordea ] - bryanostergaard.com [01:37:05] Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate [01:37:06] Title: [ Freenodegate - Encyclopedia Dramatica ] - encyclopediadramatica.rs [01:37:08] A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ [01:37:09] Title: [ GirlLove Blog ] - MattSTrout.com [01:37:11] u1dzer027: please stop spamming [01:37:50] Thank you [01:37:56] AmandaCatherine that is a spam bot [01:37:57] I’ve seen that spambot around quite a bit [01:38:00] it hit the wmf [01:38:10] and now they found us [01:38:32] RECOVERY - cp5 Current Load on cp5 is OK: OK - load average: 0.27, 0.06, 0.02 [01:39:02] Hello missnomer25! If you have any questions feel free to ask and someone should answer soon. [01:39:04] oh [01:39:06] With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ [01:39:06] Title: [ William “nenolod” Pitcock website ] - williampitcock.com [01:39:09] I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ [01:39:10] Title: [ Bryan Østergaard (kloeri) - Freenode head of infrastructure, Senior IT Infrastructure Specialist at Nordea ] - bryanostergaard.com [01:39:12] Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate [01:39:13] Title: [ Freenodegate - Encyclopedia Dramatica ] - encyclopediadramatica.rs [01:39:14] Grrrr [01:39:16] A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ [01:39:16] Title: [ GirlLove Blog ] - MattSTrout.com [01:39:20] dumb spambots [01:39:59] AmandaCatherine round 3 should be here shortly. [01:40:17] Does the WMF know who is controlling them? [01:40:22] Or what their purpose is supposed to be [01:40:25] AmandaCatherine it's not just hitting the wmf [01:40:36] Okay, does Freenode know? [01:40:46] it's hitting the whole freenode [01:40:47] though it's a user that was kicked off freenode [01:40:48] and is taking revenge [01:40:52] so what ever the bot says it is fake news [01:41:14] So the bot operator is known to the Freenode opers [01:41:29] AmandaCatherine the user yes (i think) [01:41:32] or could be someone else. [01:41:58] Hopefully they don’t find my channel [01:42:10] Reception123 and rest of the team, im going to stay opped for a bit in case the bots come back. [01:42:47] With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ [01:42:47] I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ [01:42:47] Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate [01:42:47] Hello morsik22! If you have any questions feel free to ask and someone should answer soon. [01:42:48] Title: [ William “nenolod” Pitcock website ] - williampitcock.com [01:42:51] Title: [ Bryan Østergaard (kloeri) - Freenode head of infrastructure, Senior IT Infrastructure Specialist at Nordea ] - bryanostergaard.com [01:42:51] A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ [01:42:52] Title: [ Freenodegate - Encyclopedia Dramatica ] - encyclopediadramatica.rs [01:42:53] Title: [ GirlLove Blog ] - MattSTrout.com [01:42:56] Yep [01:43:00] bugger [01:43:18] Y’know, we should mute ZppixBot so that it doesn’t keep posting the spam URLs [01:44:59] Hello nlsun24! If you have any questions feel free to ask and someone should answer soon. [01:45:03] With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ [01:45:04] Title: [ William “nenolod” Pitcock website ] - williampitcock.com [01:45:07] I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ [01:45:08] Title: [ Bryan Østergaard (kloeri) - Freenode head of infrastructure, Senior IT Infrastructure Specialist at Nordea ] - bryanostergaard.com [01:45:11] Grrrr..... [01:45:24] I wonder should i set this channel to +r [01:45:26] temporarily [01:45:51] We could also moderate the channel by oping the current voiced users, voicing all the other users, and then setting mode +m [01:50:23] Whoops [01:50:26] Didn’t mean to post that [01:50:28] Trying to block it [01:50:48] WTF [01:50:53] AmandaCatherine block what? [01:50:53] The /block command isn’t working [01:51:03] Block the hostmasks so I won’t see their messages [01:51:10] huh? [01:51:11] Basically is Mutter’s version of ignore [01:51:17] oh [01:52:16] Oh, it didn’t actually post [01:52:27] (Or at least botbot didn’t log it) [01:52:34] nope i doint see it [01:55:07] part 4 will be here shortly AmandaCatherine [01:55:22] I’m doing preventive bans in my channel now [01:55:35] Are they spamming other channels you’re in paladox [01:55:39] yes [01:55:40] a ton [01:56:19] Hello april9! If you have any questions feel free to ask and someone should answer soon. [01:56:22] !log /mode #miraheze +r (to prevent the spam going around freenode). remove +r if you see this message and haven't done so [01:56:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [01:56:47] With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ [01:56:47] Hello OwenBarfield! If you have any questions feel free to ask and someone should answer soon. [01:56:47] I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ [01:56:48] Title: [ William “nenolod” Pitcock website ] - williampitcock.com [01:56:49] Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate [01:56:50] Title: [ Bryan Østergaard (kloeri) - Freenode head of infrastructure, Senior IT Infrastructure Specialist at Nordea ] - bryanostergaard.com [01:56:51] Title: [ Freenodegate - Encyclopedia Dramatica ] - encyclopediadramatica.rs [01:56:56] K-Lined [01:56:59] That’s good [01:59:09] AmandaCatherine yeh, but not before it puts spammy text in your logs... [02:00:03] I think they’re probably using some sort of malicious proxy, given how quickly and drastically they’ve been changing hostmasks/IP’s [02:00:23] If Freenode opers can figure out which proxy they’re using, they may be able to set an auto-Kline against the entire proxy [02:01:19] Also I think botbot will suppress spam from the logs [02:01:27] Especially if the spam contains libel etc [02:01:38] Which according to the Freenode statement some of it does [02:03:20] yep [02:04:51] Anyway [02:04:52] !night [02:04:52] Good night, sweet dreams and dream of the miraheze servers without errors! [02:23:48] [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fNrOL [02:23:50] [02miraheze/MirahezeMagic] 07paladox 03df8ddf2 - Fix script [02:23:51] [02MirahezeMagic] 07paladox created branch 03paladox-patch-1 - 13https://git.io/fQRGX [02:23:53] [02MirahezeMagic] 07paladox opened pull request 03#49: Fix script - 13https://git.io/fNrOt [02:24:32] miraheze/MirahezeMagic/paladox-patch-1/df8ddf2 - paladox The build was broken. https://travis-ci.com/miraheze/MirahezeMagic/builds/80572385 [02:25:01] [02MirahezeMagic] 07paladox synchronize pull request 03#49: Fix script - 13https://git.io/fNrOt [02:25:03] [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fNrOm [02:25:04] [02miraheze/MirahezeMagic] 07paladox 03ef5889f - Update addWikiToServices.php [02:25:43] miraheze/MirahezeMagic/paladox-patch-1/ef5889f - paladox The build was fixed. https://travis-ci.com/miraheze/MirahezeMagic/builds/80572463 [04:48:11] Hello ProClifo! If you have any questions feel free to ask and someone should answer soon. [04:54:58] With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ [04:54:58] I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ [04:54:58] Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate [04:54:58] Hello mort24! If you have any questions feel free to ask and someone should answer soon. [04:54:59] Title: [ William “nenolod” Pitcock website ] - williampitcock.com [04:55:02] Title: [ Bryan Østergaard (kloeri) - Freenode head of infrastructure, Senior IT Infrastructure Specialist at Nordea ] - bryanostergaard.com [04:55:02] A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ [04:55:03] Title: [ Freenodegate - Encyclopedia Dramatica ] - encyclopediadramatica.rs [04:55:04] Title: [ GirlLove Blog ] - MattSTrout.com [04:56:04] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNrcL [04:56:06] [02miraheze/puppet] 07Reception123 031cf2348 - add The Pioneer's email to CVT [04:56:48] With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ [04:56:48] I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ [04:56:48] Hello Hink! If you have any questions feel free to ask and someone should answer soon. [04:56:48] Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate [04:56:49] Title: [ William “nenolod” Pitcock website ] - williampitcock.com [04:56:52] Title: [ Bryan Østergaard (kloeri) - Freenode head of infrastructure, Senior IT Infrastructure Specialist at Nordea ] - bryanostergaard.com [04:56:52] A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ [04:56:53] Title: [ Freenodegate - Encyclopedia Dramatica ] - encyclopediadramatica.rs [04:56:54] Title: [ GirlLove Blog ] - MattSTrout.com [05:03:18] Hello CGML19! If you have any questions feel free to ask and someone should answer soon. [05:03:22] With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ [05:03:23] Title: [ William “nenolod” Pitcock website ] - williampitcock.com [05:03:25] I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ [05:03:26] Title: [ Bryan Østergaard (kloeri) - Freenode head of infrastructure, Senior IT Infrastructure Specialist at Nordea ] - bryanostergaard.com [05:03:29] Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate [05:03:30] Title: [ Freenodegate - Encyclopedia Dramatica ] - encyclopediadramatica.rs [05:03:32] A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ [05:03:33] Title: [ GirlLove Blog ] - MattSTrout.com [05:05:01] With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ [05:05:01] I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ [05:05:02] Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate [05:05:02] Hello infernix23! If you have any questions feel free to ask and someone should answer soon. [05:05:02] Title: [ William “nenolod” Pitcock website ] - williampitcock.com [05:05:05] A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ [05:05:05] Title: [ Bryan Østergaard (kloeri) - Freenode head of infrastructure, Senior IT Infrastructure Specialist at Nordea ] - bryanostergaard.com [05:05:06] Title: [ Freenodegate - Encyclopedia Dramatica ] - encyclopediadramatica.rs [05:05:07] Title: [ GirlLove Blog ] - MattSTrout.com [05:05:11] keep the +zq [05:05:22] revi: what does that do again? [05:05:35] z for relaxed moderate [05:05:53] +q $~a for shut up unregistered [05:06:13] ok, will do, thanks [05:06:15] Hello RoyK0! If you have any questions feel free to ask and someone should answer soon. [05:06:18] With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ [05:06:19] Title: [ William “nenolod” Pitcock website ] - williampitcock.com [05:06:29] the spambots are just ongoing for whole day I guess [05:06:38] so keep it for a while [05:07:10] yeah, I'll make it for 12 hours and we'll see after that [05:10:10] I miss the time when Sigyn was around to help us [05:10:22] with the ILB bullshit [05:11:17] yeah, tried to invite it but it didn't come, I guess we need 50 [05:11:21] no [05:11:23] 100 now [05:11:29] oh.. [05:11:29] such wow, yes [05:11:40] they need sigyn v2 and v3 and lol [05:11:56] why does it need 100? should "smaller" channels just get spammed? [05:12:15] in freenode view probably lol [05:12:16] ;-; [05:14:06] you may want to run your own instance of wmopbot tho [05:14:09] (link wait a sec [05:16:10] https://phabricator.wikimedia.org/source/tool-wmopbot/ [05:16:10] Title: [ tool-wmopbot · tool-wmopbot ] - phabricator.wikimedia.org [05:16:15] some wmf specific stuff tho [05:16:49] thanks [05:16:55] if the spam continues, we might have to [05:17:18] I wonder how these spambots only get the more "popular" channels [05:17:31] like miraheze-cvt and other small MH channels are not affected [05:20:26] there's some sort of list of channels stuff [05:20:27] lol^ [05:22:34] what I said 10 hours [05:23:30] ah I just wrote 10 forgot the h [05:25:00] Hello of! If you have any questions feel free to ask and someone should answer soon. [05:40:41] Hello egos7! If you have any questions feel free to ask and someone should answer soon. [05:49:22] Hello mdroid! If you have any questions feel free to ask and someone should answer soon. [05:51:21] I don’t think that channel IP bans can seriously deter these spammers. [05:51:46] yes, botnet [05:52:00] so now it's just +zq $~a [05:53:01] Hello pppingme2! If you have any questions feel free to ask and someone should answer soon. [05:54:12] are you going to quiet ZppixBot? [05:54:24] no although thats a good idea [05:54:25] or just +f ##fix_your_connection [05:54:43] that too [05:54:46] paladox: oh, what does +r do? [05:54:47] I'm reporting this to staffers so just wanted to see if the people joining are actually botnets [05:54:50] registered user only [05:54:51] since we already have +zq [05:54:54] PuppyKun: they already know it [05:54:55] oh [05:54:55] oops [05:54:56] i meant [05:54:59] to +m [05:55:08] revi: yeah but since they're still joining I'm just providing hostmasks and shit [05:55:13] PuppyKun: oh, Freenode already knows. See the topic in #freenode [05:55:16] it's botnet, probably useless [05:56:27] Let Freenode fight their foes, indeed. [06:11:17] BTW it looks unlike botnet. Just a mob attack presumedly coordinated on a troll site. [06:12:03] Modern botnet clients usually have randomly generated id@ field. [06:13:47] Possibly some of ED mobsters used proxies, but it does not make them botnet ☺ [06:19:03] well it's definitely not the same hostmasks/ips/etc. [06:19:15] so even if we ban them or quiet them they'll just keep coming back anyway [06:19:34] I saw actual botnet attacks in IRC many times, the first one in 2007. [06:22:20] It was rather stupid attack (and we successfully fought it back looking on timings of connections), but it was indeed a kind of botnet. [06:41:36] Well, for worse cases we have $lockdown [07:22:59] oh yeah I forgot that lol [07:29:43] Reception123: I thought https://phabricator.miraheze.org/T3438 is actually bypassing the T1761 [07:29:44] Title: [ ⚓ T3438 Making Weather Wiki private for only unregistered users ] - phabricator.miraheze.org [07:43:15] It’s the opposite [10:07:39] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 5801 [12:05:50] Reception123: only allows registered users to join [12:06:03] hm? [12:06:07] oh, +r [12:06:10] It is used as a temporarily measure when there’s spam bots going around [12:56:21] PROBLEM - test1 Puppet on test1 is WARNING: WARNING: Puppet is currently disabled, message: John, last run 5 minutes ago with 0 failures [13:34:06] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [14:16:22] Good morning [14:16:40] hi [14:17:14] It is so Americacentric. [14:18:10] Did the spambots hit again paladox? [14:18:15] yes [14:18:24] * AmandaCatherine sighs [14:18:38] it's a bot net i think. [14:19:38] paladox, why do you believe in this nonsense too? [14:19:45] uh what? [14:20:10] And what happened to Not 683 bot? [14:20:34] !log updated Lincode email from ops@ -> labster's personal email [14:20:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [14:21:03] qq[IrcCity] what do you mean? [14:22:04] I mean that there is no botnet. There is a handful of trolls from encyclopediadramatica; some possibly use a kind of proxy. [14:22:25] it is a botnet. [14:22:35] otherwise they would not be changing there ips [14:22:37] like they are [14:23:33] paladox, botnet means automatic programs (albeit with central command) connecting from multiple places. [14:23:50] that is exactly what's happening [14:24:27] I did not see evidence that these spammers were a kind of special software. [14:24:55] paladox: can you review and approve? https://github.com/miraheze/services/pull/153 [14:24:56] Title: [ add ourwiki, ourrail, pmspace, oursource, programario, ourjoke, kasopedia, encyclopedia on services per T3440 by Wiki1776 · Pull Request #153 · miraheze/services · GitHub ] - github.com [14:25:19] done [14:26:27] thanks paladox [14:26:38] your welcome :) [14:26:47] oh, uh because of +r notifications can't join [14:26:55] notifico* [14:27:15] yep, to prevent the spammer bots from comming inside this channel [14:28:47] yeh I saw thsat [14:28:53] that* [14:29:20] .announce https://github.com/miraheze/mw-config/pull/2328/files [14:29:20] AmandaCatherine: Sorry, I can't let you do that [14:29:22] of the channels I'm in, it only came to this one and #wm-bot [14:29:23] Title: [ Add additional namespaces on 2b2twiki per T3441 by Amanda-Catherine · Pull Request #2328 · miraheze/mw-config · GitHub ] - github.com [14:29:28] Well, all that's left to do is to enable in ManageWikiExtensions :) [14:29:39] Posting the link as notbot can’t join [14:29:47] Not sure why announce didn’t work [14:30:01] you have to be a bot admin to do it [14:30:05] .botadmins [14:30:06] MacFan4000: The bot's admins are: You, SwisterTwister, Reception123, Reception|away, paladox and Zppix [14:30:10] .access [14:30:10] Oh [14:30:10] The access level for MacFan4000 is Admin. [14:30:23] Well, just pasting the URL also works too [14:32:40] Does anyone know what the size limit for Special:Import is? [14:32:56] There’s a request to import XML that’ only 4MB, and I feel like they should be able to do that themselves [14:34:23] Ive added notifico@ to the invite list which overrides +r [14:34:34]