[00:02:37] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:02:45] PROBLEM - misc3 Puppet on misc3 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:02:49] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:23] PROBLEM - lizardfs1 Puppet on lizardfs1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:31] PROBLEM - misc2 Puppet on misc2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:35] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:51] PROBLEM - misc4 Puppet on misc4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:53] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:59] PROBLEM - bacula1 Puppet on bacula1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:04:17] HTTP CRITICAL - Unable to open TCP socket [00:04:21] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:04:23] PROBLEM - lizardfs2 Puppet on lizardfs2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:04:27] PROBLEM - db4 Puppet on db4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:05:13] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpSjK [00:05:14] [02miraheze/services] 07MirahezeSSLBot 03da49d91 - BOT: Updating services config for wikis [00:06:19] [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbiAS [00:06:21] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fpSji [00:06:22] [02miraheze/puppet] 07paladox 037fc5e02 - Update db.pp [00:06:24] [02puppet] 07paladox opened pull request 03#927: Update db.pp - 13https://git.io/fpSjP [00:06:58] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fpSj1 [00:06:59] [02miraheze/puppet] 07paladox 03947a131 - Update config.pp [00:07:01] [02puppet] 07paladox synchronize pull request 03#927: Update db.pp - 13https://git.io/fpSjP [00:07:05] [02puppet] 07paladox closed pull request 03#927: Update db.pp - 13https://git.io/fpSjP [00:07:06] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fpSjM [00:07:07] [02miraheze/puppet] 07paladox 034a27458 - Update db.pp (#927) * Update db.pp * Update config.pp [00:07:21] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1 [00:07:22] [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbiAS [00:08:06] RECOVERY - db4 Puppet on db4 is OK: OK: Puppet is currently enabled, last run 25 seconds ago with 0 failures [00:08:53] [02miraheze/puppet] 07paladox deleted branch 03icinga-refactor [00:08:54] [02puppet] 07paladox deleted branch 03icinga-refactor - 13https://git.io/vbiAS [00:10:42] [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbiAS [00:10:43] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fpSj9 [00:10:45] [02miraheze/puppet] 07paladox 03045d1b3 - Add "roundcubemail" to grants [00:11:09] [02puppet] 07paladox opened pull request 03#928: Add "roundcubemail" to grants - 13https://git.io/fpSjH [00:11:24] RECOVERY - lizardfs1 Puppet on lizardfs1 is OK: OK: Puppet is currently enabled, last run 30 seconds ago with 0 failures [00:11:32] RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [00:11:36] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 16 seconds ago with 0 failures [00:11:52] RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 42 seconds ago with 0 failures [00:11:54] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 46 seconds ago with 0 failures [00:12:00] RECOVERY - bacula1 Puppet on bacula1 is OK: OK: Puppet is currently enabled, last run 26 seconds ago with 0 failures [00:12:16] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:12:24] RECOVERY - lizardfs2 Puppet on lizardfs2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:12:35] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fpSj5 [00:12:37] [02miraheze/puppet] 07paladox 03f8b74dc - Update default-grants.sql.erb [00:12:38] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:12:38] [02puppet] 07paladox synchronize pull request 03#928: Add "roundcubemail" to grants - 13https://git.io/fpSjH [00:12:44] RECOVERY - misc3 Puppet on misc3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:12:50] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:13:03] [02puppet] 07paladox closed pull request 03#928: Add "roundcubemail" to grants - 13https://git.io/fpSjH [00:13:04] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fpSjb [00:13:06] [02miraheze/puppet] 07paladox 03ec3f79e - Add "roundcubemail" to grants (#928) * Add "roundcubemail" to grants * Update default-grants.sql.erb [00:13:07] [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbiAS [00:13:09] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1 [00:14:22] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:54:56] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fp9ff [01:54:58] [02miraheze/puppet] 07paladox 030094d1c - Set auth_username_format to %Ln This fixes roundcube mail support. [02:10:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fp9fg [02:10:14] [02miraheze/services] 07MirahezeSSLBot 034494b1c - BOT: Updating services config for wikis [02:10:28] [02ssl] 07MacFan4000 created branch 03MacFan4000-patch-1 - 13https://git.io/vxP9L [02:10:29] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-0/±1] 13https://git.io/fp9f2 [02:10:31] [02miraheze/ssl] 07MacFan4000 03490738e - Update certs.yaml [02:10:59] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-1/±0] 13https://git.io/fp9fV [02:11:01] [02miraheze/ssl] 07MacFan4000 03bf30846 - Delete saf.songcontests.eu.crt [02:11:20] [02ssl] 07MacFan4000 opened pull request 03#112: Remove a cert - 13https://git.io/fp9fw [02:11:26] [02ssl] 07MacFan4000 closed pull request 03#112: Remove a cert - 13https://git.io/fp9fw [02:11:27] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03master [+0/-1/±1] 13https://git.io/fp9fr [02:11:29] [02miraheze/ssl] 07MacFan4000 03563049e - Remove a cert (#112) * Update certs.yaml * Delete saf.songcontests.eu.crt [02:42:01] RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [03:40:13] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fp9UL [03:40:15] [02miraheze/services] 07MirahezeSSLBot 03c71666d - BOT: Updating services config for wikis [05:40:42] PROBLEM - cp5 Varnish Backends on cp5 is CRITICAL: 2 backends are down. mw1 mw3 [05:41:36] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 172.104.111.8/cpweb, 2400:8902::f03c:91ff:fe07:444e/cpweb [05:41:56] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 1 datacenter is down: 172.104.111.8/cpweb [05:42:40] RECOVERY - cp5 Varnish Backends on cp5 is OK: All 5 backends are healthy [05:43:36] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [05:43:56] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [12:03:37] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 172.104.111.8/cpweb, 2400:8902::f03c:91ff:fe07:444e/cpweb [12:03:55] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 2 datacenters are down: 172.104.111.8/cpweb, 2400:8902::f03c:91ff:fe07:444e/cpweb [12:05:13] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fp9YH [12:05:15] [02miraheze/services] 07MirahezeSSLBot 03e26fa77 - BOT: Updating services config for wikis [12:07:37] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [12:07:55] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [12:23:40] PROBLEM - cp5 Varnish Backends on cp5 is CRITICAL: 1 backends are down. mw2 [12:23:56] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 1 datacenter is down: 2400:8902::f03c:91ff:fe07:444e/cpweb [12:25:36] RECOVERY - cp5 Varnish Backends on cp5 is OK: All 5 backends are healthy [12:25:56] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [16:44:15] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fp9lt [16:44:17] [02miraheze/puppet] 07paladox 038b41d90 - Revert "users: Re enable labster shell access" This reverts commit 88276c58c666191e35f8e5f8596185080c12689b. [17:46:05] Hello psiconauta! If you have any questions feel free to ask and someone should answer soon. [17:47:02] good evening :) [17:47:14] hi sysadmin_wannabe [17:47:39] sup Reception123 [17:48:08] fine :) you? [17:49:29] great. Still messing with ManageWiki doc :) [17:50:39] adding a brief desc. for each ext [17:52:06] even though each one links to MW documentation [17:52:56] you guys support a lot of extensions. Do you measure which ones aren't being used? [18:03:01] sysadmin_wannabe: not really but we have a way to find out how many wikis have a given extension enabled [18:03:15] nice [18:04:09] you guys support unman. extensions. Is it worth? Perhaps, some are not being used [18:04:36] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+5/-0/±1] 13https://git.io/fp9B3 [18:04:37] [02miraheze/puppet] 07paladox 032fe6999 - Initial import of roundcubemail module ref T3874 Also enable it on misc1 [18:07:31] PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [18:07:51] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fp9Bc [18:07:53] [02miraheze/puppet] 07paladox 034697138 - Fix Duplicate declaration: Ufw::Allow[icinga2 http] [18:07:56] what are the most used extensions? besides VE and Flow [18:13:32] ex: Extension:News [18:13:45] are uses that? [18:13:52] *who uses that [18:14:13] not many I would guess [18:31:27] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fp9BN [18:31:29] [02miraheze/puppet] 07paladox 03f7d7b0e - Remove duplicate resources [18:33:26] RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 34 seconds ago with 0 failures [18:34:16] PROBLEM - misc1 webmail.miraheze.org HTTPS on misc1 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 189 bytes in 0.016 second response time [18:34:46] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fp9Bh [18:34:47] [02miraheze/puppet] 07paladox 0388f2d91 - Fix roundcubemail config [18:40:53] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fp9Rq [18:40:55] [02miraheze/puppet] 07paladox 03b87f00a - Fix syntax error [18:42:09] PROBLEM - misc1 webmail.miraheze.org HTTPS on misc1 is WARNING: HTTP WARNING: HTTP/1.1 401 Unauthorized - 5607 bytes in 0.035 second response time [19:21:47] PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 1 backends are down. mw3 [19:22:03] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 1 datacenter is down: 2400:8902::f03c:91ff:fe07:444e/cpweb [19:23:46] RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy [19:24:03] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [20:01:58] !log root@mw1:/srv/mediawiki/w/maintenance# php deleteBatch.php --wiki=nonsensopediawiki text [20:02:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [23:06:43] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+23/-15/±64] 13https://git.io/fp9wp [23:06:44] [02miraheze/puppet] 07paladox 0312159fb - Update stdlib to 4.25.1 * Also split some parser functions that are not apart of stdlib into "mlib" based on wmflib [1] [1] https://github.com/wikimedia/puppet/tree/production/modules/stdlib [23:06:45] Title: [ puppet/modules/stdlib at production · wikimedia/puppet · GitHub ] - github.com [23:10:27] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:12:25] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:12:33] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±9] 13https://git.io/fp9rq [23:12:35] [02miraheze/puppet] 07paladox 03eccb68f - Fix puppet type names used through the puppet repo [23:12:45] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:12:55] PROBLEM - misc4 Puppet on misc4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:13:05] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:13:25] PROBLEM - misc3 Puppet on misc3 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:13:27] PROBLEM - bacula1 Puppet on bacula1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:13:35] PROBLEM - lizardfs2 Puppet on lizardfs2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:13:43] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:13:45] PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:13:55] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/fp9r3 [23:13:57] PROBLEM - misc2 Puppet on misc2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:13:57] [02miraheze/puppet] 07paladox 03c58bf9c - Fix puppet type names used part 2 [23:13:59] PROBLEM - lizardfs1 Puppet on lizardfs1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:14:11] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:14:13] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:14:29] PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:14:44] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fp9rG [23:14:46] [02miraheze/puppet] 07paladox 036f550a9 - Fix puppet type names used part 3 [23:14:51] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:19:10] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±5] 13https://git.io/fp9r0 [23:19:12] [02miraheze/puppet] 07paladox 03ae9e4df - Fix puppet type names used part 4 [23:20:27] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 53 seconds ago with 0 failures [23:21:35] RECOVERY - lizardfs2 Puppet on lizardfs2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:21:45] RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 58 seconds ago with 0 failures [23:21:58] RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:21:59] RECOVERY - lizardfs1 Puppet on lizardfs1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:22:11] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:22:25] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:23:06] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:23:42] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 34 seconds ago with 0 failures [23:38:56] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/fp9oT [23:38:58] [02miraheze/puppet] 07paladox 0374f575d - Add ensure_resource_duplicate parser function This is based on ensure_resource in the stdlib. But only different is this will not fail on a duplicate resource. [23:41:07] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fp9om [23:41:09] [02miraheze/puppet] 07paladox 03be6b978 - Use ensure_resource_duplicate in role roundcubemail [23:42:22] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fp9os [23:42:23] [02miraheze/puppet] 07paladox 0374442ef - Update node_gdnsd.pp [23:46:12] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fp9oB [23:46:14] [02miraheze/puppet] 07paladox 037b8c8d6 - Update ensure_resource_duplicate.rb [23:46:29] RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:50:29] PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [23:50:45] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 17 seconds ago with 0 failures