[04:08:00] 10Cloud-Services, 10DBA: Prepare and check storage layer for hif.wiktionary - https://phabricator.wikimedia.org/T173647#3535715 (10Jayprakash12345) [04:08:16] 10Cloud-Services, 10DBA: Prepare and check storage layer for hif.wiktionary - https://phabricator.wikimedia.org/T173647#3535715 (10Jayprakash12345) p:05Normal>03Low [04:11:44] 10VPS-project-Wikistats: Add hif.wiktionary to wikistats - https://phabricator.wikimedia.org/T173648#3535730 (10Jayprakash12345) [08:14:55] 10Tools, 10Wikisource: Create the front-end of Tools for the Wikisouce Anniversary Proofreading Contest - https://phabricator.wikimedia.org/T163060#3535874 (10jayantanth) a:03Pmlineditor [08:20:46] PROBLEM - Puppet errors on tools-exec-1437 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [09:00:44] RECOVERY - Puppet errors on tools-exec-1437 is OK: OK: Less than 1.00% above the threshold [0.0] [10:05:29] PROBLEM - Puppet errors on tools-webgrid-lighttpd-1418 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [10:40:26] RECOVERY - Puppet errors on tools-webgrid-lighttpd-1418 is OK: OK: Less than 1.00% above the threshold [0.0] [11:09:21] 10VPS-project-Wikistats: Add hif.wiktionary to wikistats - https://phabricator.wikimedia.org/T173648#3536060 (10Aklapper) [11:09:25] 10VPS-project-Wikistats: Add hif.wiktionary to wikistats - https://phabricator.wikimedia.org/T173648#3535730 (10Aklapper) [13:50:59] Is there a simple way to count the number of indef blocks a user has? https://meta.wikimedia.org/wiki/Special:CentralAuth/L%C3%BAcia_Amadeu seems to indicate its stored somewhere [13:52:01] SELECT * FROM centralauth_p.globalblocks WHERE gb_address NOT LIKE "%.%" AND gb_address NOT LIKE "%:%" LIMIT 5; Yields no results [16:15:45] PROBLEM - Puppet errors on tools-webgrid-lighttpd-1416 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [16:45:45] RECOVERY - Puppet errors on tools-webgrid-lighttpd-1416 is OK: OK: Less than 1.00% above the threshold [0.0] [16:51:37] 10PAWS: Debugging notebook cell action/state - https://phabricator.wikimedia.org/T173416#3527551 (10yuvipanda) It's possible that you just ran out of RAM and the kernel died? I think we have a 1G memory limit... [17:24:05] 10Data-Services, 10DC-Ops, 10Operations: Split up labstore external shelf storage available in codfw between labstore2001 and 2 - https://phabricator.wikimedia.org/T171623#3536348 (10madhuvishy) @Papaul Aah, sorry, I had pinged you on the task and didn't know about adding to the ops-codfw board, I'll definit... [17:24:17] 10Data-Services, 10DC-Ops, 10Operations, 10ops-codfw: Split up labstore external shelf storage available in codfw between labstore2001 and 2 - https://phabricator.wikimedia.org/T171623#3536349 (10madhuvishy) [19:16:46] PROBLEM - Puppet errors on tools-webgrid-lighttpd-1416 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [19:47:37] 10Toolforge: Tool Labs membership has a huge backlog - https://phabricator.wikimedia.org/T173674#3536421 (10PokestarFan) [19:47:53] 10Toolforge: Tool Labs membership has a huge backlog - https://phabricator.wikimedia.org/T173674#3536433 (10PokestarFan) p:05Triage>03Low [20:16:45] RECOVERY - Puppet errors on tools-webgrid-lighttpd-1416 is OK: OK: Less than 1.00% above the threshold [0.0] [23:58:24] 10Toolforge: Tool Labs membership has a huge backlog - https://phabricator.wikimedia.org/T173674#3536588 (10madhuvishy) 05Open>03Resolved a:03madhuvishy I've either approved or followed up on all current open requests.