[00:37:54] zhuyifei1999_: I'm happy to add people and teams to the new toolforge org :) [00:38:46] PROBLEM - Puppet errors on tools-exec-1438 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [00:41:14] bd808: well, idk about the 'tool-labs' org, but 'toollabs' org is sort of like everyone-is-admin type [00:43:35] idk if that fits if we are going to invite a lot of people here [00:43:57] btw what's the org repo creation policy at github? [00:47:34] https://help.github.com/articles/repository-permission-levels-for-an-organization/ hmm [00:57:23] the only thing that does not really look self-served: only owners can invite [01:02:40] bd808: could you invite me, Steinsplitter, FDMS? I'll move some of mine [01:05:13] and can we not use this 'tool-' prefix? I find it very redundant [01:13:43] RECOVERY - Puppet errors on tools-exec-1438 is OK: OK: Less than 1.00% above the threshold [0.0] [02:45:14] PROBLEM - Puppet errors on tools-exec-1418 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [03:20:13] RECOVERY - Puppet errors on tools-exec-1418 is OK: OK: Less than 1.00% above the threshold [0.0] [04:18:12] (03PS2) 10Lokal Profil: Handle sparql http timeout issue [labs/tools/heritage] (wikidata) - 10https://gerrit.wikimedia.org/r/371602 (https://phabricator.wikimedia.org/T172690) [04:32:53] is there a better way to create a repository on diffusion than creating a dummy tool I don't intend to use? [04:57:34] PROBLEM - Puppet errors on tools-exec-1429 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [05:16:58] legoatm: is there a "create repository" button for you on the top right here? https://phabricator.wikimedia.org/diffusion/ [05:17:10] yes [05:17:14] am I allowed to use that? [05:17:39] you're in https://phabricator.wikimedia.org/project/members/85/ so yeah [05:17:52] (#repo-admins) [05:18:01] alright, I'll try that when I'm awake then ;) [05:18:03] thanks [05:18:06] wod [05:18:07] +r [05:18:09] g'night [05:27:35] RECOVERY - Puppet errors on tools-exec-1429 is OK: OK: Less than 1.00% above the threshold [0.0] [08:20:40] PROBLEM - ToolLabs Home Page on toollabs is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:25:27] RECOVERY - ToolLabs Home Page on toollabs is OK: HTTP OK: HTTP/1.1 200 OK - 4888 bytes in 0.025 second response time [09:16:38] PROBLEM - ToolLabs Home Page on toollabs is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:21:27] RECOVERY - ToolLabs Home Page on toollabs is OK: HTTP OK: HTTP/1.1 200 OK - 4888 bytes in 0.040 second response time [09:36:01] PROBLEM - Puppet errors on tools-worker-1020 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [09:57:38] PROBLEM - ToolLabs Home Page on toollabs is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:07:25] RECOVERY - ToolLabs Home Page on toollabs is OK: HTTP OK: HTTP/1.1 200 OK - 4888 bytes in 0.025 second response time [10:11:00] RECOVERY - Puppet errors on tools-worker-1020 is OK: OK: Less than 1.00% above the threshold [0.0] [12:48:35] PROBLEM - ToolLabs Home Page on toollabs is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:52:36] Home page is up for me...not sure what is actually flapping yet [12:53:29] RECOVERY - ToolLabs Home Page on toollabs is OK: HTTP OK: HTTP/1.1 200 OK - 4888 bytes in 0.036 second response time [12:54:24] Still on the grid so will move to k8s in a minute to see what happens. Gotta coffee first. [13:03:13] "Coffee.... it let you do stupid things with more energy" xD [13:26:27] !log tools.admin webservice --backend=gridengine stop && webservice --backend=kubernetes start [13:26:30] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.admin/SAL [13:29:01] 10Data-Services, 10DBA: Prepare and check storage layer for hi.wikiversity - https://phabricator.wikimedia.org/T171829#3477438 (10chasemp) We are all either at wikimania or on vacation, I expect this will be addressed in the coming week. :) [14:07:01] zhuyifei1999_: invites sent. I marked you as an org admin. Feel free to adjust the rights of others as needed too. [14:18:07] 10Cloud-Services, 10Wikimania-Hackathon-2017: History & Purpose of Wikimedia Cloud Services @ Wikimania Hackathon - https://phabricator.wikimedia.org/T170833#3522187 (10bd808) It would be nice to track down the video from this session and get it posted on wikitech/commons. I poked around a bit on the wikimania... [14:42:50] 10Cloud-Services, 10Wikimania-Hackathon-2017: History & Purpose of Wikimedia Cloud Services @ Wikimania Hackathon - https://phabricator.wikimedia.org/T170833#3522235 (10bcampbell) @bd808 I'm uploading them to the MediaWiki YouTube channel as I have time to edit them. I'll upload them all to Commons when I retu... [15:06:34] 10Toolforge, 10User-Urbanecm: Allow tool's maintainers to force HTTPS for their tool - https://phabricator.wikimedia.org/T163019#3522294 (10bd808) [15:10:54] 10Toolforge, 10User-Urbanecm: Allow tool's maintainers to force HTTPS for their tool - https://phabricator.wikimedia.org/T163019#3522312 (10bd808) [15:11:23] 10Toolforge, 10User-Urbanecm: Allow tool's maintainers to force HTTPS for their tool - https://phabricator.wikimedia.org/T163019#3183510 (10bd808) [15:58:25] !log striker Hacked keystone admin endpoint config manually -- openstack endpoint set --url http://striker-deploy03.striker.eqiad.wmflabs:5000/v3/ 35205d049ccc4235a7e165bae9632ee0 [15:58:28] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Striker/SAL [16:04:12] 10Striker: Groups and tools only refreshed at login - https://phabricator.wikimedia.org/T144943#3522508 (10bd808) This is especially annoying/confusing when a user is first granted access to the tools project itself. Striker will tell you that you are approved with a notice, but then you still see the non-member... [16:19:15] 10Cloud-Services, 10Wikimania-Hackathon-2017: History & Purpose of Wikimedia Cloud Services @ Wikimania Hackathon - https://phabricator.wikimedia.org/T170833#3522536 (10bd808) >>! In T170833#3522235, @bcampbell wrote: > @bd808 I'm uploading them to the MediaWiki YouTube channel as I have time to edit them. I'l... [16:20:53] 10Cloud-Services, 10Wikimania-Hackathon-2017: History & Purpose of Wikimedia Cloud Services @ Wikimania Hackathon - https://phabricator.wikimedia.org/T170833#3522541 (10bcampbell) Thanks @bd808 [18:45:27] (03CR) 10BryanDavis: [C: 032] Add toolinfo.json style data [labs/striker] - 10https://gerrit.wikimedia.org/r/353909 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [18:45:35] (03CR) 10BryanDavis: [C: 032] Add support for "tagging" toolinfo records [labs/striker] - 10https://gerrit.wikimedia.org/r/358505 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [18:45:43] (03CR) 10BryanDavis: [C: 032] Expose all toolinfo data for indexing [labs/striker] - 10https://gerrit.wikimedia.org/r/358506 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [18:45:50] (03CR) 10BryanDavis: [C: 032] Upgrade parsley.js to v2.7.2 [labs/striker] - 10https://gerrit.wikimedia.org/r/364132 (owner: 10BryanDavis) [18:45:57] (03CR) 10BryanDavis: [C: 032] Create new tools [labs/striker] - 10https://gerrit.wikimedia.org/r/364133 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [18:46:07] (03CR) 10BryanDavis: [C: 032] Update to use Toolforge branding [labs/striker] - 10https://gerrit.wikimedia.org/r/364134 (https://phabricator.wikimedia.org/T168480) (owner: 10BryanDavis) [18:46:15] (03CR) 10BryanDavis: [C: 032] Manage tool maintainers [labs/striker] - 10https://gerrit.wikimedia.org/r/364135 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [18:46:23] (03CR) 10BryanDavis: [C: 032] Refactor striker.tools.views [labs/striker] - 10https://gerrit.wikimedia.org/r/364136 (owner: 10BryanDavis) [18:46:30] (03CR) 10BryanDavis: [C: 032] Tools LDAP model migrations [labs/striker] - 10https://gerrit.wikimedia.org/r/364138 (owner: 10BryanDavis) [18:46:38] (03CR) 10BryanDavis: [C: 032] Check to see if ssh key is a duplicate [labs/striker] - 10https://gerrit.wikimedia.org/r/364139 (https://phabricator.wikimedia.org/T167931) (owner: 10BryanDavis) [18:46:45] (03CR) 10BryanDavis: [C: 032] Show message when duplicate SUL attach occurs [labs/striker] - 10https://gerrit.wikimedia.org/r/364140 (https://phabricator.wikimedia.org/T164847) (owner: 10BryanDavis) [18:47:04] (03CR) 10BryanDavis: [C: 032] Change ToolInfo authors to list of strings [labs/striker] - 10https://gerrit.wikimedia.org/r/370134 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [18:47:13] (03CR) 10BryanDavis: [C: 032] Encode toolinfo.json as utf8 [labs/striker] - 10https://gerrit.wikimedia.org/r/370135 (owner: 10BryanDavis) [18:47:19] (03CR) 10BryanDavis: [C: 032] Change default mysql collation to utf8mb4_unicode_ci [labs/striker] - 10https://gerrit.wikimedia.org/r/370143 (owner: 10BryanDavis) [18:47:24] (03CR) 10BryanDavis: [C: 032] Fix author tracking for toolinfo create/edit [labs/striker] - 10https://gerrit.wikimedia.org/r/371504 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [18:47:28] (03CR) 10BryanDavis: [C: 032] Use renamed Maintainer.cn attribute [labs/striker] - 10https://gerrit.wikimedia.org/r/371518 (owner: 10BryanDavis) [18:47:32] (03Merged) 10jenkins-bot: Add toolinfo.json style data [labs/striker] - 10https://gerrit.wikimedia.org/r/353909 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [18:47:37] (03CR) 10BryanDavis: [C: 032] Use new Toolforge logo and favicon [labs/striker] - 10https://gerrit.wikimedia.org/r/371645 (https://phabricator.wikimedia.org/T168480) (owner: 10BryanDavis) [18:47:39] (03Merged) 10jenkins-bot: Add support for "tagging" toolinfo records [labs/striker] - 10https://gerrit.wikimedia.org/r/358505 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [18:47:41] (03Merged) 10jenkins-bot: Expose all toolinfo data for indexing [labs/striker] - 10https://gerrit.wikimedia.org/r/358506 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [18:47:48] (03Merged) 10jenkins-bot: Upgrade parsley.js to v2.7.2 [labs/striker] - 10https://gerrit.wikimedia.org/r/364132 (owner: 10BryanDavis) [18:47:56] (03Merged) 10jenkins-bot: Create new tools [labs/striker] - 10https://gerrit.wikimedia.org/r/364133 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [18:48:45] (03Merged) 10jenkins-bot: Update to use Toolforge branding [labs/striker] - 10https://gerrit.wikimedia.org/r/364134 (https://phabricator.wikimedia.org/T168480) (owner: 10BryanDavis) [18:48:52] (03Merged) 10jenkins-bot: Manage tool maintainers [labs/striker] - 10https://gerrit.wikimedia.org/r/364135 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [18:48:56] (03CR) 10jerkins-bot: [V: 04-1] Refactor striker.tools.views [labs/striker] - 10https://gerrit.wikimedia.org/r/364136 (owner: 10BryanDavis) [18:48:58] (03CR) 10jerkins-bot: [V: 04-1] Tools LDAP model migrations [labs/striker] - 10https://gerrit.wikimedia.org/r/364138 (owner: 10BryanDavis) [18:49:00] (03CR) 10jerkins-bot: [V: 04-1] Check to see if ssh key is a duplicate [labs/striker] - 10https://gerrit.wikimedia.org/r/364139 (https://phabricator.wikimedia.org/T167931) (owner: 10BryanDavis) [18:49:03] (03CR) 10jerkins-bot: [V: 04-1] Show message when duplicate SUL attach occurs [labs/striker] - 10https://gerrit.wikimedia.org/r/364140 (https://phabricator.wikimedia.org/T164847) (owner: 10BryanDavis) [18:49:05] (03CR) 10jerkins-bot: [V: 04-1] Phabricator: replace maniphest.update with maniphest.edit [labs/striker] - 10https://gerrit.wikimedia.org/r/364144 (https://phabricator.wikimedia.org/T159044) (owner: 10BryanDavis) [18:49:06] (03CR) 10jerkins-bot: [V: 04-1] Change ToolInfo authors to list of strings [labs/striker] - 10https://gerrit.wikimedia.org/r/370134 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [18:49:08] (03CR) 10jerkins-bot: [V: 04-1] Encode toolinfo.json as utf8 [labs/striker] - 10https://gerrit.wikimedia.org/r/370135 (owner: 10BryanDavis) [18:49:11] (03CR) 10jerkins-bot: [V: 04-1] Change default mysql collation to utf8mb4_unicode_ci [labs/striker] - 10https://gerrit.wikimedia.org/r/370143 (owner: 10BryanDavis) [18:49:13] (03CR) 10jerkins-bot: [V: 04-1] Fix author tracking for toolinfo create/edit [labs/striker] - 10https://gerrit.wikimedia.org/r/371504 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [18:49:15] (03CR) 10jerkins-bot: [V: 04-1] Use renamed Maintainer.cn attribute [labs/striker] - 10https://gerrit.wikimedia.org/r/371518 (owner: 10BryanDavis) [18:49:17] (03CR) 10jerkins-bot: [V: 04-1] Use new Toolforge logo and favicon [labs/striker] - 10https://gerrit.wikimedia.org/r/371645 (https://phabricator.wikimedia.org/T168480) (owner: 10BryanDavis) [18:56:22] the magical jerkins bot says no [18:57:20] (03CR) 10Luke081515: "recheck" [labs/striker] - 10https://gerrit.wikimedia.org/r/364136 (owner: 10BryanDavis) [18:58:41] bd808: that looks like a CI-error to me, the git fetch failed. try it again? [18:59:10] (I can't trigger the gate pipeline again without +2) [19:09:04] (03PS2) 10BryanDavis: Refactor striker.tools.views [labs/striker] - 10https://gerrit.wikimedia.org/r/364136 [19:09:06] (03PS2) 10BryanDavis: Tools LDAP model migrations [labs/striker] - 10https://gerrit.wikimedia.org/r/364138 [19:09:08] (03PS3) 10BryanDavis: Check to see if ssh key is a duplicate [labs/striker] - 10https://gerrit.wikimedia.org/r/364139 (https://phabricator.wikimedia.org/T167931) [19:09:10] (03PS2) 10BryanDavis: Show message when duplicate SUL attach occurs [labs/striker] - 10https://gerrit.wikimedia.org/r/364140 (https://phabricator.wikimedia.org/T164847) [19:09:12] (03PS2) 10BryanDavis: Phabricator: replace maniphest.update with maniphest.edit [labs/striker] - 10https://gerrit.wikimedia.org/r/364144 (https://phabricator.wikimedia.org/T159044) [19:09:14] (03PS3) 10BryanDavis: Change ToolInfo authors to list of strings [labs/striker] - 10https://gerrit.wikimedia.org/r/370134 (https://phabricator.wikimedia.org/T149458) [19:09:16] (03PS3) 10BryanDavis: Encode toolinfo.json as utf8 [labs/striker] - 10https://gerrit.wikimedia.org/r/370135 [19:09:18] (03PS3) 10BryanDavis: Change default mysql collation to utf8mb4_unicode_ci [labs/striker] - 10https://gerrit.wikimedia.org/r/370143 [19:09:20] (03PS2) 10BryanDavis: Fix author tracking for toolinfo create/edit [labs/striker] - 10https://gerrit.wikimedia.org/r/371504 (https://phabricator.wikimedia.org/T149458) [19:09:22] (03PS2) 10BryanDavis: Use renamed Maintainer.cn attribute [labs/striker] - 10https://gerrit.wikimedia.org/r/371518 [19:10:05] (03PS2) 10BryanDavis: Use new Toolforge logo and favicon [labs/striker] - 10https://gerrit.wikimedia.org/r/371645 (https://phabricator.wikimedia.org/T168480) [19:17:28] * bd808 smacks jerkins with a fluffy goat [19:28:33] (03CR) 10BryanDavis: [C: 032] Add new wheels [labs/striker/wheels] - 10https://gerrit.wikimedia.org/r/371036 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [19:28:39] (03Merged) 10jenkins-bot: Add new wheels [labs/striker/wheels] - 10https://gerrit.wikimedia.org/r/371036 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [19:28:44] (03CR) 10BryanDavis: [C: 032] Update static assets [labs/striker/staticfiles] - 10https://gerrit.wikimedia.org/r/364360 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [19:28:51] (03Merged) 10jenkins-bot: Update static assets [labs/striker/staticfiles] - 10https://gerrit.wikimedia.org/r/364360 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [19:33:01] (03PS1) 10Lokal Profil: Investigate harvest of large wikidata dataset [labs/tools/heritage] (wikidata) - 10https://gerrit.wikimedia.org/r/371744 (https://phabricator.wikimedia.org/T172691) [19:38:39] (03PS4) 10BryanDavis: Tool account creation and more [labs/striker/deploy] - 10https://gerrit.wikimedia.org/r/370139 (https://phabricator.wikimedia.org/T128400) [19:43:23] (03PS1) 10Lokal Profil: Removing invalid namespace and non-existent parameter [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/371745 [19:48:14] !log striker Cherry-picked 370139 fro final testing [19:48:16] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Striker/SAL [20:13:16] !log striker Got a clean scap3 deploy after manually deleting __pycache__ directories on deploy target [20:13:18] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Striker/SAL [20:16:22] bd808: can you check fluorine's titleblacklist log for me? [20:16:29] on Meta-Wiki [20:17:49] TabbyCat: what am I looking for? [20:18:09] bd808: any recent entry by Martin Urbanec [20:18:26] looking at why he cannot upload files when he's got rights to do so [20:19:47] if you could PM the results to me I'd appreciate it, in case there's something private [20:20:00] or [redact] it [20:20:04] TabbyCat: I can't find a logfile that is recording blacklist reasons [20:20:21] we probably don't normally log that channel [20:20:32] hmm... there should be a spamblacklist log and a titleblacklist log [20:20:46] Reedy: where are titleblacklist hits logged? [20:20:55] Dunno [20:21:00] sigh :( [20:21:13] we have TitleBlacklist-cache.log saved, but not just titleblacklist... [20:21:22] yeah [20:21:28] it's on mwlog1001 [20:21:42] 2017-08-13 20:21:26 [WZC0xgpAMFoAAKQuDA8AAAAW] mw1255 nowiktionary 1.30.0-wmf.13 TitleBlacklist-cache INFO: Updated nowiktionary:title_blacklist_entries with 548 entries. [20:21:42] 2017-08-13 20:21:28 [WZC0yApAIDsAADZaBOAAAAEW] mw1189 urwiki 1.30.0-wmf.13 TitleBlacklist-cache INFO: Updated urwiki:title_blacklist_entries with 653 entries. [20:21:42] 2017-08-13 20:21:30 [WZC0ygpAMCUAAEf30oQAAAAC] mw1209 frwiki 1.30.0-wmf.13 TitleBlacklist-cache INFO: Updated frwiki:title_blacklist_entries with 568 entries. [20:21:44] Nothing useful [20:23:19] could maybe have him use https://wikitech.wikimedia.org/wiki/X-Wikimedia-Debug and upload via a test server with verbose logging turned on [20:23:28] per https://gerrit.wikimedia.org/r/#/c/138684/ I guess legoktm knows where hits are logged? [20:24:05] IIRC they logged somewhere [20:24:53] No [20:24:57] That means they should be logged [20:25:05] But there's no log channel defined [20:25:06] So they don't go anywhere [20:28:31] that patch isn't actually in mw-config now either [20:28:56] x-wikimedia-debug is probably your best bet [20:36:39] bd808: Urbanecm didn't had it enabled [20:36:59] so https://gerrit.wikimedia.org/r/#/c/123128/ created the posibility to log the hits, but it's not enabled [20:37:15] maybe we should send those hits to some server log [20:37:20] meanwhile [20:48:24] those are on-wiki logs, not debug logging [20:48:27] TabbyCat: title blacklist log was never enabled [20:49:01] legoatm: and hits are not reported internally anywhere either? [20:49:20] Probably not. [20:49:42] but spamblacklist log hits did, even before the /spamblacklist log IIRC [20:49:50] Hmmm yeah [20:50:02] But title blacklist is used as protection [20:50:23] looks like a valid request to have that data sent to fluorine for debugging and other stuff [20:50:38] or so I think [20:50:42] could be wrong [20:51:04] There are too many false positives I think [20:51:19] Because TB can get triggered on GET it doesn't require user action [20:53:49] not privy to the internals of how the extension work sadly, will trust you on that :) [21:36:35] 10PAWS: Installing R packages fails. Directory not write-able - https://phabricator.wikimedia.org/T173278#3523053 (10Halfak) [22:45:29] !log rcm CAC: vagrant git-update [22:45:31] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Rcm/SAL