[00:06:20] (03PS2) 10Lokal Profil: [WIP]Group unused images per source page [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379141 (https://phabricator.wikimedia.org/T117327) [00:08:05] (03CR) 10jerkins-bot: [V: 04-1] [WIP]Group unused images per source page [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379141 (https://phabricator.wikimedia.org/T117327) (owner: 10Lokal Profil) [00:17:24] (03PS5) 10Lokal Profil: Add mechanism for storing wikipage locally instead of writing to wiki [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378800 (https://phabricator.wikimedia.org/T174614) [00:17:26] (03PS2) 10Lokal Profil: Harvest the source page of unknown fields [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379126 (https://phabricator.wikimedia.org/T117330) [00:18:42] (03CR) 10Lokal Profil: "Also updated the preview on Commons" (031 comment) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379126 (https://phabricator.wikimedia.org/T117330) (owner: 10Lokal Profil) [00:21:12] (03CR) 10Lokal Profil: "https://gerrit.wikimedia.org/r/#/c/379141/2 handles a sparql hiccup for unused images (final statistics expected rowTemplate field)" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378982 (owner: 10Jean-Frédéric) [00:22:51] (03PS3) 10Lokal Profil: [WIP]Group unused images per source page [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379141 (https://phabricator.wikimedia.org/T117327) [00:32:14] PROBLEM - Puppet errors on tools-exec-1441 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [00:44:47] PROBLEM - Puppet errors on tools-exec-1412 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [00:52:50] 10Data-Services, 10DBA: Grant tool "tool-db-usage" (s53508) ability to read full table_schema.TABLES contents - https://phabricator.wikimedia.org/T176381#3623376 (10bd808) [01:12:15] RECOVERY - Puppet errors on tools-exec-1441 is OK: OK: Less than 1.00% above the threshold [0.0] [01:40:16] PROBLEM - Puppet errors on tools-exec-1424 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [01:49:45] RECOVERY - Puppet errors on tools-exec-1412 is OK: OK: Less than 1.00% above the threshold [0.0] [02:20:15] RECOVERY - Puppet errors on tools-exec-1424 is OK: OK: Less than 1.00% above the threshold [0.0] [03:42:42] PROBLEM - Puppet errors on tools-exec-1408 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [04:00:33] 10Striker: "No Phabricator accounts found for tool maintainers." while creating the a new diffusion repository - https://phabricator.wikimedia.org/T176325#3623550 (10Yashasingh) Thank you for your support. I found that my phabricator account was linked with mediawiki account but not via LDAP account. I resolved... [04:03:07] 10Striker: "No Phabricator accounts found for tool maintainers." while creating the a new diffusion repository - https://phabricator.wikimedia.org/T176325#3623551 (10bd808) >>! In T176325#3623550, @Yashasingh wrote: > I resolved the issue by linking phabricator account with LDAP account. This is definitely a bu... [04:23:36] PROBLEM - Puppet errors on tools-exec-1429 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [04:29:30] 10Data-Services, 10DBA: Grant tool "tool-db-usage" (s53508) ability to read full table_schema.TABLES contents - https://phabricator.wikimedia.org/T176381#3623556 (10bd808) ``` +-----------------------------------------------------------------+ | Grants for s53508@% |... [04:37:42] RECOVERY - Puppet errors on tools-exec-1408 is OK: OK: Less than 1.00% above the threshold [0.0] [04:58:35] RECOVERY - Puppet errors on tools-exec-1429 is OK: OK: Less than 1.00% above the threshold [0.0] [05:20:46] PROBLEM - Puppet errors on tools-exec-1412 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [06:15:07] 10Data-Services: Add api_url to meta_p.wiki database - https://phabricator.wikimedia.org/T93483#3623587 (10Krenair) I agree that it should be script_path and not api_url [06:20:46] RECOVERY - Puppet errors on tools-exec-1412 is OK: OK: Less than 1.00% above the threshold [0.0] [06:43:34] PROBLEM - Puppet errors on tools-worker-1026 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [07:18:33] RECOVERY - Puppet errors on tools-worker-1026 is OK: OK: Less than 1.00% above the threshold [0.0] [07:47:48] PROBLEM - Puppet errors on tools-exec-1412 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [08:22:45] RECOVERY - Puppet errors on tools-exec-1412 is OK: OK: Less than 1.00% above the threshold [0.0] [09:18:47] PROBLEM - Puppet errors on tools-exec-1412 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [10:16:10] (03PS4) 10Lokal Profil: [WIP]Group unused images per source page [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379141 (https://phabricator.wikimedia.org/T117327) [10:23:47] RECOVERY - Puppet errors on tools-exec-1412 is OK: OK: Less than 1.00% above the threshold [0.0] [10:50:55] PROBLEM - Puppet errors on tools-webgrid-generic-1401 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [10:53:37] 10Tools: [Flickr2Commons] File uploads need to recognise urls on blacklist early in the process - https://phabricator.wikimedia.org/T157436#3623939 (10Pigsonthewing) 05Invalid>03Open @Aklapper Reopened, as this is not about Flickr2Commons (despite the edit someone made to the title), which was mentioned on... [11:25:56] RECOVERY - Puppet errors on tools-webgrid-generic-1401 is OK: OK: Less than 1.00% above the threshold [0.0] [11:33:57] PROBLEM - Puppet errors on tools-worker-1020 is CRITICAL: CRITICAL: 14.29% of data above the critical threshold [0.0] [12:13:59] RECOVERY - Puppet errors on tools-worker-1020 is OK: OK: Less than 1.00% above the threshold [0.0] [12:19:46] PROBLEM - Puppet errors on tools-exec-1412 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [13:19:47] RECOVERY - Puppet errors on tools-exec-1412 is OK: OK: Less than 1.00% above the threshold [0.0] [14:07:32] 10Cloud-Services, 10cloud-services-team (Kanban), 10Patch-For-Review: Investigate and implement alternative for showmount based check at instance boot time - https://phabricator.wikimedia.org/T171508#3624462 (10MoritzMuehlenhoff) The difference between "account" and "auth" is that the auth step ensures that... [14:11:02] (03PS1) 10Elukey: Add tlsproxy fake credentials for Druid [labs/private] - 10https://gerrit.wikimedia.org/r/379538 (https://phabricator.wikimedia.org/T176223) [14:11:21] (03CR) 10Elukey: [V: 032 C: 032] Add tlsproxy fake credentials for Druid [labs/private] - 10https://gerrit.wikimedia.org/r/379538 (https://phabricator.wikimedia.org/T176223) (owner: 10Elukey) [14:19:43] (03PS1) 10Elukey: Rename druid worker hieradata config [labs/private] - 10https://gerrit.wikimedia.org/r/379540 (https://phabricator.wikimedia.org/T176223) [14:19:57] (03CR) 10Elukey: [V: 032 C: 032] Rename druid worker hieradata config [labs/private] - 10https://gerrit.wikimedia.org/r/379540 (https://phabricator.wikimedia.org/T176223) (owner: 10Elukey) [14:35:21] (03PS1) 10Elukey: Add fake TLS private key for druid.svc.eqiad.wmnet [labs/private] - 10https://gerrit.wikimedia.org/r/379543 (https://phabricator.wikimedia.org/T176223) [14:35:36] (03CR) 10Elukey: [V: 032 C: 032] Add fake TLS private key for druid.svc.eqiad.wmnet [labs/private] - 10https://gerrit.wikimedia.org/r/379543 (https://phabricator.wikimedia.org/T176223) (owner: 10Elukey) [14:39:57] (03PS1) 10Elukey: Rename the druid fake SSL key [labs/private] - 10https://gerrit.wikimedia.org/r/379544 (https://phabricator.wikimedia.org/T176223) [14:40:08] (03CR) 10Elukey: [V: 032 C: 032] Rename the druid fake SSL key [labs/private] - 10https://gerrit.wikimedia.org/r/379544 (https://phabricator.wikimedia.org/T176223) (owner: 10Elukey) [14:45:46] PROBLEM - Puppet errors on tools-exec-1412 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [14:48:11] !log debdeploy deleting all instances in the debdeploy project [14:48:14] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Debdeploy/SAL [14:52:14] !log debdeploy deleting project as per Moritz's request. [14:52:16] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Debdeploy/SAL [15:16:52] Cyberpower678: musikanimal: One of the very large users of disk space on our db servers is 's51187__xtools_tmp' — does that '_tmp' mean that that db can just be deleted? [15:17:20] there's supposed to be a script that deletes old tables [15:17:22] lemme check [15:18:26] It's about 10G — I have no idea if that's a reasonable size or not. [15:19:01] I've just changed the script to delete tables over 3 days old instead of 1 week [15:19:19] this is for the legacy Edit Counter, by the way. It's days are numbered [15:20:48] RECOVERY - Puppet errors on tools-exec-1412 is OK: OK: Less than 1.00% above the threshold [0.0] [15:21:54] musikanimal: ok, so I should expect to see that _tmp database shrink but not disappear entirely, is that right? [15:22:11] correct [15:22:13] for now, that is! [15:22:24] sounds good — thanks for changing that. [15:22:25] hopefully in maybe 2-3 weeks we'll be done with the old XTools [15:22:27] np [15:25:08] PROBLEM - Puppet errors on tools-exec-1407 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [15:28:37] PROBLEM - Puppet errors on tools-exec-1411 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [15:52:04] (03Draft1) 10Paladox: Update for icinga 2.7.1 [labs/icinga2] - 10https://gerrit.wikimedia.org/r/379554 [15:52:07] (03PS2) 10Paladox: Update for icinga 2.7.1 [labs/icinga2] - 10https://gerrit.wikimedia.org/r/379554 [15:52:10] (03CR) 10Paladox: [V: 032 C: 032] Update for icinga 2.7.1 [labs/icinga2] - 10https://gerrit.wikimedia.org/r/379554 (owner: 10Paladox) [16:00:10] RECOVERY - Puppet errors on tools-exec-1407 is OK: OK: Less than 1.00% above the threshold [0.0] [16:03:37] RECOVERY - Puppet errors on tools-exec-1411 is OK: OK: Less than 1.00% above the threshold [0.0] [16:04:55] 10Data-Services, 10DBA: Grant tool "tool-db-usage" (s53508) ability to read full table_schema.TABLES contents - https://phabricator.wikimedia.org/T176381#3624803 (10Andrew) 05Open>03Resolved a:03Andrew Done via GRANT SHOW VIEW ON *.* TO 's53508'@'%' on labsdb1001 and labdb1003 [16:51:47] PROBLEM - Puppet errors on tools-exec-1412 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [16:56:02] PROBLEM - Puppet errors on tools-webgrid-lighttpd-1413 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [17:00:35] PROBLEM - Puppet errors on tools-webgrid-generic-1404 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [17:21:02] RECOVERY - Puppet errors on tools-webgrid-lighttpd-1413 is OK: OK: Less than 1.00% above the threshold [0.0] [17:21:46] RECOVERY - Puppet errors on tools-exec-1412 is OK: OK: Less than 1.00% above the threshold [0.0] [17:40:37] RECOVERY - Puppet errors on tools-webgrid-generic-1404 is OK: OK: Less than 1.00% above the threshold [0.0] [17:43:36] it would be so awesome for those puppet runs to stop timing out and alerting :/ [17:47:48] PROBLEM - Puppet errors on tools-exec-1412 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [17:50:29] tools-exec-1412 is not having a good time with NFS [18:07:01] bd808: i'll look [18:07:21] madhuvishy: it seems better now. just something soaking up all the IOPS [18:07:45] I think WLM is hitting up tools pretty hard these days [18:07:56] ah that could be related [18:08:00] I noticed it running on the other exec host you pointed out [18:08:17] I saw a job that had something to do with commons upload processing running [18:08:36] tools.mifterbot 22190 /bin/bash /mnt/nfs/labstore-secondary-tools-project/mifterbot/checkimages.sh [18:08:40] yeah [18:08:56] yeah, that's the one [18:12:48] RECOVERY - Puppet errors on tools-exec-1412 is OK: OK: Less than 1.00% above the threshold [0.0] [18:23:30] (03CR) 10Jean-Frédéric: "> Would you also need to handle the `ALTER TABLE monuments_all ADD" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378974 (owner: 10Jean-Frédéric) [18:25:46] (03CR) 10Jean-Frédéric: "> set `skip: true` for nl-wd_(nl)" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379140 (owner: 10Lokal Profil) [18:27:38] (03CR) 10Jean-Frédéric: Add mechanism for storing wikipage locally instead of writing to wiki (031 comment) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378800 (https://phabricator.wikimedia.org/T174614) (owner: 10Lokal Profil) [18:32:57] (03CR) 10Jean-Frédéric: [C: 032] Add mechanism for storing wikipage locally instead of writing to wiki [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378800 (https://phabricator.wikimedia.org/T174614) (owner: 10Lokal Profil) [18:35:16] (03Merged) 10jenkins-bot: Add mechanism for storing wikipage locally instead of writing to wiki [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378800 (https://phabricator.wikimedia.org/T174614) (owner: 10Lokal Profil) [18:38:52] (03PS2) 10Jean-Frédéric: Use isort to sort imports [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378741 [18:40:01] (03CR) 10Jean-Frédéric: "> Should isort then be added to the dev-requirements?" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378741 (owner: 10Jean-Frédéric) [18:52:06] PROBLEM - Puppet errors on tools-webgrid-lighttpd-1413 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [19:09:24] (03CR) 10jenkins-bot: Add mechanism for storing wikipage locally instead of writing to wiki [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378800 (https://phabricator.wikimedia.org/T174614) (owner: 10Lokal Profil) [19:17:38] (03PS3) 10Jean-Frédéric: Use isort to sort imports [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378741 [19:18:59] (03CR) 10Jean-Frédéric: "> > for tox I thunk you might need 4.2.8 per https://github.com/timothycrosley/isort/issues/487" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378741 (owner: 10Jean-Frédéric) [19:21:58] (03PS4) 10Jean-Frédéric: Use isort to sort imports [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378741 [19:23:15] (03CR) 10Jean-Frédéric: "Ok, so now I’m not sure anymore whether I should check that via a distinct tox target (like now) or should I use flake8-isort... :thinking" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378741 (owner: 10Jean-Frédéric) [19:23:50] !log tools.heritage Deploy latest from Git master: bf7488d (T174614) [19:23:54] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.heritage/SAL [19:23:54] T174614: Add mechanism for switching between writing to wiki and outputting locally - https://phabricator.wikimedia.org/T174614 [19:25:59] (03PS5) 10Jean-Frédéric: Ensure skipped image categorizations are mentioned in stats [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378641 (https://phabricator.wikimedia.org/T174871) (owner: 10Lokal Profil) [19:26:42] (03CR) 10Jean-Frédéric: [C: 032] Ensure skipped image categorizations are mentioned in stats [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378641 (https://phabricator.wikimedia.org/T174871) (owner: 10Lokal Profil) [19:28:49] (03Merged) 10jenkins-bot: Ensure skipped image categorizations are mentioned in stats [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378641 (https://phabricator.wikimedia.org/T174871) (owner: 10Lokal Profil) [19:35:40] !log tools.heritage Deploy latest from Git master: 730d577 (T174871) [19:35:45] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.heritage/SAL [19:35:45] T174871: Solve ErfgoedBot categorisation problem - https://phabricator.wikimedia.org/T174871 [19:41:06] (03CR) 10jenkins-bot: Ensure skipped image categorizations are mentioned in stats [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378641 (https://phabricator.wikimedia.org/T174871) (owner: 10Lokal Profil) [19:52:04] RECOVERY - Puppet errors on tools-webgrid-lighttpd-1413 is OK: OK: Less than 1.00% above the threshold [0.0] [20:01:33] 10Cloud-VPS (Quota-requests), 10cloud-services-team (Kanban), 10Discovery, 10Wikidata, 10Wikidata-Query-Service: WDQS testing setup platform sizing - https://phabricator.wikimedia.org/T169133#3625423 (10Smalyshev) 05Open>03Resolved I think it's ok for now with bigdisk template. [20:12:36] 10cloud-services-team (FY2017-18), 10Goal, 10Patch-For-Review, 10User-bd808: Perform core Cloud Services rebranding - https://phabricator.wikimedia.org/T168480#3625475 (10bd808) [20:13:47] PROBLEM - Puppet errors on tools-exec-1412 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [20:13:51] 10cloud-services-team (FY2017-18), 10Goal, 10Patch-For-Review, 10User-bd808: Perform core Cloud Services rebranding - https://phabricator.wikimedia.org/T168480#3365842 (10bd808) [20:13:53] 10Cloud-Services, 10Wikimedia-Mailing-lists: Create cloud mailman list and archive labs-l list - https://phabricator.wikimedia.org/T175190#3625489 (10bd808) [20:14:02] 10cloud-services-team (FY2017-18), 10Goal, 10Patch-For-Review, 10User-bd808: Perform core Cloud Services rebranding - https://phabricator.wikimedia.org/T168480#3365842 (10bd808) [20:15:26] 10Cloud-Services, 10Wikimedia-Mailing-lists: Create cloud mailman list and archive labs-l list - https://phabricator.wikimedia.org/T175190#3585613 (10bd808) p:05Triage>03High We would like to get this done by the end of the current Foundation quarter. [20:16:06] 10cloud-services-team (FY2017-18), 10Goal, 10Patch-For-Review, 10User-bd808: Perform core Cloud Services rebranding - https://phabricator.wikimedia.org/T168480#3625502 (10bd808) [20:16:18] 10cloud-services-team (FY2017-18), 10Goal, 10Patch-For-Review, 10User-bd808: Perform core Cloud Services rebranding - https://phabricator.wikimedia.org/T168480#3365842 (10bd808) [20:19:05] 10cloud-services-team (Kanban), 10Operations: puppet ca_server confusion - https://phabricator.wikimedia.org/T176437#3625520 (10Andrew) [20:27:06] 10Data-Services: Add script_path to meta_p.wiki database - https://phabricator.wikimedia.org/T93483#3625563 (10Krinkle) [20:32:21] PROBLEM - Puppet errors on tools-paws-worker-1016 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [20:53:44] RECOVERY - Puppet errors on tools-exec-1412 is OK: OK: Less than 1.00% above the threshold [0.0] [20:56:22] 10Striker: "No Phabricator accounts found for tool maintainers." while creating the a new diffusion repository - https://phabricator.wikimedia.org/T176325#3625644 (10Yashasingh) Yes , that is probable (bug in Striker) & Welcome ! [21:04:25] !help Hello! Is there a way to avoid "504 Gateway Time-out" for tools. [21:04:26] Sanyi4: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team [21:07:20] RECOVERY - Puppet errors on tools-paws-worker-1016 is OK: OK: Less than 1.00% above the threshold [0.0] [21:15:35] Sanyi4: which tool? [21:16:30] im currently developing a tools here: http://tools.wmflabs.org/lonelylinks/ [21:17:24] the query which i want to use to update the databases takes a lot of time [21:18:43] then either you can try to optimize the query, or you can make static pages [21:20:01] a web request should not take too much time to respond or else a. you open a dos endpoint for attackers b. legit users are unlikely to wait [21:22:31] what do you mean by static? it is static in the sense, that databases will be updated occasionally. querys do function while normal usage, just the database update query is problematic. [21:26:45] by static I mean run the expensive query updates periodically [21:26:58] and save the results somewhere [21:27:44] database queries has a time limit around 30 mins afaik [21:28:14] but gateway timeouts only happen for web requests are have a much smaller threshols [21:28:19] *threshold [21:30:21] thats exactly what i want to do. i tried it in command line too, but the query does not manage to finish the update. [21:30:55] what is your query? let me try optimizing [21:35:16] well, its not that simple. first, im importing wb_items_per_site table from the wikidatawiki_p replica database to the tool database. after that i run the following queries on that table: [21:35:44] INSERT INTO lpi SELECT ips_item_id, COUNT(ips_site_id) FROM wb_items_per_site GROUP BY ips_item_id; [21:36:01] NSERT INTO links SELECT wb_items_per_site.ips_item_id, ips_site_id, ips_site_page FROM wb_items_per_site INNER JOIN lpi ON wb_items_per_site.ips_item_id=lpi.ips_item_id WHERE lpi.count_ips_site_id=1 [21:36:29] uh [21:38:57] I may be able to optimize queries that run directly on the replicas without creating any permanent tables, but for those tables in tool database, sorry, can't do that without knowing the indexes [21:42:17] ive read somewhere that there is a way to create tables on replica databases. i may do the whole thing on wikidatawiki_p. how can i access it via command line? [21:45:38] creating tables on replica databases will be disabled in the near future [21:45:44] so don't rely on that [21:45:49] :( [21:46:04] https://phabricator.wikimedia.org/T172704 [22:18:53] (03CR) 10Lokal Profil: [C: 032] "> > [QUOTE]Would you also need to handle the `ALTER TABLE monuments_all ADD" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378974 (owner: 10Jean-Frédéric) [22:20:13] (03Merged) 10jenkins-bot: Add SQL table for `statistics` [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378974 (owner: 10Jean-Frédéric) [22:21:03] (03CR) 10Lokal Profil: "> > set `skip: true` for nl-wd_(nl)" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379140 (owner: 10Lokal Profil) [22:22:51] (03PS4) 10Jean-Frédéric: Make all erfgoedbot scripts respect the skipping mechanisms. [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379140 (owner: 10Lokal Profil) [22:23:31] (03CR) 10Jean-Frédéric: [C: 032] "> > > set `skip: true` for nl-wd_(nl)" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379140 (owner: 10Lokal Profil) [22:27:55] (03Merged) 10jenkins-bot: Make all erfgoedbot scripts respect the skipping mechanisms. [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379140 (owner: 10Lokal Profil) [22:44:45] PROBLEM - Puppet errors on tools-exec-1412 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [22:45:03] (03CR) 10jenkins-bot: Add SQL table for `statistics` [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378974 (owner: 10Jean-Frédéric) [22:50:12] (03CR) 10jenkins-bot: Make all erfgoedbot scripts respect the skipping mechanisms. [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379140 (owner: 10Lokal Profil) [22:51:57] I will depool the server anyway and investigate tomorrow [22:52:05] (wrong channel) [22:55:04] (03PS1) 10Jean-Frédéric: Harvest the source page of unknown fields [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379685 (https://phabricator.wikimedia.org/T117330) [22:55:10] (03CR) 10jerkins-bot: [V: 04-1] Harvest the source page of unknown fields [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379685 (https://phabricator.wikimedia.org/T117330) (owner: 10Jean-Frédéric) [22:55:38] (03Abandoned) 10Jean-Frédéric: Harvest the source page of unknown fields [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378981 (https://phabricator.wikimedia.org/T117330) (owner: 10Jean-Frédéric) [22:56:12] (03PS2) 10Jean-Frédéric: Harvest the source page of unknown fields [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379685 (https://phabricator.wikimedia.org/T117330) [22:57:28] (03CR) 10Jean-Frédéric: "This is an alternate implementation of https://gerrit.wikimedia.org/r/#/c/379126, building upon that one to use a Counter of all violation" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379685 (https://phabricator.wikimedia.org/T117330) (owner: 10Jean-Frédéric) [22:57:42] !log tools.heritage Deploy latest from Git master: 783aca6, 6932790 [22:57:46] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.heritage/SAL [22:59:23] (03PS3) 10Jean-Frédéric: Harvest the source page of unknown fields [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379685 (https://phabricator.wikimedia.org/T117330) [23:02:30] (03CR) 10Lokal Profil: "my gut feeling says flake8-isort but I see that it cannot read the [isort] section from tox (yet, open PR exists)" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378741 (owner: 10Jean-Frédéric) [23:03:27] (03Abandoned) 10Jean-Frédéric: Skip SPARQL type in unused_monument_images.py [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378982 (owner: 10Jean-Frédéric) [23:04:11] 10Cloud-VPS, 10Operations-Software-Development: Cumin: create backend for OpenStack - https://phabricator.wikimedia.org/T175711#3625962 (10Volans) 05Open>03Resolved @bd808 @Andrew @chasemp @madhuvishy - OpenStack backend added to Cumin - created new Cumin release of Cumin 1.1.0 - uploaded to wikimedia AP... [23:06:33] (03CR) 10Lokal Profil: "flake8-isort would simply be triggered as part of the flake8 env? we already have a setup.cfg so the lack of [isort] tox support isn't a b" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378741 (owner: 10Jean-Frédéric) [23:13:24] (03CR) 10Jean-Frédéric: "> flake8-isort would simply be triggered as part of the flake8 env?" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378741 (owner: 10Jean-Frédéric) [23:14:26] (03CR) 10jerkins-bot: [V: 04-1] Harvest the source page of unknown fields [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379685 (https://phabricator.wikimedia.org/T117330) (owner: 10Jean-Frédéric) [23:16:32] (03PS4) 10Jean-Frédéric: Harvest the source page of unknown fields [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/379685 (https://phabricator.wikimedia.org/T117330) [23:18:55] (03CR) 10Lokal Profil: "> > flake8-isort would simply be triggered as part of the flake8 env?" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378741 (owner: 10Jean-Frédéric) [23:19:48] RECOVERY - Puppet errors on tools-exec-1412 is OK: OK: Less than 1.00% above the threshold [0.0] [23:28:13] (03CR) 10Jean-Frédéric: "> > > flake8-isort would simply be triggered as part of the flake8" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378741 (owner: 10Jean-Frédéric) [23:45:16] (03CR) 10Jean-Frédéric: "> > would you mind changing the find to a grep to use a similar format" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/378741 (owner: 10Jean-Frédéric)