[08:02:07] !log admin Safe rebooting 'cloudvirt1029.eqiad.wmnet'. (T280641) - cookbook ran by dcaro@vulcanus [08:02:12] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [08:19:02] !log admin Safe reboot of 'cloudvirt1029.eqiad.wmnet' finished successfully. (T280641) - cookbook ran by dcaro@vulcanus [08:19:03] !log admin Safe rebooting 'cloudvirt1030.eqiad.wmnet'. (T280641) - cookbook ran by dcaro@vulcanus [08:19:06] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [08:19:08] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [08:45:42] !log admin Safe reboot of 'cloudvirt1030.eqiad.wmnet' finished successfully. (T280641) - cookbook ran by dcaro@vulcanus [08:45:43] !log admin Safe rebooting 'cloudvirt1031.eqiad.wmnet'. (T280641) - cookbook ran by dcaro@vulcanus [08:45:45] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [08:45:47] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [09:21:32] !log admin Safe reboot of 'cloudvirt1031.eqiad.wmnet' finished successfully. (T280641) - cookbook ran by dcaro@vulcanus [09:21:33] !log admin Safe rebooting 'cloudvirt1032.eqiad.wmnet'. (T280641) - cookbook ran by dcaro@vulcanus [09:21:36] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [09:21:38] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [09:27:19] * arturo really wants that cookbook [09:30:34] it's the one under review :), just waiting for reviews on the parent commits to merge [09:47:25] !log admin Safe reboot of 'cloudvirt1032.eqiad.wmnet' finished successfully. (T280641) - cookbook ran by dcaro@vulcanus [09:47:26] !log admin Safe rebooting 'cloudvirt1033.eqiad.wmnet'. (T280641) - cookbook ran by dcaro@vulcanus [09:47:28] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [09:47:30] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:13:15] !log admin Safe reboot of 'cloudvirt1033.eqiad.wmnet' finished successfully. (T280641) - cookbook ran by dcaro@vulcanus [10:13:16] !log admin Safe rebooting 'cloudvirt1034.eqiad.wmnet'. (T280641) - cookbook ran by dcaro@vulcanus [10:13:19] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:13:21] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:39:41] !log admin Safe reboot of 'cloudvirt1034.eqiad.wmnet' finished successfully. (T280641) - cookbook ran by dcaro@vulcanus [10:39:42] !log admin Safe rebooting 'cloudvirt1035.eqiad.wmnet'. (T280641) - cookbook ran by dcaro@vulcanus [10:39:46] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:39:48] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:40:46] that is going quite smoothly :) [11:02:09] 🎉 [11:04:41] do you think it would be useful to add a log for each VM that is being migrated in the project SAL? [11:08:10] !log admin Safe reboot of 'cloudvirt1035.eqiad.wmnet' finished successfully. (T280641) - cookbook ran by dcaro@vulcanus [11:08:11] !log admin Safe rebooting 'cloudvirt1036.eqiad.wmnet'. (T280641) - cookbook ran by dcaro@vulcanus [11:08:13] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [11:08:15] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [11:10:02] dcaro: I think it would make sense if for whatever reason we need to reboot the VM (imagine if the script had logic to handle some migration errors or the like) [11:10:59] if no errors, live migration is 100% harmless and doesn't require a !log entry [11:31:17] !log admin Safe reboot of 'cloudvirt1036.eqiad.wmnet' finished successfully. (T280641) - cookbook ran by dcaro@vulcanus [11:31:19] !log admin Safe rebooting 'cloudvirt1037.eqiad.wmnet'. (T280641) - cookbook ran by dcaro@vulcanus [11:31:21] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [11:31:25] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [11:56:23] !log admin Safe reboot of 'cloudvirt1037.eqiad.wmnet' finished successfully. (T280641) - cookbook ran by dcaro@vulcanus [11:56:24] !log admin Safe rebooting 'cloudvirt1038.eqiad.wmnet'. (T280641) - cookbook ran by dcaro@vulcanus [11:56:26] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [11:56:28] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [12:35:14] !log admin Safe rebooting 'cloudvirt1039.eqiad.wmnet'. (T280641) - cookbook ran by dcaro@vulcanus [12:35:17] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [14:10:07] !log admin Safe rebooting 'cloudvirt1039.eqiad.wmnet'. (T280641) - cookbook ran by dcaro@vulcanus [14:10:11] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [14:14:42] !log admin Safe reboot of 'cloudvirt1039.eqiad.wmnet' finished successfully. (T280641) - cookbook ran by dcaro@vulcanus [14:14:43] !log admin Safe rebooting 'cloudvirt1041.eqiad.wmnet'. (T280641) - cookbook ran by dcaro@vulcanus [14:14:46] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [14:14:48] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [14:17:57] !log deployment-prep Disable ReferencePreviews beta mode on beta labs (T271206) [14:18:00] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL [14:18:01] T271206: Enable RefPreviews on first wikis - https://phabricator.wikimedia.org/T271206 [14:33:06] !log cloudinfra delete zones 'mx-out01.wmflabs.org' and 'mx-out02.wmflabs.org' [14:33:08] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Cloudinfra/SAL [14:33:20] !log cloudinfra delete also old VMs mx-out01/02 [14:33:21] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Cloudinfra/SAL [14:39:57] !log admin Safe reboot of 'cloudvirt1041.eqiad.wmnet' finished successfully. (T280641) - cookbook ran by dcaro@vulcanus [14:39:58] !log admin Safe rebooting 'cloudvirt1042.eqiad.wmnet'. (T280641) - cookbook ran by dcaro@vulcanus [14:40:00] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [14:40:06] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [14:49:03] so if I have a script on toolforge that's already reading data from the database (as opposed to by the API), and I get a bunch of revisions from some SQL query, what's the best way to get the content for those revs? [14:58:24] inductiveload: you will have to use a production API to get page content. The wiki replicas only have the meta data tables and not the giant content tables/external storage. [14:58:59] The only page content that we have locally in Cloud VPS/Toolforge are the dumps and https://wikitech.wikimedia.org/wiki/Help:CirrusSearch_elasticsearch_replicas [14:59:44] !log admin Safe reboot of 'cloudvirt1042.eqiad.wmnet' finished successfully. (T280641) - cookbook ran by dcaro@vulcanus [14:59:45] !log admin Safe rebooting 'cloudvirt1043.eqiad.wmnet'. (T280641) - cookbook ran by dcaro@vulcanus [14:59:48] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [14:59:50] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [15:03:39] !log admin Safe reboot of 'cloudvirt1043.eqiad.wmnet' finished successfully. (T280641) - cookbook ran by dcaro@vulcanus [15:03:41] !log admin Safe rebooting 'cloudvirt1044.eqiad.wmnet'. (T280641) - cookbook ran by dcaro@vulcanus [15:03:41] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [15:03:43] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [15:05:51] bd808: ah right, OK, makes sense, I wasn't sure if there was a more direct way [15:06:55] its a good question inductiveload! It just has a a sort of unsatisfying answer. :) [15:07:13] if I were to use a dump, what is the right way, btw? [15:07:34] !log admin Safe reboot of 'cloudvirt1044.eqiad.wmnet' finished successfully. (T280641) - cookbook ran by dcaro@vulcanus [15:07:35] !log admin Safe rebooting 'cloudvirt1045.eqiad.wmnet'. (T280641) - cookbook ran by dcaro@vulcanus [15:07:37] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [15:07:39] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [15:08:55] is it more efficient (in broad terms) to duig stuff out of a dump than over the API? [15:09:24] 99% of the data I want is "old" (it's for gathering a time series of edit stats for a wikisource community project) [15:09:46] inductiveload: it depends on what you want the page content for. The dumps are monthly snapshots of content. That makes them good for things that want to look at a lot of pages, but not so good for things that want to know exactly what the page looks like right now. [15:10:34] so basically i'm looking for "the latest rev of all pages in a certain set" and then I need to parse that page for a couple of bits of data [15:11:20] (to be exact, the "set" is all Page: NS pages connected to Index: pages in a certain category, and the data is the proofread status at the time) [15:11:21] I'm not sure where the break point will be hit in time spent looking through the compressed dump content for the pages you want vs time spent waiting for the API to give you page content for the same number of pages. [15:11:27] !log admin Safe reboot of 'cloudvirt1045.eqiad.wmnet' finished successfully. (T280641) - cookbook ran by dcaro@vulcanus [15:11:29] !log admin Safe rebooting 'cloudvirt1046.eqiad.wmnet'. (T280641) - cookbook ran by dcaro@vulcanus [15:11:30] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [15:11:33] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [15:12:18] ok, fair enough, i'll probably keep it simple then and use the API, just wondered if there was a rule of thumb like "always use a dump if you possibly can" [15:13:06] once the stats table is built, the actual ongoing data collection is on a daily basis and only a few hundred pages max, so it's hardly a drama to use the API [15:13:23] (and i'd have to anyway due to dump ages) [15:14:38] the Action API handles *a lot* of traffic in production. The main thing I would recommend is using https://www.mediawiki.org/wiki/Manual:Maxlag_parameter to tell MediaWiki that you are ok with getting a "try again later" result when the database is really busy [15:15:21] !log admin Safe reboot of 'cloudvirt1046.eqiad.wmnet' finished successfully. (T280641) - cookbook ran by dcaro@vulcanus [15:15:25] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [15:30:28] bd808: sure it's very much a background thing, 5 secs like PWB is fine [16:07:25] !log admin disallowing insecure global ids on the eqiad ceph cluster (T280641) [16:07:28] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [16:07:28] T280641: ceph: Upgrade to latest Nautilus/Octopus to fix CVE-2021-20288 - https://phabricator.wikimedia.org/T280641 [16:07:36] !log toolsbeta grant `taavi` projectadmin (Majavah) [16:07:37] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [16:08:17] and ceph cluster health is green again :) [16:08:40] 🎉 [16:25:20] !log toolsbeta add self to sudo policy `roots` [16:25:22] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [17:46:35] bd808: hi, when you have some time, let's discuss this project for creation (T281600) [17:46:36] T281600: Request creation of wikinewsie VPS project - https://phabricator.wikimedia.org/T281600 [17:47:15] If you want to accept or reject it, it's the team's decision but I don't think I'll be happy having this wiki in wmf production [17:48:16] we are basically having more and more misc wikis that are hard to maintain (due to special needs of these wikis) plus they just get created and barely used and people forget about them. [17:49:12] (and also requirements to have huge files uploaded to swift) [18:29:19] Amir1: I think I understand your concerns. Ultimately this is not my personal decision so discussion is probably best on the ticket where others can follow. And I think we should keep the discussion there scoped to the Cloud VPS project request and not any other past or future hosting venue deliberation. :) [18:34:25] noted [19:26:54] !log adding tools taavi as a sudo root to project toolforge for T278390 [19:26:54] andrewbogott: Unknown project "adding" [19:26:55] T278390: Toolforge root for Majavah - https://phabricator.wikimedia.org/T278390 [19:27:03] !log tools adding taavi as a sudo root to project toolforge for T278390 [19:27:08] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [19:36:34] wheeeee [19:36:40] congrats Majavah! [19:37:02] thank you :-) [19:40:16] Congrats Majavah [21:04:04] I seem to have successfully started a nodejs project with kubernetes, but when I go to the tool URL, I get redirected to https://wikitech.wikimedia.org/wiki/Portal:Toolforge [21:04:21] dungodung: are you visiting .toolforge.org ? [21:04:50] well, now I am. [21:04:53] * dungodung facepalms [21:05:50] sorry, I kept using the old URL scheme (https://tools.wmflabs.org/tool), since I thought the redirects would exist for new tools, since they are still in place for the old ones [21:05:55] so never mind, it works :D [21:07:16] Nah, only old tools [21:07:22] Can't remember what old is [21:07:44] I think about mid last year [21:09:02] any tool that existed before 2020-07-07 [21:09:34] It was more selective until we merged https://gerrit.wikimedia.org/r/c/operations/puppet/+/682325 a week or so ago