[00:29:29] bd808, chicocvenancio: could you have a look at https://gerrit.wikimedia.org/r/#/c/415489/ if you have time? [00:36:40] zhuyifei1999_: one nitpick. it looks sane otherwise at least as far as core logic goes [00:37:23] !log quarry `UPDATE query join query_revision on query.latest_rev_id = query_revision.id join query_run on latest_run_id = query_run.id SET status=1 where (status = 2 or status = 1) and query_run.timestamp <= DATE_ADD(NOW(), INTERVAL -1 HOUR);` 251 rows affected (1.81 sec) T139162 T172086 T188564 [00:37:27] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Quarry/SAL [00:37:28] T139162: Query runs over 5 hours without being killed - https://phabricator.wikimedia.org/T139162 [00:37:28] T188564: Quarry should refuse to save results that are way too large - https://phabricator.wikimedia.org/T188564 [00:37:28] T172086: Gigantic query results cause a SIGKILL and the query status do not update - https://phabricator.wikimedia.org/T172086 [00:37:53] bd808: k [00:39:41] second patchset uploaded. if nothing goes wrong I'll deploy and test tomorrow. thanks for the review [01:21:38] !log tool.zppixbot Restarted a few times for .tell cancelation/module update [01:21:39] MacFan4000: Unknown project "tool.zppixbot" [01:22:03] !log tools.zppixbot Restarted a few times for .tell cancelation/module update [01:22:05] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.zppixbot/SAL [01:55:11] Anyone able to help me? How do you locate a user's id for rev_user=x? [01:55:41] legoktm: I know you'd know :P [01:55:47] rileyh: api or page? [01:55:51] api [01:56:01] list=users or list=allusers, I forget what it's called [01:56:21] Cheers; need it to run a quarry [01:56:47] https://en.wikipedia.org/w/api.php?action=query&list=users&ususers=~riley&usprop=groups|editcount|gender [01:56:55] rileyh: ist=users&usprop=centralids&ususers= [01:57:03] or just select user_id from user where user_name="whatever" [01:57:11] You guys rock. thank you! [01:58:07] rileyh: I saw you reopened T120066 a few hours ago [01:58:09] T120066: PAWS 404 for users with special characters in their names - https://phabricator.wikimedia.org/T120066 [01:58:25] Yes, can't use PAWS on my main account [01:59:16] you successfully started a pod, which was why I wondered [01:59:37] but yes, I can replicate it [01:59:55] I'll check it out tommorow [02:00:06] Eh, it was weird. Problems with having a stupid name [02:00:13] My bots are running with no problem [03:26:10] So PAWS is giving me error 503 and I need to kill a task thats running [03:26:56] rileyh: want me to stop the server? [03:27:09] RileyBot server needs to be stopped please [03:27:19] Otherwise a sysadmin is going to shoot me [03:27:40] I killed the terminals running there [03:28:03] Thank you [03:28:10] Wonder why I can't get in though [03:28:25] np [03:29:38] can't you still? [03:29:58] It's let me in now [03:30:03] You're magic it seems [03:30:12] lol [03:31:06] the node it was in was probably slow, killing it ussually will make it go to another node [03:31:17] Ahh [03:31:53] now, why it was slow? thats a long investigation [03:32:05] usually not worth the effort [03:59:55] !help Hi Wiki support team. I have a question about pageview data. I saw the pagecounts-ez data ("Hourly page views per article") is from 11/2011 but it is derived from pagecount-raw. I'd like to know whether the data between 207 and 2011 are available somewhere. [03:59:55] dx_: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team [04:36:59] (03PS1) 10Legoktm: Have write_config.py generate the systemd unit files [labs/codesearch] - 10https://gerrit.wikimedia.org/r/415515 [04:37:14] (03CR) 10jerkins-bot: [V: 04-1] Have write_config.py generate the systemd unit files [labs/codesearch] - 10https://gerrit.wikimedia.org/r/415515 (owner: 10Legoktm) [04:38:20] (03PS2) 10Legoktm: Have write_config.py generate the systemd unit files [labs/codesearch] - 10https://gerrit.wikimedia.org/r/415515 [04:38:48] (03CR) 10Legoktm: [C: 032] Have write_config.py generate the systemd unit files [labs/codesearch] - 10https://gerrit.wikimedia.org/r/415515 (owner: 10Legoktm) [04:39:04] (03Merged) 10jenkins-bot: Have write_config.py generate the systemd unit files [labs/codesearch] - 10https://gerrit.wikimedia.org/r/415515 (owner: 10Legoktm) [04:48:19] (03PS1) 10Legoktm: Index ArmchairGM [labs/codesearch] - 10https://gerrit.wikimedia.org/r/415517 (https://phabricator.wikimedia.org/T188536) [04:48:30] (03CR) 10Legoktm: [C: 032] Index ArmchairGM [labs/codesearch] - 10https://gerrit.wikimedia.org/r/415517 (https://phabricator.wikimedia.org/T188536) (owner: 10Legoktm) [04:48:45] (03Merged) 10jenkins-bot: Index ArmchairGM [labs/codesearch] - 10https://gerrit.wikimedia.org/r/415517 (https://phabricator.wikimedia.org/T188536) (owner: 10Legoktm) [04:53:18] (03PS1) 10Legoktm: Merge enable.sh and start.sh into manage.sh [labs/codesearch] - 10https://gerrit.wikimedia.org/r/415518 [04:53:28] (03CR) 10Legoktm: [C: 032] Merge enable.sh and start.sh into manage.sh [labs/codesearch] - 10https://gerrit.wikimedia.org/r/415518 (owner: 10Legoktm) [04:53:42] (03Merged) 10jenkins-bot: Merge enable.sh and start.sh into manage.sh [labs/codesearch] - 10https://gerrit.wikimedia.org/r/415518 (owner: 10Legoktm) [06:37:18] 504 error timeout on toolforge [06:37:26] just my luck [07:17:04] (03CR) 10jenkins-bot: Localisation updates from https://translatewiki.net. [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/415527 (owner: 10L10n-bot) [10:19:08] chicocvenancio: hi, thanks for your help yesterday. I am fixing more things now. If I go to https://tools.wmflabs.org/etytree/ I can see that the img/etytree_logo.png is not loaded and also I cannot access paths like http://localhost:4800/label=door&lang=nld&ety=1 [10:19:13] not sure how to solve this [12:08:45] Well, the localhost address not working is expected [12:09:18] Give me a minute to check the logo, Ester [12:10:32] sorry I meant https://tools.wmflabs.org/etytree/label=door&lang=nld&ety=1 [12:10:44] I'm using page.js, not sure this is ok [12:18:18] it probably is, but I need to check what we need to change [12:19:19] abou the logo, it is `` [12:19:51] that address does not point to your tool, but to the general toolforge server [12:20:39] add `/etytree` before that and it will work [12:20:56] you migh as well make the an absolute path as weel [12:21:02] *well [12:21:26] Like so `` [12:22:09] https://tools.wmflabs.org/etytree/img/etytree_logo.png [12:22:13] looks nice [12:36:12] chicocvenancio: fixed that :) thanks [12:36:36] instead of page js i can use something simpler [12:36:45] if you have suggestions [12:44:02] Ester: page.js should work on toolforge, but we need to keep two things in mind [12:45:46] one is that you're sharing the domain, page.js needs to have all routes added the `/etytree` prefix. The other is that we need to have all routes somehow serve page.js [12:47:55] ok, so maybe I just need to add `/etytree` [12:48:17] that will take care of the home page [12:48:26] but I'm checking on that second parte [12:48:46] how to make https://tools.wmflabs.org/etytree/label=door&lang=nld&ety=1 also server page.js [12:48:50] *serve [13:00:35] Ester: one way that it should work is to make symlinks between the route names and the index.html file [13:01:12] for example? [13:04:05] lets say you have a "label" route [13:05:29] inside page.js that would be something like `page('/etytree/label', dosomething_callback)` [13:13:16] for lighttpd, we can make a symbolic link in `public_html` like `ln -s index.html label ` [13:14:10] you also need to have `mimetype.assign += ("" => "text/html" )` in your .lighttpd.conf on your tools home folder [13:14:38] I just did the last two steps on your tool to make sure it would work [13:15:31] ok; thanks a lot; i see what you mean [13:15:48] for simplicity I'm trying to see if I can use URLSearchParams [13:15:53] and not page [13:17:37] if all information is displayed in that search page, page.js is not necessary indeed [13:18:39] if you have/want a page for details of search results, then you will need some way to deal with different routes [13:19:34] since your app is client-side, that means a client-side router (such as page.js) and something server-side to allow the client-side router to start [13:20:03] feel free to ping if you need any help [13:20:08] thanks a lot [13:20:17] you have been very helpful! [13:20:26] you're welcome [13:24:05] !log rcm Neon: Package updates [13:24:06] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Rcm/SAL [13:27:30] !log tools deploy https://gerrit.wikimedia.org/r/#/c/415057/ [13:27:33] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [16:25:44] chicocvenancio: done [16:25:47] it's working now [16:25:50] thanks a lor [16:25:54] *t [16:26:58] bd808 or anybody who knows the ins and out of wmflabs... would API edits from a labs virtual server come through IPv4 or IPv6? [16:27:12] dx_: The best place to ask questions about the pageview data is on the analytics@lists.wikimedia.org mailing list [16:27:16] ragesoss_: ipv4 [16:27:30] anyone can point to the documentaion on how to do restart an instance (without loosing the data) (etytree-b.etytree.eqiad.wmflabs) [16:27:41] IPv4 but exercise caution [16:28:35] thanks. Ran into an unexpected problem with account creation via OAuth, https://phabricator.wikimedia.org/T188630 [16:29:17] But maybe we can get a short-term workaround by exempting the IP for outreachdashboard.wmflabs.org [16:30:11] Ester: if you are able to ssh into the instance then `sudo reboot` should do it for you. The other option is to use the web interface at https://horizon.wikimedia.org/project/instances/ and choose "soft reboot instance" or "hard reboot instance". [16:30:45] Krenair "but exercise caution" with API edits in general, or specifically with regards to relying on them being IPv4? [16:31:20] sudo reboot does a soft reboot? [16:31:36] Ester: yes [16:32:09] Please type in hostname of the machine to reboot [16:32:20] "etytree-b" [16:32:51] that safety check exists because y.uvi rebooted the wrong box one day :) [16:32:54] ragesoss, Well, theoretically if you're running in labs, you should always get sent to eqiad LVS/Varnish. Both eqiad and codfw will see your private, wikimedia-internal IP [16:33:20] but esams and ulsfo machines will see the relevant public IP (either a floating IP attached to the instance you're running on, or the generic labs NAT one) [16:34:13] it'll be IPv4, but still [16:35:37] Krenair: helpful, thanks. [16:38:21] dx_: you should look at the list archives too . There has been a tread recently about older pageview data. [16:38:28] *thread [16:41:44] I made https://phabricator.wikimedia.org/T174596 about it a while back [17:59:15] ragesoss: hey. Is account creation via the dashboard still broken? [17:59:28] throttled, I mean [18:00:10] doesn't the user need to have the rights for it not be throttled? [18:03:18] chicocvenancio, yes, the task says "even when the user creating the accounts has account creator rights" though [18:03:36] which https://en.wikipedia.org/wiki/Special:ListGroupRights lists as having 'noratelimit' [18:04:10] ah, Umherirrender might've found the problem :) [18:04:30] Krenair: ohh, lets wait for ragesoss then. [18:06:20] the idea is that the rights in https://en.wikipedia.org/wiki/Special:ListGrants are applied like an umask to your normal rights [18:06:44] so you get the intersection of those and what you'd get via normal group rights ( https://en.wikipedia.org/wiki/Special:ListGroupRights ) [18:07:42] is it an option to create a new consumer, or is the event too close for that? we could live-hack the list of grants I suppose [18:11:28] tgr, this makes sense [18:11:48] tgr, on an unrelated note, is there a reason the rights are grouped up? [18:12:52] before my time, but the product department asked for it AIUI, to make the consumer creation screen more manageable [18:13:10] probably a good idea, almost all sites that use OAuth present it like that [18:17:44] tgr: what event do you have in mind? [18:18:25] there is some ongoing editathon thing that makes this urgent, AIUI [18:18:48] Women in Red, maybe? [18:25:47] thanks! I didn't realize the ratelimit permission was needed for account creation limits as well. [18:26:45] There isn't a centralized/canonical list of all editathons ("there's a feature-request for that!"), but if you're talking about something in the next few days at Enwiki, there are lists in these 2 places: [18:26:52] https://en.wikipedia.org/wiki/Wikipedia:Meetup#Future_meetups and https://en.wikipedia.org/wiki/Category:Wikipedia_meetups_in_March_2018 [18:27:10] tgr: it is indeed the consumer you posted in Phab. [18:27:52] I can request a new consumer a couple of hours from now, but if live-hacking the grants on that consumer is an option, that would be awesome. [18:29:12] ragesoss: never tried it before; is everything you care about broken already or could it make things worse? :) [18:30:52] hahaha [18:31:06] yeah, could definitely be worse if the consumer broke. that would break login. [18:31:32] when do you need it fixed by? [18:31:35] ragesoss: the check uses ExemptFromAccountCreationThrottle which is not affected by OAuth so I could just add you to that [18:32:07] tgr: is that account-based? [18:32:23] that requires an IP address though and in this case the IP address would probably have to be the one for Toolforge [18:32:38] I don't think there is a single IP for toolforge [18:33:07] tgr: if we could do that shortterm for the IP of outreachdashboard.wmflabs.org, that would be helpful. [18:33:37] is ThrottleOverride in production already? [18:34:16] by later today I can add a new consumer. Today is the first day of Art+Feminism; there are about 300 editathons over the course of March, but just a few today. [18:34:26] tgr, nope, Still waiting for beta-cluster: https://phabricator.wikimedia.org/project/view/671/ [18:34:33] ragesoss, so they would all appear to come from 10.68.16.172 ? [18:34:33] (top-left card) [18:34:37] Krenair: do you think it's OK to whitelist Toolforge temporarily? [18:34:52] I believe so. [18:35:01] tgr, I don't think it's possible without whitelisting all of labs or all private IPs (bad idea). I also don't think we're talking about toolforge though [18:35:42] that outreachdashboard.wmflabs.org domain is not tools.wmflabs.org/outreachdashboard [18:35:43] oh, right, the edu dashboard is Cloud VPS [18:35:59] globaleducation outreachdashboard.wmflabs.org http://10.68.16.172:80 outreachdashboard.globaleducation.eqiad.wmflabs [18:36:16] in that case, should not be a problem to whitelist, right? [18:36:34] (project, domain, internal IP and port, name for internal IP) [18:37:08] tgr, probably not technically difficult, though you're trusting anything running through that box, and I don't know what restrictions ragesoss has placed on the system [18:38:18] i.e. can anyone go there without any permissions, log in and start making new accounts bypassing the rate limit? [18:38:24] we can just add a limit of 100 per day or something like that iin wmf-config/throttle.php [18:38:28] without any advanced* permissions [18:38:36] Krenair: it would be possible for anyone to use it to create a flood of accounts, although highly unlikely. the security model for that feature was built around assuming people who needed it would get Account Creator permissions. [18:38:47] ot much abuse can happen with that [18:39:19] ragesoss, when do you need this problem fixed by? [18:40:31] * bd808 should really help get that rate limits extension finished [18:41:12] Krenair: there are a few events going on right now, with probably less than 20 users without accounts affected. But the rest of the month is the much bigger part of it. If it's fixed by today via updated consumer, it'll be okay. [18:41:38] yeah, the new consumer should be the long-term fix [18:41:47] so it sounds like a consumer change would be an acceptable fix, and you can get that done soon enough? [18:41:48] (as in, longer than a few hours) [18:41:54] !log quarry deploying d5e2845 to quarry-runner-01 & 02 [18:41:56] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Quarry/SAL [18:42:50] yeah. I'd do it now, but I forgot my device with 2FA tokens at home, so I can't log in as Ragesoss and request a new consumer. [18:43:26] if it needs to be done before you can get to that then I doubt anyone would have a real problem with a temp account creation throttle raise for the instance, though I haven't been a deployer for over a year now, so [18:44:50] there is a SWAT window coming up in fifteen minutes so if you feel it's urgent I can do it now [18:45:24] otherwise, file a new consumer, most regulars in this channel can probably approve it for you [18:46:47] thanks all! really appreciate the help! I'll go AFK now and go the new consumer route in a few hours. [18:47:03] ragesoss, so do you want the short-term fix in the mean time? [18:47:21] yeah, that would be nice. [18:47:22] :) [18:47:26] tgr, ^ [18:51:14] ragesoss: is an account creation limit of 100 reasonable for today? [18:52:08] tgr: yes, that should be great for today. [18:55:05] ragesoss: Krenair: https://gerrit.wikimedia.org/r/c/415624/ [19:00:39] tgr, looks ok but I have a feeling that's 100 accounts on each wiki [19:00:47] indeed [19:00:53] ragesoss, does it let people create on any wiki or just enwiki or..? [19:00:57] if no wiki is specified, it takes all wikis [19:01:22] IIRC the account creation throttle is global [19:01:36] Hauskatze, right but more importantly the actual counting of attempts is ... per-wiki or global? [19:02:03] certainly I would expect this to set the limit across all wikis [19:02:07] if no wiki is specified, the counter I guess it's global [19:02:28] but I don't know [19:02:41] better to set it for a wiki or a couple of wikis [19:02:52] Urbanecm might know better [19:06:12] Krenair: any wiki. [19:06:33] whatever the main wiki is for each event is the one it'll go through. [19:17:24] Krenair: so yeah, checked the code, account creation throttles are global [19:17:34] ok [19:17:55] ragesoss: can you ask someone to verify that it works? [19:22:36] tgr: confirmed! [19:23:39] cool [19:24:01] it's only for half a day or so so please make sure to fix the permission issue [19:24:18] I guess the question was answered in the meanwhile :) [21:03:29] Here's the new consumer: https://meta.wikimedia.org/w/index.php?title=Special:OAuthListConsumers/view/5709c54e5e241577730e27c13e1a56cf&name=&publisher=Ragesoss&stage=0 [21:03:51] tgr: around to approve it? [21:04:18] * chicocvenancio wants a consumer approval as well... not urgent at all though [21:04:52] ragesoss: done [21:05:00] thanks! [21:06:30] chicocvenancio: also done [21:11:42] tgr: new consumer is live now. :-) [21:14:17] chicocvenancio: I think bd808 can do it but I don't have the rights [21:14:34] tgr already did it [21:14:48] if you mean the oauth consumer.. [21:15:51] I do have the rights for those, so feel free to ping me in the future :) [21:16:46] cool [21:25:52] I have too [21:26:00] but don't do much of them