[00:16:24] !log tools remounted NFS for tools-k8s-control-3 and tools-acme-chief-01 [00:16:27] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [00:42:03] when I was searching for pagecounts dumps in toolforge I found something strange: http://dpaste.com/3067NC8 [00:42:47] I'm going to guess that symlinks are involved. [00:43:12] yup [00:43:26] I want to access /public/dumps/pagecounts-ez, what the best way to do that? [00:44:32] best? [00:45:44] 'cd /public/dumps/pagecounts-ez' returns 'No such file or directory' [00:46:52] /public/dumps/pageviews is a symlink to /mnt/nfs/dumps-labstore1007.wikimedia.org/other/pageviews [00:47:22] indeed [00:47:25] /mnt/nfs/dumps-labstore1007.wikimedia.org/other/pagecounts-ez [00:48:13] note that that path may not be stable if dumps-labstore1007 goes down/is replaced/whatever [00:48:49] that path is accessible by a script running in grid engine and k8s? [00:49:29] there's one way to find out [00:49:35] * Reedy grins [00:49:57] ok, I will test [00:53:12] yes, I can access that path in grid engine and k8s, thanks [07:57:52] !log deployment-prep Update QuickSurveys config [07:57:55] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL [08:15:38] !log deployment-prep Granted dewiki-beta sysop to Adamw via commandline [08:15:40] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL [08:44:03] Hello everyone, I am a Google Summer of Code student working with Wikimedia Foundation on the task https://phabricator.wikimedia.org/T248341 [08:45:01] I would like to create a new database and tables for my project on toolsforge, how can I get permission to create a new database? [08:48:03] madhurgupta10: hello! looks like this might be it: https://wikitech.wikimedia.org/wiki/Help:Toolforge/Database#User_databases [08:50:10] Thank you for your message. Could you please explain the puporse of this command? `mysql --defaults-file=$HOME/replica.my.cnf -h tools.db.svc.eqiad.wmflabs` [08:50:59] that commands loads your credentials file and selects the destination host for the database connection [08:52:18] Okay thanks, how can I verify if I have the permission to create new databases? [08:52:42] I am working on this one https://toolsadmin.wikimedia.org/tools/id/commons-android-app [09:10:41] madhurgupta10: just try :-P [09:12:31] i.e, step 3 in the docs [09:27:22] Okay thanks arturo :) [09:34:35] * arturo errand [11:01:18] !log paws created VM paws-acme-chief-01 (T255252) [11:01:20] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [11:01:20] T255252: PAWS: enable acme-chief in the project - https://phabricator.wikimedia.org/T255252 [11:02:50] !log paws created puppet prefix 'paws-acme-chief' (T255252) [11:02:51] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [11:31:57] !log paws introduced acme-chief private data into labs/private in paws-puppetmaster-01 (T255252) [11:32:00] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [11:32:00] T255252: PAWS: enable acme-chief in the project - https://phabricator.wikimedia.org/T255252 [11:51:41] !log paws created service account `paws-dns-manager` in wikitech (T255252) [11:51:44] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [11:51:44] T255252: PAWS: enable acme-chief in the project - https://phabricator.wikimedia.org/T255252 [11:55:04] !log paws `aborrero@cloudcontrol1004:~ $ sudo wmcs-openstack role add --user paws-dns-manager --project paws designateadmin` (T255252) [11:55:05] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [11:55:10] !log paws `aborrero@cloudcontrol1004:~ $ sudo wmcs-openstack role add --user paws-dns-manager --project paws observer` (T255252) [11:55:12] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [13:05:21] !log paws live-hacking puppet tree in paws-puppetmaster-01 for T195217 [13:05:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [13:05:23] T195217: Simplify ingress methods for PAWS - https://phabricator.wikimedia.org/T195217 [13:10:58] !log tools live-hacing puppet tree in tools-puppetmaster-02 for testing PAWS related patch (they share haproxy puppet code) [13:11:00] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [13:13:37] !log paws live-hacking session in the puppetmaster ended [13:13:38] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [13:13:42] !log tools live-hacking session in the puppetmaster ended [13:13:43] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [13:20:46] !log admin created DNS zone `paws.wmcloud.org` (T195217) [13:20:49] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [13:20:49] T195217: Simplify ingress methods for PAWS - https://phabricator.wikimedia.org/T195217 [13:23:28] !log admin DNS zone `paws.wmcloud.org` transferred to the PAWS project (T195217) [13:23:30] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [13:23:53] !log paws assigned the DNS zone `paws.wmcloud.org` (T195217) [13:23:55] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [17:27:33] Anyone know who to add a lighttpd rule for redirects [17:27:59] so project.toolforge.org is /index.html [17:28:13] Project.toolforge.org/$1.html is /$1 [17:29:17] We currently have the 1st rule and also project.toolforge.org/path/w/index.php/page is /wiki/page [17:29:21] That is set noe [17:29:32] MacFan4000: what's the current exact config [17:35:13] RhinosF1: did you look at the docs on wikitech? [17:35:27] bd808: what docs? [17:36:01] the docs you kind of obviously didn't look for. :) -- https://wikitech.wikimedia.org/wiki/Help:Toolforge/Web/Lighttpd [17:36:45] bd808: I tried stack overflow [17:38:34] Toolforge is an elaborate multi-year experiment to find out if folks can survive without SO to answer their questions. [17:39:53] https://www.irccloud.com/pastebin/nQ9dcykN [17:39:59] bd808: ^ [17:40:43] $0 is the whole match, so that rewrite doesn't really rewrite anything [17:41:21] "(.*).html" => "$1" -- that might be what you need [17:41:54] oh, with the '.' before html excaped [17:42:38] bd808: $0 to $1 and (.*)\.html?? [17:43:13] might work, yes [17:43:49] MacFan4000: ^ try that [17:43:56] you may want other anchoring too. Its not super clear to me what you are trying to achieve [17:43:58] It's in my paste [17:44:06] bd808: anchoring? [17:44:21] * RhinosF1 is trying to drop the .html from the canonical url [17:44:37] so project.toolforge.org/about [17:44:53] Would show the same as project.toolforge.org/about.html [17:45:18] both by reading a public_html/about.html source file or? [17:45:27] Yeah [17:45:40] that's an alias and not a redirect [17:46:06] Source file is at data/project/project/repo/public_html/about.html [17:46:20] bd808: every google search indicates to use a rewrite rule [17:46:29] (Not redirect rule) [17:46:33] But go on [17:46:49] oh, sure. rewrite is a variation on alias [17:47:11] So https://www.irccloud.com/pastebin/nQ9dcykN would work? [17:47:19] As that's a rewrite url? [17:47:33] Assuming I also fix the sitemap + canonical tag [17:48:46] What you want is actually the inverse of what you are trying though. The right hand side is the "canonical" based on file system state. So if you want foo.toolforge.org/about to internally resolve to $DOCROOT/about.html you need to be adding the ".html" before lighttpd looks on the file system [17:50:04] the rule you are proposing does the opposite, it tells lighttpd that your on disk files do not have a .html extension [17:50:44] https://www.irccloud.com/pastebin/hhQS7SRH/ [17:50:57] that is what's currently in .lighttpd.conf [17:51:35] I'm still very amused that y'all do so much work to run a wiki there with what, 4 pages of content? [17:51:59] bd808: They will be more [17:52:10] its a pretty slow and bloated system to use for a tiny number of non-collaborative documents [17:52:18] I just need to write some of the dev docs [17:52:25] Which is what the wiki is for [17:52:36] The website is user docs [17:52:37] * bd808 shrugs [17:53:44] you could much more easily dod the doc wiki over at miraheze where your users are too right? [17:53:50] *do the doc [17:54:16] That's sane [17:54:29] I wonder why no one has ever thought of that [17:56:53] The website is basic [17:57:00] But the wiki is a pain [17:57:47] toolforge is not built to run mediawiki easily. it is possible, but not a core use case at all [17:58:38] I've gathered that. Maybe we should move the wiki and just keep the static site on toolforge [17:58:53] Or just move the few bits of dev docs to wikitech [17:59:11] As a subpage of Tool:ZppixBot [17:59:33] i mean we have some dev docs in documentation.html [17:59:58] (managing bot/module development) [18:00:17] MacFan4000: Well yeah [18:00:38] The wiki is a dump for dev stuff tbh [18:00:43] Like ideas [18:01:05] It's a skectch pad and notes for things that don't need to be on the static site [18:01:48] bd808: you are fascinated by how much we do for an irc bot aren't you [18:03:25] Fascinated is maybe not the word I would choose... [18:03:35] yeah https://wikitech.wikimedia.org/wiki/Tool:Zppixbot doesn't have much [18:04:05] bd808: what would you use? [18:04:22] Confused. [18:05:14] y'all are obsessively monitoring and tweaking what looks to be a small toy [18:06:25] We are pretty insane [18:06:51] And yes it is a literal fun project that we run because we can [18:08:04] Because you can? [18:08:10] You mean, because Wikimedia will let you? ;) [18:08:13] I have been watching more lately because y'all have been explicitly pinging me and my engineering team. And the more I watch the more I wonder how this compute power and attention from Foundation staff is advancing the Wikimedia movement. [18:08:34] Reedy: well yes [18:09:26] bd808: we have it running in channels of wikimedia users and it has functions allowing basic editing via the mw api [18:09:57] editing of Wikimedia project wikis? [18:10:21] like constructive article edits? [18:10:52] the source repo says "ZppixBot is an IRC bot mainly used by Miraheze (#miraheze on freenode)." [18:11:38] And I would agree that Miraheze is Wikimedia movement adjacent... [18:12:04] bd808: it's not been switched on for any wikimedia wiki. It's a /status page updater script. [18:12:13] but we don't run bots here for Fandom... [18:12:28] I can tone are asking for help down if better [18:12:33] RhinosF1: so it's a toy to play with your User: namespace [18:12:35] And move the wiki [18:12:52] bd808: it's used to show whose active [18:13:22] But not too widely used [18:20:50] bd808: if i/we're a bit too needy, just say. I do thank you and appreciate the work you do to help us and understand you probably have better to do [18:49:03] !log paws deployed a test of paws chart in the new cluster T211096 [18:49:06] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [18:49:06] T211096: PAWS: Rebuild and upgrade Kubernetes - https://phabricator.wikimedia.org/T211096 [19:41:49] !log toolsbeta set `profile::wmcs::nfsclient::mode: soft` on toolsbeta-workflow-test T127559 [19:41:51] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [19:41:51] T127559: Soft mount option via hiera for NFS - https://phabricator.wikimedia.org/T127559 [20:05:02] bd808: I messed up the callback URL |:( [20:05:14] so resubmitted [20:19:15] valhallasw`cloud: {{done}} [20:22:42] redirect works, login works, now I just need to find some time to upgrade the virtualenv to a non-ancient python :-) [20:23:26] valhallasw`cloud: I have similar problems :) I did a few recently, but have many py3.4 things still rotting [20:25:01] valhallasw`cloud: legoktm made it a tiny bit easier with `webservice-python-bootstrap --fresh`, but you still have to fix flask api changes, etc [20:25:27] oooh [20:25:36] * bd808 should really figure out how to have `webservice shell -- something/in/container do` work [20:25:51] depending on the weather I hope to take a look at it this weekend [20:26:32] To use webservice-python-bootstrap you do `webservice shell` first and then that inside the running pod [20:27:15] --fresh will rm your current www/python/venv and then make one from www/python/src/requirements.txt [20:29:15] the main thing I've found to deal with in upgrading flask things is the removal of werkzeug.contrib.fixers [20:29:41] specifically, werkzeug.contrib.fixers.ProxyFix is now werkzeug.middleware.proxy_fix.ProxyFix [20:30:18] most of my flask stuff is as bog standard as it can be, maybe with the oauth stuff as an exception... so I hope it'll be OK