[15:40:41] Can anyone here tell me Wikipedia's maximum crawl rate? [15:42:09] What sort of crawling? [15:46:53] Web crawling. I'm trying to get some information for a bot I'm building [15:47:11] What are you requesting? [15:47:13] API calls? [15:47:16] Loading HTML of pages? [15:48:12] Loading html. Where can I find these APIs? [15:48:44] https://www.mediawiki.org/wiki/Wikimedia_REST_API [15:49:17] https://en.wikipedia.org/w/api.php [15:49:55] https://www.mediawiki.org/wiki/API:Main_page [15:51:40] Thanks! I'll check those out. In the meantime, do you happen to know the "speed limit"? I seem to recall having found it once, but I don't remember what it is or how to find it again. [15:53:32] https://wikitech.wikimedia.org/wiki/Robot_policy [15:53:35] https://en.wikipedia.org/wiki/Wikipedia:Don%27t_worry_about_performance [15:54:30] That's exactly what I needed. Thanks a lot. [15:55:39] Nice tech support Reedy [15:56:10] dancy: Hardest thing is sometimes finding the docs... :) [15:56:25] Nod. There's a ton of content [16:21:43] [[Tech]]; IFried (WMF); /* "Watch This Page", "Permanent" */; https://meta.wikimedia.org/w/index.php?diff=20563135&oldid=20547358&rcid=16482489