[00:11:37] Dispenser: in what db? [00:12:14] cluster "web" it seem to time out before my query killer kicks in at 180 seconds [00:15:50] I'm not sure what the config is for the query killer there [00:16:19] but I think it's set dynamically based on load [00:39:41] Dispenser: yes, it seems "slow queries" are defined as those running more than 60s in web wikireplicas [00:49:10] Dispenser: scratch that. It seems it is 60 minutes at the moment (at least was in January). [00:49:24] what is the error you're seeing? [01:17:39] chicocvenancio: I'm see "'Prepared statement needs to be re-prepared'". I've only encountered this when testing my query-killer, to see what error codes would be thrown (turns out too many so I just check query time to throw out a special exception) [01:21:39] Dispenser: seems worth a phab task, I'm pretty sure this isn't the query-killer (but I could be wrong) [01:22:36] Ok, its a bit hard to replicate (query caching on server). But I'll include more details. [01:24:01] thanks [01:36:04] Dispenser: I know this bug. it's supposed to be fixed now [01:36:35] https://phabricator.wikimedia.org/T179041 [01:37:17] (or is there something else going on?) [01:53:27] zhuyifei1999_: I saw elapsed time of 90 seconds and it seems to hard to replicate [01:56:04] race condition? [12:16:00] !log tools running `apt-get autoremove` in canary servers [12:16:04] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [12:23:50] !log tools running `apt-get autoclean` in canary servers [12:23:55] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [12:45:04] bd808: clazz here are not typos right? https://gerrit.wikimedia.org/r/#/c/414972/ [13:43:31] !log git upgrading puppet-paladox to stretch. [13:43:33] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL [14:02:11] is time/date on toolforge k8s set correctly, my bot is experiencing weird behaviour [14:05:48] Zppix: afaik it is, if you can provide more information then I can assess better whether there is an issue [14:06:25] chasemp: Well one of my bots functions relay on time and suddenly its just been acting up, but I have no logs on to why... so I assumed it was time/date setup [14:06:30] rely* [14:09:24] Zppix: nothing changed recently to my knowledge [14:10:11] strange... [14:10:29] And I've seen date outputs from grid and k8s consistent [14:11:09] I can try to assist more if you give more details [14:11:23] chicocvenancio: I dont really have any details, my bot is running on python 2 [14:11:35] chicocvenancio: logs dont say anythnig [16:15:07] https://www.irccloud.com/pastebin/sJtzrbD1/ [16:15:38] Zppix: fwiw ^ grid, k8s and bastion agree on date [16:16:27] Weird [16:37:16] !log phabricator upgrade puppet-phabricator to stretch (sed -i 's/jessie/stretch/g' /etc/apt/sources.list) [16:37:18] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Phabricator/SAL [17:37:15] !log add chico as admin to toolsbeta [17:37:16] chasemp: Unknown project "add" [17:37:21] !log tools add chico as admin to toolsbeta [17:37:26] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [17:57:07] hi channel, qq: I have some questions about the Wikimedia API, do you know who can I contact? [17:59:06] dsaez: the easiest thing might be an email to the wikitech-l mailing list, but I guess it depends on the type of questions you have [17:59:25] thanks bd808 [17:59:52] like are you wanting to know how to use the Action API, or are you wanting to know how to make a new action, or ... ? [18:00:29] there are lots of folks about who know many, many things about how to use the Action API to do things [18:01:06] this channel might be good for random questions too :) [18:11:20] andrewbogott, chasemp, paravoid: thanks for your guidance getting that licensing stuff figured out! great to see it's already merged. [18:14:45] bd808, I want to use the parser intensivily, and I was wondering if calling the API is the best way to do it, or if there is any offline tool that might do the same work, as good as the API [18:15:45] dsaez: well.... a local MediaWiki install would be the "offline" tool [18:16:15] bd808, yes but the API gets all the templates by default [18:17:27] yes, If you need things like enwiki template expansion then you'd need them locally too or as you say to use the Action API [18:18:10] ok [18:20:59] dsaez: what do you mean with "intensivily"? [18:22:00] *intensely, around 10 millions queries, for example. [18:22:15] on which time span? [18:22:26] ASAP xD [18:22:34] exactly :D [18:22:39] that is the question i guess. [18:22:57] do you want to parse all enwiki pages? [18:23:11] or something else? [18:23:26] yes, and more than one revision. [18:23:52] ariel wanted to do an html dump soon [18:24:31] I would coordinate to avoid doing the same work twice [18:25:00] I see. [18:25:40] other than that, the rest api has precached the last revision of each page (but only the latest) [18:27:57] as a very general guideliness, we frown upon bots doing queries in concurrency if they are non-stop [18:28:41] not that we cannot handle multiple simultaneous queries- just that we ask not to take over too many resources [18:29:00] think if serial api.php queries would be fast enough for you [18:34:24] got it, I'll explore other options, maybe local installation, plus importing all the templates [18:34:38] but I don't know how to get&import templates [18:45:10] Dispenser: https://en.wiktionary.org/wiki/Special:Export [18:45:21] oops dsaez [18:45:55] * zhuyifei1999_ was supposed to link to wikipedia instead of wiktionary [18:46:59] zhuyifei1999_ i'll check, thanks [18:47:12] np [20:56:26] !log phragile - puppet tries to run "composer install" but that fails with return code 255 - that leads to dependency issues and ultimately "Info: Class[Phragile]: Unscheduling all events on Class[Phragile]" and that means i can't apply the changes from gerrit:415092 even though it looks like puppet is running [20:56:28] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Phragile/SAL [21:03:46] !log phragile - composer install fails because: HP Fatal error: Uncaught exception 'UnexpectedValueException' with message 'The stream or file "/var/lib/phragile/phragile/storage/logs/laravel-2018-02-27.log" could not be opened [21:03:49] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Phragile/SAL [21:13:55] !log phragile - fixed permission issues which were root cause for PHP Fatal error on "composer install" | chown www-data:phragile laravel-2018-02-27.log and ./storage/logs dirs above it [21:13:57] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Phragile/SAL [21:14:29] !log phragile - now new ErrorException. fopen(/var/lib/phragile/phragile/bootstrap/cache/compiled.php): failed to open stream: Permission denied (and that ./bootstrap/ path doesn't exit) [21:14:30] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Phragile/SAL [21:28:33] !log phragile - also fixed permissions on /var/lib/phragile/phragile and let phragile user write to it. chown root:phragile compiled.php ; chmod g+w compiled.php | Manually ran composer install command as phragile with right env. Now puppet agent run was fixed (at least once) but it changes permissions back. [21:28:35] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Phragile/SAL [22:44:18] hey bd808 - that patch you removed from yourself, you're listed as owner :) [23:06:07] Hauskatze: I'm the owner? weird [23:06:23] one of them [23:06:31] that's why added you [23:06:36] sorry for the trouble