[01:01:36] bd808: did I miss anything? [01:02:03] bd808: I was asking about a php code whose webservice does not automatically restart, and when I do it manually, I have to restart it twice for the web service to come back up [08:56:57] !log integration T223148 reallocating integration-puppetmaster01 to cloudvirt1001 [08:57:00] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Integration/SAL [08:57:00] T223148: Cloud Services: reallocate workload from rack B5-eqiad - https://phabricator.wikimedia.org/T223148 [08:58:38] bd808: hi [08:59:41] Sveta: is the middle of the night for bryan, can I help you instead? [09:00:14] arturo: a php script crashes on some inputs, i want it to restart automatically when it happens. not sure why the webservice doesn't restart in this case [09:00:20] !log tools T223148 depool tools-sgeexec-0901 and reallocate to cloudvirt1004 [09:00:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [09:00:51] arturo: he was looking into it before, but I disconnected and lost the chat [09:02:46] Sveta: I would suggest using a more async communication method, like email. The cloud@lists.wikimedia.org mailing list is a great place to share questions and issues. Also phabricator [09:03:01] that being said, your use case I think is one we support in toolforge (automatic restart of webservices) [09:03:05] let me find some docs [09:04:29] Sveta: is a webservice your job? in the grid? [09:04:43] yes it is mine [09:04:50] https://wikitech.wikimedia.org/wiki/Help:Toolforge/Grid#Submitting_continuous_jobs_(such_as_bots)_with_'jstart' [09:04:55] Sveta: try that ^^^ [09:05:10] I am bad at troubleshooting by email, I often forget to include information and miss what I was told [09:05:16] thanks, I will try this [09:05:24] currently I use 'webservice start' for it [09:05:43] how do I do it with jstart instead? [09:06:03] there is no 'program' command that I have [09:06:08] I don't have it [09:07:19] I see [09:07:29] we need that webservice monitor thing [09:10:55] Sveta: please open a phabricator task and I will take a look later [09:13:34] !log integration T223148 reallocating integration-castor03 to cloudvirt1002 [09:13:36] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Integration/SAL [09:13:37] T223148: Cloud Services: reallocate workload from rack B5-eqiad - https://phabricator.wikimedia.org/T223148 [09:20:43] !log integration T223148 reallocating saucelabs-01 to cloudvirt1007 [09:20:46] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Integration/SAL [09:20:46] T223148: Cloud Services: reallocate workload from rack B5-eqiad - https://phabricator.wikimedia.org/T223148 [09:25:37] !log integration add myself as projectadmin [09:25:38] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Integration/SAL [09:31:08] !log integration updating DNS servers in integration-puppetmaster01 and reboot [09:31:10] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Integration/SAL [09:44:08] !log tools T223148 repool tools-sgeexec-0901 [09:44:11] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [09:44:11] T223148: Cloud Services: reallocate workload from rack B5-eqiad - https://phabricator.wikimedia.org/T223148 [10:36:40] !log integration T223148 reallocation of integration-castor03 is now done [10:36:44] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Integration/SAL [10:36:45] T223148: Cloud Services: reallocate workload from rack B5-eqiad - https://phabricator.wikimedia.org/T223148 [10:46:14] !log tools T223148 depool tools-sgeexec-0941 and move to cloudvirt1005 [10:46:18] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [10:46:18] T223148: Cloud Services: reallocate workload from rack B5-eqiad - https://phabricator.wikimedia.org/T223148 [11:11:07] !log tools T223148 repool tools-sgeexec-0941 [11:11:10] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [11:11:10] T223148: Cloud Services: reallocate workload from rack B5-eqiad - https://phabricator.wikimedia.org/T223148 [11:20:50] !log tools T223148 depool tools-sgeexec-0940 and move to cloudvirt1006 [11:20:56] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [11:20:57] T223148: Cloud Services: reallocate workload from rack B5-eqiad - https://phabricator.wikimedia.org/T223148 [11:34:33] !log tools T223148 repool tools-sgeexec-0940 [11:34:36] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [11:34:36] T223148: Cloud Services: reallocate workload from rack B5-eqiad - https://phabricator.wikimedia.org/T223148 [12:07:43] !log bastion T223148 move bastion-eqiad1-02 to cloudvirt1001 [12:07:46] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Bastion/SAL [12:07:46] T223148: Cloud Services: reallocate workload from rack B5-eqiad - https://phabricator.wikimedia.org/T223148 [12:13:06] !log tools T223148 depool tools-sgeexec-0939 and move to cloudvirt1007 [12:13:09] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [12:13:09] T223148: Cloud Services: reallocate workload from rack B5-eqiad - https://phabricator.wikimedia.org/T223148 [12:13:18] !log tools T223148 depool tools-sgeexec-0937 and move to cloudvirt1008 [12:13:20] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [12:29:54] !log tools T223148 repool both tools-sgeexec-09[37,39] [14:01:32] Technical Advice IRC meeting starting in 60 minutes in channel #wikimedia-tech, hosts: @alaa_wmde & @nuria - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [14:50:48] Technical Advice IRC meeting starting in 10 minutes in channel #wikimedia-tech, hosts: @alaa_wmde & @nuria - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [14:52:32] huh, for some reason the TAIM announcement in this channel has an extra space at the beginning o_O [15:04:21] Lucas_WMDE: I think that's an artifact caused by the lack of auth token to authenticate to wm-bot in this channel [15:32:28] !log tools T223148 depool tools-sgeexec-0920 and move to cloudvirt1014 [15:32:32] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [15:32:33] T223148: Cloud Services: reallocate workload from rack B5-eqiad - https://phabricator.wikimedia.org/T223148 [15:32:35] !log tools T223148 depool tools-sgeexec-0921 and move to cloudvirt1014 [15:32:37] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [16:20:03] !log tools T223148 repool both tools-sgeexec-0921 and -0929 [16:20:06] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [16:20:06] T223148: Cloud Services: reallocate workload from rack B5-eqiad - https://phabricator.wikimedia.org/T223148 [17:00:57] !log admin touching /root/firstboot_done on all VMs that cumin can reach. This will prevent firstboot.sh from running a second time if/when any of these are rebooted. T223370 [17:01:00] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [17:01:00] T223370: CloudVPS DNS: weird behavior in integration-puppetmaster01 - https://phabricator.wikimedia.org/T223370 [17:43:35] Hi, I just wanted to report that I'm getting a 500 Internal Server error for https://toolsadmin.wikimedia.org/profile/settings/ssh-keys/delete Is there someone here that can take a look? Thank you! [17:47:18] hmonroy: I see the problem too — I'll open a ticket [17:48:56] T223394 [17:48:57] T223394: https://toolsadmin.wikimedia.org/profile/settings/ssh-keys/delete throws a 500 - https://phabricator.wikimedia.org/T223394 [17:49:52] Thank you andrewbogott ! [20:24:57] !log tools.quickcategories Toolforge dologmsg test (T222244) [20:25:00] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.quickcategories/SAL [20:32:15] 🎉