{"action":"closed","issue":{"url":"https://api.github.com/repos/quintilesims/layer0/issues/34","repository_url":"https://api.github.com/repos/quintilesims/layer0","labels_url":"https://api.github.com/repos/quintilesims/layer0/issues/34/labels{/name}","comments_url":"https://api.github.com/repos/quintilesims/layer0/issues/34/comments","events_url":"https://api.github.com/repos/quintilesims/layer0/issues/34/events","html_url":"https://github.com/quintilesims/layer0/issues/34","id":200458950,"number":34,"title":"Environment delete error due to waiting for tasks to stop","user":{"login":"tribaljack","id":24942917,"avatar_url":"https://avatars.githubusercontent.com/u/24942917?v=3","gravatar_id":"","url":"https://api.github.com/users/tribaljack","html_url":"https://github.com/tribaljack","followers_url":"https://api.github.com/users/tribaljack/followers","following_url":"https://api.github.com/users/tribaljack/following{/other_user}","gists_url":"https://api.github.com/users/tribaljack/gists{/gist_id}","starred_url":"https://api.github.com/users/tribaljack/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tribaljack/subscriptions","organizations_url":"https://api.github.com/users/tribaljack/orgs","repos_url":"https://api.github.com/users/tribaljack/repos","events_url":"https://api.github.com/users/tribaljack/events{/privacy}","received_events_url":"https://api.github.com/users/tribaljack/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2017-01-12T19:33:36Z","updated_at":"2017-01-27T02:04:11Z","closed_at":"2017-01-27T02:04:11Z","body":"deleted environment once,\r\nthat seemed to hang:\r\n\r\n```\r\nl0-job\r\n------\r\n2016-12-08 01:49:02 [Main] INFO : Loading job '4e4fb3df25de'\r\n2016-12-08 01:49:02 [Main] INFO : Running step 'Delete Dependencies'\r\n2016-12-08 01:49:02 [Main] INFO : Running Action: DeleteEnvironmentServices\r\n2016-12-08 01:49:02 [Main] INFO : Running Action: DeleteEnvironmentLoadBalancers\r\n2016-12-08 01:49:03 [Main] INFO : Running Action: DeleteService on 'TheChune7a13'\r\n2016-12-08 01:49:03 [Main] DEBUG: Waiting for service to stop\r\n2016-12-08 01:49:03 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 1 of %!s(int=10)\r\n2016-12-08 01:49:07 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 2 of %!s(int=10)\r\n\r\n```\r\ndeleted again\r\nthat failed:\r\n```\r\n ~  l0 job logs 4e4fb3df25de\r\nl0-job\r\n------\r\n2016-12-08 01:49:02 [Main] INFO : Loading job '4e4fb3df25de'\r\n2016-12-08 01:49:02 [Main] INFO : Running step 'Delete Dependencies'\r\n2016-12-08 01:49:02 [Main] INFO : Running Action: DeleteEnvironmentServices\r\n2016-12-08 01:49:02 [Main] INFO : Running Action: DeleteEnvironmentLoadBalancers\r\n2016-12-08 01:49:03 [Main] INFO : Running Action: DeleteService on 'TheChune7a13'\r\n2016-12-08 01:49:03 [Main] DEBUG: Waiting for service to stop\r\n2016-12-08 01:49:03 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 1 of %!s(int=10)\r\n2016-12-08 01:49:07 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 2 of %!s(int=10)\r\n2016-12-08 01:49:11 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 3 of %!s(int=10)\r\n2016-12-08 01:49:15 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 4 of %!s(int=10)\r\n2016-12-08 01:49:19 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 5 of %!s(int=10)\r\n2016-12-08 01:49:23 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 6 of %!s(int=10)\r\n2016-12-08 01:49:27 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 7 of %!s(int=10)\r\n2016-12-08 01:49:31 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 8 of %!s(int=10)\r\n2016-12-08 01:49:35 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 9 of %!s(int=10)\r\n2016-12-08 01:49:39 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 10 of %!s(int=10)\r\n2016-12-08 01:49:43 [Main] WARN : Wait for `Stop Service l0-prod084-TheChune7a13` timeout\r\n2016-12-08 01:49:53 [Main] INFO : Running Action: DeleteService on 'TheChune7a13'\r\n2016-12-08 01:49:53 [Main] DEBUG: Waiting for service to stop\r\n2016-12-08 01:49:53 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 1 of %!s(int=10)\r\n2016-12-08 01:49:57 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 2 of %!s(int=10)\r\n2016-12-08 01:50:01 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 3 of %!s(int=10)\r\n2016-12-08 01:50:05 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 4 of %!s(int=10)\r\n2016-12-08 01:50:09 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 5 of %!s(int=10)\r\n2016-12-08 01:50:13 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 6 of %!s(int=10)\r\n2016-12-08 01:50:17 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 7 of %!s(int=10)\r\n2016-12-08 01:50:21 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 8 of %!s(int=10)\r\n2016-12-08 01:50:25 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 9 of %!s(int=10)\r\n2016-12-08 01:50:29 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 10 of %!s(int=10)\r\n2016-12-08 01:50:33 [Main] WARN : Wait for `Stop Service l0-prod084-TheChune7a13` timeout\r\n2016-12-08 01:50:43 [Main] INFO : Running Action: DeleteService on 'TheChune7a13'\r\n2016-12-08 01:50:43 [Main] DEBUG: Waiting for service to stop\r\n2016-12-08 01:50:43 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 1 of %!s(int=10)\r\n2016-12-08 01:50:47 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 2 of %!s(int=10)\r\n2016-12-08 01:50:51 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 3 of %!s(int=10)\r\n2016-12-08 01:50:55 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 4 of %!s(int=10)\r\n2016-12-08 01:50:59 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 5 of %!s(int=10)\r\n2016-12-08 01:51:03 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 6 of %!s(int=10)\r\n2016-12-08 01:51:07 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 7 of %!s(int=10)\r\n2016-12-08 01:51:11 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 8 of %!s(int=10)\r\n2016-12-08 01:51:15 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 9 of %!s(int=10)\r\n2016-12-08 01:51:19 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 10 of %!s(int=10)\r\n2016-12-08 01:51:23 [Main] WARN : Wait for `Stop Service l0-prod084-TheChune7a13` timeout\r\n2016-12-08 01:51:33 [Main] INFO : Running Action: DeleteService on 'TheChune7a13'\r\n2016-12-08 01:51:33 [Main] DEBUG: Waiting for service to stop\r\n2016-12-08 01:51:33 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 1 of %!s(int=10)\r\n2016-12-08 01:51:37 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 2 of %!s(int=10)\r\n2016-12-08 01:51:42 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 3 of %!s(int=10)\r\n2016-12-08 01:51:46 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 4 of %!s(int=10)\r\n2016-12-08 01:51:50 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 5 of %!s(int=10)\r\n2016-12-08 01:51:54 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 6 of %!s(int=10)\r\n2016-12-08 01:51:58 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 7 of %!s(int=10)\r\n2016-12-08 01:52:02 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 8 of %!s(int=10)\r\n2016-12-08 01:52:06 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 9 of %!s(int=10)\r\n2016-12-08 01:52:10 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 10 of %!s(int=10)\r\n2016-12-08 01:52:14 [Main] WARN : Wait for `Stop Service l0-prod084-TheChune7a13` timeout\r\n2016-12-08 01:52:24 [Main] INFO : Running Action: DeleteService on 'TheChune7a13'\r\n2016-12-08 01:52:24 [Main] DEBUG: Waiting for service to stop\r\n2016-12-08 01:52:24 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 1 of %!s(int=10)\r\n2016-12-08 01:52:28 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 2 of %!s(int=10)\r\n2016-12-08 01:52:32 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 3 of %!s(int=10)\r\n2016-12-08 01:52:36 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 4 of %!s(int=10)\r\n2016-12-08 01:52:40 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 5 of %!s(int=10)\r\n2016-12-08 01:52:44 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 6 of %!s(int=10)\r\n2016-12-08 01:52:48 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 7 of %!s(int=10)\r\n2016-12-08 01:52:52 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 8 of %!s(int=10)\r\n2016-12-08 01:52:56 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 9 of %!s(int=10)\r\n2016-12-08 01:53:00 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 10 of %!s(int=10)\r\n2016-12-08 01:53:04 [Main] WARN : Wait for `Stop Service l0-prod084-TheChune7a13` timeout\r\n2016-12-08 01:53:14 [Main] INFO : Running Action: DeleteService on 'TheChune7a13'\r\n2016-12-08 01:53:14 [Main] DEBUG: Waiting for service to stop\r\n2016-12-08 01:53:14 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 1 of %!s(int=10)\r\n2016-12-08 01:53:18 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 2 of %!s(int=10)\r\n2016-12-08 01:53:22 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 3 of %!s(int=10)\r\n2016-12-08 01:53:26 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 4 of %!s(int=10)\r\n2016-12-08 01:53:30 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 5 of %!s(int=10)\r\n2016-12-08 01:53:34 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 6 of %!s(int=10)\r\n2016-12-08 01:53:38 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 7 of %!s(int=10)\r\n2016-12-08 01:53:42 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 8 of %!s(int=10)\r\n2016-12-08 01:53:46 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 9 of %!s(int=10)\r\n2016-12-08 01:53:50 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 10 of %!s(int=10)\r\n2016-12-08 01:53:54 [Main] WARN : Wait for `Stop Service l0-prod084-TheChune7a13` timeout\r\n2016-12-08 01:54:04 [Main] INFO : Running Action: DeleteService on 'TheChune7a13'\r\n2016-12-08 01:54:04 [Main] DEBUG: Waiting for service to stop\r\n2016-12-08 01:54:04 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 1 of %!s(int=10)\r\n2016-12-08 01:54:08 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 2 of %!s(int=10)\r\n2016-12-08 01:54:12 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 3 of %!s(int=10)\r\n2016-12-08 01:54:16 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 4 of %!s(int=10)\r\n2016-12-08 01:54:20 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 5 of %!s(int=10)\r\n2016-12-08 01:54:24 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 6 of %!s(int=10)\r\n2016-12-08 01:54:28 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 7 of %!s(int=10)\r\n2016-12-08 01:54:32 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 8 of %!s(int=10)\r\n2016-12-08 01:54:37 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 9 of %!s(int=10)\r\n2016-12-08 01:54:41 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 10 of %!s(int=10)\r\n2016-12-08 01:54:45 [Main] WARN : Wait for `Stop Service l0-prod084-TheChune7a13` timeout\r\n2016-12-08 01:54:55 [Main] INFO : Running Action: DeleteService on 'TheChune7a13'\r\n2016-12-08 01:54:55 [Main] DEBUG: Waiting for service to stop\r\n2016-12-08 01:54:55 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 1 of %!s(int=10)\r\n2016-12-08 01:54:59 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 2 of %!s(int=10)\r\n2016-12-08 01:55:03 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 3 of %!s(int=10)\r\n2016-12-08 01:55:07 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 4 of %!s(int=10)\r\n2016-12-08 01:55:11 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 5 of %!s(int=10)\r\n2016-12-08 01:55:15 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 6 of %!s(int=10)\r\n2016-12-08 01:55:19 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 7 of %!s(int=10)\r\n2016-12-08 01:55:23 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 8 of %!s(int=10)\r\n2016-12-08 01:55:27 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 9 of %!s(int=10)\r\n2016-12-08 01:55:31 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 10 of %!s(int=10)\r\n2016-12-08 01:55:35 [Main] WARN : Wait for `Stop Service l0-prod084-TheChune7a13` timeout\r\n2016-12-08 01:55:45 [Main] INFO : Running Action: DeleteService on 'TheChune7a13'\r\n2016-12-08 01:55:45 [Main] DEBUG: Waiting for service to stop\r\n2016-12-08 01:55:45 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 1 of %!s(int=10)\r\n2016-12-08 01:55:49 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 2 of %!s(int=10)\r\n2016-12-08 01:55:53 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 3 of %!s(int=10)\r\n2016-12-08 01:55:57 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 4 of %!s(int=10)\r\n2016-12-08 01:56:01 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 5 of %!s(int=10)\r\n2016-12-08 01:56:05 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 6 of %!s(int=10)\r\n2016-12-08 01:56:09 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 7 of %!s(int=10)\r\n2016-12-08 01:56:13 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 8 of %!s(int=10)\r\n2016-12-08 01:56:17 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 9 of %!s(int=10)\r\n2016-12-08 01:56:21 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 10 of %!s(int=10)\r\n2016-12-08 01:56:25 [Main] WARN : Wait for `Stop Service l0-prod084-TheChune7a13` timeout\r\n2016-12-08 01:56:35 [Main] INFO : Running Action: DeleteService on 'TheChune7a13'\r\n2016-12-08 01:56:35 [Main] DEBUG: Waiting for service to stop\r\n2016-12-08 01:56:35 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 1 of %!s(int=10)\r\n2016-12-08 01:56:39 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 2 of %!s(int=10)\r\n2016-12-08 01:56:43 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 3 of %!s(int=10)\r\n2016-12-08 01:56:47 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 4 of %!s(int=10)\r\n2016-12-08 01:56:51 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 5 of %!s(int=10)\r\n2016-12-08 01:56:55 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 6 of %!s(int=10)\r\n2016-12-08 01:56:59 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 7 of %!s(int=10)\r\n2016-12-08 01:57:03 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 8 of %!s(int=10)\r\n2016-12-08 01:57:07 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 9 of %!s(int=10)\r\n2016-12-08 01:57:11 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 10 of %!s(int=10)\r\n2016-12-08 01:57:15 [Main] WARN : Wait for `Stop Service l0-prod084-TheChune7a13` timeout\r\n2016-12-08 01:57:25 [Main] INFO : Running Action: DeleteService on 'TheChune7a13'\r\n2016-12-08 01:57:25 [Main] DEBUG: Waiting for service to stop\r\n2016-12-08 01:57:25 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 1 of %!s(int=10)\r\n2016-12-08 01:57:29 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 2 of %!s(int=10)\r\n2016-12-08 01:57:33 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 3 of %!s(int=10)\r\n2016-12-08 01:57:37 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 4 of %!s(int=10)\r\n2016-12-08 01:57:41 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 5 of %!s(int=10)\r\n2016-12-08 01:57:45 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 6 of %!s(int=10)\r\n2016-12-08 01:57:50 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 7 of %!s(int=10)\r\n2016-12-08 01:57:54 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 8 of %!s(int=10)\r\n2016-12-08 01:57:58 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 9 of %!s(int=10)\r\n2016-12-08 01:58:02 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 10 of %!s(int=10)\r\n2016-12-08 01:58:06 [Main] WARN : Wait for `Stop Service l0-prod084-TheChune7a13` timeout\r\n2016-12-08 01:58:16 [Main] INFO : Running Action: DeleteService on 'TheChune7a13'\r\n2016-12-08 01:58:16 [Main] DEBUG: Waiting for service to stop\r\n2016-12-08 01:58:16 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 1 of %!s(int=10)\r\n2016-12-08 01:58:20 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 2 of %!s(int=10)\r\n2016-12-08 01:58:24 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 3 of %!s(int=10)\r\n2016-12-08 01:58:28 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 4 of %!s(int=10)\r\n2016-12-08 01:58:32 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 5 of %!s(int=10)\r\n2016-12-08 01:58:36 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 6 of %!s(int=10)\r\n2016-12-08 01:58:40 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 7 of %!s(int=10)\r\n2016-12-08 01:58:44 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 8 of %!s(int=10)\r\n2016-12-08 01:58:48 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 9 of %!s(int=10)\r\n2016-12-08 01:58:52 [Main] DEBUG: Wait Stop Service l0-prod084-TheChune7a13 iteration 10 of %!s(int=10)\r\n2016-12-08 01:58:56 [Main] WARN : Wait for `Stop Service l0-prod084-TheChune7a13` timeout\r\n2016-12-08 01:59:06 [Main] ERROR: Error on step 'Delete Dependencies': Timeout reached after 10m0s\r\n/home/ec2-user/go/src/gitlab.imshealth.com/xfra/layer0/runner/job/runner.go:61                 (*JobRunner).Run\r\n/home/ec2-user/go/src/gitlab.imshealth.com/xfra/layer0/runner/main.go:114                      Run\r\n/usr/local/go/src/runtime/asm_amd64.s:479                                                      call32\r\n/usr/local/go/src/reflect/value.go:434                                                         Value.call\r\n/usr/local/go/src/reflect/value.go:302                                                         Value.Call\r\n/home/ec2-user/go/src/gitlab.imshealth.com/xfra/layer0/vendor/github.com/urfave/cli/app.go:487 HandleAction\r\n/home/ec2-user/go/src/gitlab.imshealth.com/xfra/layer0/vendor/github.com/urfave/cli/app.go:245 (*App).Run\r\n/home/ec2-user/go/src/gitlab.imshealth.com/xfra/layer0/runner/main.go:58                       main\r\n/usr/local/go/src/runtime/proc.go:183                                                          main\r\n/usr/local/go/src/runtime/asm_amd64.s:2086                                                     goexit\r\n2016-12-08 01:59:06 [Main] INFO : Starting Rollback\r\n2016-12-08 01:59:06 [Main] FATAL: Error on step 'Delete Dependencies': Timeout reached after 10m0s\r\n/home/ec2-user/go/src/gitlab.imshealth.com/xfra/layer0/runner/main.go:115                      Run\r\n/usr/local/go/src/runtime/asm_amd64.s:479                                                      call32\r\n/usr/local/go/src/reflect/value.go:434                                                         Value.call\r\n/usr/local/go/src/reflect/value.go:302                                                         Value.Call\r\n/home/ec2-user/go/src/gitlab.imshealth.com/xfra/layer0/vendor/github.com/urfave/cli/app.go:487 HandleAction\r\n/home/ec2-user/go/src/gitlab.imshealth.com/xfra/layer0/vendor/github.com/urfave/cli/app.go:245 (*App).Run\r\n/home/ec2-user/go/src/gitlab.imshealth.com/xfra/layer0/runner/main.go:58                       main\r\n/usr/local/go/src/runtime/proc.go:183                                                          main\r\n/usr/local/go/src/runtime/asm_amd64.s:2086                                                     goexit\r\n\r\n```\r\n\r\nwondering if there's a more brute-force task kill we can be doing? because if i stop tasks from the console, they stop immediately and then environment delete works fine\r\n"}}
{"actor":{"display_login":"zpatrick"}}