{"action":"created","issue":{"url":"https://api.github.com/repos/cockroachdb/cockroach/issues/16875","repository_url":"https://api.github.com/repos/cockroachdb/cockroach","labels_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/16875/labels{/name}","comments_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/16875/comments","events_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/16875/events","html_url":"https://github.com/cockroachdb/cockroach/issues/16875","id":240861352,"number":16875,"title":"Cluster crashes once every 2 days on average.","user":{"login":"mattiasmak","id":606639,"avatar_url":"https://avatars6.githubusercontent.com/u/606639?v=4","gravatar_id":"","url":"https://api.github.com/users/mattiasmak","html_url":"https://github.com/mattiasmak","followers_url":"https://api.github.com/users/mattiasmak/followers","following_url":"https://api.github.com/users/mattiasmak/following{/other_user}","gists_url":"https://api.github.com/users/mattiasmak/gists{/gist_id}","starred_url":"https://api.github.com/users/mattiasmak/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mattiasmak/subscriptions","organizations_url":"https://api.github.com/users/mattiasmak/orgs","repos_url":"https://api.github.com/users/mattiasmak/repos","events_url":"https://api.github.com/users/mattiasmak/events{/privacy}","received_events_url":"https://api.github.com/users/mattiasmak/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":23,"created_at":"2017-07-06T06:56:17Z","updated_at":"2017-07-16T14:13:57Z","closed_at":null,"body":"We have a pretty small cluster. Out problem is that it goes down once every few days and we need to kill (killall -9 cockroach) and restart the cluster manually. I have previously had similar problems with cockroach, but it continues to be very unstable.\r\n\r\nI think the best way to find out what happens is to supply you the logs.\r\n\r\nHopefully this gives you some help in making cockroach a more robust database. \r\n\r\nLOGS:\r\n[ro-db1.tar.gz](https://github.com/cockroachdb/cockroach/files/1126950/ro-db1.tar.gz)\r\n[ro-db2.tar.gz](https://github.com/cockroachdb/cockroach/files/1126951/ro-db2.tar.gz)\r\n[ro-db3.tar.gz](https://github.com/cockroachdb/cockroach/files/1126952/ro-db3.tar.gz)\r\n\r\n\r\n*** \r\n\r\nI170705 06:47:09.341881 1 util/log/clog.go:1007  [config] file created at: 2017/07/05 06:47:09\r\nI170705 06:47:09.341881 1 util/log/clog.go:1007  [config] running on machine: RO-DB-001\r\nI170705 06:47:09.341881 1 util/log/clog.go:1007  [config] binary: CockroachDB CCL beta-20170413-dirty (linux amd64, built 2017/04/13 21:06:17, go1.8.1)\r\nI170705 06:47:09.341881 1 util/log/clog.go:1007  [config] arguments: [cockroach start --insecure --advertise-host=10.135.17.161 --host=10.135.17.161]\r\n\r\nI170705 06:47:12.135272 1 util/log/clog.go:1007  [config] file created at: 2017/07/05 06:47:12\r\nI170705 06:47:12.135272 1 util/log/clog.go:1007  [config] running on machine: RO-DB-002\r\nI170705 06:47:12.135272 1 util/log/clog.go:1007  [config] binary: CockroachDB CCL beta-20170413-dirty (linux amd64, built 2017/04/13 21:06:17, go1.8.1)\r\nI170705 06:47:12.135272 1 util/log/clog.go:1007  [config] arguments: [cockroach start --insecure --advertise-host=10.135.1.165 --join=10.135.17.161:26257 --host=10.135.1.165]\r\n\r\nI170705 06:47:14.053046 1 util/log/clog.go:1007  [config] file created at: 2017/07/05 06:47:14\r\nI170705 06:47:14.053046 1 util/log/clog.go:1007  [config] running on machine: RO-DB-003\r\nI170705 06:47:14.053046 1 util/log/clog.go:1007  [config] binary: CockroachDB CCL beta-20170413-dirty (linux amd64, built 2017/04/13 21:06:17, go1.8.1)\r\nI170705 06:47:14.053046 1 util/log/clog.go:1007  [config] arguments: [cockroach start --insecure --advertise-host=10.135.15.39 --join=10.135.17.161:26257 --host=10.135.15.39]"},"comment":{"url":"https://api.github.com/repos/cockroachdb/cockroach/issues/comments/315611890","html_url":"https://github.com/cockroachdb/cockroach/issues/16875#issuecomment-315611890","issue_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/16875","id":315611890,"user":{"login":"mattiasmak","id":606639,"avatar_url":"https://avatars6.githubusercontent.com/u/606639?v=4","gravatar_id":"","url":"https://api.github.com/users/mattiasmak","html_url":"https://github.com/mattiasmak","followers_url":"https://api.github.com/users/mattiasmak/followers","following_url":"https://api.github.com/users/mattiasmak/following{/other_user}","gists_url":"https://api.github.com/users/mattiasmak/gists{/gist_id}","starred_url":"https://api.github.com/users/mattiasmak/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mattiasmak/subscriptions","organizations_url":"https://api.github.com/users/mattiasmak/orgs","repos_url":"https://api.github.com/users/mattiasmak/repos","events_url":"https://api.github.com/users/mattiasmak/events{/privacy}","received_events_url":"https://api.github.com/users/mattiasmak/received_events","type":"User","site_admin":false},"created_at":"2017-07-16T14:13:57Z","updated_at":"2017-07-16T14:13:57Z","body":"<img width=\"845\" alt=\"skarmavbild 2017-07-16 kl 16 13 26\" src=\"https://user-images.githubusercontent.com/606639/28248247-bf085530-6a41-11e7-8139-609b99bce98b.png\">\r\n"}}
{"actor":{"display_login":"mattiasmak"}}