{"action":"created","issue":{"url":"https://api.github.com/repos/monero-project/monero/issues/2970","repository_url":"https://api.github.com/repos/monero-project/monero","labels_url":"https://api.github.com/repos/monero-project/monero/issues/2970/labels{/name}","comments_url":"https://api.github.com/repos/monero-project/monero/issues/2970/comments","events_url":"https://api.github.com/repos/monero-project/monero/issues/2970/events","html_url":"https://github.com/monero-project/monero/issues/2970","id":283489986,"number":2970,"title":"Daemon stops syncing after sometime running","user":{"login":"vdo","id":170204,"avatar_url":"https://avatars1.githubusercontent.com/u/170204?v=4","gravatar_id":"","url":"https://api.github.com/users/vdo","html_url":"https://github.com/vdo","followers_url":"https://api.github.com/users/vdo/followers","following_url":"https://api.github.com/users/vdo/following{/other_user}","gists_url":"https://api.github.com/users/vdo/gists{/gist_id}","starred_url":"https://api.github.com/users/vdo/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vdo/subscriptions","organizations_url":"https://api.github.com/users/vdo/orgs","repos_url":"https://api.github.com/users/vdo/repos","events_url":"https://api.github.com/users/vdo/events{/privacy}","received_events_url":"https://api.github.com/users/vdo/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2017-12-20T08:53:16Z","updated_at":"2018-01-01T02:36:24Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"The daemon stops syncing just after this block:\r\n\r\n`2017-12-20 00:16:39.304 [P2P6]  INFO    global  src/cryptonote_protocol/cryptonote_protocol_handler.inl:1154    ESC[1;33m[163.172.255.56:57526 INC]  Synced 1121073/1468507ESC[0m\r\n`\r\nThen after some time, like 2 hours , it reports this stacktrace:\r\n```\r\n2017-12-20 01:51:21.972 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:120  Exception: cryptonote::BLOCK_DNE\r\n2017-12-20 01:51:21.972 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:121  Unwound call stack:\r\n2017-12-20 01:51:21.979 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [1] /opt/monero-v0.11.1.0/monerod:__wrap___cxa_throw+0x102 [0x8914e2]\r\n2017-12-20 01:51:21.979 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [2] /opt/monero-v0.11.1.0/monerod() [0x7c8184]\r\n2017-12-20 01:51:21.979 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [3] /opt/monero-v0.11.1.0/monerod:cryptonote::BlockchainLMDB::get_block_height(crypto::hash const&) const+0x461 [0x7d39d1]\r\n2017-12-20 01:51:21.979 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [4] /opt/monero-v0.11.1.0/monerod:cryptonote::BlockchainLMDB::get_block_blob[abi:cxx11](crypto::hash const&) const+0x12b [0x7c97fb]\r\n2017-12-20 01:51:21.979 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [5] /opt/monero-v0.11.1.0/monerod:bool cryptonote::Blockchain::get_blocks<std::__cxx11::list<crypto::hash, std::allocator<crypto::hash> >, std::_\r\n_cxx11::list<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, cryptonote::block>, std::allocator<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, crypton\r\note::block> > >, std::__cxx11::list<crypto::hash, std::allocator<crypto::hash> > >(std::__cxx11::list<crypto::hash, std::allocator<crypto::hash> > const&, std::__cxx11::list<std::pair<std::__cxx11::basic_string<char, std::char_traits<cha\r\nr>, std::allocator<char> >, cryptonote::block>, std::allocator<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, cryptonote::block> > >&, std::__cxx11::list<crypto::hash, std::allocator<crypto::ha\r\nsh> >&) const+0x1ac [0x82941c]\r\n2017-12-20 01:51:21.979 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [6] /opt/monero-v0.11.1.0/monerod:cryptonote::Blockchain::handle_get_objects(cryptonote::NOTIFY_REQUEST_GET_OBJECTS::request&, cryptonote::NOTIFY\r\n_RESPONSE_GET_OBJECTS::request&)+0x1b2 [0x80ec22]\r\n2017-12-20 01:51:21.979 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [7] /opt/monero-v0.11.1.0/monerod:cryptonote::t_cryptonote_protocol_handler<cryptonote::core>::handle_request_get_objects(int, cryptonote::NOTIFY\r\n_REQUEST_GET_OBJECTS::request&, cryptonote::cryptonote_connection_context&)+0x16c [0x70b3fc]\r\n2017-12-20 01:51:21.979 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [8] /opt/monero-v0.11.1.0/monerod:int epee::net_utils::buff_to_t_adapter<cryptonote::t_cryptonote_protocol_handler<cryptonote::core>, cryptonote:\r\n:NOTIFY_REQUEST_GET_OBJECTS::request, cryptonote::cryptonote_connection_context, boost::_bi::bind_t<int, boost::_mfi::mf3<int, cryptonote::t_cryptonote_protocol_handler<cryptonote::core>, int, cryptonote::NOTIFY_REQUEST_GET_OBJECTS::requ\r\nest&, cryptonote::cryptonote_connection_context&>, boost::_bi::list4<boost::_bi::value<cryptonote::t_cryptonote_protocol_handler<cryptonote::core>*>, boost::arg<1>, boost::arg<2>, boost::arg<3> > > >(cryptonote::t_cryptonote_protocol_han\r\ndler<cryptonote::core>*, int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, boost::_bi::bind_t<int, boost::_mfi::mf3<int, cryptonote::t_cryptonote_protocol_handler<cryptonote::core>, int, crypton\r\note::NOTIFY_REQUEST_GET_OBJECTS::request&, cryptonote::cryptonote_connection_context&>, boost::_bi::list4<boost::_bi::value<cryptonote::t_cryptonote_protocol_handler<cryptonote::core>*>, boost::arg<1>, boost::arg<2>, boost::arg<3> > >, c\r\nryptonote::cryptonote_connection_context&)+0x227 [0x7068f7]\r\n2017-12-20 01:51:21.979 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [9] /opt/monero-v0.11.1.0/monerod:int cryptonote::t_cryptonote_protocol_handler<cryptonote::core>::handle_invoke_map<cryptonote::cryptonote_conne\r\nction_context>(bool, int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&, cryptonote::cryptonote_connection_context\r\n&, bool&)+0x2ab [0x70c55b]\r\n2017-12-20 01:51:21.979 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [10] /opt/monero-v0.11.1.0/monerod:int nodetool::node_server<cryptonote::t_cryptonote_protocol_handler<cryptonote::core> >::handle_invoke_map<nod\r\netool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> >(bool, int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std:\r\n:allocator<char> >&, nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context>&, bool&)+0xbe [0x70c7ce]\r\n2017-12-20 01:51:21.979 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [11] /opt/monero-v0.11.1.0/monerod:nodetool::node_server<cryptonote::t_cryptonote_protocol_handler<cryptonote::core> >::notify(int, std::__cxx11:\r\n:basic_string<char, std::char_traits<char>, std::allocator<char> > const&, nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context>&)+0x4f [0x70cbdf]\r\n2017-12-20 01:51:21.980 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [12] /opt/monero-v0.11.1.0/monerod:epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_conte\r\nxt> >::handle_recv(void const*, unsigned long)+0x470 [0x70d0b0]\r\n2017-12-20 01:51:21.980 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [13] /opt/monero-v0.11.1.0/monerod:epee::net_utils::connection<epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote:\r\n:cryptonote_connection_context> > >::handle_read(boost::system::error_code const&, unsigned long)+0x1ba [0x724cea]\r\n2017-12-20 01:51:21.980 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [14] /opt/monero-v0.11.1.0/monerod:void boost::asio::detail::strand_service::dispatch<boost::asio::detail::binder2<boost::_bi::bind_t<void, boost\r\n::_mfi::mf2<void, epee::net_utils::connection<epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> > >, boost::system::error_code const&, unsigned long>, boost::_bi::list3<boos\r\nt::_bi::value<boost::shared_ptr<epee::net_utils::connection<epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> > > > >, boost::arg<1> (*)(), boost::arg<2> (*)()> >, boost::sy\r\nstem::error_code, unsigned long> >(boost::asio::detail::strand_service::strand_impl*&, boost::asio::detail::binder2<boost::_bi::bind_t<void, boost::_mfi::mf2<void, epee::net_utils::connection<epee::levin::async_protocol_handler<nodetool:\r\n:p2p_connection_context_t<cryptonote::cryptonote_connection_context> > >, boost::system::error_code const&, unsigned long>, boost::_bi::list3<boost::_bi::value<boost::shared_ptr<epee::net_utils::connection<epee::levin::async_protocol_han\r\ndler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> > > > >, boost::arg<1> (*)(), boost::arg<2> (*)()> >, boost::system::error_code, unsigned long>&)+0x71 [0x6cc391]\r\n2017-12-20 01:51:21.980 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [15] /opt/monero-v0.11.1.0/monerod:boost::asio::detail::completion_handler<boost::asio::detail::rewrapped_handler<boost::asio::detail::binder2<boost::asio::detail::wrapped_handler<boost::asio::io_service::strand, boost::_bi::bind_t<void, boost::_mfi::mf2<void, epee::net_utils::connection<epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> > >, boost::system::error_code const&, unsigned long>, boost::_bi::list3<boost::_bi::value<boost::shared_ptr<epee::net_utils::connection<epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> > > > >, boost::arg<1> (*)(), boost::arg<2> (*)()> >, boost::asio::detail::is_continuation_if_running>, boost::system::error_code, unsigned long>, boost::_bi::bind_t<void, boost::_mfi::mf2<void, epee::net_utils::connection<epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> > >, boost::system::error_code const&, unsigned long>, boost::_bi::list3<boost::_bi::value<boost::shared_ptr<epee::net_utils::connection<epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> > > > >, boost::arg<1> (*)(), boost::arg<2> (*)()> > > >::do_complete(boost::asio::detail::task_io_service*, boost::asio::detail::task_io_service_operation*, boost::system::error_code const&, unsigned long)+0x179 [0x6cc7c9]\r\n2017-12-20 01:51:21.980 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [16] /opt/monero-v0.11.1.0/monerod:void boost::asio::detail::strand_service::dispatch<boost::asio::detail::rewrapped_handler<boost::asio::detail::binder2<boost::asio::detail::wrapped_handler<boost::asio::io_service::strand, boost::_bi::bind_t<void, boost::_mfi::mf2<void, epee::net_utils::connection<epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> > >, boost::system::error_code const&, unsigned long>, boost::_bi::list3<boost::_bi::value<boost::shared_ptr<epee::net_utils::connection<epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> > > > >, boost::arg<1> (*)(), boost::arg<2> (*)()> >, boost::asio::detail::is_continuation_if_running>, boost::system::error_code, unsigned long>, boost::_bi::bind_t<void, boost::_mfi::mf2<void, epee::net_utils::connection<epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> > >, boost::system::error_code const&, unsigned long>, boost::_bi::list3<boost::_bi::value<boost::shared_ptr<epee::net_utils::connection<epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> > > > >, boost::arg<1> (*)(), boost::arg<2> (*)()> > > >(boost::asio::detail::strand_service::strand_impl*&, boost::asio::detail::rewrapped_handler<boost::asio::detail::binder2<boost::asio::detail::wrapped_handler<boost::asio::io_service::strand, boost::_bi::bind_t<void, boost::_mfi::mf2<void, epee::net_utils::connection<epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> > >, boost::system::error_code const&, unsigned long>, boost::_bi::list3<boost::_bi::value<boost::shared_ptr<epee::net_utils::connection<epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> > > > >, boost::arg<1> (*)(), boost::arg<2> (*)()> >, boost::asio::detail::is_continuation_if_running>, boost::system::error_code, unsigned long>, boost::_bi::bind_t<void, boost::_mfi::mf2<void, epee::net_utils::connection<epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> > >, boost::system::error_code const&, unsigned long>, boost::_bi::list3<boost::_bi::value<boost::shared_ptr<epee::net_utils::connection<epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> > > > >, boost::arg<1> (*)(), boost::arg<2> (*)()> > >&)+0x20a [0x6ccb8a]\r\n2017-12-20 01:51:21.980 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [17] /opt/monero-v0.11.1.0/monerod:boost::asio::detail::reactive_socket_recv_op<boost::asio::mutable_buffers_1, boost::asio::detail::wrapped_handler<boost::asio::io_service::strand, boost::_bi::bind_t<void, boost::_mfi::mf2<void, epee::net_utils::connection<epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> > >, boost::system::error_code const&, unsigned long>, boost::_bi::list3<boost::_bi::value<boost::shared_ptr<epee::net_utils::connection<epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> > > > >, boost::arg<1> (*)(), boost::arg<2> (*)()> >, boost::asio::detail::is_continuation_if_running> >::do_complete(boost::asio::detail::task_io_service*, boost::asio::detail::task_io_service_operation*, boost::system::error_code const&, unsigned long)+0x233 [0x6cce43]\r\n2017-12-20 01:51:21.980 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [18] /opt/monero-v0.11.1.0/monerod:boost::asio::detail::epoll_reactor::descriptor_state::do_complete(boost::asio::detail::task_io_service*, boost::asio::detail::task_io_service_operation*, boost::system::error_code const&, unsigned long)+0x15c [0x649d1c]\r\n2017-12-20 01:51:21.980 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [19] /opt/monero-v0.11.1.0/monerod:epee::net_utils::boosted_tcp_server<epee::levin::async_protocol_handler<nodetool::p2p_connection_context_t<cryptonote::cryptonote_connection_context> > >::worker_thread()+0x807 [0x66a7f7]\r\n2017-12-20 01:51:21.980 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [20] /opt/monero-v0.11.1.0/monerod() [0x988fa5]\r\n2017-12-20 01:51:21.980 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [21] /lib/x86_64-linux-gnu/libpthread.so.0+0x7494 [0x7f5cdea24494]\r\n2017-12-20 01:51:21.980 [P2P3]  INFO    stacktrace      src/common/stack_trace.cpp:159      [22] /lib/x86_64-linux-gnu/libc.so.6:clone+0x3f [0x7f5cde766aff]\r\n```\r\n\r\nBut then, if I stop the daemon manually and I start it again, it continues the sync just where it stopped. \r\nI had to do this a couple of times.\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/monero-project/monero/issues/comments/354633844","html_url":"https://github.com/monero-project/monero/issues/2970#issuecomment-354633844","issue_url":"https://api.github.com/repos/monero-project/monero/issues/2970","id":354633844,"user":{"login":"jredwine2857","id":34180339,"avatar_url":"https://avatars2.githubusercontent.com/u/34180339?v=4","gravatar_id":"","url":"https://api.github.com/users/jredwine2857","html_url":"https://github.com/jredwine2857","followers_url":"https://api.github.com/users/jredwine2857/followers","following_url":"https://api.github.com/users/jredwine2857/following{/other_user}","gists_url":"https://api.github.com/users/jredwine2857/gists{/gist_id}","starred_url":"https://api.github.com/users/jredwine2857/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jredwine2857/subscriptions","organizations_url":"https://api.github.com/users/jredwine2857/orgs","repos_url":"https://api.github.com/users/jredwine2857/repos","events_url":"https://api.github.com/users/jredwine2857/events{/privacy}","received_events_url":"https://api.github.com/users/jredwine2857/received_events","type":"User","site_admin":false},"created_at":"2018-01-01T02:36:24Z","updated_at":"2018-01-01T02:36:24Z","author_association":"NONE","body":"Yep, same here on 5 nodes running on ubuntu 16.04 running 0.11.1.0. Happens daily some days then other times it will go several before it stops synching.  Have a cron job to bounce it daily and it helps some.  Still have it every few days even with that.  \r\n\r\nI'll run with the log level 1 and see what it shows and post back."}}
{"actor":{"display_login":"jredwine2857"}}