{"action":"created","issue":{"url":"https://api.github.com/repos/openucx/ucx/issues/1641","repository_url":"https://api.github.com/repos/openucx/ucx","labels_url":"https://api.github.com/repos/openucx/ucx/issues/1641/labels{/name}","comments_url":"https://api.github.com/repos/openucx/ucx/issues/1641/comments","events_url":"https://api.github.com/repos/openucx/ucx/issues/1641/events","html_url":"https://github.com/openucx/ucx/issues/1641","id":238845276,"number":1641,"title":"hang in udrc/test_ucp_rma.nonblocking_stream_get_nbi_flush_worker/1","user":{"login":"yosefe","id":2255631,"avatar_url":"https://avatars3.githubusercontent.com/u/2255631?v=3","gravatar_id":"","url":"https://api.github.com/users/yosefe","html_url":"https://github.com/yosefe","followers_url":"https://api.github.com/users/yosefe/followers","following_url":"https://api.github.com/users/yosefe/following{/other_user}","gists_url":"https://api.github.com/users/yosefe/gists{/gist_id}","starred_url":"https://api.github.com/users/yosefe/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/yosefe/subscriptions","organizations_url":"https://api.github.com/users/yosefe/orgs","repos_url":"https://api.github.com/users/yosefe/repos","events_url":"https://api.github.com/users/yosefe/events{/privacy}","received_events_url":"https://api.github.com/users/yosefe/received_events","type":"User","site_admin":false},"labels":[{"id":138949041,"url":"https://api.github.com/repos/openucx/ucx/labels/bug","name":"bug","color":"fc2929","default":true}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2017-06-27T13:09:24Z","updated_at":"2017-06-27T13:10:17Z","closed_at":null,"body":"happens because ucp_worker_flush is blocking(), so receiver does not make progress and does not let the sender to switch from stub_ep to real ep.\r\n```\r\n(gdb) bt\r\n#0  0x00007f5971b64f16 in ?? () from /usr/lib64/libmlx4-rdmav2.so\r\n#1  0x00007f597244f256 in ibv_poll_cq (arg=0x3b8ab90) at /usr/include/infiniband/verbs.h:1271\r\n#2  uct_ib_poll_cq (arg=0x3b8ab90) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../src/uct/ib/base/ib_device.h:267\r\n#3  uct_rc_verbs_iface_poll_rx_common (arg=0x3b8ab90) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../src/uct/ib/rc/verbs/rc_verbs_common.h:154\r\n#4  uct_rc_verbs_iface_progress (arg=0x3b8ab90) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../src/uct/ib/rc/verbs/rc_verbs_iface.c:129\r\n#5  0x00007f597244030a in ucs_callbackq_dispatch (worker=<value optimized out>) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../src/ucs/datastruct/callbackq.h:150\r\n#6  uct_worker_progress (worker=<value optimized out>) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../src/uct/base/uct_worker.c:37\r\n#7  0x00007f5971fdf283 in ucp_worker_progress (worker=0x3b9aa60) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../src/ucp/core/ucp_worker.c:850\r\n#8  0x00007f5971fe22a0 in ucp_worker_flush_inner (worker=0x3b9aa60) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../src/ucp/rma/basic_rma.c:430\r\n#9  ucp_worker_flush (worker=0x3b9aa60) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../src/ucp/rma/basic_rma.c:423\r\n#10 0x000000000057a3b1 in ucp_test_base::entity::flush_worker (this=0x39c0330, worker_index=0) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../test/gtest/ucp/ucp_test.cc:362\r\n#11 0x00000000004f5c70 in test_ucp_memheap::test_nonblocking_implicit_stream_xfer (this=0x3b62650, send=\r\n    (void (test_ucp_memheap::*)(test_ucp_memheap *, ucp_test_base::entity *, size_t, void *, ucp_rkey_h, std::string &)) 0x508980 <test_ucp_rma::nonblocking_get_nbi(ucp_test_base::entity*, size_t, void*, ucp_rkey_h, std::string&)>, \r\n    size=4730, max_iter=300, alignment=1, malloc_allocate=false, is_ep_flush=false) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../test/gtest/ucp/test_ucp_memheap.cc:118\r\n#12 0x00000000005012e0 in test_ucp_rma_nonblocking_stream_get_nbi_flush_worker_Test::test_body (this=0x3b62650) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../test/gtest/ucp/test_ucp_rma.cc:244\r\n#13 0x0000000000436f9e in ucs::test_base::run (this=0x3b62650) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../test/gtest/common/test.cc:204\r\n#14 0x0000000000437a0d in ucs::test_base::TestBodyProxy (this=0x3b62650) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../test/gtest/common/test.cc:230\r\n#15 0x000000000043088d in HandleSehExceptionsInMethodIfSupported<testing::Test, void> (object=0x3b626a8, method=&virtual testing::Test::TestBody(), location=0x64515a \"the test body\")\r\n    at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../test/gtest/common/gtest-all.cc:3562\r\n#16 testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void> (object=0x3b626a8, method=&virtual testing::Test::TestBody(), location=0x64515a \"the test body\")\r\n    at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../test/gtest/common/gtest-all.cc:3598\r\n#17 0x0000000000428157 in testing::Test::Run (this=0x3b626a8) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../test/gtest/common/gtest-all.cc:3635\r\n#18 0x000000000042822e in testing::TestInfo::Run (this=0x3ac3ae0) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../test/gtest/common/gtest-all.cc:3812\r\n#19 0x0000000000428377 in testing::TestCase::Run (this=0x3aa35a0) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../test/gtest/common/gtest-all.cc:3930\r\n#20 0x000000000042860c in testing::internal::UnitTestImpl::RunAllTests (this=0x3946aa0) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../test/gtest/common/gtest-all.cc:5802\r\n#21 0x000000000043041d in HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool> (object=0x3946aa0, method=\r\n    (bool (testing::internal::UnitTestImpl::*)(testing::internal::UnitTestImpl *)) 0x4283f0 <testing::internal::UnitTestImpl::RunAllTests()>, location=0x646110 \"auxiliary test code (environments or event listeners)\")\r\n    at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../test/gtest/common/gtest-all.cc:3562\r\n#22 testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool> (object=0x3946aa0, method=\r\n    (bool (testing::internal::UnitTestImpl::*)(testing::internal::UnitTestImpl *)) 0x4283f0 <testing::internal::UnitTestImpl::RunAllTests()>, location=0x646110 \"auxiliary test code (environments or event listeners)\")\r\n    at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../test/gtest/common/gtest-all.cc:3598\r\n#23 0x0000000000427859 in testing::UnitTest::Run (this=0x999860) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../test/gtest/common/gtest-all.cc:5416\r\n#24 0x0000000000431b7f in RUN_ALL_TESTS (argc=1, argv=<value optimized out>) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../test/gtest/common/gtest.h:20059\r\n#25 main (argc=1, argv=<value optimized out>) at /hpc/mtr_scrap/users/yosefe/ucx/contrib/../test/gtest/common/main.cc:79\r\n```"},"comment":{"url":"https://api.github.com/repos/openucx/ucx/issues/comments/311353185","html_url":"https://github.com/openucx/ucx/issues/1641#issuecomment-311353185","issue_url":"https://api.github.com/repos/openucx/ucx/issues/1641","id":311353185,"user":{"login":"yosefe","id":2255631,"avatar_url":"https://avatars3.githubusercontent.com/u/2255631?v=3","gravatar_id":"","url":"https://api.github.com/users/yosefe","html_url":"https://github.com/yosefe","followers_url":"https://api.github.com/users/yosefe/followers","following_url":"https://api.github.com/users/yosefe/following{/other_user}","gists_url":"https://api.github.com/users/yosefe/gists{/gist_id}","starred_url":"https://api.github.com/users/yosefe/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/yosefe/subscriptions","organizations_url":"https://api.github.com/users/yosefe/orgs","repos_url":"https://api.github.com/users/yosefe/repos","events_url":"https://api.github.com/users/yosefe/events{/privacy}","received_events_url":"https://api.github.com/users/yosefe/received_events","type":"User","site_admin":false},"created_at":"2017-06-27T13:10:17Z","updated_at":"2017-06-27T13:10:17Z","body":"```\r\n(gdb) get_flags ((ucp_stub_ep_t*)$ep2->uct_eps[0])->flags\r\n$35 = 0\r\n$36 = 1\r\n(gdb) get_flags ((ucp_stub_ep_t*)$ep->uct_eps[0])->flags\r\n$37 = 1\r\n(gdb) get_flags $ep->flags \r\n$14 = 0\r\n$15 = 2\r\n$16 = 3\r\n(gdb) get_flags $ep2->flags\r\n$23 = 0\r\n$24 = 1\r\n$25 = 2\r\n$26 = 3\r\n\r\n```"}}
{"actor":{"display_login":"yosefe"}}