{"action":"opened","issue":{"url":"https://api.github.com/repos/Cysu/open-reid/issues/15","repository_url":"https://api.github.com/repos/Cysu/open-reid","labels_url":"https://api.github.com/repos/Cysu/open-reid/issues/15/labels{/name}","comments_url":"https://api.github.com/repos/Cysu/open-reid/issues/15/comments","events_url":"https://api.github.com/repos/Cysu/open-reid/issues/15/events","html_url":"https://github.com/Cysu/open-reid/issues/15","id":246563565,"number":15,"title":"Fail to reproduce triplet loss benchmark on Market1501","user":{"login":"huanghoujing","id":13362456,"avatar_url":"https://avatars2.githubusercontent.com/u/13362456?v=4","gravatar_id":"","url":"https://api.github.com/users/huanghoujing","html_url":"https://github.com/huanghoujing","followers_url":"https://api.github.com/users/huanghoujing/followers","following_url":"https://api.github.com/users/huanghoujing/following{/other_user}","gists_url":"https://api.github.com/users/huanghoujing/gists{/gist_id}","starred_url":"https://api.github.com/users/huanghoujing/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/huanghoujing/subscriptions","organizations_url":"https://api.github.com/users/huanghoujing/orgs","repos_url":"https://api.github.com/users/huanghoujing/repos","events_url":"https://api.github.com/users/huanghoujing/events{/privacy}","received_events_url":"https://api.github.com/users/huanghoujing/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2017-07-30T05:28:03Z","updated_at":"2017-07-30T05:28:03Z","closed_at":null,"body":"Hi, Tong Xiao, very grateful for your complete and self-contained ReID library. I have a small question to consult you about. I failed to reproduce the performance using triplet loss on Market1501. \r\n\r\nI think my script is effectively the same as provided in your github.io page:\r\n```\r\nCUDA_VISIBLE_DEVICES=0,1,2,3 python examples/triplet_loss.py -d market1501 -a resnet50 --combine-trainval --logs-dir examples/logs/triplet-loss/market1501-resnet50-4gpu-batch-size-256 -b 256 --print-freq 20\r\n```\r\n\r\nThe performance it achieved is quite worse than reported on your github.io page:\r\n```\r\nMean AP: 60.3%\r\nCMC Scores    allshots      cuhk03  market1501\r\n  top-1          34.8%       63.1%       80.4%\r\n  top-5          51.4%       87.4%       92.1%\r\n  top-10         59.7%       92.7%       95.1%\r\n```\r\n\r\nDo you have anything not updated on the github.io page? Waiting for your kind response and thank you very much. \r\n\r\nAnyone else who has run this code and notices this issue is also highly appreciated to share your results."}}
{"actor":{"display_login":"huanghoujing"}}