{"action":"created","issue":{"url":"https://api.github.com/repos/gcp/leela-zero/issues/260","repository_url":"https://api.github.com/repos/gcp/leela-zero","labels_url":"https://api.github.com/repos/gcp/leela-zero/issues/260/labels{/name}","comments_url":"https://api.github.com/repos/gcp/leela-zero/issues/260/comments","events_url":"https://api.github.com/repos/gcp/leela-zero/issues/260/events","html_url":"https://github.com/gcp/leela-zero/issues/260","id":279422727,"number":260,"title":"Experiment request: multithreading","user":{"login":"isty2e","id":571680,"avatar_url":"https://avatars3.githubusercontent.com/u/571680?v=4","gravatar_id":"","url":"https://api.github.com/users/isty2e","html_url":"https://github.com/isty2e","followers_url":"https://api.github.com/users/isty2e/followers","following_url":"https://api.github.com/users/isty2e/following{/other_user}","gists_url":"https://api.github.com/users/isty2e/gists{/gist_id}","starred_url":"https://api.github.com/users/isty2e/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/isty2e/subscriptions","organizations_url":"https://api.github.com/users/isty2e/orgs","repos_url":"https://api.github.com/users/isty2e/repos","events_url":"https://api.github.com/users/isty2e/events{/privacy}","received_events_url":"https://api.github.com/users/isty2e/received_events","type":"User","site_admin":false},"labels":[{"id":729737326,"url":"https://api.github.com/repos/gcp/leela-zero/labels/question","name":"question","color":"cc317c","default":true}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":24,"created_at":"2017-12-05T15:43:19Z","updated_at":"2017-12-07T07:52:49Z","closed_at":null,"author_association":"NONE","body":"I was really surprised to see that black's winrate is over 90% in [this comment](https://github.com/gcp/leela-zero/issues/78#issuecomment-349334079), since it never happened to me. For me, though black tends to win more, it was like somewhere between 60% and 70%.\r\n\r\nOne suspicious thing is that I always compile autogtp with m_cmdLine.append(\" -t 1\"); inserted in autogtp/Game.cpp, line 38 or somewhere. Otherwise it often crashes and self-play games are not terminated normally.\r\n\r\nCould someone test the winrate of black/white with single/multithread? I'm afraid I can't, because as stated above multithreading results in frequent crashes for me."},"comment":{"url":"https://api.github.com/repos/gcp/leela-zero/issues/comments/349889967","html_url":"https://github.com/gcp/leela-zero/issues/260#issuecomment-349889967","issue_url":"https://api.github.com/repos/gcp/leela-zero/issues/260","id":349889967,"user":{"login":"sethtroisi","id":10172976,"avatar_url":"https://avatars2.githubusercontent.com/u/10172976?v=4","gravatar_id":"","url":"https://api.github.com/users/sethtroisi","html_url":"https://github.com/sethtroisi","followers_url":"https://api.github.com/users/sethtroisi/followers","following_url":"https://api.github.com/users/sethtroisi/following{/other_user}","gists_url":"https://api.github.com/users/sethtroisi/gists{/gist_id}","starred_url":"https://api.github.com/users/sethtroisi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sethtroisi/subscriptions","organizations_url":"https://api.github.com/users/sethtroisi/orgs","repos_url":"https://api.github.com/users/sethtroisi/repos","events_url":"https://api.github.com/users/sethtroisi/events{/privacy}","received_events_url":"https://api.github.com/users/sethtroisi/received_events","type":"User","site_admin":false},"created_at":"2017-12-07T07:52:49Z","updated_at":"2017-12-07T07:52:49Z","author_association":"CONTRIBUTOR","body":"```\r\n**-t 1**\r\n78 game(s) played in 231 minutes = 178 seconds/game, 1294 ms/move\r\n              wins        black       white\r\nad8a1d02   72  92.3%   72 100.0%    0   0.0%\r\nad8a1d02    6   7.7%    0   0.0%    6 100.0%\r\n                       72  92.3%    6   7.7%\r\n```\r\n```\r\n**-t 2**\r\n116 game(s) played in 227 minutes = 117 seconds/game, 466 ms/move\r\n              wins        black       white\r\nad8a1d02   89  76.7%   89 100.0%    0   0.0%\r\nad8a1d02   27  23.3%    0   0.0%   27 100.0%\r\n                       89  76.7%   27  23.3%\r\n```\r\n@isty2e Something weird is going on.\r\n\r\nI used [two proportion z test](http://stattrek.com/hypothesis-test/difference-in-proportions.aspx?Tutorial=AP).\r\n\r\n````\r\np = (p1 * n1 + p2 * n2) / (n1 + n2) = (72 + 89) / (78 + 116) = 0.83\r\nSE = sqrt(0.83 * 0.17 * (1 / 78 + 1 / 116)) = 0.055\r\nz_score = (p1 - p2) / SE = (72/78 - 89/116) / 0.055 = 2.833\r\n|z| > 2.833 = 0.0046\r\n````\r\n\r\n**there's a difference!** between `-t 1` and `-t 2` on my computer (ubuntu, 1080Ti, next branch).\r\n\r\nOne thing I noticed was load on processor may play a part. I ran two instances of autogtp at the same time which can saturating my CPU, I'm rerunning on a different computer (with an older GPU) one at a time right now."}}
{"actor":{"display_login":"sethtroisi"}}