{"action":"created","issue":{"url":"https://api.github.com/repos/gcp/leela-zero/issues/78","repository_url":"https://api.github.com/repos/gcp/leela-zero","labels_url":"https://api.github.com/repos/gcp/leela-zero/issues/78/labels{/name}","comments_url":"https://api.github.com/repos/gcp/leela-zero/issues/78/comments","events_url":"https://api.github.com/repos/gcp/leela-zero/issues/78/events","html_url":"https://github.com/gcp/leela-zero/issues/78","id":274802705,"number":78,"title":"How to find Information about the new best network","user":{"login":"sethtroisi","id":10172976,"avatar_url":"https://avatars2.githubusercontent.com/u/10172976?v=4","gravatar_id":"","url":"https://api.github.com/users/sethtroisi","html_url":"https://github.com/sethtroisi","followers_url":"https://api.github.com/users/sethtroisi/followers","following_url":"https://api.github.com/users/sethtroisi/following{/other_user}","gists_url":"https://api.github.com/users/sethtroisi/gists{/gist_id}","starred_url":"https://api.github.com/users/sethtroisi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sethtroisi/subscriptions","organizations_url":"https://api.github.com/users/sethtroisi/orgs","repos_url":"https://api.github.com/users/sethtroisi/repos","events_url":"https://api.github.com/users/sethtroisi/events{/privacy}","received_events_url":"https://api.github.com/users/sethtroisi/received_events","type":"User","site_admin":false},"labels":[{"id":729737326,"url":"https://api.github.com/repos/gcp/leela-zero/labels/question","name":"question","color":"cc317c","default":true}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":366,"created_at":"2017-11-17T09:30:12Z","updated_at":"2017-11-28T15:12:26Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"I noticed a new network (fe3f6...) in http://zero.sjeng.org/networks/\r\n\r\nCan you provide some information about win rate over the previous best network?\r\nNumber of games it was trained on? How long it took to train?\r\n\r\nI'm thirsty for details :)"},"comment":{"url":"https://api.github.com/repos/gcp/leela-zero/issues/comments/347554014","html_url":"https://github.com/gcp/leela-zero/issues/78#issuecomment-347554014","issue_url":"https://api.github.com/repos/gcp/leela-zero/issues/78","id":347554014,"user":{"login":"Dorus","id":4461459,"avatar_url":"https://avatars2.githubusercontent.com/u/4461459?v=4","gravatar_id":"","url":"https://api.github.com/users/Dorus","html_url":"https://github.com/Dorus","followers_url":"https://api.github.com/users/Dorus/followers","following_url":"https://api.github.com/users/Dorus/following{/other_user}","gists_url":"https://api.github.com/users/Dorus/gists{/gist_id}","starred_url":"https://api.github.com/users/Dorus/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Dorus/subscriptions","organizations_url":"https://api.github.com/users/Dorus/orgs","repos_url":"https://api.github.com/users/Dorus/repos","events_url":"https://api.github.com/users/Dorus/events{/privacy}","received_events_url":"https://api.github.com/users/Dorus/received_events","type":"User","site_admin":false},"created_at":"2017-11-28T15:12:26Z","updated_at":"2017-11-28T15:12:26Z","author_association":"NONE","body":"I have some real doubt about Leela Zero being \"slower\" than alpha go. With 1000 instead of 1600 playouts, we simply use 37.5% less computational power. Also i would theorize that less playouts just means more values to train on, and the lower quality should offset the higher quantity, however that still means that to progress x amount, you do need 60% more games. That also puts our 500k window equal to only 312k at 1600 playouts.\r\n\r\nRight now we have a 405k network at -2216 elo. That would be the same as AGZ at 255k games. At 255k games AGZ was at -2176 elo (and that is exactly the point where it made a sharp turn upwards in elo).\r\n\r\nAnd even then, there is a lot of randomness in game generation and training, it could very well be that if they ran AGZ from scratch again another time, it's 20% faster or slower. We might just be a little unlucky, but that doesn't mean our parameters are wrong. Testing new parameters would require at least like 1 million games to compare, and we're not even at 1m for the current settings."}}
{"actor":{"display_login":"Dorus"}}