{"action":"closed","number":17,"pull_request":{"url":"https://api.github.com/repos/hclhkbu/dlbench/pulls/17","id":122763964,"html_url":"https://github.com/hclhkbu/dlbench/pull/17","diff_url":"https://github.com/hclhkbu/dlbench/pull/17.diff","patch_url":"https://github.com/hclhkbu/dlbench/pull/17.patch","issue_url":"https://api.github.com/repos/hclhkbu/dlbench/issues/17","number":17,"state":"closed","locked":false,"title":"FCN5 update for single and multi-GPU performance","user":{"login":"tfboyd","id":23486130,"avatar_url":"https://avatars2.githubusercontent.com/u/23486130?v=3","gravatar_id":"","url":"https://api.github.com/users/tfboyd","html_url":"https://github.com/tfboyd","followers_url":"https://api.github.com/users/tfboyd/followers","following_url":"https://api.github.com/users/tfboyd/following{/other_user}","gists_url":"https://api.github.com/users/tfboyd/gists{/gist_id}","starred_url":"https://api.github.com/users/tfboyd/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tfboyd/subscriptions","organizations_url":"https://api.github.com/users/tfboyd/orgs","repos_url":"https://api.github.com/users/tfboyd/repos","events_url":"https://api.github.com/users/tfboyd/events{/privacy}","received_events_url":"https://api.github.com/users/tfboyd/received_events","type":"User","site_admin":false},"body":"I clocked the AWS K80s to the same 562MHz with BOOST off as what I think occurs in your tests.  K80s can vary based on peering and setup but I think even though your K80s show as not peered that they actually work fine if treated as if they are but I cannot know for sure.  \r\n \r\n- For TF 1.1 (which I am guessing you are running now) New args: use_datasets=False and xla=False, which are the defaults so this will work on TF 1.1 without issues.\r\n    - 4 GPUs should now be about 100ms\r\n    - 1 GPU (K80) 1024 batch-size should now be about 57ms\r\n\r\n- For TF ~1.2(RC1) with the use of use_datasets=True and xla=True.  DataSets is the bigger improvement as feeding the data via feed_dict results in some hiccups that throws off the average and feed_dict does not scale well beyond 1 GPU.  \r\n    - 4 GPUs is about 100ms\r\n    - 1 GPU (K80) 1024 batch-size should now be about 50ms which would if our clocks are the same is nearly best in class.\r\n    -  GTX 1080 (clocked to match yours) 1024 batch-size should be about 15.3ms, which if our clocks are the same is a big improvement and possibly best in class. \r\n\r\n- Regardless of version the final loss is now about half of what it was before and I also add training accuracy to the multi-gpu because it is just nice to have.  \r\n\r\nI do not expect you to run TF 1.2 given it is RC and you already started the v8 tests.  I would appreciate it if this code was used (after you approve it) for the v8 runs using the features available in TF 1.1.  You could even use xla, which is a boost for single GPU with TF 1.1 but you need to compile it in by choosing 'Y' during ./configure.  Even without XLA this provides users a better resource.  I will likely publish select numbers on our website with the TF 1.2 release to highlight the improvements\r\n\r\nFinally, your numbers may vary from mine.  Slightly different versions of TensorFlow as well as compile options and obviously hardware.  I completely understand and it is expected.  This is also a simple network I doubt anyone runs but it is fun to tweak and it shows how important the input pipeline is to getting the best possible performance.  \r\n\r\nGood Luck with V8\r\n\r\np.s. I might have some more tweaks to Alexnet and Resnet but they are at least OK.  NCHW is a big deal but I can always post results on our main website with the updated code.  \r\n","created_at":"2017-05-27T15:05:48Z","updated_at":"2017-05-29T03:29:05Z","closed_at":"2017-05-29T03:29:05Z","merged_at":"2017-05-29T03:29:05Z","merge_commit_sha":"bb6f45b62a1520e4548c58d0f97ab35a3294f5a1","assignee":null,"assignees":[],"requested_reviewers":[],"milestone":null,"commits_url":"https://api.github.com/repos/hclhkbu/dlbench/pulls/17/commits","review_comments_url":"https://api.github.com/repos/hclhkbu/dlbench/pulls/17/comments","review_comment_url":"https://api.github.com/repos/hclhkbu/dlbench/pulls/comments{/number}","comments_url":"https://api.github.com/repos/hclhkbu/dlbench/issues/17/comments","statuses_url":"https://api.github.com/repos/hclhkbu/dlbench/statuses/33f3020c896592fb01eac955d43723dd3ec132f7","head":{"label":"tfboyd:fcn5_updates","ref":"fcn5_updates","sha":"33f3020c896592fb01eac955d43723dd3ec132f7","user":{"login":"tfboyd","id":23486130,"avatar_url":"https://avatars2.githubusercontent.com/u/23486130?v=3","gravatar_id":"","url":"https://api.github.com/users/tfboyd","html_url":"https://github.com/tfboyd","followers_url":"https://api.github.com/users/tfboyd/followers","following_url":"https://api.github.com/users/tfboyd/following{/other_user}","gists_url":"https://api.github.com/users/tfboyd/gists{/gist_id}","starred_url":"https://api.github.com/users/tfboyd/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tfboyd/subscriptions","organizations_url":"https://api.github.com/users/tfboyd/orgs","repos_url":"https://api.github.com/users/tfboyd/repos","events_url":"https://api.github.com/users/tfboyd/events{/privacy}","received_events_url":"https://api.github.com/users/tfboyd/received_events","type":"User","site_admin":false},"repo":{"id":91376143,"name":"dlbench","full_name":"tfboyd/dlbench","owner":{"login":"tfboyd","id":23486130,"avatar_url":"https://avatars2.githubusercontent.com/u/23486130?v=3","gravatar_id":"","url":"https://api.github.com/users/tfboyd","html_url":"https://github.com/tfboyd","followers_url":"https://api.github.com/users/tfboyd/followers","following_url":"https://api.github.com/users/tfboyd/following{/other_user}","gists_url":"https://api.github.com/users/tfboyd/gists{/gist_id}","starred_url":"https://api.github.com/users/tfboyd/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tfboyd/subscriptions","organizations_url":"https://api.github.com/users/tfboyd/orgs","repos_url":"https://api.github.com/users/tfboyd/repos","events_url":"https://api.github.com/users/tfboyd/events{/privacy}","received_events_url":"https://api.github.com/users/tfboyd/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/tfboyd/dlbench","description":"Benchmarking State-of-the-Art Deep Learning Software Tools","fork":true,"url":"https://api.github.com/repos/tfboyd/dlbench","forks_url":"https://api.github.com/repos/tfboyd/dlbench/forks","keys_url":"https://api.github.com/repos/tfboyd/dlbench/keys{/key_id}","collaborators_url":"https://api.github.com/repos/tfboyd/dlbench/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/tfboyd/dlbench/teams","hooks_url":"https://api.github.com/repos/tfboyd/dlbench/hooks","issue_events_url":"https://api.github.com/repos/tfboyd/dlbench/issues/events{/number}","events_url":"https://api.github.com/repos/tfboyd/dlbench/events","assignees_url":"https://api.github.com/repos/tfboyd/dlbench/assignees{/user}","branches_url":"https://api.github.com/repos/tfboyd/dlbench/branches{/branch}","tags_url":"https://api.github.com/repos/tfboyd/dlbench/tags","blobs_url":"https://api.github.com/repos/tfboyd/dlbench/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/tfboyd/dlbench/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/tfboyd/dlbench/git/refs{/sha}","trees_url":"https://api.github.com/repos/tfboyd/dlbench/git/trees{/sha}","statuses_url":"https://api.github.com/repos/tfboyd/dlbench/statuses/{sha}","languages_url":"https://api.github.com/repos/tfboyd/dlbench/languages","stargazers_url":"https://api.github.com/repos/tfboyd/dlbench/stargazers","contributors_url":"https://api.github.com/repos/tfboyd/dlbench/contributors","subscribers_url":"https://api.github.com/repos/tfboyd/dlbench/subscribers","subscription_url":"https://api.github.com/repos/tfboyd/dlbench/subscription","commits_url":"https://api.github.com/repos/tfboyd/dlbench/commits{/sha}","git_commits_url":"https://api.github.com/repos/tfboyd/dlbench/git/commits{/sha}","comments_url":"https://api.github.com/repos/tfboyd/dlbench/comments{/number}","issue_comment_url":"https://api.github.com/repos/tfboyd/dlbench/issues/comments{/number}","contents_url":"https://api.github.com/repos/tfboyd/dlbench/contents/{+path}","compare_url":"https://api.github.com/repos/tfboyd/dlbench/compare/{base}...{head}","merges_url":"https://api.github.com/repos/tfboyd/dlbench/merges","archive_url":"https://api.github.com/repos/tfboyd/dlbench/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/tfboyd/dlbench/downloads","issues_url":"https://api.github.com/repos/tfboyd/dlbench/issues{/number}","pulls_url":"https://api.github.com/repos/tfboyd/dlbench/pulls{/number}","milestones_url":"https://api.github.com/repos/tfboyd/dlbench/milestones{/number}","notifications_url":"https://api.github.com/repos/tfboyd/dlbench/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/tfboyd/dlbench/labels{/name}","releases_url":"https://api.github.com/repos/tfboyd/dlbench/releases{/id}","deployments_url":"https://api.github.com/repos/tfboyd/dlbench/deployments","created_at":"2017-05-15T19:21:46Z","updated_at":"2017-05-15T19:21:48Z","pushed_at":"2017-05-29T02:35:34Z","git_url":"git://github.com/tfboyd/dlbench.git","ssh_url":"git@github.com:tfboyd/dlbench.git","clone_url":"https://github.com/tfboyd/dlbench.git","svn_url":"https://github.com/tfboyd/dlbench","homepage":"http://dlbench.comp.hkbu.edu.hk/","size":27043,"stargazers_count":0,"watchers_count":0,"language":"Python","has_issues":false,"has_projects":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"open_issues_count":0,"forks":0,"open_issues":0,"watchers":0,"default_branch":"master"}},"base":{"label":"hclhkbu:master","ref":"master","sha":"93205c4e1387752df146b4fcd5e5882fab20d2a6","user":{"login":"hclhkbu","id":25343557,"avatar_url":"https://avatars2.githubusercontent.com/u/25343557?v=3","gravatar_id":"","url":"https://api.github.com/users/hclhkbu","html_url":"https://github.com/hclhkbu","followers_url":"https://api.github.com/users/hclhkbu/followers","following_url":"https://api.github.com/users/hclhkbu/following{/other_user}","gists_url":"https://api.github.com/users/hclhkbu/gists{/gist_id}","starred_url":"https://api.github.com/users/hclhkbu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hclhkbu/subscriptions","organizations_url":"https://api.github.com/users/hclhkbu/orgs","repos_url":"https://api.github.com/users/hclhkbu/repos","events_url":"https://api.github.com/users/hclhkbu/events{/privacy}","received_events_url":"https://api.github.com/users/hclhkbu/received_events","type":"User","site_admin":false},"repo":{"id":80006443,"name":"dlbench","full_name":"hclhkbu/dlbench","owner":{"login":"hclhkbu","id":25343557,"avatar_url":"https://avatars2.githubusercontent.com/u/25343557?v=3","gravatar_id":"","url":"https://api.github.com/users/hclhkbu","html_url":"https://github.com/hclhkbu","followers_url":"https://api.github.com/users/hclhkbu/followers","following_url":"https://api.github.com/users/hclhkbu/following{/other_user}","gists_url":"https://api.github.com/users/hclhkbu/gists{/gist_id}","starred_url":"https://api.github.com/users/hclhkbu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hclhkbu/subscriptions","organizations_url":"https://api.github.com/users/hclhkbu/orgs","repos_url":"https://api.github.com/users/hclhkbu/repos","events_url":"https://api.github.com/users/hclhkbu/events{/privacy}","received_events_url":"https://api.github.com/users/hclhkbu/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/hclhkbu/dlbench","description":"Benchmarking State-of-the-Art Deep Learning Software Tools","fork":false,"url":"https://api.github.com/repos/hclhkbu/dlbench","forks_url":"https://api.github.com/repos/hclhkbu/dlbench/forks","keys_url":"https://api.github.com/repos/hclhkbu/dlbench/keys{/key_id}","collaborators_url":"https://api.github.com/repos/hclhkbu/dlbench/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/hclhkbu/dlbench/teams","hooks_url":"https://api.github.com/repos/hclhkbu/dlbench/hooks","issue_events_url":"https://api.github.com/repos/hclhkbu/dlbench/issues/events{/number}","events_url":"https://api.github.com/repos/hclhkbu/dlbench/events","assignees_url":"https://api.github.com/repos/hclhkbu/dlbench/assignees{/user}","branches_url":"https://api.github.com/repos/hclhkbu/dlbench/branches{/branch}","tags_url":"https://api.github.com/repos/hclhkbu/dlbench/tags","blobs_url":"https://api.github.com/repos/hclhkbu/dlbench/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/hclhkbu/dlbench/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/hclhkbu/dlbench/git/refs{/sha}","trees_url":"https://api.github.com/repos/hclhkbu/dlbench/git/trees{/sha}","statuses_url":"https://api.github.com/repos/hclhkbu/dlbench/statuses/{sha}","languages_url":"https://api.github.com/repos/hclhkbu/dlbench/languages","stargazers_url":"https://api.github.com/repos/hclhkbu/dlbench/stargazers","contributors_url":"https://api.github.com/repos/hclhkbu/dlbench/contributors","subscribers_url":"https://api.github.com/repos/hclhkbu/dlbench/subscribers","subscription_url":"https://api.github.com/repos/hclhkbu/dlbench/subscription","commits_url":"https://api.github.com/repos/hclhkbu/dlbench/commits{/sha}","git_commits_url":"https://api.github.com/repos/hclhkbu/dlbench/git/commits{/sha}","comments_url":"https://api.github.com/repos/hclhkbu/dlbench/comments{/number}","issue_comment_url":"https://api.github.com/repos/hclhkbu/dlbench/issues/comments{/number}","contents_url":"https://api.github.com/repos/hclhkbu/dlbench/contents/{+path}","compare_url":"https://api.github.com/repos/hclhkbu/dlbench/compare/{base}...{head}","merges_url":"https://api.github.com/repos/hclhkbu/dlbench/merges","archive_url":"https://api.github.com/repos/hclhkbu/dlbench/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/hclhkbu/dlbench/downloads","issues_url":"https://api.github.com/repos/hclhkbu/dlbench/issues{/number}","pulls_url":"https://api.github.com/repos/hclhkbu/dlbench/pulls{/number}","milestones_url":"https://api.github.com/repos/hclhkbu/dlbench/milestones{/number}","notifications_url":"https://api.github.com/repos/hclhkbu/dlbench/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/hclhkbu/dlbench/labels{/name}","releases_url":"https://api.github.com/repos/hclhkbu/dlbench/releases{/id}","deployments_url":"https://api.github.com/repos/hclhkbu/dlbench/deployments","created_at":"2017-01-25T10:59:20Z","updated_at":"2017-05-20T01:49:05Z","pushed_at":"2017-05-29T03:29:05Z","git_url":"git://github.com/hclhkbu/dlbench.git","ssh_url":"git@github.com:hclhkbu/dlbench.git","clone_url":"https://github.com/hclhkbu/dlbench.git","svn_url":"https://github.com/hclhkbu/dlbench","homepage":"http://dlbench.comp.hkbu.edu.hk/","size":27057,"stargazers_count":77,"watchers_count":77,"language":"Python","has_issues":true,"has_projects":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":21,"mirror_url":null,"open_issues_count":7,"forks":21,"open_issues":7,"watchers":77,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/hclhkbu/dlbench/pulls/17"},"html":{"href":"https://github.com/hclhkbu/dlbench/pull/17"},"issue":{"href":"https://api.github.com/repos/hclhkbu/dlbench/issues/17"},"comments":{"href":"https://api.github.com/repos/hclhkbu/dlbench/issues/17/comments"},"review_comments":{"href":"https://api.github.com/repos/hclhkbu/dlbench/pulls/17/comments"},"review_comment":{"href":"https://api.github.com/repos/hclhkbu/dlbench/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/hclhkbu/dlbench/pulls/17/commits"},"statuses":{"href":"https://api.github.com/repos/hclhkbu/dlbench/statuses/33f3020c896592fb01eac955d43723dd3ec132f7"}},"merged":true,"mergeable":null,"rebaseable":null,"mergeable_state":"unknown","merged_by":{"login":"FreemanX","id":9710644,"avatar_url":"https://avatars3.githubusercontent.com/u/9710644?v=3","gravatar_id":"","url":"https://api.github.com/users/FreemanX","html_url":"https://github.com/FreemanX","followers_url":"https://api.github.com/users/FreemanX/followers","following_url":"https://api.github.com/users/FreemanX/following{/other_user}","gists_url":"https://api.github.com/users/FreemanX/gists{/gist_id}","starred_url":"https://api.github.com/users/FreemanX/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/FreemanX/subscriptions","organizations_url":"https://api.github.com/users/FreemanX/orgs","repos_url":"https://api.github.com/users/FreemanX/repos","events_url":"https://api.github.com/users/FreemanX/events{/privacy}","received_events_url":"https://api.github.com/users/FreemanX/received_events","type":"User","site_admin":false},"comments":0,"review_comments":0,"maintainer_can_modify":false,"commits":5,"additions":149,"deletions":89,"changed_files":3}}
{"actor":{"display_login":"FreemanX"}}