{"action":"created","issue":{"url":"https://api.github.com/repos/BVLC/caffe/issues/4328","repository_url":"https://api.github.com/repos/BVLC/caffe","labels_url":"https://api.github.com/repos/BVLC/caffe/issues/4328/labels{/name}","comments_url":"https://api.github.com/repos/BVLC/caffe/issues/4328/comments","events_url":"https://api.github.com/repos/BVLC/caffe/issues/4328/events","html_url":"https://github.com/BVLC/caffe/issues/4328","id":161010000,"number":4328,"title":"Sparse convolutional neural networks","user":{"login":"wenwei202","id":12142066,"avatar_url":"https://avatars0.githubusercontent.com/u/12142066?v=4","gravatar_id":"","url":"https://api.github.com/users/wenwei202","html_url":"https://github.com/wenwei202","followers_url":"https://api.github.com/users/wenwei202/followers","following_url":"https://api.github.com/users/wenwei202/following{/other_user}","gists_url":"https://api.github.com/users/wenwei202/gists{/gist_id}","starred_url":"https://api.github.com/users/wenwei202/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wenwei202/subscriptions","organizations_url":"https://api.github.com/users/wenwei202/orgs","repos_url":"https://api.github.com/users/wenwei202/repos","events_url":"https://api.github.com/users/wenwei202/events{/privacy}","received_events_url":"https://api.github.com/users/wenwei202/received_events","type":"User","site_admin":false},"labels":[{"id":161740234,"url":"https://api.github.com/repos/BVLC/caffe/labels/speed-up","name":"speed-up","color":"c7def8","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":178,"created_at":"2016-06-18T06:30:47Z","updated_at":"2017-10-11T18:08:10Z","closed_at":null,"author_association":"NONE","body":"Anyone has interest to utilize the sparsity to accelerate DNNs?\r\n\r\nI am working on the fork https://github.com/wenwei202/caffe/tree/scnn and currently, on average, achieve ~5x CPU and ~3x GPU layer-wise speedups of convolutional layers in AlexNet by off-the-shelf GEMM (after ~2% top1 accuracy loss). \r\n\r\nhttp://papers.nips.cc/paper/6504-learning-structured-sparsity-in-deep-neural-networks.pdf"},"comment":{"url":"https://api.github.com/repos/BVLC/caffe/issues/comments/335898538","html_url":"https://github.com/BVLC/caffe/issues/4328#issuecomment-335898538","issue_url":"https://api.github.com/repos/BVLC/caffe/issues/4328","id":335898538,"user":{"login":"Jarvistonychen","id":6901949,"avatar_url":"https://avatars0.githubusercontent.com/u/6901949?v=4","gravatar_id":"","url":"https://api.github.com/users/Jarvistonychen","html_url":"https://github.com/Jarvistonychen","followers_url":"https://api.github.com/users/Jarvistonychen/followers","following_url":"https://api.github.com/users/Jarvistonychen/following{/other_user}","gists_url":"https://api.github.com/users/Jarvistonychen/gists{/gist_id}","starred_url":"https://api.github.com/users/Jarvistonychen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Jarvistonychen/subscriptions","organizations_url":"https://api.github.com/users/Jarvistonychen/orgs","repos_url":"https://api.github.com/users/Jarvistonychen/repos","events_url":"https://api.github.com/users/Jarvistonychen/events{/privacy}","received_events_url":"https://api.github.com/users/Jarvistonychen/received_events","type":"User","site_admin":false},"created_at":"2017-10-11T18:08:10Z","updated_at":"2017-10-11T18:08:10Z","author_association":"NONE","body":"@wenwei202 Thanks a lot for spending time answering my question! Since there is only column sparsity in entry 5 of table 4, I think 0.0005 is for kernel_shape_decay? If I also wanna do breadth_decay, is 0.0005 also the right value to use?\r\nThanks again!"}}
{"actor":{"display_login":"Jarvistonychen"}}