{"action":"created","issue":{"url":"https://api.github.com/repos/dmlc/mxnet/issues/6680","repository_url":"https://api.github.com/repos/dmlc/mxnet","labels_url":"https://api.github.com/repos/dmlc/mxnet/issues/6680/labels{/name}","comments_url":"https://api.github.com/repos/dmlc/mxnet/issues/6680/comments","events_url":"https://api.github.com/repos/dmlc/mxnet/issues/6680/events","html_url":"https://github.com/dmlc/mxnet/pull/6680","id":235441890,"number":6680,"title":"Added script to test caffe converted models layer by layer","user":{"login":"arikpoz","id":9167746,"avatar_url":"https://avatars0.githubusercontent.com/u/9167746?v=3","gravatar_id":"","url":"https://api.github.com/users/arikpoz","html_url":"https://github.com/arikpoz","followers_url":"https://api.github.com/users/arikpoz/followers","following_url":"https://api.github.com/users/arikpoz/following{/other_user}","gists_url":"https://api.github.com/users/arikpoz/gists{/gist_id}","starred_url":"https://api.github.com/users/arikpoz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/arikpoz/subscriptions","organizations_url":"https://api.github.com/users/arikpoz/orgs","repos_url":"https://api.github.com/users/arikpoz/repos","events_url":"https://api.github.com/users/arikpoz/events{/privacy}","received_events_url":"https://api.github.com/users/arikpoz/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":8,"created_at":"2017-06-13T05:43:58Z","updated_at":"2017-06-14T17:45:34Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/dmlc/mxnet/pulls/6680","html_url":"https://github.com/dmlc/mxnet/pull/6680","diff_url":"https://github.com/dmlc/mxnet/pull/6680.diff","patch_url":"https://github.com/dmlc/mxnet/pull/6680.patch"},"body":"I've added a script which compares layer by layer both the **weights** and the **outputs** of a caffe model and its converted mxnet model.\r\n\r\nThe script by default runs on the known test models mentioned in **test_converter.py**, namely: **bvlc_googlenet**, **vgg-16** and **resnet-50**.\r\nIn addition the script offers functions for comparing any model by supplying the parameters of the caffe model.\r\n\r\nThe script goes over the layers of the network DAG, in BFS order, and compares the layer's parameters, usually weights and bias, but others as well.\r\n\r\nIn addition the script takes an image as input and run inference using both caffe and mxnet models, and compare the blob outputs of each layer, taking into consideration inplace layers.\r\n\r\nFor each weight blob and output blob the script log to screen the mean and max of the absolute difference between the blobs.\r\n\r\nAttached output generated when running the script using default parameters: [compare_layers_output.txt](https://github.com/dmlc/mxnet/files/1070397/compare_layers_output.txt)\r\n\r\nSince the script runs caffe inference, it depends on caffe being installed. The dependency is implicit, so the user of the script can resolve it by installing his favorite caffe version and setting the proper environment variables. All the script requires is that 'import caffe' will work.\r\n"},"comment":{"url":"https://api.github.com/repos/dmlc/mxnet/issues/comments/308506815","html_url":"https://github.com/dmlc/mxnet/pull/6680#issuecomment-308506815","issue_url":"https://api.github.com/repos/dmlc/mxnet/issues/6680","id":308506815,"user":{"login":"arikpoz","id":9167746,"avatar_url":"https://avatars0.githubusercontent.com/u/9167746?v=3","gravatar_id":"","url":"https://api.github.com/users/arikpoz","html_url":"https://github.com/arikpoz","followers_url":"https://api.github.com/users/arikpoz/followers","following_url":"https://api.github.com/users/arikpoz/following{/other_user}","gists_url":"https://api.github.com/users/arikpoz/gists{/gist_id}","starred_url":"https://api.github.com/users/arikpoz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/arikpoz/subscriptions","organizations_url":"https://api.github.com/users/arikpoz/orgs","repos_url":"https://api.github.com/users/arikpoz/repos","events_url":"https://api.github.com/users/arikpoz/events{/privacy}","received_events_url":"https://api.github.com/users/arikpoz/received_events","type":"User","site_admin":false},"created_at":"2017-06-14T17:45:34Z","updated_at":"2017-06-14T17:45:34Z","body":"Finally, **continuous-integration/jenkins/pr-head** passed with the new test.\r\nI'm not familiar with the problem of **continuous-integration/travis-ci/pr**, if someone can check it out it would be great.."}}
{"actor":{"display_login":"arikpoz"}}