{"action":"opened","issue":{"url":"https://api.github.com/repos/openai/iaf/issues/10","repository_url":"https://api.github.com/repos/openai/iaf","labels_url":"https://api.github.com/repos/openai/iaf/issues/10/labels{/name}","comments_url":"https://api.github.com/repos/openai/iaf/issues/10/comments","events_url":"https://api.github.com/repos/openai/iaf/issues/10/events","html_url":"https://github.com/openai/iaf/issues/10","id":258311623,"number":10,"title":"conv2d running very slowly","user":{"login":"findhushi","id":1526817,"avatar_url":"https://avatars0.githubusercontent.com/u/1526817?v=4","gravatar_id":"","url":"https://api.github.com/users/findhushi","html_url":"https://github.com/findhushi","followers_url":"https://api.github.com/users/findhushi/followers","following_url":"https://api.github.com/users/findhushi/following{/other_user}","gists_url":"https://api.github.com/users/findhushi/gists{/gist_id}","starred_url":"https://api.github.com/users/findhushi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/findhushi/subscriptions","organizations_url":"https://api.github.com/users/findhushi/orgs","repos_url":"https://api.github.com/users/findhushi/repos","events_url":"https://api.github.com/users/findhushi/events{/privacy}","received_events_url":"https://api.github.com/users/findhushi/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2017-09-17T15:32:26Z","updated_at":"2017-09-17T15:32:26Z","closed_at":null,"author_association":"NONE","body":"Hi, \r\n\r\nI am running the tf_train.py and tf_utils code out of the box. Our tensorflow's version is 1.3.0 and GPU is  GeForce GTX TITAN X. The conv2d function in tf_utils/layers.py is running very slowly. Specifically, the following two lines in conv2d take a long time:\r\n  _ = tf.get_variable(\"g\", initializer=tf.log(scale_init) / 3.0)\r\n  _ = tf.get_variable(\"b\", initializer=-m_init * scale_init)\r\n\r\nI think due to lazy evaluation, what is actually taking time is this line:\r\n  m_init, v_init = tf.nn.moments(x_init, [0, 2, 3])\r\nas both m_init and scale_init depend on the moments.\r\n\r\nWhen running conv2d, nvidia-smi shows 'No running processes found' and 'GPU-Util  Compute M.' and the CPU utilization is ~ 95%, which means it isn't exploiting the multi-core CPU architecture either. I wonder how I can speed it up.\r\n\r\nThank you!"}}
{"actor":{"display_login":"findhushi"}}