{"action":"created","issue":{"url":"https://api.github.com/repos/tensorflow/tensorflow/issues/15159","repository_url":"https://api.github.com/repos/tensorflow/tensorflow","labels_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/15159/labels{/name}","comments_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/15159/comments","events_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/15159/events","html_url":"https://github.com/tensorflow/tensorflow/issues/15159","id":279797931,"number":15159,"title":"Unable access S3 using the S3 filesystem","user":{"login":"chris-smith-zocdoc","id":2537809,"avatar_url":"https://avatars0.githubusercontent.com/u/2537809?v=4","gravatar_id":"","url":"https://api.github.com/users/chris-smith-zocdoc","html_url":"https://github.com/chris-smith-zocdoc","followers_url":"https://api.github.com/users/chris-smith-zocdoc/followers","following_url":"https://api.github.com/users/chris-smith-zocdoc/following{/other_user}","gists_url":"https://api.github.com/users/chris-smith-zocdoc/gists{/gist_id}","starred_url":"https://api.github.com/users/chris-smith-zocdoc/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chris-smith-zocdoc/subscriptions","organizations_url":"https://api.github.com/users/chris-smith-zocdoc/orgs","repos_url":"https://api.github.com/users/chris-smith-zocdoc/repos","events_url":"https://api.github.com/users/chris-smith-zocdoc/events{/privacy}","received_events_url":"https://api.github.com/users/chris-smith-zocdoc/received_events","type":"User","site_admin":false},"labels":[{"id":404586594,"url":"https://api.github.com/repos/tensorflow/tensorflow/labels/stat:awaiting%20tensorflower","name":"stat:awaiting tensorflower","color":"b60205","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2017-12-06T15:37:22Z","updated_at":"2017-12-09T01:21:40Z","closed_at":null,"author_association":"NONE","body":"------------------------\r\n\r\n### System information\r\n- **Have I written custom code (as opposed to using a stock example script provided in TensorFlow)**: yes \r\n- **OS Platform and Distribution (e.g., Linux Ubuntu 16.04)**:  docker container based on centos7\r\n- **TensorFlow installed from (source or binary)**: binary, from pip\r\n- **TensorFlow version (use command below)**: ('v1.4.0-rc1-11-g130a514', '1.4.0')\r\n- **Python version**: 2.7.5\r\n- **Bazel version (if compiling from source)**: n/a\r\n- **GCC/Compiler version (if compiling from source)**: n/a\r\n- **CUDA/cuDNN version**: n/a\r\n- **GPU model and memory**: n/a\r\n- **Exact command to reproduce**:\r\n```\r\nfrom tensorflow.python.lib.io import file_io\r\nfile_io.stat('s3://datasets.elasticmapreduce/ngrams/books/20090715/eng-1M/1gram/data')\r\n```\r\n\r\n\r\n### Describe the problem\r\nI'm unable to read files using the s3 filesystem. I believe my example above should work, please correct my usage of the api if not. I tried using both an object in a public bucket and one in a private bucket that I have credentials in my ~/.aws/config for. \r\n\r\nI'm not quite sure what the error is, or how to diagnose it further. Setting the log level to Debug had no effect. `tf.logging.set_verbosity(tf.logging.DEBUG)` \r\n\r\n### Source code / logs\r\n\r\nTraceback from file_io.stat\r\n```\r\nTraceback (most recent call last):\r\n  File \"<stdin>\", line 1, in <module>\r\n  File \"/usr/lib/python2.7/site-packages/tensorflow/python/lib/io/file_io.py\", line 540, in stat\r\n    return file_statistics\r\n  File \"/usr/lib/python2.7/site-packages/tensorflow/python/framework/errors_impl.py\", line 473, in __exit__\r\n    c_api.TF_GetCode(self.status.status))\r\ntensorflow.python.framework.errors_impl.NotFoundError: Object s3://datasets.elasticmapreduce/ngrams/books/20090715/eng-1M/1gram/data does not exist\r\n```\r\n\r\nUsing the aws cli, you can verify the object exists \r\n```\r\naws s3 ls s3://datasets.elasticmapreduce/ngrams/books/20090715/eng-1M/1gram/data\r\n```"},"comment":{"url":"https://api.github.com/repos/tensorflow/tensorflow/issues/comments/350412333","html_url":"https://github.com/tensorflow/tensorflow/issues/15159#issuecomment-350412333","issue_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/15159","id":350412333,"user":{"login":"drpngx","id":20959853,"avatar_url":"https://avatars1.githubusercontent.com/u/20959853?v=4","gravatar_id":"","url":"https://api.github.com/users/drpngx","html_url":"https://github.com/drpngx","followers_url":"https://api.github.com/users/drpngx/followers","following_url":"https://api.github.com/users/drpngx/following{/other_user}","gists_url":"https://api.github.com/users/drpngx/gists{/gist_id}","starred_url":"https://api.github.com/users/drpngx/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/drpngx/subscriptions","organizations_url":"https://api.github.com/users/drpngx/orgs","repos_url":"https://api.github.com/users/drpngx/repos","events_url":"https://api.github.com/users/drpngx/events{/privacy}","received_events_url":"https://api.github.com/users/drpngx/received_events","type":"User","site_admin":false},"created_at":"2017-12-09T01:21:40Z","updated_at":"2017-12-09T01:21:40Z","author_association":"MEMBER","body":"Can you try `env` to see what you have defined (please don't paste your secret key here)."}}
{"actor":{"display_login":"drpngx"}}