{"action":"created","issue":{"url":"https://api.github.com/repos/tensorflow/tensorflow/issues/12208","repository_url":"https://api.github.com/repos/tensorflow/tensorflow","labels_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/12208/labels{/name}","comments_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/12208/comments","events_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/12208/events","html_url":"https://github.com/tensorflow/tensorflow/issues/12208","id":249585806,"number":12208,"title":"Document changes in notMNIST data sets","user":{"login":"jowagner","id":5215253,"avatar_url":"https://avatars1.githubusercontent.com/u/5215253?v=4","gravatar_id":"","url":"https://api.github.com/users/jowagner","html_url":"https://github.com/jowagner","followers_url":"https://api.github.com/users/jowagner/followers","following_url":"https://api.github.com/users/jowagner/following{/other_user}","gists_url":"https://api.github.com/users/jowagner/gists{/gist_id}","starred_url":"https://api.github.com/users/jowagner/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jowagner/subscriptions","organizations_url":"https://api.github.com/users/jowagner/orgs","repos_url":"https://api.github.com/users/jowagner/repos","events_url":"https://api.github.com/users/jowagner/events{/privacy}","received_events_url":"https://api.github.com/users/jowagner/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2017-08-11T09:45:20Z","updated_at":"2017-08-12T16:51:16Z","closed_at":"2017-08-11T13:36:13Z","body":"### Describe the problem\r\nThe notMNIST data set used in Assignment 1 and maybe elsewhere in this repo repeatedly changed size over the last 12 months. Last year, in issue #4693, a size of about 50 MB is reported for notMNIST_large.tar.gz. Now this file is 236 MB. People doing the assignment are comparing their classifier accuracy to results published by previous assignment takers and some are talking about publishing research using this data set. If the data set is modified unknowingly to the users, observed accuracy figures are not comparable and can mislead people to wrong conclusions.\r\n\r\n@yaroslavvb The files is also bigger now on your personal website. However, the time stamps of the .atr.gz and all files inside are still from 2011.\r\n\r\n### Source code / logs\r\nThe changes in size can also be tracked in changes to the calls of maybe_download() in https://github.com/tensorflow/tensorflow/blob/master/tensorflow/examples/udacity/1_notmnist.ipynb\r\n\r\n### Suggestions\r\n\r\n- The .tar.gz files should contain a readme and changelog with version information.\r\n- The filename should include the version number.\r\n- References to the data set in the assignments should be changed from \"the notMNIST dataset\" to \"version 1.23 of the notMNIST dataset\".\r\n- Result tables produced by code should quote the version of the data set.\r\n"},"comment":{"url":"https://api.github.com/repos/tensorflow/tensorflow/issues/comments/321992547","html_url":"https://github.com/tensorflow/tensorflow/issues/12208#issuecomment-321992547","issue_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/12208","id":321992547,"user":{"login":"jowagner","id":5215253,"avatar_url":"https://avatars1.githubusercontent.com/u/5215253?v=4","gravatar_id":"","url":"https://api.github.com/users/jowagner","html_url":"https://github.com/jowagner","followers_url":"https://api.github.com/users/jowagner/followers","following_url":"https://api.github.com/users/jowagner/following{/other_user}","gists_url":"https://api.github.com/users/jowagner/gists{/gist_id}","starred_url":"https://api.github.com/users/jowagner/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jowagner/subscriptions","organizations_url":"https://api.github.com/users/jowagner/orgs","repos_url":"https://api.github.com/users/jowagner/repos","events_url":"https://api.github.com/users/jowagner/events{/privacy}","received_events_url":"https://api.github.com/users/jowagner/received_events","type":"User","site_admin":false},"created_at":"2017-08-12T16:51:16Z","updated_at":"2017-08-12T16:51:16Z","body":"Thanks. Diving deeper into the git log for `1_notmnist.ipynb` and reading more threads mentioning issues with the size of the data set downloads, it seems indeed more plausible that the files did not change on the server and the deviant sizes were related to unexpected interactions between http server and client with the presence or absence of certain http headers and/or proxy servers."}}
{"actor":{"display_login":"jowagner"}}