{"action":"created","issue":{"url":"https://api.github.com/repos/open-source-economics/taxdata/issues/114","repository_url":"https://api.github.com/repos/open-source-economics/taxdata","labels_url":"https://api.github.com/repos/open-source-economics/taxdata/issues/114/labels{/name}","comments_url":"https://api.github.com/repos/open-source-economics/taxdata/issues/114/comments","events_url":"https://api.github.com/repos/open-source-economics/taxdata/issues/114/events","html_url":"https://github.com/open-source-economics/taxdata/pull/114","id":255715133,"number":114,"title":"2011 PUF and 2016 CPS","user":{"login":"andersonfrailey","id":20684675,"avatar_url":"https://avatars0.githubusercontent.com/u/20684675?v=4","gravatar_id":"","url":"https://api.github.com/users/andersonfrailey","html_url":"https://github.com/andersonfrailey","followers_url":"https://api.github.com/users/andersonfrailey/followers","following_url":"https://api.github.com/users/andersonfrailey/following{/other_user}","gists_url":"https://api.github.com/users/andersonfrailey/gists{/gist_id}","starred_url":"https://api.github.com/users/andersonfrailey/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/andersonfrailey/subscriptions","organizations_url":"https://api.github.com/users/andersonfrailey/orgs","repos_url":"https://api.github.com/users/andersonfrailey/repos","events_url":"https://api.github.com/users/andersonfrailey/events{/privacy}","received_events_url":"https://api.github.com/users/andersonfrailey/received_events","type":"User","site_admin":false},"labels":[{"id":552692119,"url":"https://api.github.com/repos/open-source-economics/taxdata/labels/in%20progress","name":"in progress","color":"ededed","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":32,"created_at":"2017-09-06T19:22:45Z","updated_at":"2017-11-09T22:12:51Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/open-source-economics/taxdata/pulls/114","html_url":"https://github.com/open-source-economics/taxdata/pull/114","diff_url":"https://github.com/open-source-economics/taxdata/pull/114.diff","patch_url":"https://github.com/open-source-economics/taxdata/pull/114.patch"},"body":"This PR makes the changes in TaxData to take us from a match of the 2009 PUF/2014 CPS to a match between the 2011 PUF/2016 CPS. Here's a quick summary of the changes:\r\n\r\n1. Fixed a couple small bugs I found in the matching scripts and made some changes for PEP8 compliance.\r\n2. Updated `cpsmar.py` to read in the raw 2016 CPS.\r\n3. Updated `runmatch.py` to handle the changes between the 2009 and 2011 PUF files (the aggregate record that we drop was split into 4 separate records) and replace all missing variables with zero.\r\n4. New weights, grow factors, and adjustment factors.\r\n5. Updated `stage1-3.py` as necessary.\r\n\r\nIn issue #104 and PR #113 I discussed how the CyLP model we use in stage 2 no longer works with the most recent versions of scipy and numpy. I talked with @MattHJensen and in order to get this PR open as soon as possible I created a new Conda environment with earlier versions of Scipy and Numpy, 0.18.1 and 1.12.1, respectively, to run everything. I will be making that available as soon as I figure out how.\r\n\r\nI put together a notebook to compare Tax-Calculator output between the current PUF and this new version to SOI reported data. That notebook can be seen [here](http://nbviewer.jupyter.org/github/andersonfrailey/Notebook-Uploads/blob/master/2011%20PUF%20Comparisons.ipynb). \r\n\r\nThere are some noticeable differences between the current and new PUF, particularly in individual income tax and AMT liability, but those changes tend to bring the Tax-Calculator calculations closer to the SOI numbers (I'm comparing for the year 2014 because that is the most recent data from SOI). This is not the case for interest income and interest paid, both of which rose dramatically. I haven't yet figured out the cause of this.\r\n\r\nIf there is anything else you would like added to the notebook, let me know and I will do so.\r\n\r\ncc @martinholmer @hdoupe @Amy-Xu "},"comment":{"url":"https://api.github.com/repos/open-source-economics/taxdata/issues/comments/343308856","html_url":"https://github.com/open-source-economics/taxdata/pull/114#issuecomment-343308856","issue_url":"https://api.github.com/repos/open-source-economics/taxdata/issues/114","id":343308856,"user":{"login":"martinholmer","id":12170745,"avatar_url":"https://avatars1.githubusercontent.com/u/12170745?v=4","gravatar_id":"","url":"https://api.github.com/users/martinholmer","html_url":"https://github.com/martinholmer","followers_url":"https://api.github.com/users/martinholmer/followers","following_url":"https://api.github.com/users/martinholmer/following{/other_user}","gists_url":"https://api.github.com/users/martinholmer/gists{/gist_id}","starred_url":"https://api.github.com/users/martinholmer/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/martinholmer/subscriptions","organizations_url":"https://api.github.com/users/martinholmer/orgs","repos_url":"https://api.github.com/users/martinholmer/repos","events_url":"https://api.github.com/users/martinholmer/events{/privacy}","received_events_url":"https://api.github.com/users/martinholmer/received_events","type":"User","site_admin":false},"created_at":"2017-11-09T22:12:51Z","updated_at":"2017-11-09T22:12:51Z","author_association":"CONTRIBUTOR","body":"@andersonfrailey said:\r\n> Both of the PUF files I referred to in the [code snippet](https://github.com/open-source-economics/taxdata/pull/114#issuecomment-342947846) are the original IRS SOI PUFs.  `puf` is the 2011 file and `puf09` is the 2009 file. \r\n\r\nWell then it would seem as if you've discovered a serious error in the 2011 PUF.  \r\nGood work!\r\n\r\n**I strongly advise you to prepare the text of an email that @MattHJensen and/or @feenberg can send to IRS-SOI staff to confirm that the E30400 data are defined as you think they are and that the documentation of the 2011 PUF E30400 variable is incorrect.**"}}
{"actor":{"display_login":"martinholmer"}}