{"action":"closed","issue":{"url":"https://api.github.com/repos/Great-Hill-Corporation/quickBlocks/issues/397","repository_url":"https://api.github.com/repos/Great-Hill-Corporation/quickBlocks","labels_url":"https://api.github.com/repos/Great-Hill-Corporation/quickBlocks/issues/397/labels{/name}","comments_url":"https://api.github.com/repos/Great-Hill-Corporation/quickBlocks/issues/397/comments","events_url":"https://api.github.com/repos/Great-Hill-Corporation/quickBlocks/issues/397/events","html_url":"https://github.com/Great-Hill-Corporation/quickBlocks/issues/397","id":260613427,"number":397,"title":"Issues related to upgrading data","user":{"login":"tjayrush","id":5417918,"avatar_url":"https://avatars2.githubusercontent.com/u/5417918?v=4","gravatar_id":"","url":"https://api.github.com/users/tjayrush","html_url":"https://github.com/tjayrush","followers_url":"https://api.github.com/users/tjayrush/followers","following_url":"https://api.github.com/users/tjayrush/following{/other_user}","gists_url":"https://api.github.com/users/tjayrush/gists{/gist_id}","starred_url":"https://api.github.com/users/tjayrush/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tjayrush/subscriptions","organizations_url":"https://api.github.com/users/tjayrush/orgs","repos_url":"https://api.github.com/users/tjayrush/repos","events_url":"https://api.github.com/users/tjayrush/events{/privacy}","received_events_url":"https://api.github.com/users/tjayrush/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2017-09-26T12:57:10Z","updated_at":"2017-09-26T12:59:39Z","closed_at":"2017-09-26T12:59:39Z","author_association":"CONTRIBUTOR","body":"#### OPEN\r\n- [ ] #25 Compare old data to new. What changed? This is last chance to explore chain re-orgs.\r\n-- `receipt.logs.logIndex` used to be incorrect in Parity. This might change in old blocks.\r\n- [ ] #162 All binary data must use exitHandlers to delete lock file if quitting early.\r\n- [ ] #313 Collect statistics prior to upgrading binary databases\r\n\r\n#### CLOSED\r\n- [x] ~~Change accessibility (getters/setters) to the data from the class perspective~~ (not yet)\r\n- [x] Use ethName, acctIndex, ethPrice, and ethSlurp as examples of upgrading the data files before doing the blocks.\r\n- [x] Preserve old data until all testing is done.\r\n- [x] Surround as much of the data with tests and statistics as possible before starting\r\n- [x] Stats: nTrans per block, nError trans per block, nTraces per trans, nLogs per receipt, nFiles, nBytes, nBloom files, nBloom bytes\r\n- [x] Store bloom at the trace level not the block level.\r\n- [x] ~~All binary data should have versioning~~ (it already does)\r\n- [x] Renumber blooms to by block.txID.traceID (i.e. 4102010.10.2) (no need to track this)\r\n- [x] Learn how to work with 'geth' traces\r\n- [x] If a parent class holds data, don't store it in the base class--ever. (Breaks ethslurp.)\r\n- [x] Bloom filters should be stored in a separate file per block, otherwise regular opening is slower (I don't even know what this means)\r\n- [x] #21 Serialize in derived classes does not check parent's return value\r\n- [x] #24 BLOCK_CACHE has to be made arbitrary and not fixed\r\n- [x] #31 blockScrape --deep --check\r\n- [x] #61 All binary file opening must be protected with the CShareResource class\r\n- [x] #68 Header information, including versioning, for every binary cache (any type)\r\n- [x] #140 First time blockScraper runs it runs silently until block 47,000\r\n- [x] #148 blockScrape -fl does not check for lock file\r\n- [x] #151 Blocks stored below block 50,000 are messed up (not true as per ./below0050000)\r\n- [x] #153 blockScraper, if the files are locked, proceeds anyway without really showing a useful message.\r\n- [x] #159 ethName should store a binary backing cache\r\n- [x] #228 ethPrice hardcodes its data location in the library, it should look it up from a config file with a default. (As should all other databases.)\r\n- [x] #240 CBaseNode should store a timestamp called `lastModified` (unless it takes up too much space--do an estimate)\r\n- [x] #247 Allow for upgrading of binary files on the fly (or at least understand the issue).\r\n- [x] #315 Complete binary upgradability with prices/poloniex.bin is first since it's self contained.\r\n- [x] #386 Ethslurp slurps can be stored in the binary cache folders\r\n\r\n#### DELAYED\r\n- [x] #154 Traces larger than 5megabytes (5b5b5b5b5b5 in them) are skipped. Fix this.\r\n- [x] #221 Trace optimizations I - Store nTraces in transaction. Only scan if < BIG unless --deep\r\n- [x] #222 Trace optimizations II - Most time is parsing traces. If > BIG stored pre-parsed traces\r\n- [x] #223 Bloom optimizations - Hierarchical, enhanced, blooms.\r\n- [x] #388 Store some mining data (at least address and probably reward)\r\n- [x] #389  Store 'badTrans' flag in transactions and cache traces for bad transactions (all traces for both in error and not in error)\r\n"}}
{"actor":{"display_login":"tjayrush"}}