{'fraction_non_alphanumeric': 0.014483212639894667, 'fraction_numerical': 0.0, 'mean_word_length': 4.779467680608365, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A Dangerous Trade-off : Policymaking in the Era of Big Data

O of the most astonishing aspects of Edward Snowden’s revelations and the consequent congressional hearings regarding the NSA’s data collection activities was the sheer size of the program. While the notion of living in an increasingly connected and digitalized world is widely recognized, it is easy to overlook how this state of constant communication is shaping business and government and what this means for our society as a whole. Viktor MayerSchonberger, professor of internet governance and regulation at the Oxford Internet Institute at the University of Oxford, and Kenneth Cukier, Data Editor for The Economist, are certain that we live on the cusp of the next paradigm shift. With this in mind, the authors of Big Data: A Revolution That Will Transform How We Live, Work, and Think set out to build a framework for understanding how technology allows us to process increasingly large amounts of information, how we can use this information, and why big data may be the biggest thing since the printing press. At the heart of the book is the idea that we are seeing a qualitative shift in knowledge as we increase the size of the information we process. Sampling was a revolutionary instrument, but in many fields it may outlive its usefulness as we now have the opportunity to work with samples so large they come close to including the entire statistical population. The authors make a strong case for building a new methodology for the big data