{'fraction_non_alphanumeric': 0.023715415019762844, 'fraction_numerical': 0.0, 'mean_word_length': 5.2809917355371905, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A Framework of Analyzing Border Crossing Transportation Data

In this paper, authors present a framework on developing a comprehensive system to analyze border crossing transportation using an open-source meta-data acquisition and aggregation tool. It is a platform integration approach based on Hadoop, MapReduce and MongoDB to consolidate databases from both U. S. and Mexico. We design data-driven XML schema for tagging the data entries from different sources with different formats, and implement a package using open-source software R to aggregate XML-transformed data into time and space dimensions. Then the transformed data is analyzed by a Difference-in-Difference (DiD) estimation model to understand the behavior of border crossing transportation.