{'fraction_non_alphanumeric': 0.014257939079714841, 'fraction_numerical': 0.0, 'mean_word_length': 4.804511278195489, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A Soft but Effective Strategy to Ensure Data Completeness and Data Quality


 In the Big Data and Artificial Intelligence (AI) era, Data Completeness and Data Quality are corner stones to get data insights. Among many projects in this field, ADNOC Onshore put in place a framework supported by a comprehensive Service Level Agreement to ensure that all data either internally generated by the company or acquired from our service providers are made available for the user's community to use after validating the Data Quality.
 The outcome of this effort is a framework that defines the boundaries and the rules, which govern the data completeness and data quality in the organization. It is meant also to support the implementation of the technical tools, which are meant for this purpose. The Service Level Agreements covered all sub-surface, drilling and engineering data from initiation, to provisional data, to interpreted data to final and complete data that is required for AI and Data Analytics use by the end-users. The SLAs identified the role and the time allocated for each stakeholder to perform its job. A Dashboard has been developed to show the status of each data set in terms of completion within the stipulated time by the data owner, custodian and steward.
 The Data Quality rules have been embedded in the SLAs terms to ensure reliable and trustworthy data. This foundation is a soft approach to support the system and various Data Management tools in facilitating data enrichment for comprehensive business value to ADNOC.