{'fraction_non_alphanumeric': 0.0160857908847185, 'fraction_numerical': 0.0, 'mean_word_length': 5.327683615819209, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Evaluating knowledge management systems efficacy and effectiveness in a design science context

Purpose – This paper aims to propose a framework for the evaluation of artefacts in Design Science and test it using an exemplar case of a knowledge management system (KMS) developed for an Australian refrigeration manufacturing company. Design/methodology/approach – The research uses Design Science research methodology in a specific case study context. The artefact studied was developed using an ontology based on an engineering design conceptualisation and created using an ontology generator, Protege. Research data for the evaluation of the framework were collected using a combination of document analysis, interviews, shadowing and observations. Findings – The evaluation framework developed for the research and applied to the KMS specifically built for the company was shown to be useful in determining the efficacy and effectiveness of the research outcomes in terms of usefulness to the company engineers in the technical analysis of their work, and for the CEO and COO as part of their strategic planning f...