{'fraction_non_alphanumeric': 0.01882985877605918, 'fraction_numerical': 0.0020174848688634837, 'mean_word_length': 5.763636363636364, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A Process for Selecting Standard Reference Algorithms for Evaluating Coordinate Measurement Software

NIST is continuing efforts to standardize the evaluation of coordinate measuring systems (CMS) software by developing the Algorithm Testing and Evaluation Program (ATEP) [1]. This program will be the first calibration service in the United States for dimensional metrology software. To test and evaluate CMS software, ATEP will rely on three components: NIST’s Algorithm Testing System (ATS), test procedures based on national standards [2], and reference algorithms. This document focuses on a description of a selection process for reference algorithms. The ATS and the test procedures are briefly described in Section 2. Reference algorithms provide a baseline of performance for testing and assessing the data analysis software found in CMSs. Geometric fitting reference algorithms are incorporated in the NIST ATS to provide this performance baseline. Many geometric fitting algorithms could serve as reference algorithms. NIST will address mechanisms for selecting and replacing reference algorithms with ones that provide an improved performance baseline. The selection process for reference algorithms will lead to identifying standard reference algorithms (SRAs) for different objective functions. The SRA will then be the current baseline for CMS data analysis software performance evaluation. This report is directed towards the dimensional metrology community interested in