{'fraction_non_alphanumeric': 0.02354480052321779, 'fraction_numerical': 0.001962066710268149, 'mean_word_length': 5.538461538461538, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
LSpeakIt : Immersive interface for 3D object Search

The number of available three-dimensional digital objects has been increasing considerably. As a result, retrieving such objects from large collections has been subject of research. However, proposed solutions do not explore natural interactions in their interfaces. In this work, we propose a speech interface for 3D object retrieval in immersive virtual environments. For our prototype, LSpeakIt, the context of LEGO blocks was used as a toy-problem. To understand how people naturally describe objects, we conducted a preliminary study. We found that participants mainly resorted to verbal descriptions. Considering these descriptions, we developed our search by speech system. Taking advantage of a low cost visualization device, the Oculus Rift, we implemented four modes for immersive query results’ visualization. These modes were evaluated by users, being compared against each other and a traditional approach. Users favored the immersive modes, despite being more acquainted with the traditional approach. For our final prototype, a fifth mode for result’s visualization was implemented, adapting the users’ preferred modes. We compared the proposed solution with the LEGO Digital Designer commercial application. Results suggest that LSpeakIt can outperform its contestant, while providing users with a simple and natural way for searching virtual objects, and ensuring better performance and results’ perception than traditional approaches for 3D object retrieval.