{'fraction_non_alphanumeric': 0.022130013831258646, 'fraction_numerical': 0.0, 'mean_word_length': 4.608527131782946, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Interaction with virtual environment using verbal/non-verbal communication

Verbal/non-verbal communication between a human and a computer system in a virtual space is proposed. As a concrete example, we have applied it to the field of mechanical assembly domain. The system accepts questions/commands from a user in a spoken language and is successful in the correct interpretation of the user's intentions and in the maintenance of the communication between the user and the system. Using non-verbal operations such as pointing actions, a user is able to point out an object simply. Because there is no depth feeling in the virtual space used in the system, it is often difficult for a user to grasp or point to an object using a data glove. The way a user instructs a system to assemble a virtual machine is reported in this paper. We have reported the way that the system watches a user's behavior while he/she is assembling a virtual machine, but the system simply points at the part being erroneously operated; no instruction is given to the user. An avatar should perform this instruction along with a vocal explanation for manipulating mechanical parts. In the same way, for questions from a user, the avatar should answer with a gesture and in a spoken language. If this bi-directional verbal/non-verbal communication can be realized, a user has only to imitate the avatar's action. This means that mutual comprehension will be promoted.