{'fraction_non_alphanumeric': 0.03020961775585697, 'fraction_numerical': 0.012546239210850801, 'mean_word_length': 4.635052978982109, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 1, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 1, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Practicality Assessment of the Improved ICT-Based Dementia Care Mapping Support System

Objectives: Authors have developed an ICT (Information-Communication Technology)-based Dementia Care Mapping (DCM™) support system and assessed its usefulness previously using videos. The aim of this study is to evaluate practicality of the improved support system by actual mapping. Methods: We obtained highly reliable mapping data by a team of 3 mappers (M1, M2, and M3), who mapped 5 elderly people with dementia continuously over 4 hours in 2 sites. M1 mapped by conventional paper-based DCM™, while M2 and M3 mapped using the support system. Collected mapping data (n = 8, total of 232.5 hours = 2790 time frames) were compared. Results: The concordance rates between M1 and M2/M3 were over 70%; the required level for DCM™ evaluation purposes, with 1 exception. We also obtained users’ positive ratings regarding the system usability. Conclusion: Practicality of the ICT-based DCM™ support system was confirmed for evaluation purposes, demonstrating the system is ready for practical use.


Introduction
Dementia Care Mapping (DCM™ ) 1,2 was developed aiming at implementing Person-centred Care (PCC) 3 in formal dementia care facilities. Dementia Care Mapping is a developmental evaluation system through which care quality is observed and fed back to care staff team for developing better care practice via its repetitive cyclic process ( Figure 1). The feature of DCM™ is to promote an understanding of care practice from the viewpoint and personal experience of people with dementia, 3,4 which is represented by observers (mappers). Hence, mappers play a very important role in DCM™.
Dementia Care Mapping is a well-developed method, which is standardized in the United Kingdom 5 and has been used successfully worldwide for over 20 years. [6][7][8][9][10] However, recent randomized controlled trials (RCTs) of DCM™ have reported mixed results on efficacy and indicated that process and implementation issues are potential factors to explain the differences in the results. [11][12][13] To explore the issues, Surr et al 14 conducted a systematic review and found out that, from the relatively little evidence available on how the approach was applied in practice, appropriate manager support, and adequate staffing seemed to be essential to the successful implementation of DCM™. They also conducted an RCT for evaluating the effectiveness and costeffectiveness of DCM™ based on the study protocol. 15 During the process evaluation conducted as part of the RCT, Griffiths et al 16 identified the barriers and facilitators to DCM™ implementation at the mapper level (eg, motivation and confidence), the intervention level (eg, understanding of DCM™), and the care home level (eg, staffing issues, manager support). It was highlighted by these studies that good understanding and strong support by managers and staff were quite important for successful implementation of DCM™. Also highlighted were the complex nature of DCM™ and requirement for high skills and qualities of the mapper role. Griffiths, therefore, suggested alternative models of implementation such that external teams of expert practitioners and/or researchers undertake the mapper role, if appropriate 16 .
It may be a safe approach toward successful implementing of DCM™ to rely on external professional teams; however, it might restrict the implementation of DCM™ if such professional teams are not sufficiently available. In addition, the authors often hear from many of the domestic mappers that in-house mappers can learn a lot from mapping at external care facilities in particular, by sharing the mapping experiences and cultures of both sides with the staff members there. Thus, care home staff members can learn from mapping not only inside but also outside the own care home as in-house mappers, which may be one of the big advantages of implementation of DCM™ without relying on external professionals and the motivation for staff members to undertake the mapper role instead of their being full of demanding job. Hence, we think it is more important and sound assisting as many inhouse staff members as possible in undertaking the role of the mapper or acquiring the mapper's viewpoint than relying on external professionals. The most complex process involved in DCM™ is the observational method, and its complexity is likely to account for posing issues at both the mapper and the intervention levels which Griffiths identified. 16 We think it is possible to solve the complexity by utilizing technology; thereby mappers can make the best use of their ability of observing people with confidence, without concerning for the complex method.
Hence, we have developed an ICT-based DCM™ support system on a tablet PC ( Figure 2) 17 in order to reduce mappers' burden, making it easier to carry out DCM™, and assessed its usefulness using videos. 18 As a result, we obtained users' positive ratings of the system for burden reduction and its usability. Moreover, the developed prototype system indicated to have already reached the level of conventional paper-based DCM™ in terms of mapping accuracy.
In this article, we report on the practicality of the improved support system by actual mapping in dementia care facilities. This study is based on DCM 8; the latest edition of DCM™ published in 2005. 2 To the best of our knowledge, there is no research published to date concerning the development of ICTbased DCM™ support systems except our studies. 17,18 Methods

Improvement of the ICT-Based Support System for DCM™
The DCM™ observational method is described elsewhere. 6,19 Because the method is rather complex, the descriptions tend to be wordy, such as an observer (mapper) observes 5 elderly people with dementia (participants) continuously over a representative period (eg, 6 hours during the waking day) in communal areas of care facilities. After each 5-minute period (a time frame), 2 types of codes are used to record what has happened; the behavior category code (BCC) and the mood and engagement value (ME value). The BCC describes 1 of 23 different domains of participant behavior. The ME value describes the participant's mood state alongside their level of engagement with their environment, being expressed on a 6-point scale ranging from À5 to þ5 and so on and so forth.
Since it is not easy for general readers to understand the complex method described by words, the authors made schematic explanations 18 illustrating a clear picture of DCM™ and its complex nature at a glance; the observation and feedback process of DCM™ is shown in Figure 3A, and the manner of deciding the representative BCC and ME value for each time frame according to the operational rules 2 is illustrated in Figure 3B. . Schematics of mapping and feedback process and the operational rules of DCM™. A, Observation and feedback process of DCM™. A mapper observes the participants' activities and their state of well/ill-being, using (i) the BCC and (ii) the ME value. After each 5-minute period (time frame), a mapper decides a representative pair of BCC and ME value according to (iii) the DCM™ operational rules for record. The recorded time-series data look like (iv) a resultant chart. A mapper also records qualitative notes concerning (v) PDs and PEs, which are the staff behaviors having potential to undermine/uphold the 5 psychological needs of people with dementia. Finally, a mapper analyzes the results to prepare (vi) a summary for giving feedback to the care staff team 2 . DCM indicates Dementia Care Mapping; PwDementia, the person with dementia (the participant of DCM). B, Decision-making of the representative BCC and ME for each timeframe according to the DCM™ operational rules. When 2 or more behaviors occur within 1 time frame, follow the operational rules to decide. They are: (1) BCCs of higher potential, for positive ME, take precedence over those of lower potential, (2) record the behavior with the longest duration, (3) record the behavior with the most extreme ME value, and (4) record the behavior engaged in for the latter part of the time frame. The rules are applied one at a time beginning with (1) through (4) until a decision can be made 2 . BCC indicates behavior category code; ME value, mood and engagement value; PD, personal detraction; PE, personal enhancer.
Dementia Care Mapping is a well-developed method. However, it sets high requirements on the mapper in order to ensure its quality. The mapper needs to keep track of time precisely during 6-hour period to record time frame results every 5-minute according to the rules, which is difficult and burdensome. The ICT-based DCM™ support system helps reduce the mapper's burden 17 in such a way that the system keeps time and automatizes the rules for the mapper to simply record what is observed at a given moment. The mapper selects a name of the participant (elderly person with dementia for observation) on the entry form of the graphical user interface (GUI), shown in Figure 2, enters observed codes of BCC and ME by tapping appropriate icons, and handwrites notes as necessary. Then the system processes the entered codes automatically to finalize the representative (BCC, ME) pair for each time frame according to the operational rules. Thus, the mapper can concentrate on observation, without paying attention to keeping track of time and the complex rules. Regarding the major functionality and specifications of the DCM™ support system, please refer to our previous article. 18 We actually obtained quite positive ratings of the system for burden reduction and its usability in the previous assessment 18 using role-play videos of 2 participants, except for one problem that cannot be left unsolved. You need to select a proper nametab to switch the entry form for the intended participant through the GUI; however, not a few mappers had forgotten or mistaken to select a proper one in the previous experiment. In this study, the number of target participants increased up to 5 from the previous 2; therefore, the mistake in selecting a proper nametab would cause a more serious problem. In order to solve the issue, we changed the main screen of the GUI so that you can now enter BCCs and/or ME values for any one of the 5 participants without switching the entry form, as shown in Figure 4A. The sub-screen of each participant appears by just 1 tap from the main screen, as shown in Figure 4B, and you can review the entered records in detail or make handwritten notes.
We made other improvements, such as component bar charts on the main screen to indicate changes of each participant's BCC and ME every 15 seconds ( Figure 4A), a side window on the sub-screen ( Figure 4B) for reviewing record of any time frame backward/forward, and so on. You can also print out mapping results in a tabula worksheet form ( Figure 5), which includes the rules applied to decide the predominant BCC and ME value for each time frame. Printouts are quite useful to review and make amendments after mapping as you can look at several sheets of paper at a glance.

Data Collection
When we assessed the usefulness of the support system previously, 18 we collected mapping data under the same condition using videos and compared them with prepared standard answers. Real mapping at dementia care facilities, on the contrary, is quite different since conditions vary depending on places, time, participants, staff, and so on, all of which are uncertain. Above all, there are no correct answers for real mapping, therefore, it is a difficult issue of both how to collect and evaluate data. It may be reasonable only to compare reliable data. Hence, we tried to collect as highly reliable data as possible by recruiting highlevel mappers, as described later in the Subjects section.
The data were collected as follows: 1. Prime Map: In order to obtain IRR (inter-rater reliability) analyzing data, a team of 3 mappers (subjects) mapped 5 participants (elderly persons with dementia) in common continuously over 4 hours (up to 6 hours). One of them (M1) mapped by conventional paper-based DCM™, while other 2 (M2 and M3) mapped using the support system. 2. Prep Map: Prior to the Prime Map, all 3 subjects carried out mapping by conventional DCM™ for 1 to 1.5 hour, in order to obtain baseline data to check IRR concordance rate. 3. After the Prime Map, we conducted a questionnaire survey regarding the usefulness and usability of the improved support system.

Subjects, Participants, and Sites
We set the following 2 recruitment criteria in order to obtain highly reliable data: 1. Those who achieved correctly answered rate above 80% in the previous video map. 2. Those DCM™ users of higher level (trainer or advanced user of DCM™) who conduct mapping in a regular basis.
We recruited 3 mappers for each criterion 1 and criterion 2 and conducted tests at 2 different nursing homes (case 1 and 2, thereafter).
Notes: Each mapper M1, M2, and M3 in case i will be noted as M1 i , M2 i , and M3 i , respectively.
In addition to reliable data, feedback from ordinary users regarding the usability of the system is inevitable for practicality assessment. We, therefore, recruited a basic DCM™ user who was not so experienced in mapping and conducted a set of Prime Map with one of the authors who is an advanced user of DCM™ (case 3).
Characteristics of the subjects, participants, and test sites are listed in Table 1.

Practicality Evaluation of the Support System
In DCM™, each pair of mappers should achieve at least 70% concordance in order to map for evaluation purposes. 2,20 It is therefore necessary that, in cases 1 and 2, concordance rates CR(M1, M2) and CR(M1, M3) should achieve at least 70% concordance in order for utilizing the support system to be good for evaluation purpose, where CR(Mj, Mk) denotes the concordance rate in Prime Map between Mj and Mk. Moreover, if CR(M2, M3), the concordance rate between the 2 mappers both used the support system, achieved more than 70% at the same time, then the reliability of the system would be confirmed to a certain degree.
If CRs resulted in lower than 70%, we would need to analyze the data and discuss the results based on the CR0s, where CR0 is the baseline IRR concordance rate in Prep Map.
Regarding case 3, we calculate CR between the basic user and the advanced user for reference, though the level of reliability of the data obtained by the basic user is unknown.

Usefulness Evaluation of the Support System
We evaluated the usefulness of the support system likewise as previously, 18 looking at the decreased level of mapping difficulty using the support system in cases 1, 2, and 3, as follows: We formerly investigated mappers' difficulties and/or burden being experienced during mapping 18 as listed in Table 2.
Ask a subject, concerning each item in Table 2, their usual feeling of level of difficulty (D) and level of help (H) that they have felt after using the support system:  Calculate the obtained easiness level (E) by the support system by Equation (1): where À6 (E) 6, and the more (H) exceeds (D), the larger (E) becomes. Calculate the obtained easiness level (E(j)i) concerning each item j (j ¼ 1-17) for each subject i (i ¼ 1 to N, N: total number of subjects). If mean (E(j)i) > 0, then item j is considered to have become easier by the support system, where mean (E(j)i) is the average of (E(j)) of all subjects.
Measures DCM™ Codes. The BCCs were assigned to participants (elderly people with dementia) along with the ME values, both of which were recorded as per DCM 8 User's Manual. 2

Ethical Issues
Ethical approval was granted by the Human Ethics Committee of Graduate School of Engineering, Kobe University. We explained to all of the subjects that subject anonymity would be preserved strictly, and written informed consent was obtained prior to conducting each experiment. In addition, the director of each care facility had explained all of the mapping participants about the experiment and obtained consent for their participation, and we obtained written informed consent from the directors.

Practicality Evaluation
CR0s; the concordance rates in Prep Map in cases 1 and 2, and CRs; the concordance rates in Prime Map in cases 1, 2, and 3, are listed in Table 3. Behavior category code and ME distributions were observed relatively broad in any of the cases, which are also included in Table 3.
The BCC and ME distributions of P2 observed by the 3 subjects, M1 2 , M2 2 , and M3 2 , are shown in Table 5 In case 3, CR(M2 3 , M3 3 ), the concordance rate between a basic user and an advanced user of DCM™, both used the support system, was 66%.

Usefulness Evaluation
We calculated obtained easiness level (E) for each item listed in Table 2, estimated by Equation (1), using the data obtained by the 6 subjects who used the support system in cases 1 through 3. We had previously obtained values of (E) from 22 mappers the same way after the video map. 18 In order to compare the 2 sets of data, the data obtained by 4 high-level mappers in the previous assessment and those by 5 subjects in current assessment, excluding the basic user in case 3, were averaged and shown in Figure 6 as "Easiness_v" and "Easiness," respectively. Also shown in Figure 6 were "Difficulty_v" and "Difficulty," for reference, which are twice of the negated level of difficulty (D) in previous and current assessment, respectively. Items 1, 8, 16, and 17 in Table 2 were eliminated from Figure 6 because those items were answered easy for high-level mappers.
The obtained easiness level (E) of current assessment looked more or less the same and was all positive as the previous one, with one exception of item 14, to take notes at the right moment and/or not to lose the chance to take notes, which received a very low point for obtained easiness level. In addition, we received responses to open question regarding item 14 as follows: It is not easy to make notes in relation to code entries, since the entry forms for notes and codes are separated. It is easier to write on a sheet of paper. The support system is superior and easy for entering codes, however, if only it were more user friendly regarding notes taking. It is a bit hard to enter codes or take notes when 2 or more participants become involved in some activities at the same time. It is also true with the paper-based system, though. It is impossible to enter codes/notes timely when observing many participants. You must switch entry-form screens back and forth when 2 participants are talking with each other and another participant begins some activity, and so on. It would not be a problem if I got used to operating the system, though. I may be able to cope with it using the common notes entry form; I noticed the entry form available after the mapping.

Practicality of the Support System
The observed BCCs and MEs showed a relatively wide distribution in all cases 1-3 (Table 3), in which there was no bias that made obstacle to evaluate IRR concordance.
In case 1, all of each pair of subjects (mappers) achieved over 70% concordance in Prep Map, therefore, it was assured that the data obtained by the 3 subjects would be valid for evaluation purposes. And the concordance rates CR(M1 1 , M2 1 ) and CR(M1 1 , M3 1 ) in Prime Map also reached higher than 70%, thus it was confirmed that the support system could be utilized for evaluation purposes without any problems. Furthermore, the fact that CR(M2 1 , M3 1 ) achieved 83% indicates the reliability of the support system to a certain extent.
In case 2, on the other hand, the concordance rate CR(M1 2 , M2 2 ) in Prime Map did not reach 70%, indicating that at least the pair of mapping data obtained by M1 2 using conventional DCM™ and by M2 2 using the support system did not seem to be valid for evaluation purposes. We should note, however, that CR0(M1 2 , M2 2 ) in Prep Map was as low as 58% and CR0(M2 2 , M3 2 ) did not reach 70%, despite the fact that the 3 subjects were mappers of high-level (trainer or an advanced user). In order to verify what was happening in case 2, we analyzed the baseline data of the 3 subjects M1 2 , M2 2 , and M3 2 .
As shown in Table 4, concordance rates regarding participant 2 (P2) were all quite low in any pair of subjects. There were big differences among the codes recorded for P2 per subject, as shown in Table 5, resulting in the low concordance rates for P2, which seemed to be the major reason for lowering the total concordance rates. Hence, we looked into the raw mapping data, including notes, of the 3 subjects regarding P2 in detail and found out why and how the differences have occurred, as follows: All of the 3 subjects made notes regarding subtle body movements of the participant 2 more or less the same as follows: P2, who can stroll with a wheelchair, was dozing fairly long time during the mapping period, laying back on her wheelchair with her head putting down. Every once in a while, she slightly moved back and forth, gave a slight shrug, or leaned forward. M1 2 recorded BCC ¼ [N] (sleeping, dozing) for as many as 9 time frames ( The reason of differences in ME coding: As per the DCM™ rules [N] is allocated no ME value, unless the sleeping/dozing is with some signs of discomfort or restlessness. Therefore, the number of M1 2 's time frames relevant for IRR evaluation became smaller as that of [N] became larger, resulting in the ME As seen above, the differences in BCC coding for P2 was apparently caused by the difference in vision of each subject. Furthermore, the slight body motion of P2 could have been so subtle to have caused differences in interpretation by each subject. In other words, most of the time frames of P2 could have been recorded as [N]s if a mapper of less experience had mapped, while the 3 mappers ended up with different BCC coding with each other because of their highlevel observation ability sensible of slightest body motion   (Table 5), demonstrating each subject mapped quite consistently. In principle, you need to conduct an IRR map before a full evaluation map, with another or some other mappers until each pair could achieve at least 70% concordance for evaluation purposes and 80% for research purposes. 2,20 Considering their consistency in mapping, if the 3 subjects could have conducted an IRR map properly the results of their mapping might have ended up with one of the following coding agreements: (1) Both M2 2 Table 6 shows the resultant concordance rates, given the above agreements were reached. CR0 and CR regarding P2 reached 70% or above, under both conditions (1) and (2), ended up with the total concordances CR0 and CR regarding 5 participants reached 70% or above, as well. As a reference, we calculated the total concordances regarding 4 participants, excluding P2 as singular, all of the concordance rates CR reached 70% or above, as shown in Table 6; condition (3). Thus, it seems to be highly probable that each pair of the 3 subjects could have achieved at least 70% concordance in Prep Map and Prime Map if they had conducted an IRR map properly and that utilization of the support system did not affect the mapping results.
According to the results of foregoing discussion, it was confirmed that the support system could be utilized for evaluation purposes without any problems in case 2, as well. Furthermore, the fact that the differences in coding regarding P2 among the 3 subjects in Prep Map appeared with a quite similar pattern in Prime Map indicates that the consistency of the subjects' mapping policy was maintained even using the support system. Hence, the reliability of the support system was confirmed to a certain extent.

Usefulness of the Support System
We developed the DCM™ support system aiming at burden reduction and easier operation of DCM™ for starter-level mappers in particular and assessed its usefulness previously. 18 The obtained easiness level (E) by the improved support system was also all positive, as shown in Figure 6, which confirmed that the system was useful for high-level mappers, as well. However, the level (E) for item 14 in Table 2 was very low and many of the subjects expressed their dissatisfaction by taking notes using the system. No trouble was reported regarding the entry-form selection for 5 participants by the changes of GUI (Figures 2 and 4A). However, the disadvantage of the system regarding notes taking seemed to have become more critical by the separation of entryforms for codes ( Figure 4A) and for notes ( Figure 4B). Further improvements, such as a seamless transition from coding entry form to notes entry form, are needed.
The other issue regarding the difficulties to "cope with 2 or more participants' activities at the same time" or to "enter codes/ notes timely for many participants" also became apparent in the actual mapping instead of the previous video mapping with just 2 participants with no interaction between the 2. However, we obtained a comment; such as, "It wouldn't be a problem if I got used to operating the system, though. I may be able to cope with   it using the common notes entry-form, which I noticed after the mapping," as well. Therefore, we think we need a lot more feedback to come up with a plan to solve the issue. One of the subjects, a basic user of DCM™ in case 3, who mapped 5 participants for the first time over 5 hours, gave us comments; "I could carry out the mapping without any problems, thanks to the support system. I don't think I could have mapped 5 participants without it." For a starter level mapper, it is very challenging to observe 5 participants at a time and quite tiring to continue such mapping for a long period. Thus, it was demonstrated that, with the help of the support system, a mapper can concentrate on observing/recording instead of having to pay attention to keeping track of time or to the complex DCM™ rules in actual mapping.
The feedback comments obtained in this assessment ended, as a whole, stating, "I need to get used to the system. I cannot make a firm comment on the usability of the system unless I use it several more times," or "I do want to map using the system again after enough practice." In fact, we only took some 30 minutes for instructions and practice of the support system before conducting the tests, therefore, the subjects were not explained all functions nor getting used to the operation of the system. In order to make improvements of the system based on usability assessment, it is therefore necessary to offer chances  for many users to get used to the system and then obtain as much feedback as possible from them. We received some other responses of open question regarding the usefulness of the support system as follows: I do not feel fatigued with the support system, indeed. I do wish the system would be put into practical use! Development of the system is challenging, but I look forward to its finalization. The support system can serve as assistance in education; for example, review of the rules, decision of coding, and so on. It would be nice if data were processed and graphs would come out right after the mapping.
It would be nice if I could compare coding with other mapper easily after mapping; for example, only the time frames with coding disagreements would be displayed automatically.
Regarding the last 2 needs, it is technically easy to realize. Furthermore, it is not technically difficult, for example, to project, in a meeting form, the mapping data on a screen in a tabula worksheet form for reviewing/correcting the data and make summary documents. As Griffiths et al 16 identified further barriers caused by the burdens of data analysis, paperwork, and report writing, there remains issues for the DCM™ support system to reduce mappers' burden, which we plan to include in the future study.
Step Toward the Practical Use of the Support System We conducted the practicality assessment of the support system with extreme care by selecting 2 typical cases where we could obtain highly reliable mapping data. Yet, it is necessary to conduct assessment with larger size samples in order to ensure the reliability of the assessment. It should be noted, however, that evaluation tests should be carried out under the following conditions for valid assessment: (1) Recruit subjects (users) who adequately have got used to operating the support system. (2) Obtain highly reliable data for evaluation.
The easiest way to satisfy condition (1) may be to select a limited number of subjects and let them have enough practice to use the system. It may cause a problem, however, that the candidates will be limited to high-level mappers in order to satisfy condition (2), which ends up with limited number of subjects. In addition, feedback for the system improvement will be limited due to the limited number of subjects, although it is necessary to obtain as much feedback as possible to improve and finalize the support system. Hence, the authors propose to let a wide range of mappers of all levels trying out the support system as is in their usual mapping activities, supposing that the practicality of the system is confirmed to a certain degree by this assessment. The aim of this proposal is to promote finalization of the DCM™ support system for practical use. There will be a big chance to conduct mapping of a larger sample size with a longer period of time for proper evaluation of the support system, once skilled users of the system have grown and the system has been highly improved. It may become possible, at that stage, to evaluate the reliability and usefulness of the support system not only for evaluation purposes but also for research purposes. The system can be used for research purposes to evaluate, for example, the validity of 5-minute time frame. Formerly, Thornton et al 21 assessed whether the 5-minute time frame was able to provide a meaningful representation of actual events. They compared the data obtained by 2 different methods, DCM™ mapping and continuous-time sampling, to discuss the issue. The support system makes it possible to analyze the identical raw DCM™ data under different time frame lengths because the mapping data obtained using the support system is practically continuous, and therefore, it can be analyzed with an arbitrary length of time frame.
As described above, the advantage of adopting ICT to DCM™ is to help increase mapping accuracy and reduce mappers' burden not only during mapping but also after mapping regarding data processing and paperwork such as making documents for feedback by reducing the time required. In addition, it may be possible to analyze and develop the DCM™ method from research aspect. The DCM™ support system is still halfway for practical use officially; however, we think it is important to let many users try out the system as soon as possible to accumulate users' experiences and improve the system in order to pursue foregoing possibilities.

Limitations
Some of the limitations of this study are (1) the small sample size and (2) the seating arrangement of the 3 subjects (mappers) side by side in a row, which made them difficult to observe a specific participant equally precisely in case 2.
We selected the subjects very carefully in this study in order to obtain highly reliable mapping data for the assessment, which ended up with conducting the tests in a small sample size. However, we selected 2 typical cases in which highly reliable data were assured, which made the tests probably more general than just a couple of case studies. In order to conduct assessment in a larger sample size, it is necessary to grow the number of users of the support system first to prepare for it, as described previously.
Regarding the limitation (2), we asked each team of 3 subjects (mappers) to be seated closer together so that they have the same view of the participants, expecting to obtain good data for a fair comparison. However, it did not work right regarding a specific participant in case 2. We learned from the results that mapping could be carried out more properly if we had let each mapper sit or move around as they want so that they could best observe the participants and make detailed notes as usual. Moreover, it is more desirable to evaluate the support system using data obtained from mappers who made the best use of DCM™ in such a way.