AAC 애플리케이션 디자인 및 사용성 평가를 위한 성과지표 개발 = Development of Performance Indicators for AAC Application Design and Usability Evaluation

다국어 초록 (Multilingual Abstract)

Objectives: With advancements in scientific and technological progress, various Augmentative and Alternative Communication (AAC) applications (apps) have been developed. AAC users require AAC systems that align with their personal characteristics and needs. AAC performance indicators, which encompass usability evaluation, aim to measure communication effectiveness and satisfaction. These indicators can be utilized to assist AAC users in selecting appropriate AAC systems. The goal of this study was to develop performance indicators that would allow AAC users and stakeholders to evaluate AAC apps from multiple perspectives. Methods: Mobile apps and usability evaluations in prior studies were analyzed to extract keywords. Performance indicator items were developed based on this analysis. Expert validity was evaluated, and a survey of AAC users and stakeholders was done to adjust the number of items included and measure validity and reliability. Results: The analysis of prior studies for the development of performance indicator items was visualized in the form of a word cloud. The reliability assessment of AAC app performance indicators yielded a Cronbach’s α value of 0.9 or higher. Regarding content validity, the expert validity showed an S-CVI of 0.978, while the survey with AAC users and stakeholders resulted in 0.754. Exploratory factor analysis was performed to assess construct validity, revealing that all variables demonstrated a communalities value of 0.4 or higher. The items were categorized into five factors: usability, social communication, user-centered design, adoption, and empowerment. Conclusion: AAC app performance indicators should be user-centered, incorporating diverse perspectives and evaluating various aspects of app usage.

참고문헌 (Reference)

• 1 김남규 ; 이동훈 ; 최호창 ; WILLIAMWONGXIUSHUN, "텍스트 분석 기술 및 활용 동향" 한국통신학회 42 (42): 471-492, 2017
• 2 윤성욱 ; 김희선 ; 김현기, "전자책(e-Book) 인터페이스 사용성 평가에 관한 연구" 한국콘텐츠학회 13 (13): 137-144, 2013
• 3 김경양 ; 김영태 ; 백경랑 ; 박은혜, "위치, 상황 기반 AAC 애플리케이션 개발에 대한 텍스트마이닝 분석: AAC 사용자 및 주변 관련인 리빙랩을 중심으로" 한국지체·중복·건강장애교육학회 65 (65): 137-165, 2022
• 4 김정연 ; 김시원, "스마트기기 기반 AAC 앱의 사용성 평가" 한국특수교육교과교육학회 9 (9): 59-80, 2016
• 5 이만 ; 김맹호, "스마트 홈(Smart Home) 앱 디자인의 사용성 평가를 위한 평가지표 개발" 한국콘텐츠학회 19 (19): 249-258, 2019
• 6 변대호, "스마트 물류를 위한 모바일 애플리케이션의 사용성 평가" 한국콘텐츠학회 19 (19): 10-21, 2019
• 7 이희연 ; 홍기형, "모바일 보완대체의사소통(AAC) 소프트웨어의 사용성 평가 및 모바일 기기의 크기에 대한 선호도 조사" 한국재활복지공학회 6 (6): 37-43, 2012
• 8 Heimerl, F., "Word cloud explorer:text analytics based on word clouds" 1833-1842, 2014
• 9 Burkhart, L. J, "What is AAC? International Society for Augmentative and Alternative Communication"
• 10 Quesenbery, W., "What does usability mean: looking beyond ‘ease of use’" 432-436, 2001
• 11 Ariffin, S. R., "Validity and reliability mul-tiple intelligent item using rasch measurement model" 9 : 729-733, 2010
• 12 Hassenzahl, M., "User experience-a research agenda" 25 (25): 91-97, 2006
• 13 Shackel, B., "Usability-context, framework, definition, design and eval-uation" 21 (21): 339-346, 2009
• 14 Kaikkonen, A., "Usability testing of mobile applications : a comparison between laboratory and field testing" 1 (1): 4-16, 2005
• 15 Arthana, I. K. R., "Usability test-ing on website wadaya based on ISO 9241-11" 1165 (1165): 1-8, 2019
• 16 Chang, W., "Usability evaluation for smart phone augmented reality application user interface" 919-923, 2011
• 17 McNaughton, D., "The iPad and mobile technology revolu-tion : benefits and challenges for individuals who require augmentative and alternative communication" 29 (29): 107-116, 2013
• 18 Hyatt, G. W., "The iPad : a cool communicator on the go" 20 (20): 24-27, 2011
• 19 Bronfenbrenner, U., "The ecology of human development: experiments by nature and design" Harvard University Press 1979
• 20 Waller, A., "Telling tales : unlocking the potential of AAC technologies" 54 (54): 159-169, 2019
• 21 Holyfield, C., "Systematic re-view of AAC intervention research for adolescents and adults with autism spectrum disorder" 33 (33): 201-212, 2017
• 22 Pampoulou, E., "Speech and language therapists’ views about AAC system acceptance by people with acquired communication disorders" 14 (14): 471-478, 2019
• 23 O’Neill, T., "Preliminary investigation of the per-spectives of parents of children with cerebral palsy on the supports, chal-lenges, and realities of integrating augmentative and alternative communi-cation into everyday life" 29 (29): 238-254, 2020
• 24 McCall, F., "Perspec-tives on AAC systems by the users and by their communication partners" 32 (32): 235-256, 1997
• 25 Kim, S., "New in-terface for mobile UCC services : applying tag and multi-display button to mobile device" 16-24, 2007
• 26 Light, J., "New and emerging AAC tech-nology supports for children with complex communication needs and their communication partners : state of the science and future research di-rections" 35 (35): 26-41, 2019
• 27 Braddock, B. A., "Multimodal behaviors in au-tism spectrum : insights from typical development inform AAC" 2 (2): 116-126, 2017
• 28 Kim, K., "Menu design for computers and cell phones : review and reappraisal" 27 (27): 383-404, 2011
• 29 Russ, S., "Measuring safety and efficiency in the operating room : development and validation of a metric for evaluating task execution in the operating room" 216 (216): 472-481, 2013
• 30 Nielsen, J., "Iterative user-interface design" 26 (26): 32-41, 1993
• 31 Polit, D. F., "Is the CVI an acceptable indica-tor of content validity? Appraisal and recommendations" 30 (30): 459-467, 2007
• 32 Angelo, D. H., "Impact of augmentative and alternative communica-tion devices on families" 16 (16): 37-47, 2000
• 33 Davies, D. K., "Geo-Talk : a GPS-enabled portable speech output device for people with intel-lectual disability" 2 : 253-261, 2018
• 34 Morville, P, "Experience design unplugged [ACM SIGGRAPH 2005 Web Program]"
• 35 de los Reyes, J., "Evaluation of a mobile AAC application for Filipino language" 137-142, 2014
• 36 Pitt, K. M., "Evaluating the perspectives of those with severe physical impairments while learning BCI control of a commercial augmentative and alternative communication paradigm" 35 (35): 74-82, 2023
• 37 International Organization for Standardization., "Ergonomics of human-system interaction-Part 11: Usability: definitions and concepts (ISO Standard No. 9241-11:2018)"
• 38 McCarty, B., "Differentiated social skills curricu-lum for AAC users" Illinois State University 2019
• 39 Caligari, M., "Development of a new high sensitivity mechanical switch for augmentative and alternative communication access in people with amyotrophic lateral sclerosis" 16 : 1-13, 2019
• 40 Atkinson, B. F. W., "Development of a multiple heuristics evaluation table (MHET) to support software development and usability analysis" 563-572, 2007
• 41 Ahn, S. Y., "Development of a loca-tion and situation based augmentative and alternative communication service" 489-495, 2022
• 42 Lynn, M. R., "Determination and quantification of content validity" 35 (35): 382-386, 1986
• 43 Light, J., "Designing efective AAC displays for individuals with developmen-tal or acquired disabilities : state of the science and future research direc-tions" 35 (35): 42-55, 2019
• 44 Zamanzadeh, V., "Design and implementation content validity study : development of an instrument for measuring patient-cen-tered communication" 4 (4): 165-178, 2015
• 45 Lee, H., "Data science and digi-tal transformation in the fourth industrial revolution. studies in computa-tional intelligence" Springer 219-229, 2021
• 46 Soto, G., "Critical issues in the inclu-sion of students who use augmentative and alternative communication : an educational team perspective" 17 (17): 62-72, 2001
• 47 Chung, Y. C., "Communicative competence inven-tory for students who use augmentative and alternative communication : a team approach" 47 (47): 56-68, 2014
• 48 Light, J., "Communicative competence for indi-viduals who require augmentative and alternative communication : a new definition for a new era of communication" 30 (30): 1-18, 2014
• 49 Park, J., "Com-parison of usability evaluation methods for mobile application" 154-157, 2012
• 50 Light, J., "Challenges and opportunities in augmentative and alternative communication : research and technology development to enhance communication and participation for individuals with complex communication needs" 35 (35): 1-12, 2019
• 51 Niven, P. R., "Balanced scorecard: step-by-step for government and non-profit agencies" John Wiley & Sons 2008
• 52 Romski, M., "Augmentative communication and early intervention : myths and realities" 18 (18): 174-185, 2005
• 53 Maresca, G., "Augmentative and alternative communication improves quality of life in the early stages of amyotrophic lateral sclerosis" 34 (34): 35-43, 2019
• 54 Beukelman, D. R., "Augmentative and alternative com-munication: supporting children and adults with complex communication needs" Paul H. Brookes Publishing 2013
• 55 Ryu, S. H., "Augmentative and al-ternative interaction service with AI speakers to access home IoT devices and internet services for people with multiple disabilities" 496-502, 2022
• 56 Murero, M., "Artificial intelli-gence for severe speech impairment : innovative approaches to AAC and communication" 1-6, 2020
• 57 Bond, T. G., "Applying the Rasch model: fundamental measurement in the human sciences" Lawrence Erlbaum Associ-ates Publishers 2007
• 58 Dünser, A., "Applying HCI principles to AR systems design" 1-5, 2007
• 59 Elliott, C., "An evaluation of the P300 brain-computer interface, EyeLink board, and eye-tracking cam-era as augmentative and alternative communication devices" 65 (65): 4280-4290, 2022
• 60 Hirotomi, T., "An AAC system designed for improving behaviors and attitudes in communication between children with CCN and their peers" 530-541, 2018
• 61 Higginbotham, D. J., "Access to AAC : present, past, and future" 23 (23): 243-257, 2007
• 62 Yusoff, M. S. B., "ABC of content validation and content validity index calculation" 11 (11): 49-54, 2019
• 63 백경랑 ; 김경양 ; 박은혜 ; 김영태, "AAC 사용 경험에 기반한 당사자 및 주변 관련인의 위치 및 상황 기반 AAC에 대한 요구 분석" 한국보완대체의사소통학회 11 (11): 1-35, 2023
• 64 Beukelman, D, "AAC for the 21st century: framing the future"
• 65 McBride, D., "AAC evaluations and new mobile technologies : asking and answering the right questions" 20 (20): 9-16, 2011
• 66 Tsai, Y. S., "A scale for measuring evidence-searching capability : a development and validation study" 25 (25): 676-681, 2019
• 67 Rummel-Hudson, R., "A revolution at their fingertips" 20 (20): 19-23, 2011
• 68 Hemsley, B., "A call for innovative social media research in the field of augmentative and alternative commu-nication" 33 (33): 14-22, 2017
• 69 Nielsen, J., "10 usability heuristics for user interface design"
• 70 Donaldson, A. L., ""Everyone deserves AAC" : preliminary study of the experiences of speaking autistic adults who use augmentative and alternative communication" 6 (6): 315-326, 2021