미디어 멀티태스킹 환경에서 인터페이스의 감각양식 차이가 인지부하와 과업수행에 미치는 영향에 관한 연구 -다중 자원 이론과 스레드 인지 모델을 기반으로- = The Effects of Interface Modality on Cognitive Load and Task Performance in Media Multitasking Environment

다국어 초록 (Multilingual Abstract)

This research examined the changes that fast-growing voice-based devices would bring in the media multitasking environment. Based on the theoretical background that information processing efficiency improves when performing multiple tasks requiring different resource structures at the same time, we conducted an experiment where participants searched for information with voice-based or screen-based devices while performing an additional visual task. Results showed that both task performance environment and interface modality had significant main effects on cognitive load. The overall cognitive load level was higher in the voice interface group, but the difference in cognitive load between the two groups decreased in a multitasking environment where the additional visual resources was required. The visual task performance was significantly higher when using the voice interface than the screen interface. Our findings suggest that voice interfaces offered advantages in the cognitive load and task performance by distributing two tasks to the auditory and visual channels. The results of this study imply that voice-based devices have the potential to facilitate efficient information processing in the screen-centric environment where visual resources collide. We provided theoretical evidence of resource distribution using multiple resource theory and tried to identify the advantages of the voice interface more specifically based on the threaded cognition model.

국문 초록 (Abstract)

본 연구는 빠르게 발전하는 음성 기반의 디바이스가 스크린 중심의 미디어 멀티태스킹 환경에 어떤 변화를 가져올 수 있을지 확인하고자 했다. 서로 다른 자원 구조를 가진 과업을 동시에 수행할 때 정보 처리 효율이 높아진다는 이론적 근거를 토대로, 시각 주의가 필요한 과제와 음성 또는 스크린 기반의 디바이스를 활용해 정보를 검색하는과업을 동시에 수행하는 실험이 진행되었다. 실험 결과, 과업수행 환경과 인터페이스 감각양식은 모두 인지부하에유의미한 영향을 미쳤다. 음성 인터페이스 그룹에서 전반적으로 인지부하 수준이 높게 나타났는데, 단독으로 사용된단일 과업 조건보다 시각 과제를 동시에 수행한 다중 과업 조건에서 시각 인터페이스 그룹과의 차이가 줄어들었다. 과업 수행도의 경우 음성 인터페이스 그룹에서 시각 과제에 대한 수행능력이 시각 인터페이스 그룹보다 더 높게 측정되었다. 이러한 결과는 멀티태스킹 환경에서 음성 인터페이스를 사용했을 때 동시적 과업을 청각 경로와 시각 경로로 나누어 처리함으로써 인지부하와 과업수행에 이점이 나타났음을 의미한다. 이는 시각 자원의 충돌이 발생하기쉬운 스크린 중심의 미디어 멀티태스킹 환경에서 음성 기반의 디바이스가 효율적 정보 처리를 촉진시키는 잠재적 역할을 할 수 있다는 함의점을 제공한다. 본 연구는 다중 자원 이론을 통해 자원의 분산처리에 대한 이론적 증거를 제시하고, 스레드 인지 모델을 기반으로 음성 인터페이스를 활용했을 때의 이점을 더욱 구체적으로 규명하고자 했다.

참고문헌 (Reference)

• 1 NAVER Corp, "네이버 - NAVER"
• 2 Van Cauwenberge, A., "“TV no longer commands our full attention”:Effects of second-screen viewing and task relevance on cognitive load and learning from news" Elsevier 38 : 100-109, 2014
• 3 NewsMediaWorks, "What we learned fromthe 2018Deloitte Media Consumer Survey"
• 4 Corbett, E, "What can I say?:addressing user experience challenges of a mobile voice user interface for accessibility" ACM 72-82, 2016
• 5 Salvucci, D. D., "Toward a unified theory of the multitasking continuum: From concurrent performance to task switching, interruption, and resumption" ACM 1819-1828, 2009
• 6 Salvucci, D. D., "Threaded cognition: An integrated theory of concurrent multitasking" American Psychological Association 115 (115): 101-130, 2008
• 7 Lang, A., "The limited capacity model of mediated message processing" International Communication Association 50 (50): 46-70, 2000
• 8 Bolls, P. D., "The effects of dual-task processing on consumers' responses to high-and low-imagery radio advertisements" Taylor & Francis 36 (36): 35-47, 2007
• 9 Getty, D., "The Effects of Voice System Design Components on Driver Workload" SAGE journals 1-7, 2018
• 10 Canalys, "Smart speaker installed base to hit 100million by end of 2018"
• 11 Maulsby, D., "Prototyping an intelligent agent through Wizard of Oz" ACM 277-284, 1993
• 12 Myers, C., "Patterns for How Users Overcome Obstacles in Voice User Interfaces" ACM 6-, 2018
• 13 Mayer, R. E., "Nine ways to reduce cognitive load in multimedia learning" Taylor & Francis 38 (38): 43-52, 2003
• 14 Hwang, Y., "Multitasking and task performance: Roles of task hierarchy, sensory interference, and behavioral response" Elsevier 81 : 161-167, 2018
• 15 Jeong, S. H., "Multitasking and persuasion: The role of structural interference" Taylor & Francis 18 (18): 451-474, 2015
• 16 Wickens, C. D., "Multiple resources and performance prediction" Taylor & Francis 3 (3): 159-177, 2002
• 17 Wang, Z., "Multidimensions of media multitasking and adaptive media selection" International Communication Association 41 (41): 102-127, 2015
• 18 Facebook business, "Mobile and TV: Between the Screens"
• 19 Lauricella, A. R., "Media exposure during infancy and early childhood" Springer 1-23, 2017
• 20 Limerick, H., "Empirical evidence for a diminished sense of agency in speech interfaces" ACM 3967-3970, 2015
• 21 Yeh, Y. Y., "Dissociation of performance and subjective measures of workload" SAGE journals 30 (30): 111-120, 1988
• 22 D Hart, S. G., "Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research" Elsevier 52 : 139-183, 1988
• 23 Sweller, J., "Cognitive load theory, learning difficulty, and instructional design" Elsevier 4 (4): 295-312, 1994
• 24 Paas, F., "Cognitive load measurement as a means to advance cognitive load theory" Taylor & Francis 38 (38): 63-71, 2003
• 25 Bowman, L. L., "Can students really multitask? An experimental study of instant messaging while reading" Elsevier 54 (54): 927-931, 2010
• 26 Wang, Z., "Behavioral performance and visual attention in communication multitasking: A comparison between instant messaging and online voice chat" Elsevier 28 (28): 968-975, 2012
• 27 Pool, M. M., "Background television as an inhibitor of performance on easy and difficult homework assignments" SAGE journals 27 (27): 293-326, 2000
• 28 Armstrong, G. B., "Background television and reading memory in context:Assessing TV interference and facilitative context effects on encoding versus retrieval processes" SAGE journals 27 (27): 327-352, 2000