심리학 연구에서 언어자료를 어떻게 활용할 것인가? = How to Make Use of Verbal Data in Psychological Research?

다국어 초록 (Multilingual Abstract)

Many of the psychological processes are revealed in language responses. Verbal reports in the form of Think-Aloud protocols, self-explanations, or responses to various questions have been successfully used to understand psychological processes that are difficult to capture by utilizing traditional measures such as reaction time and Likert-scale responses. The goal of this paper is to introduce a particular method to analyze verbal data for scientific research of psychology. Called as verbal data analysis, this method is designed to systematically analyze verbal data to produce objective and quantitative results. The paper describes core features of the method along with research examples in which verbal data analysis was successfully applied. Detailed procedures of the analysis are then described with issues that researchers need to be aware of at each stage of data collection and analysis. Lastly, verbal data analysis is compared to other similar methods. Strengths and weaknesses of the method are also discussed.

국문 초록 (Abstract)

정보의 인출부터 사고과정, 내담자의 심리적 역동까지 다양한 심리과정이 말 또는 글의 형태로 드러나지만, 언어반응의 내용을 분석할 때 발생하는 해석의 주관성으로 말미암아 언어자료는 심리학 연구에 제한적으로만 사용되었다. 언어반응을 분석하는 데 따르는 문제점을 극복하고 언어자료를 과학적 심리학 연구 내에서 활용하려는 다양한 시도가 이루어져 왔는데, 대표적인 예로 인지연구에서 개발된 프로토콜 분석 및 언어자료분석을 들 수 있다. 이들 분석 기법은 글 또는 발화 자료를 체계적, 객관적으로 수집하고, 분석하는 방법으로, 인지발달, 문제해결, 전문성, 학습 등 다양한 심리학 영역에서 마음의 작동기제를 밝히는 데 공헌해 왔다. 본 논문의 목적은 언어자료분석을 중심으로 글 또는 구어의 형태로 수집되는 언어자료를 심리학 연구에서 체계적으로 사용하는 방법을 안내하는 데 있다. 이를 위하여 언어자료분석의 주요 목표, 특징과 함께 주요 연구 사례를 살펴보고, 또한 방법을 단순히 소개하는 데서 한발 더 나아가 실제 연구에 적용할 수 있도록 분석의 절차를 제시하고 고려할 점을 연구 단계별로 제시하였다. 마지막으로 언어자료를 분석하는 데 사용되는 유사 방법들과의 공통점 및 차이점을 논의하고 방법의 장단점을 살펴보았다.

참고문헌 (Reference)

• 1 조용환, "질적연구: 방법과 사례" 교육과학사 1999
• 2 이정모, "인지심리학: 형성사, 개념적 기초, 조망" 아카넷 2001
• 3 조명한, "언어 심리학" 학지사 2003
• 4 Renkl, A., "Worked-out examples : Instructional explanations support learning by self-explanations" 12 : 529-556, 2002
• 5 Suwa, M., "What do architects and students perceive in their design sketches? A protocol analysis" 18 (18): 385-403, 1997
• 6 Ericsson, K. A., "Verbal report as data" 87 (87): 215-251, 1980
• 7 Pressley, M., "Verbal protocols of reading: The nature of constructively responsive reading" Erlbaum 1995
• 8 Schooler, J. W., "Verbal overshadowing of visual memories : Some things are better left unsaid" 22 (22): 36-71, 1990
• 9 Clark, H. H., "Using uh and um in spontaneous speaking" 84 : 73-111, 2002
• 10 Benbunan-Fich, R., "Using protocol analysis to evaluate the usability of a commercial web site" 39 : 151-163, 2001
• 11 Kimmerle, J., "Using Wikis for Learning and Knowledge Building : Results of an Experimental Study" 14 : 138-148, 2011
• 12 Schneider, J., "Understanding and Improving Wikipedia Article Discussion Spaces" 2011
• 13 Ericsson, K. A., "Uncovering the structure of a memorist’s superior"basic"memory capacity" 49 : 191-237, 2004
• 14 Hsiu-Fang, H., "Three approaches to qualitative content analysis" 15 (15): 1277-1288, 2005
• 15 Schooler, J. S., "Thoughts beyond words : When language overshadows insight" 122 (122): 166-183, 1993
• 16 Stempflea, J., "Thinking in design teams-an analysis of team communication" 23 (23): 473-496, 2002
• 17 Rattleff, P., "The reliability of content analysis of computer conference communication" 49 : 230-242, 2007
• 18 Paletz, S. B. F., "The interplay of conflict and analogy in multidisciplinary teams" 126 : 1-19, 2012
• 19 Jeong, H., "The international handbook of collaborative learning" Taylor & Francis 2013
• 20 Coleman, E. B., "The effect of instructional explanations on learning from scientific texts" 6 (6): 347-365, 1997
• 21 Bryman, A., "The debate about quantitative and qualitative research : A question of method or epistemology" 35 (35): 75-92, 1984
• 22 Neuendorf, K. A., "The content analysis: Guidebook" Thousand Oaks 2002
• 23 Nisbett, R. E., "Telling more than we can know : Verbal reports on mental processes" 84 (84): 231-259, 1977
• 24 Dyke, G., "Tatiana: An environment to support the CSCL analysis process" 2009
• 25 Payne, J. W., "Task complexity and contingent processing in decision making : An information search and protocol analysis" 16 (16): 366-387, 1976
• 26 Roscoe, R. D., "Self-monitoring and knowledge-building in learning by teaching" 42 (42): 327-351, 2013
• 27 Chi, M. T. H., "Self-explanations : How students study and use examples in learning to solve problems" 13 : 145-182, 1989
• 28 McNamara, D. S., "SERT: Self-explanation reading training" 38 (38): 1-30, 2004
• 29 Opfer, J. E., "Revisiting preschoolers' living things concept : A microgenetic analysis of conceptual change in basic biology" 49 : 301-332, 2004
• 30 Wineburg, S., "Reading Abraham Lincoln : An expert/expert study in the interpretation of historical texts" 22 (22): 319-346, 1998
• 31 Baker, M., "Rainbow : A framework for analyzing computer-mediated pedagogical debates" 2 : 315-357, 2007
• 32 Chi, M. T. H., "Quantifying qualitative analyses of verbal data : A practical guide" 6 (6): 271-315, 1997
• 33 Pennebaker, J. W., "Psychological aspects of natural language use : our words, our selves" 54 : 547-577, 2003
• 34 Ericsson, K. A., "Protocol analysis: Verbal report as data" The MIT Press 1993
• 35 Rittle-johnson, B., "Promoting transfer : Effects of self-explanation and direct instruction" 77 (77): 1-15, 2006
• 36 Chase, W. G., "Perception in chess" 4 : 55-81, 1973
• 37 Pennebaker, J. W., "Operator's manual: Linguistic inquiry and word count: LIWC2007" LIWC.net 2007
• 38 Chan, J., "On the benefits and pitfalls of analogies for innovative design : Ideation performance based on analogical distance, commonness, and modality of examples" 133 (133): 081004-, 2011
• 39 Chi, M. T. H., "Network representation of a child's dinosaur knowledge" 19 (19): 29-39, 1983
• 40 Vosniadou, S., "Mental models of the earth : A study of conceptual change in childhood" 24 : 535-585, 1992
• 41 Sacks, H., "Lectures on conversation" Blackwell 1992
• 42 Veenman, M. V. J., "Learning styles: self-reports versus thinking-aloud measures" 73 (73): 357-372, 2003
• 43 Renkl, A., "Learning from worked-out examples : The effects of example variability and elicited self-explanations" 23 (23): 90-108, 1998
• 44 Renkl, A., "Learning from worked-out examples : A study on individual difference" 21 (21): 1-29, 1997
• 45 Jeong, H., "Knowledge convergence and collaborative learning" 35 : 287-315, 2007
• 46 Jordan, B., "Interaction analysis : Foundations and practice" 4 (4): 39-103, 1995
• 47 Kaplan, C. K., "In search of insight" 22 : 374-419, 1990
• 48 Newell, A., "Human problem solving" Prentice-Hall 1972
• 49 Siegler, R. S., "How does change occur : A microgenetic study of number conservation" 28 : 225-273, 1995
• 50 Wineburg, S. S., "Historical problem solving : A study of the cognitive processes used in the evaluation of documentary and pictorial evidence" 83 (83): 73-87, 1991
• 51 Ericsson, K. A., "Expertise in interpreting : An expert-performance perspective" 5 (5): 187-220, 2000
• 52 Chi, M. T. H., "Eliciting self-explanations improves understanding" 18 : 439-477, 1994
• 53 Hoffman, R. R., "Eliciting knowledge from experts : A methodological analysis" 62 : 129-158, 1995
• 54 Johnson, R., "Educational research: Quantitative, qualitative, and mixed approaches" Sage 2008
• 55 Azevedo, R., "Does training on self-regulated learning facilitate students' learning with hypermedia?" 96 (96): 523-535, 2004
• 56 Fox, M. C., "Do procedures for verbal reporting of thinking have to be reactive? A meta-analysis and recommendations for best reporting methods" 137 (137): 316-344, 2011
• 57 Berthold, K., "Do learning protocols support learning strategies and outcomes? The role of cognitive and metacognitive prompts" 17 (17): 564-577, 2007
• 58 van Aalst, J., "Distinguishing knowledge-sharing, knowledge-construction, and knowledge-creation discourse" 4 : 259-287, 2009
• 59 Gee, J. P., "Discourse analysis, learning, and school practice: A methodological study" AERA 23 : 1998
• 60 Dunbar, K., "Creative thought: An investigation of conceptual structures and processes" American Psychological Association 461-493, 1997
• 61 Jefferson, G., "Conversation analysis: Studies from the first generation" John Benjamin Publishing Company 13-31, 2004
• 62 Strijbos, J., "Content analysis: What are they talking about?" 46 : 29-48, 2006
• 63 Krippendorff, K., "Content analysis: An introduction to its methodology" Sage Publications 2004
• 64 De Wever, B., "Content analysis schemes to analyze transcripts of online asynchronous discussion groups : A review" 46 : 6-28, 2006
• 65 Holsti, O. R., "Content analysis for the social sciences and humanities" Addison-Wesley Publishing Company 1969
• 66 Okada, T., "Collaborative discovery in a scientific domain" 21 (21): 109-146, 1997
• 67 Bosshardt, H. -G., "Cognitive processing load as a determinant of stuttering : summary of a research programme" 20 (20): 371-385, 2006
• 68 Simon, D. P., "Children's thinking: What develops?" Erlbaum 1978
• 69 Ericsson, K. A., "Cambridge Handbook of Expertise and Expert Performance" Cambridge University Press 2006
• 70 Krampe, R. T., "Cambridge Handbook of Expertise and Expert Performance" Camdridge University Press 723-742, 2006
• 71 Chi, M. T. H., "Cambridge Handbook of Expertise and Expert Performance" Cambridge University Press 167-184, 2006
• 72 Straus, A., "Basics of qualitative research" Sage publication 1990
• 73 Eye, A. V., "Analyzing rater agreement" Earlbaum 2005
• 74 Rosé, C., "Analyzing collaborative learning processes automatically : Exploiting the advances of computational linguistics in computer-supported collaborative learning" 3 : 237-271, 2008
• 75 Jeong, H., "Analysis of group understanding in artifact-mediated discourse" 2011
• 76 Meier, A., "A rating scheme for assessing the quality of computer-supported collaboration processes" 2 : 63-86, 2007
• 77 Flower, L. S., "A cognitive process theory of writing" 32 (32): 365-387, 1981