지식의 외현화에 대한 평가도구로서 개념도와 언어기반진단의 비교 = The Comparative Study of Concept map and Language Based Diagnosis as Assessment Tools for Knowledge Representation

다국어 초록 (Multilingual Abstract)

The purpose of this study is to investigate the validity of concept map as a assessment tool for knowledge representation and compare concept map and language based diagnosis. The study focuses on the differences between drawing concept map and using natural language when the students represent their knowledge and internal conceptual structure. For this purpose, this study included 25 undergraduate students. During 10 weeks learning activities, the students were asked to draw two concept maps and write two answers about learning and instruction theory and instructional design. The concept maps were rated with a rubric. The learner``s descriptive answers were compared with the expert model. The similarities between the expert’s answers and the students’ answers were calculated by the T-MITOCAR program which is a language-based diagnosis tool. The result indicated that the correlations between concept map scores and the indices of T-MITOCAR were very low. This means the knowledge representation using concept map and writing with natural language is very different method. In the group interview for the causal chain analysis, learners answered difficulty and overburden to draw concept map because of lack of understanding about drawing process of concept map, and few opportunities to see well-drawn concept map examples. From now on, the development of language based diagnosis tools such as DEEP, SMD, T-MITOCAR, CmapTools, ACSMM, KU-Mapper, ALA-Mapper, ALA-Reader, KNOT and the researches for the validity verification of the tools are exploring. Because of the problems of graders`` subjectivity, objectivity of measurement and the effectiveness of the time for scoring, this research suggested the succeeding research to develop and verify language based diagnosis tools of Korean version.

참고문헌 (Reference)

• 1 고옥란, "중학교 생물 개념 평가도구로서 개념도 활용의 가능성" 29 (29): 11-19, 2001
• 2 서수현, "쓰기 평가의 기준 설정에 관한 연구" 고려대학교 대학원 2004
• 3 조정일, "생물 개념 이해의 평가 도구로서 개념도의 타당도, 신뢰도 그리고 현실 적용 가능성에 대한 연구" 한국과학교육학회 22 (22): 398-409, 2002
• 4 이용숙, "교육에서의 질적연구" 교육과학사 1999
• 5 권창미, "교수.학습 상황에서 개념도 활용의 효과: 메타분석" 대한사고개발학회 4 (4): 31-47, 2008
• 6 박인우, "개념학습을 위한 개념도의 문제점과 개선 방안 탐색" 한국교육공학회 22 (22): 117-137, 2006
• 7 소연희, "개념도 제시 유형이 개별/소집단 학습활동, 자기결정성 및 경쟁정도에 따라 사회과 과제흥미와 과제수행에 미치는 효과" 한국교육심리학회 23 (23): 219-237, 2009
• 8 김민정, "개념도 작성의 어려움에 대한 지원 방법의 고안과 효과검증" 한국교육공학회 25 (25): 1-27, 2009
• 9 Miller, M. D., "Validation methods for direct writing assessment" 3 (3): 285-296, 1990
• 10 Novak, J. D., "The theory underlying concept maps and how to construct them" IHMC 2006
• 11 Ifenthaler, D., "The measurement of change: Learning-dependent progression of mental models" 2 (2): 317-336, 2005
• 12 Spector, J., "The DEEP methodology for assessing learning in complex domains" Syracuse University 2004
• 13 Jonassen, D. H., "Structural knowledge: Techniques for representing, conveying, and acquiring structural knowledge" Erlbaum 1993
• 14 Wasserman, S., "Social network analysis: methods and applications" Cambridge University Press 1994
• 15 Ifenthaler, D., "Relational, structural, and semantic analysis of graphical representations and concept maps" 2007
• 16 Ifenthaler, D., "Relational structural and semantic analysis of graphical representations and concept maps" 58 (58): 81-97, 2008
• 17 Ifenthaler, D., "Practical solutions for the diagnosis of progressing mental models, In Understanding models for learning and instruction. Essays in honor of Norbert M. Seel" Springer 43-61, 2008
• 18 Dummer, P., "Planning and assessing navigation in model-centered learning environments. Why learners often do not follow the path laid out for them, In Methods and technologies for learning" WIT Press 327-334, 2005
• 19 Schvaneveldt, R. W., "Pathfinder associative networks: studies in knowledge organization" Ablex Publishing Corp 1990
• 20 Schvaneveldt, R., "Network structures in proximity data, In The psychology of learning and motivation: Advances in research and theory" Academic Press 249-284, 1989
• 21 Rupp, A. A., "Modeling learning trajectories with epistemic network analysis: A simulation-based investigation of a novel analytic method for epistemic games" 2010
• 22 Pirnay-Dummer, P., "Model inspection trace of concepts and relations: A heuristic approach to language-oriented model assessment" 2007
• 23 O’Connor, D. L., "Measuring team cognition: Concept mapping elicitation as a means of constructing team shared mental models in an applied setting, In Concept maps: Theory, methodology, technology" Public University of Navarra 1 : 487-493, 2004
• 24 Novak, J. D., "Learning, creating and using knowledge: Concept maps a facilitative tools in schools and corporations" Erlbaum 1998
• 25 Novak, J. D., "Learning how to learn" Cambridge Press 1984
• 26 Pirnay-Dummer, P., "Highly integrated model assessment technology and tools" 58 (58): 3-18, 2010
• 27 Burry-Stock, J. A., "Expert science teaching educational evaluation model instruments. U. S. Department of Education" 1995
• 28 Seel, N. M., "Epistemology, situated cognition, and mental models: Like a bridge over troubled water" 29 (29): 403-427, 2001
• 29 Hollenbeck, K., "Determining the exchangability of concept map and problem-solving essay scores" 31 (31): 51-68, 2006
• 30 Clariana, R., "Deriving and measuring group knowledge structure from essays : The effects of anaphoric reference" 57 : 725-737, 2009
• 31 Kim, M. K., "Cross-validation study of methods and technologies to assess mental models in a complex problem solving situation" 28 : 703-717, 2012
• 32 McClure, J. R., "Concept map assessment of classroom learning : Reliability, validity, and logistical practicality" 36 (36): 475-492, 1999
• 33 Johnson, T. E., "Comparative study of mental model research methods: Relationships among ACSMM, SMD, MITOCAR & DEEP methodologies" 2006
• 34 Kirschner, P. A., "Cognitive load theory" 12 : 1-10, 2002
• 35 Narayanan, V. K., "Causal mapping: An historical overview, In Causal mapping for research in information technology" Idea Group Inc 1-19, 2005
• 36 김동식, "CSCL에서 스캐폴딩의 유형이 공유 정신 모형에 미치는 영향" 한국교육공학회 22 (22): 1-34, 2006
• 37 Camp, R., "Assessing writing skill" College Entrance Examination Board 1987
• 38 Kim, H., "An investigation of the effects of model-centered instruction in individual and collaborative contexts: The case of acquiring instructional design expertise" Florida State University 2008
• 39 Taricani, E. M., "A technique for automatically scoring open-ended concept maps" 54 : 65-62, 2006
• 40 Clariana, R. B., "A comparison of pair-wise, list-wise, and clustering approaches for eliciting structural knowledge in information systems courses" 36 : 287-302, 2009