사회정책 평가에서 질적 평가의 의의와 정합성 = Significance of Qualitative Evaluation and It’s Congruence in Evaluating Social Policy

국문 초록 (Abstract)

이 글은 양적, 질적 평가의 상호 보완적 기능을 강조하는 상보성의 시각에서 사회정책에 대한 양적 평가를 보완할 수 있는 정책평가수단으로서 질적 평가의 의의와 그 적용을 모색하는 데 목적이 있다. 사회정책은 사회적 실재의 맥락에서 이에 실제로 영향을 받는 이해당사자들의 시각을 반영할 때 가치 내재적인 사회정책과 사회프로그램의 실제적 기능과 효과를 정확히 평가할 수 있다. 이런 의미에서 개인적, 사회적, 구조적, 환경적 맥락을 아우르는 사회적 실재를 이해하고자 하는 질적 평가는 사회정책과 정합성을 갖고 있다. 그럼에도 그간의 사회정책 평가는 정형화된 지표와 인위적 맥락에 의한 ‘방법론적 획일화’ 경향을 보여 왔다. 이 글은 해석주의를 근간으로 하는 과정 중심의 질적 평가를 통해 사회정책의 가치를 평가할 수 있어야 한다고 주장한다. 질적 평가를 위해서는 ‘자연스런 의사소통 과정’을 중심으로 하는 심층 인터뷰, 포커스그룹 인터뷰, 참여관찰 등의 방법을 활용할 수 있다.

다국어 초록 (Multilingual Abstract)

This article gropes for the use of qualitative evaluation in social policy under consideration of its significance, which can complement quantitative evaluation. It maintains the viewpoint of complementarity. To evaluate social policy or social programs effectively, it requires for evaluators to reflect the points of view of the stakeholders in the context of social realities. Since social policy is value embedded field, qualitative evaluation has compatibility with social policy. Qualitative evaluation seeks to understand social realities including individual, social, structural, and environmental contexts. Nevertheless existing evaluations of social policy tend to show ‘methodological uniformity’ by standardized indicators and artificial contexts. This article argues to evaluate the value of social policy through qualitative evaluation focusing processes based on interpretation. For qualitative evaluation, we can use in-depth interview, focus group interview, or observation which orient ‘natural communicative process.’

목차 (Table of Contents)

• 요약
• 1. 문제제기
• 2. 이론적 배경
• 3. 사회정책 집행의 현실과 양적 평가의 한계
• 4. 사회정책에서 질적 평가의 논리와 적용
• 5. 결론 및 함의
• 참고문헌
• Abstract

참고문헌 (Reference)

• 1 이성우, "후기 실증주의와 질적 연구방법의 정책분석평가연구에의 적용가능성" 한국정책분석평가학회 18 (18): 15-42, 2008
• 2 홍경준, "한국 사회복지학계 연구방법론의 동향" 13 : 13-32, 2002
• 3 오정수, "한국 사회복지학계 연구방법론에 대한 반성적 고찰" 13 : 33-46, 2002
• 4 남찬섭, "한국 사회복지서비스에서 바우처의 의미와 평가: 바우처 사업의 사회적 맥락을 중심으로" 26 : 7-45, 2008
• 5 김인숙, "한국 사회복지 질적 연구: 동향과 의미" 한국사회복지학회 59 (59): 275-300, 2007
• 6 "통계기반 정책평가 범위 1월부터 확대… 사후점검도 강화"
• 7 김연옥, "우리나라 사회복지학 연구경향에 관한 연구: <한국사회복지학>에 실린 경험분석 연구를중심으로" 35 : 85-105, 1998
• 8 오윤정, "사회서비스 사업 평가에 관한 연구동향 분석" 비판과대안을위한사회복지학회/비판과대안을위한건강정책학회 (37) : 249-283, 2012
• 9 김인, "사회서비스 바우처프로그램의 효과성 및 고객만족도 영향요인 : 산모신생아도우미서비스를 중심으로" 한국지방정부학회 13 (13): 127-151, 2010
• 10 김은희, "사회복지서비스의 통합적 성과평가 : 광주광역시 종합사회복지관을 중심으로" 한국정부학회 23 (23): 801-827, 2011
• 11 정순둘, "사회복지사들의 조사연구활용에 관한 연구" 한국사회복지학회 58 (58): 251-271, 2006
• 12 송건섭, "사회복지관의 성과평가 모형구성과 적용에 관한 연구: SERVQUAL을 이용한 질적평가" 한국정책과학학회 10 (10): 79-100, 2006
• 13 정선욱, "사회복지 프로그램 질적 평가 연구논문에 대한 질적 분석" 한국사회복지연구회 44 (44): 321-349, 2013
• 14 이환범, "노인일자리사업 개선을 위한 효과성 평가" 대한지방자치학회 11 (11): 81-100, 2010
• 15 보건복지가족부, "긴급복지지원제도의 사업성과 평가 및 제도개선 방안" 보건복지가족부 2008
• 16 한국보건사회연구원, "긴급복지지원제도 사업성과 평가 및 제도개편 방안 연구" 2014
• 17 Cameron, A., "Working across boundaries to improve health outcomes: A case study of a housing support an outreach service for homeless people living with HIV" 17 (17): 388-395, 2009
• 18 Brannen, J., "Work-family matters in the workplace: The use of focus groups in a study of a UK social services department" 5 (5): 523-542, 2005
• 19 Evason, E., "Women and pensions: Time for a rethink" 37 (37): 253-270, 2003
• 20 Nutley, S., "What works?: Evidence-based policy and practice in public services" The Policy Press 13-41, 2000
• 21 Davies, H., "What works?: Evidence-based policy and practice in public services" The Policy Press 251-275, 2000
• 22 Davies, H., "What works?: Evidence-based policy and practice in public services" The Policy Press 1-11, 2000
• 23 Davies, P., "What works?: Evidence-based policy and practice in public services" The Policy Press 291-316, 2000
• 24 Macdonald, G., "What works?: Evidence-based policy and practice in public services" The Policy Press 117-140, 2000
• 25 Guba, E., "What have we learned about naturalistic evaluation?" 8 (8): 23-43, 1987
• 26 Davies, B., "Universality, selectivity and effectiveness in social policy" Heinemann Educational 1978
• 27 Smith, N., "Toward the justification of claims in evaluation research" 10 : 309-314, 1987
• 28 Biggs, S., "Toward critical narrativity: Stories of aging in contemporary social policy" 15 : 303-316, 2001
• 29 Dean, H., "The student's companion to social policy" Blackwell Publishers 317-322, 1998
• 30 Greener, I., "The routledge handbook of the welfare state" Routledge 419-430, 2013
• 31 Saunders, P., "The routledge handbook of the welfare state" Routledge 59-70, 2013
• 32 Pierson, J., "The routledge handbook of the welfare state" Routledge 71-83, 2013
• 33 Greve, B., "The routledge handbook of the Welfare State" Routledge 3-9, 2013
• 34 Allio, L., "The political circumstances of instrument design : The case of privatization in Eastern Europe. In B. Peters & F. van Nispen(eds)" Edward Elgar 20-149, 1998
• 35 Gage, N. L., "The paradigm wars and their aftermath: A “historical” sketch of research on teaching since 1989" 18 (18): 4-10, 1989
• 36 Peck, E., "The meanings of culture in health and social care: A case study of the combined trust in Somerset" 15 (15): 319-327, 2001
• 37 Government Social Research Unit, "The magenta book: Guidance notes for policy evaluation and analysis, background paper 1: What is policy evaluation?" HM Treasury 2003
• 38 Government Social Research Unit, "The magenta book : Guidance notes for policy evaluation and analysis, background paper 8 : How do you know why(and how)something works? Qualitative methods of evaluation" HM Treasury 2004
• 39 Alcock, P., "The influence of dynamic perspectives on poverty analysis and anti-poverty policy in the UK" 33 (33): 395-416, 2004
• 40 Weiss, C., "The haphazard connection: Social science and public policy" 23 (23): 137-150, 1995
• 41 Jessop, B., "The changing governance of welfare: Recent trends in its primary functions, scale and modes of coordination" 33 (33): 348-359, 1999
• 42 Newman, K., "Studies of welfare populations: Data collections and research issues" Committee on National Statistics, National Research Council 55-383, 2001
• 43 Sechrest, L., "Social science and social policy" Sage Publications 63-95, 1985
• 44 McLaughlin, M., "Social science and social policy" Sage Publications 96-120, 1985
• 45 Begun, A., "Social policy evaluation: An example from drinking age legislation" 3 : 165-170, 1980
• 46 Chambers, D., "Social policy and social programs: A method for the practical public policy analyst" Allyn & Bacon 2000
• 47 문신용, "SERVQUAL기법을 활용한 가족복지서비스의 질적 수준 평가 : 건강가정지원센터를 중심으로" 한국지방정부학회 13 (13): 153-172, 2010
• 48 Sale, J., "Revisiting the quantitative-qualitative debate: Implications for mixed-methods research" 36 : 43-53, 2002
• 49 Christians, C., "Research methods in mass communication" Prentice Hall 354-374, 1989
• 50 Coffey, A., "Reconceptualizing social policy: Sociological perspectives on contemporary social policy" Open University Press 2004
• 51 Goodin, R., "Reasons for welfare: The political theory of the welfare state" Princeton University Press 1988
• 52 Hutchinson, I., "Reading complexity in social policy contexts: The value of Q methodology" Victoria University of Wellington 2012
• 53 Popay, J., "Rationale and standards for the systematic review of qualitative literature in health services research" 8 (8): 341-351, 1998
• 54 Garbarino, S., "Quantitative and qualitative methods in impact evaluation and measuring results. Issues Paper" Governance and Social Development Resource Centre 2009
• 55 Pope, C., "Qualitative research: Reaching the parts other methods cannot reach:An introduction to qualitative methods in health and health services research" BMJ
• 56 Shaw, I., "Qualitative research and outcomes in health, social work and education" 3 (3): 57-77, 2003
• 57 Chen, S., "Qualitative research and aging in context: Implications to social study in China" VI (VI): 34-47, 2010
• 58 Patton, M., "Qualitative research & evaluative methods" Sage Publications 2002
• 59 House, E., "Qualitative evaluation and changing social policy"
• 60 Dryzek, J., "Public governance" Sage Publications 330-346, 2007
• 61 Cook, T., "Postpositivist critical multiplism. In R. Shotland & M. Mark(eds). Social science and social policy" Sage Publications 21-62, 1985
• 62 Schneider, A., "Policy theory and policy evaluation: Concepts, knowledge, causes and norms" Greenwood Press 77-102, 1990
• 63 Ascher, W., "Policy sciences and the economic approach in a ‘post-positivistic’ era" 20 : 3-9, 1987
• 64 Dryzek, J., "Policy analysis as a hermeneutic activity" 14 : 309-329, 1982
• 65 Colebatch, H., "Organizational meanings of program evaluation" 28 : 149-164, 1995
• 66 Pollitt, C., "No hiding place: On the discomforts of researching the contemporary policy process" 19 (19): 169-190, 1990
• 67 Myrdal, A., "Nation and family: The swedish experiment in democratic family and population policy" MIT Press 1968
• 68 Andersson, K., "Methodological challenges in the implementation and evaluation of social welfare policies" 15 (15): 69-80, 2012
• 69 General Accounting Office, "Managing for results: Measuring program results that are under limited federal control"
• 70 Dellgran, P., "Mainstream is contextual: Swedish social work research dissertations and theses" 25 (25): 243-252, 2001
• 71 Doyle, M., "Lessons from a community-based participatory research project:Older people’s and researchers’ reflections" 32 (32): 244-263, 2010
• 72 Greener, I., "Introduction: Evidence and evaluation in social policy" 47 (47): 355-358, 2013
• 73 Pleschberger, S., "Interviews on end-of-life care with older people: Reflections on six European studies" 21 (21): 1588-1600, 2011
• 74 Healy, P., "Interpretive policy inquiry: A response to the limitations of the received view" 19 : 381-396, 1986
• 75 Gardenhire, A., "Intensive qualitative research: Challenges, best uses and opportunities" Research Methodology 2003
• 76 Pressman, J., "Implementation: How great expectations in Washington are dashed in Oakland" University of California Press 1974
• 77 Blomquist, J., "Impact evaluation of social programs: A policy perspective" World Bank 2003
• 78 Bryson, J., "Handbook of practical program evaluation" Jossey-Bass 30-54, 2010
• 79 Caudle, S., "Handbook of practical program evaluation" Jossey-Bass 69-95, 1994
• 80 Dean, D., "Handbook of practical program evaluation" Jossey-Bass 338-349, 1994
• 81 Goldenkoff, R., "Handbook of practical program evaluation" Jossey-Bass 340-362, 2004
• 82 Hatry, H., "Handbook of practical program evaluation" Jossey-Bass 547-570, 2004
• 83 Krueger, R., "Handbook of practical program evaluation" Jossey-Bass 404-423, 2010
• 84 Scheirer, M., "Handbook of practical program evaluation" Jossey-Bass 40-68, 1994
• 85 Love, A., "Handbook of practical program evaluation" Jossey-Bass 63-97, 2004
• 86 Martinson, K., "Handbook of practical program evaluation" Jossey-Bass 163-181, 2010
• 87 Newcomer, K., "Handbook of practical program evaluation" Jossey-Bass xxxiii-xxxxvi, 2004
• 88 Newcomer, K., "Handbook of practical program evaluation" Jossey-Bass 5-29, 2010
• 89 Rogers, P., "Handbook of practical program evaluation" Jossey-Bass 429-453, 2010
• 90 Krueger, R., "Handbook of practical program evaluation" Jossey-Bass 378-403, 2010
• 91 Andenaes, A., "From placement to a child on the move: Methodological strategies to give children a more central position in child welfare service" 11 (11): 486-501, 2011
• 92 Riccio, J., "Extending the reach of randomized social experiments: New directions in evaluations of american welfare-to-work and employment initiatives" Manpower Demonstration Research Corporation 2001
• 93 Unrau, Y., "Expanding the role of program evaluation in social welfare policy analysis" 17 (17): 653-662, 1993
• 94 Rossi, P., "Evaluation: A systematic approach" Sage Publications 2004
• 95 Sanderson, I., "Evaluation, policy learning and evidence-based policy making" 80 (80): 1-22, 2002
• 96 Johansen, E., "Evaluation as social policy" 6 (6): 26-35, 1986
• 97 Schwandt, T., "Evaluation as practical hermeneutics" 3 (3): 69-83, 1997
• 98 Klein, R., "Evaluation and social policy: Some reflections on ideas and institutions" 5 : 133-140, 1982
• 99 Saunders, P., "Evaluation and research in social policy" 1995
• 100 Österle, A., "Evaluating equity in social policy: A framework for comparative analysis" 8 (8): 46-59, 2002
• 101 Rein, M., "Ethics, the social sciences and policy analysis" Plenum Press 83-111, 1983
• 102 Hartman, A., "Editorial: Many Ways of Knowing" 35 (35): 3-4, 1990
• 103 Stanley, L., "Doing ethnography, writing ethnography: A comment on hammersley" 24 (24): 617-627, 1990
• 104 Gilbert, N., "Dimensions of social welfare policy" Prentice-Hall 1974
• 105 Gilbert, N., "Dimensions of social welfare policy" Allyn &Bacon 2002
• 106 Rittel, H., "Dilemmas in a general theory of planning" 4 : 155-169, 1973
• 107 Butcher, T., "Delivering welfare" Open University Press 2002
• 108 Shura, R, "Culture change in long-term care: Participatory action research and the role of the eesident" 51 (51): 212-225, 2011
• 109 Silva, Maria Ozanira da Silva e Silva., "Constructing a participatory approach for the evaluation of social policies and programmes" 7 (7): 101-125, 2011
• 110 Schaffer, B., "Comparing administrations: Researching and reforming" 2-24, 1976
• 111 Simons, H., "Case study research in practice" Sage Publications 2009
• 112 Van de Walle, D., "Assessing the welfare impacts of public spending" 26 (26): 365-379, 1998
• 113 Teater, B., "A qualitative evaluation of the section 8 housing choice voucher program: The recipients perspectives" 10 (10): 503-519, 2010
• 114 Miller, M., "A conceptual and analytic framework for applied policy and evaluation research" 51 (51): 278-288, 1986
• 115 Lasswell, H., "A Preview of policy sciences" American Elsevier 1971