Novas práticas em avaliação participativa: lições de uma pesquisa avaliativa sobre os conselhos de saúde no Brasil e em Espanha
Résumé
A partir das anotações reflexivas de uma avaliação participativa realizada no Brasil e na Espanha sobre os conselhos de saúde, este artigo mostrará alguns fatores-chave que permitem o surgimento de práticas avaliativas inovadoras. Estas mudanças epistemológicas e organizacionais são manifestadas através de uma série de processos basados na coprodução dinâmica de conhecimento, na criação de espaços de aprendizagem coletiva e na articulação em rede de intervenções inovadoras. O avaliador torna-se aqui um tradutor de conhecimento, responsável em última instância da configuração de uma rede dinâmica entre as partes interessadas. A tradução neste caso, permite em primeiro lugar, alinhar diferentes lógicas de múltiplos atores e setores de intervenção e, por outro lado, favorece a criação de novas alianças e projetos inovadores. Nesse contexto, a inteligência coletiva, o “crowdsourcing” e a inovação aberta são eixos de pesquisa interessantes em relação às novas práticas avaliativas, especialmente no setor da saúde pública.
##plugins.generic.usageStats.downloads##
Références
Harris MJ. Evaluating Public and Community Health Programs. John Wiley & Sons; 2016. 408 p.
Nitsch M, Waldherr K, Denk E, Griebler U, Marent B, Forster R. Participation by different stakeholders in participatory evaluation of health promotion: A literature review. Eval Program Plann. 1 oct 2013;40:42‑54.
Rohde J, Cousens S, Chopra M, Tangcharoensathien V, Black R, Bhutta ZA, et al. 30 years after Alma-Ata: has primary health care worked in countries? The Lancet. 13 sept 2008;372(9642):950‑61.
Da Silva RB, Contandriopoulos A-P, Pineault R, Tousignant P. A Global Approach to Evaluation of Health Services Utilization: Concepts and Measures. Healthc Policy. mai 2011;6(4):e106‑17.
Kothari A, McPherson C, Gore D, Cohen B, MacDonald M, Sibbald SL. A multiple case study of intersectoral public health networks: experiences and benefits of using research. Health Res Policy Syst. 11 févr 2016;14:11.
Leeuw E de. Engagement of Sectors Other than Health in Integrated Health Governance, Policy, and Action. Annu Rev Public Health. 2017;38(1):329‑49.
Ovseiko PV, O’Sullivan C, Powell SC, Davies SM, Buchan AM. Implementation of collaborative governance in cross-sector innovation and education networks: evidence from the National Health Service in England. BMC Health Serv Res. 8 nov 2014;14:552.
Enam A, Torres-Bonilla J, Eriksson H. Evidence-Based Evaluation of eHealth Interventions: Systematic Literature Review. J Med Internet Res. 23 2018;20(11):e10971.
Figueiredo MB, Morley C. Une lecture structurationniste des pratiques de management de projet SI. Systèmes Inf Manag. 1 avr 2016;me 20(2):37‑87.
Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review. A new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. juill 2005;10 Suppl 1:21‑34.
Chapman LS. Meta-evaluation of worksite health promotion economic return studies. Am J Health Promot. 2003;17(3):1‑10.
Figueiró AC, Hartz ZM de A, Thuler LCS, Dias ALF. Meta-evaluation of baseline studies of the Brazilian Family Health Strategy Expansion Project: a participatory and formative approach. Cad Saúde Pública. déc 2010;26(12):2270‑8.
Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the Economic Evaluation of Health Care Programmes. Oxford University Press; 2015. 461 p.
Moore G, Audrey S, Barker M, Bond L, Bonell C, Cooper C, et al. Process evaluation in complex public health intervention studies: the need for guidance. J Epidemiol Community Health. 1 févr 2014;68(2):101‑2.
Oakley A, Strange V, Bonell C, Allen E, Stephenson J. Process evaluation in randomised controlled trials of complex interventions. BMJ. 16 févr 2006;332(7538):413‑6.
Saksvik PØ, Nytrø K, Dahl-Jørgensen C, Mikkelsen A. A process evaluation of individual and organizational occupational stress and health interventions. Work Stress. 1 mars 2002;16(1):37‑57.
Baranowski T, Cerin E, Baranowski J. Steps in the design, development and formative evaluation of obesity prevention-related behavior change trials. Int J Behav Nutr Phys Act. 21 janv 2009;6(1):6.
Cho H, Witte K. Managing Fear in Public Health Campaigns: A Theory-Based Formative Evaluation Process. Health Promot Pract. 1 oct 2005;6(4):482‑90.
Murray E, May C, Mair F. Development and formative evaluation of the e-Health Implementation Toolkit (e-HIT). BMC Med Inform Decis Mak. 18 oct 2010;10(1):61.
Weist M, Lever N, Stephan S, Youngstrom E, Moore E, Harrison B, et al. Formative Evaluation of a Framework for High Quality, Evidence-Based Services in School Mental Health. School Ment Health. 1 déc 2009;1(4):196‑211.
Donaldson SI. Empowerment evaluation: An approach that has literally altered the landscape of evaluation. Eval Program Plann. 1 août 2017;63:136‑7.
Fetterman DM, Wandersman A. Empowerment Evaluation Principles in Practice. Guilford Press; 2005. 244 p.
Patton MQ. Empowerment evaluation: Exemplary is its openness to dialogue, reflective practice, and process use. Eval Program Plann. 1 août 2017;63:139‑40.
Brisolara S. The history of participatory evaluation and current debates in the field. New Dir Eval. 1998;1998(80):25‑41.
Cousins JB. Consequences of Researcher Involvement in Participatory Evaluation. Stud Educ Eval. 1996;22(1):3‑27.
Garaway GB. Participatory evaluation. Stud Educ Eval. 1 janv 1995;21(1):85‑102.
Rebien CC. Participatory Evaluation of Development Assistance: Dealing with Power and Facilitative Learning. Evaluation. 1 avr 1996;2(2):151‑71.
Suarez-Herrera JC, Springett J, Kagan C. Critical Connections between Participatory Evaluation, Organizational Learning and Intentional Change in Pluralistic Organizations. Evaluation. 1 juill 2009;15(3):321‑42.
Rossi PH, Lipsey MW, Henry GT. Evaluation: A Systematic Approach. SAGE Publications; 2018. 361 p.
Verbrugge LNH, Ganzevoort W, Fliervoet JM, Panten K, van den Born RJG. Implementing participatory monitoring in river management: The role of stakeholders’ perspectives and incentives. J Environ Manage. 15 juin 2017;195:62‑9.
Yin RK. Case Study Research: Design and Methods. SAGE; 2009. 241 p.
Contandriopoulos A-P, Champagne F, Potvin L, Denis J-L, Boyle P. Savoir préparer une recherche: la définir, la structurer, la financer. Presses de l’Université de Montréal; 1990. 206 p.
Poupart J, al. La recherche qualitative: enjeux épistémologiques et méthodologiques. Montréal (Québec, Canada): Centre international de criminologie comparée, Université de Montréal; 1997. 405 p.
Fortis MF de A. Rumo à pós-modernidade em políticas públicas: a epistemologia situacional de Carlos Matus. RAE Eletrônica. déc 2010;9(2):0‑0.
Matus C. Los tres cinturones del gobierno. Caracas: Fondo Editorial Altadir; 1997.
Patton MQ. Discovering process use. Evaluation. 1998;4(2):225–233.
Patton MQ. Utilization-Focused Evaluation. 4th Revised edition. Thousand Oaks: SAGE Publications Inc; 2008. 688 p.
Cousins JB, Chouinard JA. Participatory Evaluation Up Close: An Integration of Research Based Knowledge. IAP; 2012. 308 p.
Jackson ET, Kassam Y. Knowledge Shared: Participatory Evaluation in Development Cooperation. IDRC; 1998. 265 p.
Burke B. Evaluating for a change: Reflections on participatory methodology. New Dir Eval. 1998;1998(80):43‑56.
van Winkelen C. Using developmental evaluation methods with communities of practice. Learn Organ. 11 avr 2016;23(2/3):141‑55.
Davoine E, Deitmer L. L’évaluation participative et responsabilisante : un instrument de structuration des projets de partenariat public-privé en recherche et développement. Rev Francaise Adm Publique. 2009;n° 130(2):275‑89.
Cousins JB. Utilization Effects of Participatory Evaluation. In: Kellaghan T, Stufflebeam DL, éditeurs. International Handbook of Educational Evaluation [Internet]. Dordrecht: Springer Netherlands; 2003 [cité 2 juill 2019]. p. 245‑65. (Kluwer International Handbooks of Education). Disponible sur: https://doi.org/10.1007/978-94-010-0309-4_16
Diez MA. The Evaluation of Regional Innovation and Cluster Policies: Towards a Participatory Approach. Eur Plan Stud. 1 oct 2001;9(7):907‑23.
Suarez-Herrera JC, Contandriopoulos A-P, Hartz ZM de A, Cupertino FPC de. Améliorer la performance des systèmes de santé: Concepts, méthodes, pratiques. Les Presses de l’Université de Montréal; 2017. 365 p.
Billett S. Workplace participatory practices: Conceptualising workplaces as learning environments. J Workplace Learn. 2004;16(6):312‑24.
Raţiu L, Chirică S, Rus CL. Participatory Evaluation: An Intended Catalyst to Learning within University. Procedia - Soc Behav Sci. 14 août 2014;142:140‑5.
Earl LM. Participatory Evaluation In Education: Studies Of Evaluation Use And Organizational Learning. Routledge; 2004. 212 p.
Preskill H. Evaluation’s Second Act: A Spotlight on Learning. Am J Eval. 1 juin 2008;29(2):127‑38.
Kalliola S, Nakari R, Pesonen I. Learning to Make Changes: Democratic Dialogue in Action. J Workplace Learn. 2006;18:464‑77.
Cooper S. Transformative evaluation: organizational learning through participative practice. Learn Organ. 8 avr 2014;21(2):146‑57.
O’Sullivan RG. Collaborative Evaluation within a framework of stakeholder-oriented evaluation approaches. Eval Program Plann. 1 nov 2012;35(4):518‑22.
Plottu B. Comment concilier débat public et décision rationnelle ? Vers une méthode d’évaluation démocratique. Rev DEconomie Reg Urbaine. 2005;juillet(3):355‑72.
Chavot P, Masseran A. Engagement et citoyenneté scientifique : quels enjeux avec quels dispositifs ? Quest Commun. 30 juin 2010;(17):81‑106.
Suarez-Herrera JC. L’intégration organisationnelle de la participation : des enjeux locaux pour une santé publique globale [Internet] [Thèse de doctorat]. [Montréal (Canada)]: Université de Montréal; 2010 [cité 21 juill 2017]. Disponible sur: https://papyrus.bib.umontreal.ca/xmlui/handle/1866/4543
Plottu B, Plottu É. Contraintes et vertus de l’évaluation participative. Rev Francaise Gest. 11 mai 2009;n° 192(2):31‑58.
Gregory A. Problematizing Participation: A Critical Review of Approaches to Participation in Evaluation Theory. Evaluation. 1 avr 2000;6(2):179‑99.
Mathison S. Rethinking the evaluator role: Partnerships between organizations and evaluators. Eval Program Plann. 1 juill 1994;17(3):299‑304.
Callon M. Sociologie de l’acteur réseau. In: Akrich M, Latour B, éditeurs. Sociologie de la traduction : Textes fondateurs [Internet]. Paris: Presses des Mines; 2013 [cité 14 oct 2017]. p. 267‑76. (Sciences sociales). Disponible sur: http://books.openedition.org/pressesmines/1201
Latour B. Reassembling the Social: An Introduction to Actor-Network-Theory. Oxford, New York: Oxford University Press; 2007. 320 p. (Clarendon Lectures in Management Studies).
Callon M, Ferrary M. Les réseaux sociaux à l’aune de la théorie de l’acteur-réseau. Sociol Prat. 2006;(13):37‑44.
Callon M. Éléments pour une sociologie de la traduction. La domestication des coquilles Saint-Jacques dans la Baie de Saint-Brieuc. Année Sociol. 1986;(36):169‑208.
Callon M, Lascoumes P, Barthe Y. Agir dans un monde incertain. Essai sur la démocratie technique. Paris: Le Seuil; 2001. 358 p. (La couleur des idées).
Callon M, Latour B, Akrich M. Sociologie de la traduction: Textes fondateurs. Presses des Mines via OpenEdition; 2013. 309 p.
Suarez-Herrera JC, Blain M-J. La recherche en santé mondiale : perspectives socio-anthropologiques. Montréal (Québec, Canada): Cahiers scientifiques de l’ACFAS; 2012. 276 p.
Andrews ML, Sánchez V, Carrillo C, Allen-Ananins B, Cruz YB. Using a participatory evaluation design to create an online data collection and monitoring system for New Mexico’s Community Health Councils. Eval Program Plann. 1 févr 2014;42:32‑42.
Poth C-A, Shulha L. Encouraging stakeholder engagement: A case study of evaluator behavior. Stud Educ Eval. 1 déc 2008;34(4):218‑23.
García M, Eizaguirre S, Pradel M. Social innovation and creativity in cities: A socially inclusive governance approach in two peripheral spaces of Barcelona. City Cult Soc. 1 déc 2015;6(4):93‑100.
Rühli E, Sachs S, Schmitt R, Schneider T. Innovation in Multistakeholder Settings: The Case of a Wicked Issue in Health Care. J Bus Ethics. 1 juin 2017;143(2):289‑305.
Svensson K, Szijarto B, Milley P, Cousins JB. Evaluating Social Innovations: Implications for Evaluation Design. Am J Eval. 1 déc 2018;39(4):459‑77.
Ziegler R. Social innovation as a collaborative concept. Innov Eur J Soc Sci Res. 2 oct 2017;30(4):388‑405.
Springett J. Appropriate approaches to the evaluation of health promotion. Crit Public Health. 1 juin 2001;11(2):139‑51.
Fetterman DM. Empowerment Evaluation. In: Wright JD, éditeur. International Encyclopedia of the Social & Behavioral Sciences (Second Edition) [Internet]. Oxford: Elsevier; 2015 [cité 1 juill 2019]. p. 577‑83. Disponible sur: http://www.sciencedirect.com/science/article/pii/B9780080970868105720
Chouinard JA. The Case for Participatory Evaluation in an Era of Accountability. Am J Eval. 1 juin 2013;34(2):237‑53.
Askew K, Beverly MG, Jay ML. Aligning collaborative and culturally responsive evaluation approaches. Eval Program Plann. 1 nov 2012;35(4):552‑7.
Chouinard JA, Cousins JB. A Review and Synthesis of Current Research on Cross-Cultural Evaluation. Am J Eval. 1 déc 2009;30(4):457‑94.
Laperrière H, Potvin L, Zúñiga R. A socio-political framework for evaluability assessment of participatory evaluations of partnerships: Making sense of the power differentials in programs that involve the state and civil society. Evaluation. 1 avr 2012;18(2):246‑59.
Rodríguez-Campos L. Advances in collaborative evaluation. Eval Program Plann. 1 nov 2012;35(4):523‑8.
Cousins JB. Collaborative Approaches to Evaluation: Principles in Use. SAGE Publications; 2019. 320 p.
Preskill H, Torres RT. The learning dimension of evaluation use. New Dir Eval. 2000;2000(88):25‑37.
Li SS, Fitzgerald L, Morys-Carter MM, Davie NL, Barker R. Knowledge translation in tri-sectoral collaborations: An exploration of perceptions of academia, industry and healthcare collaborations in innovation adoption. Health Policy. 1 févr 2018;122(2):175‑83.
Patton MQ. Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use. Guilford Press; 2010. 401 p.
Ce travail est disponible sous la licence Creative Commons Attribution 4.0 International .
