Novas práticas em avaliação participativa: lições de uma pesquisa avaliativa sobre os conselhos de saúde no Brasil e em Espanha
Resumo
A partir das anotações reflexivas de uma avaliação participativa realizada no Brasil e na Espanha sobre os conselhos de saúde, este artigo mostrará alguns fatores-chave que permitem o surgimento de práticas avaliativas inovadoras. Estas mudanças epistemológicas e organizacionais são manifestadas através de uma série de processos basados na coprodução dinâmica de conhecimento, na criação de espaços de aprendizagem coletiva e na articulação em rede de intervenções inovadoras. O avaliador torna-se aqui um tradutor de conhecimento, responsável em última instância da configuração de uma rede dinâmica entre as partes interessadas. A tradução neste caso, permite em primeiro lugar, alinhar diferentes lógicas de múltiplos atores e setores de intervenção e, por outro lado, favorece a criação de novas alianças e projetos inovadores. Nesse contexto, a inteligência coletiva, o “crowdsourcing” e a inovação aberta são eixos de pesquisa interessantes em relação às novas práticas avaliativas, especialmente no setor da saúde pública.
Downloads
Referências
Harris MJ. Evaluating Public and Community Health Programs. John Wiley & Sons; 2016. 408 p.
Nitsch M, Waldherr K, Denk E, Griebler U, Marent B, Forster R. Participation by different stakeholders in participatory evaluation of health promotion: A literature review. Eval Program Plann. 1 oct 2013;40:42‑54.
Rohde J, Cousens S, Chopra M, Tangcharoensathien V, Black R, Bhutta ZA, et al. 30 years after Alma-Ata: has primary health care worked in countries? The Lancet. 13 sept 2008;372(9642):950‑61.
Da Silva RB, Contandriopoulos A-P, Pineault R, Tousignant P. A Global Approach to Evaluation of Health Services Utilization: Concepts and Measures. Healthc Policy. mai 2011;6(4):e106‑17.
Kothari A, McPherson C, Gore D, Cohen B, MacDonald M, Sibbald SL. A multiple case study of intersectoral public health networks: experiences and benefits of using research. Health Res Policy Syst. 11 févr 2016;14:11.
Leeuw E de. Engagement of Sectors Other than Health in Integrated Health Governance, Policy, and Action. Annu Rev Public Health. 2017;38(1):329‑49.
Ovseiko PV, O’Sullivan C, Powell SC, Davies SM, Buchan AM. Implementation of collaborative governance in cross-sector innovation and education networks: evidence from the National Health Service in England. BMC Health Serv Res. 8 nov 2014;14:552.
Enam A, Torres-Bonilla J, Eriksson H. Evidence-Based Evaluation of eHealth Interventions: Systematic Literature Review. J Med Internet Res. 23 2018;20(11):e10971.
Figueiredo MB, Morley C. Une lecture structurationniste des pratiques de management de projet SI. Systèmes Inf Manag. 1 avr 2016;me 20(2):37‑87.
Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review. A new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. juill 2005;10 Suppl 1:21‑34.
Chapman LS. Meta-evaluation of worksite health promotion economic return studies. Am J Health Promot. 2003;17(3):1‑10.
Figueiró AC, Hartz ZM de A, Thuler LCS, Dias ALF. Meta-evaluation of baseline studies of the Brazilian Family Health Strategy Expansion Project: a participatory and formative approach. Cad Saúde Pública. déc 2010;26(12):2270‑8.
Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the Economic Evaluation of Health Care Programmes. Oxford University Press; 2015. 461 p.
Moore G, Audrey S, Barker M, Bond L, Bonell C, Cooper C, et al. Process evaluation in complex public health intervention studies: the need for guidance. J Epidemiol Community Health. 1 févr 2014;68(2):101‑2.
Oakley A, Strange V, Bonell C, Allen E, Stephenson J. Process evaluation in randomised controlled trials of complex interventions. BMJ. 16 févr 2006;332(7538):413‑6.
Saksvik PØ, Nytrø K, Dahl-Jørgensen C, Mikkelsen A. A process evaluation of individual and organizational occupational stress and health interventions. Work Stress. 1 mars 2002;16(1):37‑57.
Baranowski T, Cerin E, Baranowski J. Steps in the design, development and formative evaluation of obesity prevention-related behavior change trials. Int J Behav Nutr Phys Act. 21 janv 2009;6(1):6.
Cho H, Witte K. Managing Fear in Public Health Campaigns: A Theory-Based Formative Evaluation Process. Health Promot Pract. 1 oct 2005;6(4):482‑90.
Murray E, May C, Mair F. Development and formative evaluation of the e-Health Implementation Toolkit (e-HIT). BMC Med Inform Decis Mak. 18 oct 2010;10(1):61.
Weist M, Lever N, Stephan S, Youngstrom E, Moore E, Harrison B, et al. Formative Evaluation of a Framework for High Quality, Evidence-Based Services in School Mental Health. School Ment Health. 1 déc 2009;1(4):196‑211.
Donaldson SI. Empowerment evaluation: An approach that has literally altered the landscape of evaluation. Eval Program Plann. 1 août 2017;63:136‑7.
Fetterman DM, Wandersman A. Empowerment Evaluation Principles in Practice. Guilford Press; 2005. 244 p.
Patton MQ. Empowerment evaluation: Exemplary is its openness to dialogue, reflective practice, and process use. Eval Program Plann. 1 août 2017;63:139‑40.
Brisolara S. The history of participatory evaluation and current debates in the field. New Dir Eval. 1998;1998(80):25‑41.
Cousins JB. Consequences of Researcher Involvement in Participatory Evaluation. Stud Educ Eval. 1996;22(1):3‑27.
Garaway GB. Participatory evaluation. Stud Educ Eval. 1 janv 1995;21(1):85‑102.
Rebien CC. Participatory Evaluation of Development Assistance: Dealing with Power and Facilitative Learning. Evaluation. 1 avr 1996;2(2):151‑71.
Suarez-Herrera JC, Springett J, Kagan C. Critical Connections between Participatory Evaluation, Organizational Learning and Intentional Change in Pluralistic Organizations. Evaluation. 1 juill 2009;15(3):321‑42.
Rossi PH, Lipsey MW, Henry GT. Evaluation: A Systematic Approach. SAGE Publications; 2018. 361 p.
Verbrugge LNH, Ganzevoort W, Fliervoet JM, Panten K, van den Born RJG. Implementing participatory monitoring in river management: The role of stakeholders’ perspectives and incentives. J Environ Manage. 15 juin 2017;195:62‑9.
Yin RK. Case Study Research: Design and Methods. SAGE; 2009. 241 p.
Contandriopoulos A-P, Champagne F, Potvin L, Denis J-L, Boyle P. Savoir préparer une recherche: la définir, la structurer, la financer. Presses de l’Université de Montréal; 1990. 206 p.
Poupart J, al. La recherche qualitative: enjeux épistémologiques et méthodologiques. Montréal (Québec, Canada): Centre international de criminologie comparée, Université de Montréal; 1997. 405 p.
Fortis MF de A. Rumo à pós-modernidade em políticas públicas: a epistemologia situacional de Carlos Matus. RAE Eletrônica. déc 2010;9(2):0‑0.
Matus C. Los tres cinturones del gobierno. Caracas: Fondo Editorial Altadir; 1997.
Patton MQ. Discovering process use. Evaluation. 1998;4(2):225–233.
Patton MQ. Utilization-Focused Evaluation. 4th Revised edition. Thousand Oaks: SAGE Publications Inc; 2008. 688 p.
Cousins JB, Chouinard JA. Participatory Evaluation Up Close: An Integration of Research Based Knowledge. IAP; 2012. 308 p.
Jackson ET, Kassam Y. Knowledge Shared: Participatory Evaluation in Development Cooperation. IDRC; 1998. 265 p.
Burke B. Evaluating for a change: Reflections on participatory methodology. New Dir Eval. 1998;1998(80):43‑56.
van Winkelen C. Using developmental evaluation methods with communities of practice. Learn Organ. 11 avr 2016;23(2/3):141‑55.
Davoine E, Deitmer L. L’évaluation participative et responsabilisante : un instrument de structuration des projets de partenariat public-privé en recherche et développement. Rev Francaise Adm Publique. 2009;n° 130(2):275‑89.
Cousins JB. Utilization Effects of Participatory Evaluation. In: Kellaghan T, Stufflebeam DL, éditeurs. International Handbook of Educational Evaluation [Internet]. Dordrecht: Springer Netherlands; 2003 [cité 2 juill 2019]. p. 245‑65. (Kluwer International Handbooks of Education). Disponible sur: https://doi.org/10.1007/978-94-010-0309-4_16
Diez MA. The Evaluation of Regional Innovation and Cluster Policies: Towards a Participatory Approach. Eur Plan Stud. 1 oct 2001;9(7):907‑23.
Suarez-Herrera JC, Contandriopoulos A-P, Hartz ZM de A, Cupertino FPC de. Améliorer la performance des systèmes de santé: Concepts, méthodes, pratiques. Les Presses de l’Université de Montréal; 2017. 365 p.
Billett S. Workplace participatory practices: Conceptualising workplaces as learning environments. J Workplace Learn. 2004;16(6):312‑24.
Raţiu L, Chirică S, Rus CL. Participatory Evaluation: An Intended Catalyst to Learning within University. Procedia - Soc Behav Sci. 14 août 2014;142:140‑5.
Earl LM. Participatory Evaluation In Education: Studies Of Evaluation Use And Organizational Learning. Routledge; 2004. 212 p.
Preskill H. Evaluation’s Second Act: A Spotlight on Learning. Am J Eval. 1 juin 2008;29(2):127‑38.
Kalliola S, Nakari R, Pesonen I. Learning to Make Changes: Democratic Dialogue in Action. J Workplace Learn. 2006;18:464‑77.
Cooper S. Transformative evaluation: organizational learning through participative practice. Learn Organ. 8 avr 2014;21(2):146‑57.
O’Sullivan RG. Collaborative Evaluation within a framework of stakeholder-oriented evaluation approaches. Eval Program Plann. 1 nov 2012;35(4):518‑22.
Plottu B. Comment concilier débat public et décision rationnelle ? Vers une méthode d’évaluation démocratique. Rev DEconomie Reg Urbaine. 2005;juillet(3):355‑72.
Chavot P, Masseran A. Engagement et citoyenneté scientifique : quels enjeux avec quels dispositifs ? Quest Commun. 30 juin 2010;(17):81‑106.
Suarez-Herrera JC. L’intégration organisationnelle de la participation : des enjeux locaux pour une santé publique globale [Internet] [Thèse de doctorat]. [Montréal (Canada)]: Université de Montréal; 2010 [cité 21 juill 2017]. Disponible sur: https://papyrus.bib.umontreal.ca/xmlui/handle/1866/4543
Plottu B, Plottu É. Contraintes et vertus de l’évaluation participative. Rev Francaise Gest. 11 mai 2009;n° 192(2):31‑58.
Gregory A. Problematizing Participation: A Critical Review of Approaches to Participation in Evaluation Theory. Evaluation. 1 avr 2000;6(2):179‑99.
Mathison S. Rethinking the evaluator role: Partnerships between organizations and evaluators. Eval Program Plann. 1 juill 1994;17(3):299‑304.
Callon M. Sociologie de l’acteur réseau. In: Akrich M, Latour B, éditeurs. Sociologie de la traduction : Textes fondateurs [Internet]. Paris: Presses des Mines; 2013 [cité 14 oct 2017]. p. 267‑76. (Sciences sociales). Disponible sur: http://books.openedition.org/pressesmines/1201
Latour B. Reassembling the Social: An Introduction to Actor-Network-Theory. Oxford, New York: Oxford University Press; 2007. 320 p. (Clarendon Lectures in Management Studies).
Callon M, Ferrary M. Les réseaux sociaux à l’aune de la théorie de l’acteur-réseau. Sociol Prat. 2006;(13):37‑44.
Callon M. Éléments pour une sociologie de la traduction. La domestication des coquilles Saint-Jacques dans la Baie de Saint-Brieuc. Année Sociol. 1986;(36):169‑208.
Callon M, Lascoumes P, Barthe Y. Agir dans un monde incertain. Essai sur la démocratie technique. Paris: Le Seuil; 2001. 358 p. (La couleur des idées).
Callon M, Latour B, Akrich M. Sociologie de la traduction: Textes fondateurs. Presses des Mines via OpenEdition; 2013. 309 p.
Suarez-Herrera JC, Blain M-J. La recherche en santé mondiale : perspectives socio-anthropologiques. Montréal (Québec, Canada): Cahiers scientifiques de l’ACFAS; 2012. 276 p.
Andrews ML, Sánchez V, Carrillo C, Allen-Ananins B, Cruz YB. Using a participatory evaluation design to create an online data collection and monitoring system for New Mexico’s Community Health Councils. Eval Program Plann. 1 févr 2014;42:32‑42.
Poth C-A, Shulha L. Encouraging stakeholder engagement: A case study of evaluator behavior. Stud Educ Eval. 1 déc 2008;34(4):218‑23.
García M, Eizaguirre S, Pradel M. Social innovation and creativity in cities: A socially inclusive governance approach in two peripheral spaces of Barcelona. City Cult Soc. 1 déc 2015;6(4):93‑100.
Rühli E, Sachs S, Schmitt R, Schneider T. Innovation in Multistakeholder Settings: The Case of a Wicked Issue in Health Care. J Bus Ethics. 1 juin 2017;143(2):289‑305.
Svensson K, Szijarto B, Milley P, Cousins JB. Evaluating Social Innovations: Implications for Evaluation Design. Am J Eval. 1 déc 2018;39(4):459‑77.
Ziegler R. Social innovation as a collaborative concept. Innov Eur J Soc Sci Res. 2 oct 2017;30(4):388‑405.
Springett J. Appropriate approaches to the evaluation of health promotion. Crit Public Health. 1 juin 2001;11(2):139‑51.
Fetterman DM. Empowerment Evaluation. In: Wright JD, éditeur. International Encyclopedia of the Social & Behavioral Sciences (Second Edition) [Internet]. Oxford: Elsevier; 2015 [cité 1 juill 2019]. p. 577‑83. Disponible sur: http://www.sciencedirect.com/science/article/pii/B9780080970868105720
Chouinard JA. The Case for Participatory Evaluation in an Era of Accountability. Am J Eval. 1 juin 2013;34(2):237‑53.
Askew K, Beverly MG, Jay ML. Aligning collaborative and culturally responsive evaluation approaches. Eval Program Plann. 1 nov 2012;35(4):552‑7.
Chouinard JA, Cousins JB. A Review and Synthesis of Current Research on Cross-Cultural Evaluation. Am J Eval. 1 déc 2009;30(4):457‑94.
Laperrière H, Potvin L, Zúñiga R. A socio-political framework for evaluability assessment of participatory evaluations of partnerships: Making sense of the power differentials in programs that involve the state and civil society. Evaluation. 1 avr 2012;18(2):246‑59.
Rodríguez-Campos L. Advances in collaborative evaluation. Eval Program Plann. 1 nov 2012;35(4):523‑8.
Cousins JB. Collaborative Approaches to Evaluation: Principles in Use. SAGE Publications; 2019. 320 p.
Preskill H, Torres RT. The learning dimension of evaluation use. New Dir Eval. 2000;2000(88):25‑37.
Li SS, Fitzgerald L, Morys-Carter MM, Davie NL, Barker R. Knowledge translation in tri-sectoral collaborations: An exploration of perceptions of academia, industry and healthcare collaborations in innovation adoption. Health Policy. 1 févr 2018;122(2):175‑83.
Patton MQ. Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use. Guilford Press; 2010. 401 p.
This work is licensed under a Creative Commons Attribution 4.0 International License.
