Design and implementation of an online Delphi study to develop indicators for evidenceinformed policy making

Authors

  • Valentina Tudisca IRPPS
  • Adriana Valente

DOI:

https://doi.org/10.14600/irpps_wps.88.2016

Keywords:

evidence‐informed policy making, Delphi, indicators

Abstract

This report describes a Delphi study conducted within the European FP7 project REsearch into POlicy to enhance Physical Activity (REPOPA), whose main objective is fostering evidence-informed policy making in the field of health and physical activity. The Delphi study was designed and implemented for improving and integrating a draft list of indicators for evidence-informed policy making developed by REPOPA researchers to assess the use of evidence in policy processes, organized in thematic sets. The Delphi study involved 76 policy makers and researchers from six European countries – Italy, Romania, Denmark, Finland, United Kingdom and The Netherlands – and was conducted in two rounds consisting of online questionnaires. Preliminary results about the effect of the Delphi on the original indicators are reported.

References

Amara, N. (2004). New Evidence on Instrumental, Conceptual, and Symbolic Utilization of University Research in Government Agencies. Science Communication, 26(1), 75–106. http://doi.org/10.1177/1075547004267491

Belkhodja, O., Amara, N., Landry, R., & Ouimet, M. (2007). The Extent and Organizational Determinants of Research Utilization in Canadian Health Services Organizations. Science Communication, 28(3), 377–417. http://doi.org/10.1177/1075547006298486

Bertram M., Loncarevic N., Castellani T., Valente A., Gulis G. and Aro AR, How could we Start to Develop Indicators for Evidence-informed Policy Making in Public Health and Health Promotion?, HEALTH SYSTEMS AND POLICY RESEARCH, 2015 vol.2, N.1:16

Borrás, S. (2011). Policy learning and organizational capacities in innovation policies. Science and Public Policy, 38(9), 725–734.

Castellani, T., & Valente, A. (2012). Democrazia e partecipazione: la metodologia Delphi. IRPPS Working Papers, 46.

Castellani T., Valente A., Cori L., Bianchi F., Detecting the use of evidence in a meta-policy, Evidence & Policy 2016, doi:10.1332/174426415X14430152798949.

Cunningham, D. H., & Wyckoff, J. (2013). Policy Makers and Researchers Schooling Each Other: Lessons in Educational Policy from New York. Education, 8(3), 275–286.

De Goede, J., van Bon-Martens, M. J., Putters, K., & van Oers, H. A. (2012). Looking for interaction: quantitative measurement of research utilization by Dutch local health officials. Health Res Policy Syst, 10(9). Recuperato da http://www.biomedcentral.com/content/pdf/1478-4505-10-9.pdf.

Boulkedid, R., Abdoul, H., Loustau, M., Sibony, O., & Alberti, C. (2011). Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review. PLoS ONE, 6(6), e20476. http://doi.org/10.1371/journal.pone.0020476

Government of Canada, C. I. of H. R. (s.d.). More About Knowledge Translation at CIHR - CIHR. Recuperato 16 aprile 2014, from http://www.cihr-irsc.gc.ca/e/39033.html#Knowledge-Action

Graham, I. D., Logan, J., Harrison, M. B., Straus, S. E., Tetroe, J., Caswell, W., & Robinson, N. (2006). Lost in knowledge translation: time for a map? Journal of continuing education in the health professions, 26(1), 13–24.

Gupta, U. G., & Clarke, R. E. (1996). Theory and applications of the Delphi technique: A bibliography (1975–1994). Technological Forecasting and Social Change, 53(2), 185 – 211. http://doi.org/http://dx.doi.org/10.1016/S0040-1625(96)00094-7

Hung, H.-L., Altschuld, J. W., & Lee, Y.-F. (2008). Methodological and conceptual issues confronting a cross-country Delphi study of educational program evaluation. Evaluation and Program Planning, 31(2), 191–198.

Huzair, F., Borda-Rodriguez, A., Upton, M., & Mugwagwa, J. T. (2013). An interdisciplinary and development lens on knowledge translation. Science and Public Policy, 40(1), 43–50. http://doi.org/10.1093/scipol/scs119

Knott, J., & Wildavsky, A. (1980). If dissemination is the solution, what is the problem? Science Communication, 1(4), 537–578.

Kothari, A., Rudman, D., Dobbins, M., Rouse, M., Sibbald, S., & Edwards, N. (2012). The use of tacit and explicit knowledge in public health: A qualitative study. Implementation Science, 7, 20.

Landry, R., Lamari, M., & Amara, N. (2003). The extent and determinants of the utilization of university research in government agencies. Public Administration Review, 63(2), 192–205.

Lavis, J. N., Ross, S. E., Hurley, J. E., Hohenadel, J. M., Stoddart, G. L., Woodward, C. A., & Abelson, J. (2002). Examining the role of health services research in public policymaking. The Milbank Quarterly, 80(1), 125–154.

Lundvall, B.-Ä., & Johnson, B. (1994). The learning economy. Journal of industry studies, 1(2), 23–42.

Masser, I., & Foley, P. (1987). Delphi revisited: expert opinion in urban analysis. Urban Studies, 24(3), 217–225.

Nonaka, I. (1991). The knowledge-creating company. Harvard business review, 69(6), 96–104.

Nutley, S. M., Walter, I., & Davies, H. T. (2007). Using evidence: How research can inform public services. The Policy Press.

Pelz, D. C. (1978). Some expanded perspectives on use of social science in public policy. Major social issues: A multidisciplinary view, 346–57.

Polanyi, M. (1967). The tacit dimension London. Routledge and Kegan Paul.

Pülzl, H., & Rametsteiner, E. (2009). Indicator development as ‘boundary spanning’between scientists and policy-makers. Science and Public Policy, 36(10), 743–752.

Rowe, G., Wright, G., & Bolger, F. (1991). Delphi: a reevaluation of research and theory. Technological Forecasting and Social Change, 39(3), 235–251.

Schlierf, K., & Meyer, M. (2013). Situating knowledge intermediation: Insights from science shops and knowledge brokers. Science and Public Policy, 40(4), 430–441. http://doi.org/10.1093/scipol/sct034

Straus SE, Holroyd-Leduc J. Knowledge-to-action cycle. Evid Based Med. 2008;13(4):98-100.

Syed, A. M., Hjarnø, L., Krumkamp, R., Reintjes, R., & Aro, A. R. (2010). Developing policy options for SARS and SARS-like diseases–a Delphi study. Global public health, 5(6), 663–675.

Valente, A., Castellani, T., Larsen, M., Aro, A. (2015). Models and visions of science-policy interction: Remarks from a Delphi Study in Italy, Science and Public Policy, 42 (2): 228-241.

Valente, A., & Castellani, T. (2015). Metodologie qualitative: tra ricerca sociale, organizzazione delle conoscenze e partecipazione. In Cori L., Ballarini A., Linzalone N., Natali M., Bianchi F. (a cura di) La VIS in Italia - valutazione e partecipazione nelle decisioni su ambiente e salute, Arpa Emilia-Romagna, 2015. ISBN: 978-88-87854-39-8

Valente, A., & Luzi, D. (2000). Different contexts in electronic communication: Some remarks on the communicability of scientific knowledge. Journal of documentation, 56(3), 299–311.

Wehrens, R., Bekker, M., & Bal, R. (2011). Coordination of research, policy and practice: a case study of collaboration in the field of public health. Science and Public Policy, 38(10), 755–766.

Weiss, C. H. (1979). The many meanings of research utilization. Public administration review, 39, 426–431.

Downloads

Published

2016-07-29

How to Cite

Tudisca, V., & Valente, A. (2016). Design and implementation of an online Delphi study to develop indicators for evidenceinformed policy making. IRPPS Working Papers, 1–27. https://doi.org/10.14600/irpps_wps.88.2016

Issue

IRPPS WPs pubblicati nel 2016

Section

Working Papers

License

This licence lets others distribute, remix and build upon a work, even commercially, as long as they credit the original creator/s (and any other nominated parties). This is the most accommodating of the licences in terms of what others can do with the work.