How do organisations implement research impact assessment (RIA) principles and good practice? A narrative review and exploratory study of four international research funding and administrative organisations.

Item request has been placed! ×
Item request cannot be made. ×
loading   Processing Request
  • Additional Information
    • Author-Supplied Keywords:
      Impact
      research assessment
      research evaluation
      research funders
      research funding organisations
      research impact assessment
      RIA
      science of science
    • Abstract:
      Background: Public research funding agencies and research organisations are increasingly accountable for the wider impacts of the research they support. While research impact assessment (RIA) frameworks and tools exist, little is known and shared of how these organisations implement RIA activities in practice.Methods: We conducted a review of academic literature to search for research organisations' published experiences of RIAs. We followed this with semi-structured interviews from a convenience sample (n = 7) of representatives of four research organisations deploying strategies to support and assess research impact.Results: We found only five studies reporting empirical evidence on how research organisations put RIA principles into practice. From our interviews, we observed a disconnect between published RIA frameworks and tools, and the realities of organisational practices, which tended not to be reported. We observed varying maturity and readiness with respect to organisations' structural set ups for conducting RIAs, particularly relating to leadership, skills for evaluation and automating RIA data collection. Key processes for RIA included efforts to engage researcher communities to articulate and plan for impact, using a diversity of methods, frameworks and indicators, and supporting a learning approach. We observed outcomes of RIAs as having supported a dialogue to orient research to impact, underpinned shared learning from analyses of research, and provided evidence of the value of research in different domains and to different audiences.Conclusions: Putting RIA principles and frameworks into practice is still in early stages for research organisations. We recommend that organisations (1) get set up by considering upfront the resources, time and leadership required to embed impact strategies throughout the organisation and wider research 'ecosystem', and develop methodical approaches to assessing impact; (2) work together by engaging researcher communities and wider stakeholders as a core part of impact pathway planning and subsequent assessment; and (3) recognise the benefits that RIA can bring about as a means to improve mutual understanding of the research process between different actors with an interest in research. [ABSTRACT FROM AUTHOR]
    • :
      Copyright of Health Research Policy & Systems is the property of BioMed Central and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
    • Author Affiliations:
      1National Institute for Health Research Central Commissioning Facility, TW1 3NL, Twickenham, United Kingdom
      2Policy Institute at King's College London, Strand Campus, WC2B 6LE, London, United Kingdom
      3King's Global Health Institute, King's College London, Denmark Hill, SE5 9RJ, London, United Kingdom
    • Full Text Word Count:
      13527
    • ISSN:
      1478-4505
    • Accession Number:
      10.1186/s12961-019-0515-1
    • Accession Number:
      141291638
  • Citations
    • ABNT:
      KAMENETZKY, A.; HINRICHS-KRAPELS, S. How do organisations implement research impact assessment (RIA) principles and good practice? A narrative review and exploratory study of four international research funding and administrative organisations. Health Research Policy & Systems, [s. l.], v. 18, n. 1, p. 1–19, 2020. DOI 10.1186/s12961-019-0515-1. Disponível em: http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=asr&AN=141291638. Acesso em: 3 jul. 2020.
    • AMA:
      Kamenetzky A, Hinrichs-Krapels S. How do organisations implement research impact assessment (RIA) principles and good practice? A narrative review and exploratory study of four international research funding and administrative organisations. Health Research Policy & Systems. 2020;18(1):1-19. doi:10.1186/s12961-019-0515-1.
    • AMA11:
      Kamenetzky A, Hinrichs-Krapels S. How do organisations implement research impact assessment (RIA) principles and good practice? A narrative review and exploratory study of four international research funding and administrative organisations. Health Research Policy & Systems. 2020;18(1):1-19. doi:10.1186/s12961-019-0515-1
    • APA:
      Kamenetzky, A., & Hinrichs-Krapels, S. (2020). How do organisations implement research impact assessment (RIA) principles and good practice? A narrative review and exploratory study of four international research funding and administrative organisations. Health Research Policy & Systems, 18(1), 1–19. https://doi.org/10.1186/s12961-019-0515-1
    • Chicago/Turabian: Author-Date:
      Kamenetzky, Adam, and Saba Hinrichs-Krapels. 2020. “How Do Organisations Implement Research Impact Assessment (RIA) Principles and Good Practice? A Narrative Review and Exploratory Study of Four International Research Funding and Administrative Organisations.” Health Research Policy & Systems 18 (1): 1–19. doi:10.1186/s12961-019-0515-1.
    • Harvard:
      Kamenetzky, A. and Hinrichs-Krapels, S. (2020) ‘How do organisations implement research impact assessment (RIA) principles and good practice? A narrative review and exploratory study of four international research funding and administrative organisations’, Health Research Policy & Systems, 18(1), pp. 1–19. doi: 10.1186/s12961-019-0515-1.
    • Harvard: Australian:
      Kamenetzky, A & Hinrichs-Krapels, S 2020, ‘How do organisations implement research impact assessment (RIA) principles and good practice? A narrative review and exploratory study of four international research funding and administrative organisations’, Health Research Policy & Systems, vol. 18, no. 1, pp. 1–19, viewed 3 July 2020, .
    • MLA:
      Kamenetzky, Adam, and Saba Hinrichs-Krapels. “How Do Organisations Implement Research Impact Assessment (RIA) Principles and Good Practice? A Narrative Review and Exploratory Study of Four International Research Funding and Administrative Organisations.” Health Research Policy & Systems, vol. 18, no. 1, Jan. 2020, pp. 1–19. EBSCOhost, doi:10.1186/s12961-019-0515-1.
    • Chicago/Turabian: Humanities:
      Kamenetzky, Adam, and Saba Hinrichs-Krapels. “How Do Organisations Implement Research Impact Assessment (RIA) Principles and Good Practice? A Narrative Review and Exploratory Study of Four International Research Funding and Administrative Organisations.” Health Research Policy & Systems 18, no. 1 (January 20, 2020): 1–19. doi:10.1186/s12961-019-0515-1.
    • Vancouver/ICMJE:
      Kamenetzky A, Hinrichs-Krapels S. How do organisations implement research impact assessment (RIA) principles and good practice? A narrative review and exploratory study of four international research funding and administrative organisations. Health Research Policy & Systems [Internet]. 2020 Jan 20 [cited 2020 Jul 3];18(1):1–19. Available from: http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=asr&AN=141291638