References

Alder, Robert, John Ewing and Peter Taylor. (2008) Citation Statistics. Joint Committee on Quantitative Assessment of Research. http://www.mathunion.org/fileadmin/IMU/Report/CitationStatistics.pdf.

Australian Research Council. (2008) Consultation paper: Excellence in research for Australia (ERA) initiative. http://www.arc.gov.au/pdf/ERA_ConsultationPaper.pdf.

Bernstein, Alan, et al. (2006) A framework to measure the impact of investments in health research. OECD Blue Sky II Forum, September 25, 2006. http://www.oecd.org/dataoecd/10/42/37450246.pdf.

Bornmann L., Daniel, H-D. (2005)Does the h-index for ranking of scientists really work? Scientometrics 65: 391-392.

Bornmann, Lutz and Hans-Dieter Daniel (2009) The state of h index research: Is the h index the ideal way to measure research performance? EMBO Reports 10(1):2-6. http://www.nature.com/embor/journal/v10/n1/full/embor2008233.html.

Bornmann, Lutz, Rüdiger Mutz, and Hans-Dieter Daniel. (2008) Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine. Journal of the American Society for Information Science and Technology 59(5):830-837.

Bozeman B., and D. Sarewitz. (2005) Public values and public failure in US science policy. Science and Public Policy, 32(2), 119-136. http://www.cspo.org/ourlibrary/PublicValuesandFailure.htm.

Brutscher, Philipp-Bastian, Steven Wooding, and Jonathan Grant. (2008) Health Research Evaluation Frameworks: An International Comparison. RAND Europe Technical Report. http://www.rand.org/pubs/technical_reports/2008/RAND_TR629.pdf.

Buxton, M., and S. Hanney. (1996) How can payback from health services research be assessed? Journal of Health Services Research Policy 1(1):35-43.

Buxton, M., and S. Hanney. (1998) Evaluating the NHS research and development programme: Will the programme give value for money? Journal of the Royal Society of Medicine 91(Suppl 35):2-6.

Buxton, M., S. Hanney, and T. Jones. (2004) Estimating the economic value to societies of the impact of health research: a critical review. Bulletin of the World Health Organization Oct; 82(10):733-9.

Canadian Health Services Research Foundation. (2008) Measuring the impact of research: what do we know? (Part I). Insight and Action, Issue 46, October 2008. http://www.chsrf.ca/other_documents/insight_action/html/documents/InsightandAction_46_e.pdf.

Canadian Institutes of Health Research. (2005) Developing a CIHR Framework to measure the impact of health research. Synthesis report of meetings, February 23, 24, and May 18, 2005: A framework for measuring the impact of health research. http://www.cihr-irsc.gc.ca/e/documents/meeting_synthesis_e.pdf.

Carpenter D., et al. (2005) Dissemination Planning Tool. From: Development of a planning tool to guide dissemination of research results. Advances in patient safety: From research to implementation. “Programs, tools and practices.” (AHRQ Publication No. 05-0021-4). http://www.ahrq.gov/qual/advances/planningtool.htm.

Center for Interdisciplinary Research on AIDS: Community Research Core. (2005) Strategies for disseminating research findings. http://cira.med.yale.edu/research/dissem_strategies.doc.

Center for Outcomes and Effectiveness Research (COER). (1999) “The outcome of outcomes research at AHCPR: Final report.” (AHCPR Publication No. 99-R044). http://www.ahrq.gov/clinic/out2res/.

Contopoulos-Ioannidis, Despinda, et al. (2008) Life cycle of translational research for medical interventions. Science Magazine 312(5894):1298-1299. http://www.sciencemag.org/cgi/content/summary/321/5894/1298.

Council for Medical Sciences Amsterdam. (2002) The societal impact of applied health research: Towards a quality assessment system. http://www.knaw.nl/publicaties/pdf/20021098.pdf.

Cutler, D.M. and M. McClellan. (2001) Is technological change in medicine worth it? Health Affairs 20(5): 11. http://content.healthaffairs.org/cgi/content/full/20/5/11.

Duryea, M., Mark Hochman, and Andrew Parfitt. (2007) Measuring the impact of research. Research Global, February 2007. http://www.atn.edu.au/docs/Research%20Global%20-%20Measuring%20the%20impact%20of%20research.pdf.

Druss, B.G., and S.C. Marcus. (2005) Tracking publication outcomes of National Institutes of Health grants. The American Journal of Medicine 118(6): 658-663. doi:10.1016/j.amjmed.2005.02.015.

Garfinkel, M.S., Sarewitz, D. and Porter, A.L. (2006) A Societal outcomes map for health research and policy. American Journal of Public Health, 96(3), 441-446. http://www.cspo.org/ourlibrary/documents/AJPH%20final.pdf.

Grant, J., et al. (2000) Evaluating payback on biomedical research from papers cited in clinical guidelines: Applied bibliometric study. British Medical Journal 320(7242):1107-1111.

Hanney, S., et al. (2007) An assessment of the impact of the NHS Health Technology Assessment Programme. Health Technology Assessment Dec;11(53):iii-iv, ix-xi,1-180.

Hanney, S. et al. (2004) Proposed methods for reviewing the outcomes of research: The impact of funding by the UK’s Arthritis Research Campaign. Health Research Policy and Systems 2(4). http://www.health-policy-systems.com/content/2/1/4.

Hanney S., B. Soper, and M. Buxton (2003) Evaluation of the NHS R&D implementation methods programme. HERG Research Report No 29.

Hanney S., et al. (2003) From bench to bedside: Tracing the payback forwards from basic or early clinical research – A preliminary exercise and proposals for a future study. HERG Research Report No 31.

Hanney, S., et al. (2003) The utilisation of health research in policy-making: concepts, examples and methods of assessment. Health Research Policy and Systems 1:2. http://www.health-policy-systems.com/content/1/1/2.

Haynes, Brian and Andrew Haines. (1998) Getting research findings into practice: Barriers and bridges to evidence based clinical practice. British Medical Journal 317(7153):273. http://www.bmj.com/cgi/content/full/317/7153/273.

Institute of Health Economics. (2008) Effective dissemination of findings from research. IRE Report. http://www.ihe.ca/documents/Dissemination_0.pdf.

Joly, et al. (2007) Linking Accreditation and Public Health Outcomes: A Logic Model Approach. Journal of Public Health Management and Practice 13(4): 349-356.

Kalucy, L., McIntyre, E., and Jackson-Bowers, E. (2007) Primary health care research impact project: Final report stage 1. Primary Health Care Research and Information Service, Flinders University, Adelaide. www.phcris.org.au/phplib/filedownload.php?file=/elib/lib/downloaded_files/publications/pdfs/phcris_pub_3338.pdf.

Kuruvilla, Shyama, et al. (2006) Describing the impact of health research: A research impact framework. BMC Health Services Research 6:134. http://www.biomedcentral.com/1472-6963/6/134.

Kuruvilla, Shyama, Nicholas Mays, and Gill Walt. (2007) Describing the impact of health services and policy research. Journal of Health Services Research and Policy 12(Suppl 1):S1:23-31. http://jhsrp.rsmjournals.com/cgi/reprint/12/suppl_2/23.

Kwan, Patrick, et al. (2007) A systematic evaluation of payback of publicly funded health and health services research in Hong Kong. BMC Health Services Research 7:121. http://www.biomedcentral.com/1472-6963/7/121.

Lake, Timothy, et al. (2008) Strategies for translating health services research to policy and practice: Selected case studies of investigator-initiated research funded by AHRQ. http://www.mathematica-mpr.com/publications/pdfs/health/AHRQ_casestudies.pdf

Lavis, John, et al. (2003) Measuring the impact of health research. Journal of Health Services Research and Policy 8(3):165-170. http://jhsrp.rsmjournals.com/cgi/reprint/8/3/165.

Lewison, G. and R. Sullivan. (2008)The impact of cancer research: how publications influence UK cancer clinical guidelines. British Journal of Cancer 98:1944-1950.

Lundberg, Jonas. (2006) Bibliometrics as a research assessment tool: impact beyond the impact factor. [thesis] http://diss.kib.ki.se/2006/91-7140-965-3/thesis.pdf.

Manning, Frederick J, Michael McGeary, and Ronald Estabrook, Eds. (2004) NIH extramural center programs: Criteria for initiation and evaluation. Washington, DC.: National Academies Press, 2004. http://www.nap.edu/openbook.php?isbn=0309091527.

McMenamin, Sara B., Helen Halpin, and Theodore Ganiats. (2006) Assessing the Public Health Impact of State Health Benefit Mandates. Health Services Research 41:3, Part II. http://www.chbrp.org/documents/ph_impact_hsr062006.pdf.

Merkx, Femke, et al. (2007) Evaluation of research in context: A quick scan of an emerging field. Rathenau Institute, Department of Science System Assessment. www.rathenauinstituut.com/downloadfile.asp?ID=1217.

Murphy, Kevin M. and Robert H. Topel, ed. (2003) Measuring gains from medical research: An economic approach. Chicago: University of Chicago Press, 2003.

National Cancer Institute. (2006) NCI Conference on the Science of Team Science: Assessing the Value of Transdisciplinary Research. [Videocast and papers presented at the Assessing the Value of Transdisciplinary Research conference, Bethesda, MD, October 30-31, 2006]. http://cancercontrol.cancer.gov/BRP/scienceteam/index.html.

National Institutes of Health Systemic Assessments. (2008) Science of Science Management Meeting. [Videocast and papers presented at the Science of Science Management Meeting, Bethesda, MD, October 2-3, 2008.]. http://nihperformance.nih.gov/ScieceofScienceOctoberMeeting.htm.

Neuhaus, Christoph and Daniel Hans-Dieter. (2006) Data sources for performing citation analysis: An overview. [preprint] http://e-collection.ethbib.ethz.ch/eserv/eth:29124/eth-29124-01.pdf.

Organisation for Economic Co-operation and Development (OECD). (2007) Science, technology and innovation indicators in a changing world: Responding to policy needs. [Selection of papers presented at the OECD Blue Sky II Forum, Ottawa, Canada, 25-27 September 2006]. http://www.oecd.org/document/12/0,3343,en_2649_34409_39369868_1_1_1_1,00.html.

Organisation for Economic Co-operation and Development (OECD) and the German Federal Minister of Education and Research. (2005) Workshop on Evaluation of Publicly Funded Research. [Selection of papers presented at the Workshop on Evaluation of Publicly Funded Research, Berlin, Germany, September 26 -27, 2005]. http://www.oecd.org/document/37/0,3343,en_2649_34293_35450213_1_1_1_1,00.html.

Pang, T., et al. (2003) Knowledge for better health: a conceptual framework and foundation for health research systems. Bulletin of the World Health Organization 81:815-820. http://www.scielosp.org/scielo.php?script=sci_arttext&pid=S0042-96862003001100008&lng=en&nrm=iso.

RAND Europe. (2006) Measuring the benefits from research. http://www.rand.org/pubs/research_briefs/2007/RAND_RB9202.pdf.

Research Information Network. (2007) Research funders’ policies for the management of information outputs: A report commissioned by the Research Information Network. http://www.rin.ac.uk/files/Funders'%20Policy%20&%20Practice%20-%20Final%20Report.pdf.

Research Information Network. (2009) Communicating knowledge: How and why UK researchers publish and disseminate their findings. http://www.rin.ac.uk/system/files/attachments/sarah/Communicating-knowledge-report.pdf

Salter, A. J. and Martin, B. R. (2001) The economic benefits of publicly funded basic research: a critical review. Research Policy 30:509-532. doi:10.1016/S0048-7333(00)00091-3.

Smith, Richard. (2001) Measuring the social impact of research: Difficult but necessary. BMJ 323:528. http://www.bmj.com/cgi/content/full/323/7312/528.

Taylor and Francis. Optimizing citations to your article. http://www.tandf.co.uk/journals/pdf/author/Optimizing_Citations.pdf.

Trochim, William M., et al. (2008)The evaluation of large research initiatives: A participatory integrative mixed-methods approach. American Journal of Evaluation 29(1):8-28. http://aje.sagepub.com/cgi/content/abstract/29/1/8.

Weiss, Anthony. (2007) Measuring the impact of medical research: Moving from outputs to outcomes. American Journal of Psychiatry 164:206-214. http://ajp.psychiatryonline.org/cgi/content/abstract/164/2/206.

Wells, Robert and Judith A. Whitworth. (2007) Assessing outcomes of health and medical research: do we measure what counts or count what we can measure? Australian and New Zealand Health Policy 4:14. http://www.anzhealthpolicy.com/content/4/1/14.

Williams, Valerie L., et al. (2009) Demonstrating and communicating research impact: Preparing NIOSH programs for external review. http://www.rand.org/pubs/corporate_pubs/2009/RAND_MG809.pdf

Wooding, S. et al. (2005) Payback arising from research funding: evaluation of the Arthritis Research Campaign. Rheumatology (Oxford) Sep;44(9):1145-56. http://rheumatology.oxfordjournals.org/cgi/content/full/44/9/1145.

W.K. Kellogg Foundation Logic Model Development Guide. (2004). www.wkkf.org/Pubs/Tools/Evaluation/Pub3669.pdf.

Yates, Lyn. (2005) Is Impact a Measure of Quality? Some reflections on the research quality and impact assessment agendas. European Educational Research Journal, 4(4), pp. 391-403. http://dx.doi.org/10.2304/eerj.2005.4.4.5.

NIH Systemic Assessments, National Institutes of Health, Division of Program Coordination, Planning, and Strategic Initiatives (DPCPSI)
http://nihperformance.nih.gov/

Primary Health Care Research & Information Service (PHC RIS)
http://www.phcris.org.au/index.php

Payback Publications, Health Economics Research Group (HERG) Brunel University, UK.
http://www.brunel.ac.uk/about/acad/herg/publications/payback

United States Department of Energy, Energy Efficiency and Renewable Energy (EERE) Program Evaluation Resource Documents
http://www1.eere.energy.gov/ba/pba/program_evaluation/evaluation_documents.html

Assessment Tool
Lavis, John, et al. (2003) Measuring the impact of health research. Journal of Health Services Research and Policy 8(3):165-170.
http://jhsrp.rsmjournals.com/cgi/reprint/8/3/165.

Excellence in Research for Australia (ERA) Initiative, Australian Research Council
http://www.arc.gov.au/pdf/ERA_ConsultationPaper.pdf

Framework for Measuring the Impact of Health Research, Canadian Institutes of Health Research
http://www.cihr-irsc.gc.ca/e/documents/meeting_synthesis_e.pdf

Logic Model for Medical Research
Weiss, Anthony. (2007) Measuring the impact of medical research: Moving from outputs to outcomes. American Journal of Psychiatry 164:206-214.
http://ajp.psychiatryonline.org/cgi/content/abstract/164/2/206.

Mixed-Method Approach
Trochim, William M., et al. (2008) The evaluation of large research initiatives: A participatory integrative mixed-methods approach. American Journal of Evaluation 29(1):8-28.
http://aje.sagepub.com/cgi/content/abstract/29/1/8.

Monitoring & Evaluation (Michael Smith Foundation for Health Research)
http://www.msfhr.org/about/monitoring_evaluation

Payback Framework (Buxton, Hanney, Grant, et al), Health Economics Research Group (HERG)
http://www.brunel.ac.uk/about/acad/herg/publications/payback

RAND Europe
http://www.rand.org/pubs/research_briefs/2007/RAND_RB9202.pdf.

Research Assessment Exercises (RAE), United Kingdom
http://www.rae.ac.uk/aboutus/.

Performance Based Research Fund (PBRF), New Zealand
http://www.tec.govt.nz/templates/standard.aspx?id=588.

Research Impact Framework
Kuruvilla, Shyama, et al. (2006) Describing the impact of health research: A research impact framework. BMC Health Services Research 6:134.
http://www.biomedcentral.com/1472-6963/6/134.