Remerciez-le!

Remerciez @Admin pour avoir partagé cet document gratuitement, de la manière la plus simple, en partageant sur les réseaux sociaux.

A guide to evaluating road safety education programs for young adults Departmen

A guide to evaluating road safety education programs for young adults Department of Transport and Main Roads, A guide to evaluating road safety education programs for young adults, November 2009 Contents Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1. Identify the goals and objectives of your program. . . . . . . . . . . . . . . . . . . . . . . . . 4 2. Choose the best methods of evaluation for your program. . . . . . . . . . . . . . . . . . . . . 5 3. Choose how you will collect the information. . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 4. Carry out the evaluation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 5. Report on your findings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 Appendix A: Evaluation planning template . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 Appendix B: Case study of a young driver program . . . . . . . . . . . . . . . . . . . . . . . . . 23 Appendix C: Different types of evaluation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 Appendix D: Resources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30 Appendix E: Examples of useful surveys and questionnaires. . . . . . . . . . . . . . . . . . . 32 Glossary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44 1 Department of Transport and Main Roads, A guide to evaluating road safety education programs for young adults, November 2009 The purpose of this guide is to assist community organisations, and other providers of road safety education programs for young novice drivers, to evaluate their programs. It includes guidance, tools and templates for how to plan, undertake and report on a program evaluation. Why was the guide developed? Road safety education seeks to bring about change in knowledge, attitude or skills related to being safe and making sure others are safe on the road. It can be delivered in many ways. A key role of road safety education is to raise awareness of road safety as a personally relevant issue. There is a pressing need for this guide as many road safety education programs have not been evaluated. In addition, many providers do not have the expertise to self-evaluate their programs or the resources to employ expert consultants to undertake such a task. The Department of Transport and Main Roads is concerned that the content of some programs may not be consistent with ‘best practice’ in road safety education. In particular, some programs may contain content that research has shown to result in negative road safety outcomes (for example, skid control training in off-road areas) which have been linked to an increased crash risk. The department’s aim in developing this guide is to assist providers of road safety education programs to review the effectiveness of their existing programs so they can be improved and refocussed where necessary. This will ensure that their road safety objectives are actually being achieved. This guide may also assist those developing new programs to build in evaluation techniques. Evaluation will help to ensure that your program is based on the best available evidence, works in the way you think it does, and changes what you want to change. Evaluation results can also help you to seek funding to continue or expand your program. For more information on best practice in road safety education, it is recommended that you refer to a recent literature review of best practice, Driver education for senior school students (Years 10–12) and novice drivers, which was developed by the Department of Transport and Main Roads in conjunction with the Centre for Accident Research and Road Safety – Queensland (CARRS-Q). It should be of particular interest to those trying to develop or maintain high quality road safety education programs. What is in the guide and how to use it This guide is designed as a self-help document that assists you to plan and carry out an evaluation of your program. You can work through it at your own pace. The guide will help you to: • identify the goals and objectives of your program • choose the best methods of evaluation for your program • choose how to collect the information • carry out the evaluation • report on your findings. Introduction Department of Transport and Main Roads, A guide to evaluating road safety education programs for young adults, November 2009 2 Ready to evaluate yet? Working through the guide and completing the template may help you decide when you are ready to start the evaluation process. Perhaps you already feel confident that you have the skills and information needed to undertake an evaluation of your program? Some people may refer to this document as a ‘buyers guide’ before developing a program or seeking the services of an evaluator. Common pitfalls to evaluation are also discussed throughout. The tools identified in this guide are: • a template to help you plan an evaluation (see Appendix A). Wherever you see the symbol, that’s when you need to refer to the template. As you will probably want to fill in the template as you move through the guide, it is best to first print a copy of the template so you can have it in front of you as you work through this guide. You can then start using the template by filling in your program’s name and basic details at Step 1. An electronic version of the template can also be downloaded from www.transport.qld.gov.au/sde. • a case study (see Appendix B) – the example provided summarises the evaluation process for the passenger safety component of a road safety education program to improve the safety of teenagers. • information about more complex types of evaluation (see Appendix C). • links to sources of additional information, for example, web resources, relevant research (see Appendix D). • examples of survey forms and questionnaires that could be used in program evaluations (see Appendix E). • a glossary of key definitions, terms and concepts used in the guide. This symbol lets you know it’s time to refer to or fill in the template. 3 Department of Transport and Main Roads, A guide to evaluating road safety education programs for young adults, November 2009 The diagram below shows the recommended steps in an evaluation1 and refers you to the relevant pages where these steps are covered. Step 1 Page 4 Identify the program goals and objectives Step 2 Pages 5–6 Choose the best method of evaluation • define the objectives of the evaluation • plan your evaluation • key questions for your evaluation Step 3 Pages 7–11 Choose how you will collect the information • possible data collection methods • ethical considerations Step 4 Pages 12–13 Carry out the evaluation • collect data/information • analyse the data/information • interpret the results Step 5 Pages 14–15 Report on your findings Adapted from Sentinella (2004) 1 Sentinella, J. (2004). Guidelines for evaluating road safety education interventions . In Proceedings of 69th Road Safety Congress: Protecting Vulnerable Road Users, 1-3 March 2004. Retrieved 20 January 2009 from: http://www.rospa.com/RoadSafety/conferences/congress2004/proceedings/sentinella.pdf. Department of Transport and Main Roads, A guide to evaluating road safety education programs for young adults, November 2009 4 1. Identify the goals and objectives of your program An evaluation measures the extent to which a program has met its goals and objectives. The uploads/Ingenierie_Lourd/ evaluation-guide 1 .pdf