For Engineering and Science
Introduction: Evaluation
Parent Collection
Year
2010
DOI
https://doi.org/10.18130/z8e0-kn76
Rights
Discipline(s)
Topics
Description
Teachers of research ethics have a professional obligation as academics and as researchers to aspire to the highest quality of educational programs. As a minimum, it is often necessary to rely on anecdotal reports of best practices; however, the best use of all of our resources will occur only by seeking evidence-based approaches that align pedagogical and curricular goals with measurable outcomes. In short, we should be evaluating the outcomes of our teaching programs.
Body
- Introduction
- Topics
- Educational Settings
Descriptions of educational settings, including in the classroom, and in research contexts.
- Discussion Tools
- About the RCREC
Information about the history and authors of the Resources for Research Ethics Collection
Evaluation of training programs is essential to:
- Determine whether training goals are being met.
- Identify areas for improvement in program format and content.
- Provide quantitative evidence of success to administrators, faculty, and funding agencies.
- Demonstrate to trainees that the training is important and taken seriously.
What are the basic principles for effective evaluation?
Proper conduct of evaluation studies is governed by many principles that are not necessarily familiar to experienced researchers. The following are examples of some excellent, and accessible starting points for designing and executing studies that can help us to understand the impact of research ethics training programs upon those for whom the training was intended:
What should be evaluated?
An implicit assumption of evaluation is that it is possible to measure evidence for success in achieving goals of training in research ethics. This view is often assumed, but much more research is needed to assure that this is in fact the case. Mechanisms of feedback can consist of written evaluation forms, but verbal feedback can be at least as valuable. Verbal evaluation may consist of unsolicited comments, but can and should be explicitly requested in conversations with trainees or others, or as a topic of discussion at one or more points during (or after) the course of a training program. Evaluation instruments can be used to assess virtually all aspects of a training program including content, format, the trainees, the instructor, and the program itself. Examples of topics to be considered by the evaluation include:
- Course content
- Relevance (Is the material covered relevant to the trainees?)
- Currency (Is the information up to date?)
- Completeness (Have important topics been left out?)
- Course format
- Frequency and duration of meetings
- Cases (Is the use of cases effective?)
- Lectures (Are the lectures useful?)
- Discussions (Is the time spent in discussion useful?)
- Trainees
- Increased knowledge
- Improved decision-making skills
- Increased awareness
- Ability to identify practical applications of what has been learned
- Instructor
- Knowledgeable
- Effective
- Program
- Number of participating trainees
- Institutional awareness of program
- Institutional support for program
Who should do the evaluation?
Evaluation is not solely a matter of assaying student satisfaction using a form distributed at the end of a course. The process of evaluation should include feedback from:
- Trainees (What are their perceptions of program effectiveness? What have they learned?)
- Peers of the instructor
- The instructor (self-evaluation)
Resources
- Evaluation Tools
A collection of evaluation and assessment surveys and approaches. - Evaluation and Assessment Bibliography
Notes
The Resources for Research Ethics Education site was originally developed and maintained by Dr. Michael Kalichman, Director of the Research Ethics Program at the University of California San Diego. The site was transferred to the Online Ethics Center in 2021 with the permission of the author.
Citation
Michael Kalichman, Mark Appelbaum. . Introduction: Evaluation. Online Ethics Center. DOI:https://doi.org/10.18130/z8e0-kn76. https://onlineethics.org/cases/resources-research-ethics-education/introduction-evaluation.
