Designing Educational Project and Program Evaluations: A Practical Overview Based on Research and Experience

Front Cover
Springer Science & Business Media, Mar 31, 1994 - Education - 258 pages
0 Reviews
Drawing upon experiences at state and local level project evaluation, and based on current research in the professional literature, Payne presents a practical, systematic, and flexible approach to educational evaluations. Evaluators at all levels -- state, local and classroom -- will find ideas useful in conducting, managing, and using evaluations. Special user targets identified are state department of education personnel and local school system administrative personnel. The volume can be used by those doing evaluation projects `in the field', or as a text for graduate courses at an introductory level.
The book begins with an overview of the generic evaluation process. Chapter Two is devoted to the criteria for judging the effectiveness of evaluation practice. Chapter Three addresses the all important topic of evaluation goals and objectives. Chapters Four, Five and Six basically are concerned with the approach, framework, or design of an evaluation study. Chapter Four contains a discussion of four major philosophical frameworks or metaphors and the implications of these frameworks for conducting an evaluation. Chapters Five and Six describe predominantly quantitative and qualitative designs, respectively. Design, implementation and operational issues related to instrumentation (Chapter Seven), management and decision making (Chapter Eight), and reporting and utilization of results (Chapter Nine) are next addressed. The final chapter of the book (Chapter Ten) considers the evaluation of educational products and materials.
 

What people are saying - Write a review

We haven't found any reviews in the usual places.

Contents

Educational Evaluation Definitions Purposes and Processes
1
The Nature of Project and Program Evaluation
6
The Roles of Evaluation
7
Evaluation Is Not Research
10
Activities in the Evaluation Process
12
Evaluation Truisms
14
Cogitations
18
Suggested Readings
19
Qualitative and Ethnographic Evaluation
121
A Rationale for Interpretive Inquiry
122
Qualitative Design Issues
125
Data Collection Methods
131
Data Analysis
135
Cogitations
140
Suggested Readings
141
Creating and Selecting Instrumentation
143

Criteria for Effective and Ethical Evaluation Practice
21
The Importance of Ethics
22
Professional Standards and Metaevaluation
25
An Example Lesson from the Standards
32
Cogitations
38
Evaluation Goals Objectives and Questions
39
Identifying and Involving Stakeholders
40
Kinds of Evaluation Questions
41
Levels of Specificity in Educational Outcomes
44
Program Development and Evaluation Questions
46
Developing Evaluation Questions
48
Standard Setting
51
Evaluation Questions and the Utilization of Results
54
Cogitations
55
Evaluative Metaphors
57
The Nature of Metaphors in Education and Evaluation
59
The Management Evaluation Metaphor
60
Evaluating a Gifted and Talented Program
64
The Judicial Metaphor
66
The Anthropological Metaphor
70
Evaluating a Teacher Evaluation System
74
The Consumer Metaphor
83
In Praise of Eclecticism
89
Cogitations
90
Suggested Readings
91
Quantitatively Oriented Data Collection Design
93
Factors Affecting Evaluation Design Decisions
94
Elements of a Data Collection Design
95
The Validity of Data Collection Designs
99
Data Collection Designs
103
Cogitations
119
Suggested Readings
120
Types of Measures
144
Opinionnaire and FreeResponse Methods
147
Observation Methods
150
Approaches to the Assessment of Affective Variables
158
Authentic Assessment
163
Locating Information About Measuring Devices
165
Cogitations
169
Suggested Readings
170
Managing Evaluations
173
The Role of the Evaluator
174
Planning Considerations
177
Legal Considerations
181
Cost Considerations
183
Decision Making
187
Cogitations
190
Communicating and Using Evaluation Results
193
A Rational for Reporting
194
Report Preparation
196
Factors Related to Utilization of Evaluation Results
200
Cogitations
203
Evaluating Educational Materials
205
Evaluating Instructional Text
206
Evaluating Computer Educational Software
211
Cogitations
212
Suggested Readings
215
References
217
Multiple Criterion Measures for Evaluation of School Programs
231
Contract for Professional Services
237
Contract for Educational Program Audit
241
Subject Index
249
Name Index
253
Copyright

Other editions - View all

Common terms and phrases

References to this book

Bibliographic information