Three Empirical Investigations Into the Logic of Evaluation and Valuing Practices

Three Empirical Investigations Into the Logic of Evaluation and Valuing Practices
Author: Satoshi Ozeki
Publisher:
Total Pages: 89
Release: 2016
Genre: Evaluation
ISBN:

Download Three Empirical Investigations Into the Logic of Evaluation and Valuing Practices Book in PDF, Epub and Kindle

This three-paper dissertation investigates the logic of evaluation proposed by Michael Scriven using two different methods of inquiry: content analysis and a survey method. Scriven's logic of evaluation is one of the central concepts in evaluation, but has not been empirically investigated. Therefore, the purpose of this three-paper dissertation is to accumulate empirical knowledge on Scriven's logic of evaluation to investigate the extent to which evaluators follow his logic and their perceptions of and familiarity with his logic. Furthermore, this dissertation aims to explore valuing practices in terms of Scriven's logic of evaluation. Scriven's logic of evaluation is important because it provides a fundamental reasoning process of conducting evaluation. Whether consciously or not, if one is to conduct evaluation, Scriven's logic needs to be followed. Although there is no unanimous agreement on the extent to which Scriven's logic should be followed, Scriven's logic of evaluation is considered one of the most essential concepts in the field of evaluation. This dissertation aims to empirically investigate different aspects of Scriven's logic of evaluation using two methods of inquiry. In the first study, content analysis of evaluation reports was conducted to examine whether the utilization of Scriven's logic of evaluation is clearly identifiable or not. Findings suggest that standards were not clearly established and synthesis methodology was not found in those evaluation reports. However, it remained unclear whether the evaluators in the sample of the evaluation reports did not follow Scriven's logic of evaluation. The second study aimed to examine whether evaluators apply Scriven's logic of evaluation into their evaluation practice as well as evaluators' familiarity with and perceptions of Scriven's logic of evaluation. Findings from the second study suggest that many of the evaluators were not familiar with his logic but evaluators typically, although not always, followed Scriven's logic of evaluation. In addition, it was found that a large number of the respondents considered Scriven's logic of evaluation useful and important in conducting evaluation regardless of their familiarity. The third study sought to explore details of performance standards and evaluative conclusions. The findings from the third study suggest that many of the evaluators were engaged in making evaluative conclusions, but did not always use performance standards to reach evaluative conclusions. Most of them considered the task of making evaluative conclusions difficult yet important in their evaluation practice.

Peer Review in an Era of Evaluation

Peer Review in an Era of Evaluation
Author: Eva Forsberg
Publisher: Springer Nature
Total Pages: 414
Release: 2022
Genre: Education
ISBN: 3030752631

Download Peer Review in an Era of Evaluation Book in PDF, Epub and Kindle

This open access volume explores peer review in the scientific community and academia. While peer review is as old as modern science itself, recent changes in the evaluation culture of higher education systems have increased the use of peer review, and its purposes, forms and functions have become more diversified. This book put together a comprehensive set of conceptual and empirical contributions on various peer review practices with relevance for the scientific community and higher education institutions worldwide. Consisting of three parts, the editors and contributors examine the history, problems and developments of peer review, as well as the specificities of various peer review practices. In doing so, this book gives an overview on and examine peer review , and asks how it can move forward. Eva Forsberg is Professor of Education at Uppsala University, Sweden. Her research focuses education governance and evaluation, academic work and the interface between educational policy, practice and research. Lars Geschwind is Professor in Engineering Education Policy and Management at KTH Royal Institute of Technology, Sweden. His main research interests are higher education policy, institutional governance, academic leadership and academic work. Sara Levander is Senior Lecturer and Researcher in Education at Uppsala University, Sweden. Her research interests are higher education, academic work and faculty evaluation in academic recruitment and promotion. Wieland Wermke is Associate Professor in Special Education at Stockholm University, Sweden. His research interest focuses on comparative education methodology, and teacher practice at different levels of education.

Core Concepts in Evaluation

Core Concepts in Evaluation
Author: Lori A. Wingate
Publisher: SAGE Publications
Total Pages: 396
Release: 2024-07-19
Genre: Social Science
ISBN: 1071883852

Download Core Concepts in Evaluation Book in PDF, Epub and Kindle

This unique book features original writings from evaluation′s foundational thinkers, together with new commentaries from contemporary authors. Each section includes an introduction to a core evaluation concept by the editors, a classic reading, two commentaries on that topic by contemporary authors, and a reflection guide written by the editors.

Evaluating

Evaluating
Author: Ernest R. House
Publisher: IAP
Total Pages: 157
Release: 2014-12-01
Genre: Education
ISBN: 1623969174

Download Evaluating Book in PDF, Epub and Kindle

In this book, Ernie House reframes how we think about evaluation by reconsidering three key concepts of values, biases, and practical wisdom. The first part of the book reconstructs core evaluation concepts, with a focus on the origins of our values and biases. The second part explores how we handle values and biases in practice, and the third shows how we learn practical wisdom and use it in evaluations. Value is the central concept in this volume, yet it’s a fuzzy concept. In Part I, Ernie clarifies the concept of value by addressing basic questions: What are values? Where do they come from? Why do we have them? Why is our conception so confused? How do we handle values in evaluations? In Part II, another central concept is added, that of biases. Prominent evaluation frameworks have focused on biases, including Campbell and Stanley’s (1963) framework for validating causal inferences and Scriven’s (1972) conception of objectivity, which is achieved by correcting for biases in general. In addition, research on thought processes has made progress by focusing on cognitive biases (Kahneman, 2011). Even so, through a case example, Ernie demonstrates that the concept of biases is under-appreciated and not well engaged in evaluation practice. The third important concept, featured in Part III, is practical wisdom, which is the knowledge that evaluators acquire through experience. Practical wisdom informs what we do, possibly as much as theory. Experienced evaluators often conduct evaluations in similar ways, regardless of their theory, because practical wisdom determines much of what they do. Ernie provides concrete examples of practical wisdom and how we employ it. Throughout the book, he draws on the empirical research on thinking processes, especially Kahneman’s Thinking Fast and Slow (2011). This book will be of interest and relevance to all evaluation scholars and practitioners, as it thoughtfully engages core constructs of the field. The book can also well serve as a supplementary text in multiple evaluation courses, as it offers valuable conceptual and practical perspectives on our craft.

The Logic of Evaluation

The Logic of Evaluation
Author: Michael Scriven
Publisher:
Total Pages: 134
Release: 1981
Genre: Educational accountability
ISBN:

Download The Logic of Evaluation Book in PDF, Epub and Kindle

Values in Evaluation and Social Research

Values in Evaluation and Social Research
Author: Ernest . House
Publisher: SAGE Publications
Total Pages: 175
Release: 1999-08-03
Genre: Social Science
ISBN: 1452251770

Download Values in Evaluation and Social Research Book in PDF, Epub and Kindle

"Values in Evaluation is a breakthrough book that will change the way evaluators think about the relationship between facts and values. Using the tools of philosophy and insights from evaluation practice, the authors attack the inconsistencies in current thinking about the interplay of facts and values and give us an outline for reconstructing the approach to values within evaluation." --Gary T. Henry, Georgia State University "This book, as the title promises, unfurls the concept of value in the practice of program evaluation. The editors go well beyond recognizing that all data gathering and description are value laden and that all evaluators have value commitments shaping their designs. They examine the ethical and political burdens accompanying any evaluation contract. Out of an extended collaboration, Kenneth R. Howe and Ernest R. House together redirect their advocacy toward the pursuit of democracy." --Robert E. Stake, University of Illinois, Urbana-Champaign The authors use the tools of philosophy and the insights from evaluation practice to cut through current confusion about values and the interplay of facts and values. Four views of facts and values in evaluation are analyzed: those rooted in a fact-value dichotomy and those of radical constructivists, postmodernists, and deliberative democrats. The arguments are tough, the prose concise, and the insights compelling.

Contemporary Trends in Evaluation Research

Contemporary Trends in Evaluation Research
Author: Chris L S Coryn
Publisher: SAGE Publications Limited
Total Pages: 0
Release: 2015-10-29
Genre: Social Science
ISBN: 9781446266373

Download Contemporary Trends in Evaluation Research Book in PDF, Epub and Kindle

Evaluation is an essential characteristic of the human condition, and perhaps the single most important and sophisticated cognitive process in the repertoire of human reasoning and logic. Evaluation serves society by providing affirmations of worth, value and improvement to name just a few, and is a process which permeates all areas of human activity, scholarship and production. This work is split into four volumes: Volume One: Contains articles featuring contemporary issues and emerging trends in evaluation Volume Two: Contains articles highlighting recent theoretical, methodological, and empirical developments in quantitative evaluation designs Volume Three: Contains a summation of articles on recent developments in qualitative and mixed methods evaluation practice Volume Four: Contains a synthesis of articles on enduring issues of evaluation training and practice

Reasoning in Evaluation

Reasoning in Evaluation
Author: Deborah M. Fournier
Publisher: Jossey-Bass
Total Pages: 118
Release: 1995
Genre: Evaluation research (Social action programs)
ISBN:

Download Reasoning in Evaluation Book in PDF, Epub and Kindle

"Evaluators are in the business of reasoning their way toward legitimate conclusions that clients and other stakeholder groups can use. In everyday practice, evaluators collect and combine evidence to draw conclusions about something or someone. Reasoning is the basis for what evaluators do and what they tell their clients to do. But is the reasoning sound? Evaluative conclusions are often sources of controversy, and the inferences drawn from evidence always have potential loopholes for error. In what ways can the conclusions resulting from evaluations be trusted? How can evaluators reliably combine evidence from multiple sources into a final judgment about the merit or worth of something. How, and in what ways, can evaluative conclusions be justified in an objective way similar to empirical conclusions? Obtaining answers to these perennial questions facing evaluators in every evaluation is the field's greatest unmet challenge." "To stimulate debate and encourage more scholarship in this area the authors in this volume of New Directions for Evaluation grapple with some of the thorny problems of how to better understand the reasoning process that is used to establish evaluative conclusions. The reader will leave this discussion thinking more clearly and critically about logical practice, appreciating the central role of reasoning in the successful practice of evaluation, and pondering the various avenues by which to contribute to future developments."--BOOK JACKET.Title Summary field provided by Blackwell North America, Inc. All Rights Reserved

What Counts as Credible Evidence in Applied Research and Evaluation Practice?

What Counts as Credible Evidence in Applied Research and Evaluation Practice?
Author: Stewart I. Donaldson
Publisher: SAGE
Total Pages: 289
Release: 2009
Genre: Education
ISBN: 1412957079

Download What Counts as Credible Evidence in Applied Research and Evaluation Practice? Book in PDF, Epub and Kindle

"What Counts as Credible Evidence in Applied Research and Evaluation Practice? is the first book of its kind to define and place into greater perspective the meaning of evidence for evaluation professionals and applied researchers. Editors Stewart I. Donaldson, Christina A. Christie, and Melvin M. Mark provide observations about the diversity and changing nature of credible evidence, include lessons from their own applied research and evaluation practice, and suggest ways in which practitioners might address the key issues and challenges of collecting credible evidence." "This book is appropriate for a wide range of courses, including Introduction to Evaluation Research, Research Methods, Evaluation Practice, Program Evaluation, Program Development and Evaluation, and evaluation courses in Social Work, Education, Public Health, and Public Policy."--BOOK JACKET.

Evaluation Practice

Evaluation Practice
Author: Elizabeth DePoy
Publisher: Psychology Press
Total Pages: 240
Release: 2012-10-12
Genre: Psychology
ISBN: 1135592772

Download Evaluation Practice Book in PDF, Epub and Kindle

Evaluation Practice bridges the apparent gap between practice and research to present a logical, systematic model to guide all professional thinking and action within the context of everyday professional life. Their framework embraces diverse theories, action, and sets of evidence from a range of professional and disciplinary perspectives.