Evaluation approaches Research Paper Example | Topics and Well Written Essays - 1000 words

Evaluation approaches - Research Paper Example The paper tells that evaluation techniques are crucial in any form of research regardless of whether it is a qualitative or quantitative research or a combination of both. This is because evaluation or measurement determines the interpretation of data gathered and, hence, impacts the findings and conclusions of a particular study. There is an ongoing debate as to which technique of evaluation or measurement can best interpret probability. According to Hand, this debate is stimulated and aggravated by controversy over the legitimacy of applying different classes of statistical methods to data that emerge as a consequence of different kinds of measurement activity. The body of literature supports this theme, from theories to actual research examples. The following studies undertaken to investigate three separate issues with different evaluation and measurement techniques highlight the differences by which the studies went through with their investigations. With an aim of investigating the validation approaches in Information Systems research, Boudreau, Gefen and Straub used an evaluation technique anchored on a comprehensive review and analysis of literature on the subject, specifically comparing two time periods. The researchers refer to it simply as a literature review except that such review was undertaken in a highly systematic manner. Clearly, the study is qualitative in character and it aims to describe the validation trends from 1997 to 1999. The employment of the review of literature as a foundation for inferences and conclusions is valid since qualitative research aims to find depth when quantitative studies seek breadth. Ambert et al. (1995) for instance, explained that because of this focus, evaluation could draw from a smaller group of research subjects or respondents instead of a large representative sample of the population. (p. 880) Bourdeau et al. selected five journals to represent the periods by which the study sought to compare. Out of these jo urnals, the author evaluated a total of 193 articles selected based on specific criteria or attributes. (p. 6) There were at least eleven such attributes (i.e. research type, content and construct validity, research method, etc.) and that they were, in turn, evaluated according to a validation test statistic – a second independent coder. (p. 6) The resulting data allowed for the identification of relationships and the evaluation of the efficacy of validation approaches based on previous documents so that the research objectives are finally met. It was found, for instance, that instruments are more frequently validated today than they were 11 years ago. (p. 7) Multi-method Evaluation Boyd et al. (2007), investigated community health services with emphasis on the need for stakeholder participation and dialogue. For this purpose, they designed a multi-method approach in order to cover the numerous stakeholders involved in community health services: health practitioners, communit y leaders, marginalized people, etc. Three evaluation frameworks are designed for goals, the stakeholders and the organization. The researchers employed the so-called critical systems thinking (CST) principle in this strategy, which is typified by three fundamental characteristics, namely: Critical awareness for the examination of assumptions in addition to the conditions that led to their emergence; Improvement both on temporary and local levels done in an adequately informed manner; and, Methodological