The Ecology of Assessment: Evaluation in Educational Settings
Keywords:
Educational evaluation, Assessment models, Measurement, Reliability, Validity, Decision makingAbstract
A theoretical model of evaluation for complex educational settings would be welcome. We propose a model of evaluation with three components (measurement, judgement, and decision making) with related criteria (reliability, validity, and utility), and another for educational settings based on the work of Parsons (1986), Beer (1979), and Rees (1983). The latter model depicts the provincial educational setting as hierarchical and interdependent with lower levels nested in the operational subsystem of levels immediately above them. The development of a provincial item bank illustrates an application of the models.
References
Anthony, R.N. (1965). Planning and control systems. Boston: Harvard Administration.
Beer, S. (1979). The heart of enterprise. Chichester, UK Wiley.
Cronbach, L.J. (1971). Test validation. In R.L. Thorndike (Ed.), Educational Measurement (2nd ed.) (pp. 443-507). Washington, DC: American Council on Education.
Cronbach, L.J., Gleser, G.C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory ofgeneralizabilityforscores and profiles. New York:John Wiley & Sons.
Emery, F.E., & Trist, E.L. (1969). Socio-technical systems. In F.E. Emery (Ed.), Systems thinking (pp. 281-296) New York: Penguin.
Fullan, M., & Park, P. (1981). Curriculum implementation. Toronto: Ministry of Education, Government of Ontario.
Leithwood, K.A., Wilson, R.J. & Marshall, A.R. (1978). Final report: The development and implementation of a strategy for comprehensive program evaluation for Ontario school systems. Toronto: Ministry of Education. Unpublished.
Leithwood, K.A., Wilson, R., & Marshall, A.R. (1981). Increasing the influence of evaluation studies on program decision-making. In A. Lewy & D. Nevo (Eds.), Evaluation roles in education. London: Gordon & Breach.
McLean, L.D. (1982). Report ofthe 1981field trials inEnglish and mathematics: Intermediate division. Toronto: Ministry of Education.
Messick, S. (1975). The standard problem: meaning and values in measurement and evaluation. American Psychologist, 30, 955-965.
Parsons, T. (1956). Suggestions for a sociological approach to the theory of organization. Administrative Science Quarterly, 1, 63-85, 225-239.
Rees, R. (1983). The interorganizational collectivity: A study of the Manpower institutional training system in Manitoba. Unpublished doctoral dissertation, University of Toronto.
Scriven, M. (1967). Methodology of evaluation. In R. Tyler, R. Gagn6, & M. Scri (Eds.), Perspectives of curriculum evaluation (pp. 39-83). Chicago: Rand McNally
Scriven, M. (1974). The evaluation of educational g and outcomes or The iceman cometh. In J. Blan (Eds.), Program development in education (pp. 134 British Columbia.
Stoner, J.A.F. (1978). Management. Englewood Cliffs, NJ: Prentice-Hall.
Stufflebeam, D.L., Foley, W.J., Gephart, W.J., Guba, E.G., Hammond, R.L., Merriman H.O., & Provus, M.M. (1971). Educational evaluation and decision-making. Itasca, IL: F.E. Peacock.
Weick, KE. (1977). The social psychology of organizations (2nd ed.). Reading, MA: Addi Wesley.
Wilson, R.J. (1989). Evaluating student achievement in an Ontario high school. Alberta Journal of Educational Research, 35, 134-144.
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The Canadian Journal of Education follows Creative Commons Licencing CC BY-NC-ND.
