Proposed Solutions for Nonrandomness in Educational Research
Keywords:
educational research, randomization tests, statistical inference, resampling methodsAbstract
Experimental, quasi-experimental, and survey research in education is often carried out using accessible subjects. Such circumstances violate the assumptions of most traditional statistical inference procedures. This paper reviews and illustrates two computer-intensive procedures appropriate in such circumstances: randomization tests clarify treatment effects, and the bootstrap technique estimates the uncertainty of generalizations to populations. These techniques provide guidance in nonrandomized studies by approximating to a best-case scenario of statistical uncertainty.
Metrics
References
Bracht, G. H., & Glass, G. V. (1968). The external validity of experiments. American Educational Research Journal, 5, 437-474.
Bradley, J. V. (1968). Distribution-free statistical tests. Englewood Cliffs, NJ: Prentice-Hall.
Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research on teaching. In N. L. Gage (Ed.), Handbook of research on teaching (pp. 171-246). Chicago: Rand McNally.
Cornfield, J., & Tukey, J. (1956). Average values of mean squares in factorials. Annals of Mathematical Statistics, 27, 907-947.
Edgington, E. S. (1969). Statistical inference: The distribution-free approach. New York: McGraw-Hill.
Edgington, E. S. (1980). Randomization tests. New York: Marcel Dekker.
Edgington, E. S. (1985). Random assignment and experimental research. Educational Administration Quarterly, 21, 235-246.
Efron, B. (1979). Bootstrap methods: Another look at the jackknife. Annals of Statistics, 7, 1-26.
Efron, B. (1982). The jackknife, the bootstrap, and other resampling plans. Philadelphia, PA: Society for Industrial and Applied Mathematics.
Fisher, R. A. (1935). The design of experiments. Edinburgh: Oliver and Boyd.
Hakstian, A. R., Schroeder, M. L., & Rogers, W. T. (in press). Inferential procedures for correlation coefficients corrected for attenuation. Psychometrika.
Kempthorne, O. (1955). The randomization theory of experimental inference. Journal of American Statistical Association, 50, 946-967.
Macdonald, E. (1972). A comparison group and dyadic interaction as measured by the Flanders’ interaction analysis categories. Unpublished doctoral dissertation, University of Alberta, Edmonton.
Maguire, T. O. (1986). Applications of new directions in statistics to educational research. Alberta Journal of Educational Research, 32, 154-171.
Rao, C. R. (1973). Linear statistical inference and its applications. New York: Wiley.
Shepard, L., Gamilli, G., & Williams, D. M. (1984). Accounting for statistical artifacts in item bias research. Journal of Educational Statistics, 9, 93-128.
Stone, M. (1974). Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society, Series B, 36, 111-147.
Tukey, J. W. (1958). Bias and confidence in not quite large samples. Annals of Mathematical Statistics, 29, 614.
Tukey, J. W. (1977). Exploratory data analysis. Reading, MA: Addison-Wesley.
Winer, B. J. (1971). Statistical principles in experimental design. New York: McGraw-Hill.
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The Canadian Journal of Education follows Creative Commons Licencing CC BY-NC-ND.
