article information

Journal of Medical Education: Vol.6, issue 2; e105155
published online: February 28, 2009
article type: Research Article
received: February 28, 2009
accepted: February 28, 2009
DOI: https://doi.org/10.22037/jme.v6i2.765
Crossmark

Multivariate Analysis Of Factors Influencing Reliability Of Teacher Made Tests

authors:

avatar Z Meshkani 1 , * , avatar F Hossein Abadie 2

Associate Professor, Department of Community Medicine, Director of EDO, College of Medicine ,Tehran University of Medical Sciences.
Director of Educational Testing Services, College of Medicine, Tehran University of Medical Sciences.

how to cite: Meshkani Z, Hossein Abadie F. Multivariate Analysis Of Factors Influencing Reliability Of Teacher Made Tests. J Med Edu. 2005;6(2):e105155. https://doi.org/10.22037/jme.v6i2.765.

Abstract

Background: According to the measurements literature reliability of the test refers to the consistency of the test results and shows whether the obtained score is stable indication of the student’s performance in particular test Reliability can be measured by different statistics formula.Purpose: To determine the factors influenced the reliability of 392 MCQ examinations.Methods: The correlation of reliabilities of MCQ based examination and other characteristics of tests such as length difficult items, discrimination index, mean, standard deviation and time for answering was calculated based on the data available on examination center of Tehran University of Medical Sciences. Multivariate regression has been used for data analysis.Results: overall reliability of teacher made test is at satisfactory level in most cases. The mean value of reliability was 0.71 ±0.15. In comparing previous semester with last series of examination some improvement have been found during these years (P=0.000, for first semester, P=0.002 for second, P= 0.005 for third and P=0.005 for forth semester). Keeping other variable fixed the interaction of length of exam according to item difficulty showedl significant difference on value of test reliability. Comparing difficult and easy items question with moderate difficultyindex can increase reliability 8 times more than difficult and 13 times more than easy items P=0.000.Conclusion: Our study showed that with documentation of tests’ metric features an analysis and evaluation of tests are within reach of medical school.

Fulltext

The body of the article can be found in the PDF file.

References

  • 1.

    References are available in the PDF file.