Reliability and Validity Analysis of Test Paper Quality Based on True Score Theory -- A Case Study of Linear Algebra

Abstract

In this paper, two undergraduate majors were randomly selected as samples from the final examination of Linear Algebra in Nanchang Engineering College, and their final examination papers of Linear Algebra were used as the research object to analyse the reliability and validity of the papers respectively. Firstly, the reliability of the test papers was calculated to be 0.731 by the alpha coefficient method, and the degree of influence of each test question on the reliability of the test papers was analysed. Secondly, the content validity of the test papers is qualitatively analysed by using the two-way breakdown table of the examination content and competence requirements, with the average of the midterm grade and the usual grade as the validity score, and the correlation validity of the test papers obtained by using the correlation method is 0.669. Therefore, the reliability and validity of the final paper of "Linear Algebra" meet the requirements of the two undergraduate majors for the professional certification of engineering education. The test results truly and objectively reflect the actual level of the candidates, and the measurement results can reflect the intended purpose of the test