|
Vol.13, No.2, May 2024. ISSN: 2217-8309 eISSN: 2217-8333
TEM Journal
TECHNOLOGY, EDUCATION, MANAGEMENT, INFORMATICS Association for Information Communication Technology Education and Science |
Optimizing Item Construction in Diagnostic Mathematics Test
Wahyu Hartono, Samsul Hadi, Raden Rosnawati
© 2024 Samsul Hadi, published by UIKTEN. This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. (CC BY-NC-ND 4.0)
Citation Information: TEM Journal. Volume 13, Issue 2, Pages 1106-1115, ISSN 2217-8309, DOI: 10.18421/TEM132-25, May 2024.
Received: 15 November 2023. Revised: 13 February 2024.
Abstract:
The diagnostic mathematics test is a critical tool for measuring students' abilities to understand and apply mathematical concepts, with the design of good test items being paramount to ensure validity. This study leverages Item Response Theory (IRT) models and Differential Item Functioning (DIF) methods to refine the construction of test items, specifically focusing on rational numbers. Engaging 929 junior high school students from three public schools in Cirebon, West Java The research utilized R Software to analyze the most suitable IRT models and investigate DIF methods. The findings underscore the efficacy of the Parameter Logistic 3PL model based on Akaike Information Criterion (AIC), Bayesian Information Criterion (BIC), -2 loglikelihood, and Standardized Root Mean Square Residual (SRMSR) values, alongside item fit, highlighting that nearly all analyzed items were suitable except one that required replacement. Additionally, the identification of items with significant DIF effects points to potential biases, suggesting avenues for enhancing test fairness and reliability. The study's broader implications extend to improving diagnostic assessment practices, informing item design in educational evaluations, and guiding future research towards creating more equitable and precise measures of mathematical understanding. This contributes to a nuanced comprehension of student abilities, offering valuable insights for educators, assessment designers, and policymakers aimed at fostering improved learning outcomes in mathematics education.
Keywords –Diagnostic mathematics test, DIF, IRT, rational number. |
|
----------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------------------- |