Building an Efficient and Effective Test Management System in an ODL Institution
Keywords:ODL, Assessment, MCQ, Question Bank, Item Bank, Test Management System
Open University Malaysia (OUM) is progressively moving towards implementing assessment on demand and online assessment. This move is deemed necessary for OUM to continue to be the leading provider of flexible learning. OUM serves a very large number of students each semester and these students are vastly distributed throughout the country. As the number of learners keeps growing, the task of managing and administering examinations every semester has become increasingly laborious, time consuming and costly. In trying to deal with this situation and improve the assessment processes, OUM has embarked on the development and employment of a test management system. This test management system is named OUM QBank. The initial objectives of QBank development were aimed at enabling the systematic classification and storage of test items, as well as the auto-generation of test papers based on the required criteria. However, it was later agreed that the QBank should be a more comprehensive test management system that manages not just all assessment items but also includes the features to facilitate quality control and flexibility of use. These include the functionality to perform item analyses and also online examination. This paper identifies the key elements and the important theoretical basis in ensuring the design and development of an effective and efficient system.
Choppin, B. (1976, June). Developments in item banking. Paper presented at the First European Contact Workshop, Windsor, UK.
Estes, G. D. (Ed.). (1985). Examples of item banks to support local test development: Two case studies with reactions. Washington, DC: National Institute of Education.
Jandaghi, G., & Shaterian, F. ( 2008). Validity, reliability and difficulty indices for instructor-built exam questions. Journal of Applied Quantitative Methods, 3(2), 151-155. Retrieved from http:// files.eric.ed.gov/fulltext/EJ803060.pdf
Latchem, C., Özkul, A.E., Aydin, C.H., & Mutlu, M.E. (2006). The Open Education System, Anadolu University, Turkey: E-transformation in a mega-university. Open Learning: The Journal of Open, Distance and e-Learning, 21, 221-235.
Mutlu, M. E., Erorta, Ö. Ö., & Yılmaz, Ü. (2004, October). Efficiency of e-learning in open education. In First International Conference on “Innovations in Learning for the Future: e-Learning”, 26-27, October 2004, Istanbul.
Okonkwo, C. A. (2010). Sustainable assessment and evaluation strategies for open and distance learning. Turkish Online Journal of Distance education - TOJDE, 11(4), 121-129.
How to Cite
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).