Building an Efficient and Effective Test Management System in an ODL Institution

  • Safiah Md Yusof Open University Malaysia
  • Tick Meng Lim Open University Malaysia
  • Leo Png IMPACT Media
  • Zainuriyah Abd Khatab Open University Malaysia
  • Harvinder Kaur Dharam Singh Open University Malaysia
Keywords: ODL, Assessment, MCQ, Question Bank, Item Bank, Test Management System

Abstract

Open University Malaysia (OUM) is progressively moving towards implementing assessment on demand and online assessment. This move is deemed necessary for OUM to continue to be the leading provider of flexible learning. OUM serves a very large number of students each semester and these students are vastly distributed throughout the country. As the number of learners keeps growing, the task of managing and administering examinations every semester has become increasingly laborious, time consuming and costly. In trying to deal with this situation and improve the assessment processes, OUM has embarked on the development and employment of a test management system. This test management system is named OUM QBank. The initial objectives of QBank development were aimed at enabling the systematic classification and storage of test items, as well as the auto-generation of test papers based on the required criteria. However, it was later agreed that the QBank should be a more comprehensive test management system that manages not just all assessment items but also includes the features to facilitate quality control and flexibility of use. These include the functionality to perform item analyses and also online examination. This paper identifies the key elements and the important theoretical basis in ensuring the design and development of an effective and efficient system.

Author Biographies

Safiah Md Yusof, Open University Malaysia

Associate Professor Dr Safiah is currently the  Deputy Director for the Institute for Teaching and Learning Advancement (ITLA) at Open University Malaysia. She is also Head of the Online Learning Support Unit at ITLA, OUM.

Tick Meng Lim, Open University Malaysia
Professor Lim Tick Meng is currently the Director for the Institute for Teaching and Learning Advancement (ITLA) at OUM.
Leo Png, IMPACT Media
Mr Leo Png is currently the CEO of IMPAC Media Pte Ltd based in Singapore.
Zainuriyah Abd Khatab, Open University Malaysia
Dr Zainuriyah is currently a lecturer at OUM and Head of Assessment Support Unit for the Institute for Teaching and Learning Advancement at OUM.
Harvinder Kaur Dharam Singh, Open University Malaysia
Dr Harvinder is currently a lecturer at OUM and the Head of Face-To-Face Support Unit for the Institute for Teaching and Learning Advancement at OUM.

References

Choppin, B. (1976, June). Developments in item banking. Paper presented at the First European Contact Workshop, Windsor, UK.

Estes, G. D. (Ed.). (1985). Examples of item banks to support local test development: Two case studies with reactions. Washington, DC: National Institute of Education.

Jandaghi, G., & Shaterian, F. ( 2008). Validity, reliability and difficulty indices for instructor-built exam questions. Journal of Applied Quantitative Methods, 3(2), 151-155. Retrieved from http:// files.eric.ed.gov/fulltext/EJ803060.pdf

Latchem, C., Özkul, A.E., Aydin, C.H., & Mutlu, M.E. (2006). The Open Education System, Anadolu University, Turkey: E-transformation in a mega-university. Open Learning: The Journal of Open, Distance and e-Learning, 21, 221-235.

Mutlu, M. E., Erorta, Ö. Ö., & Yılmaz, Ü. (2004, October). Efficiency of e-learning in open education. In First International Conference on “Innovations in Learning for the Future: e-Learning”, 26-27, October 2004, Istanbul.

Okonkwo, C. A. (2010). Sustainable assessment and evaluation strategies for open and distance learning. Turkish Online Journal of Distance education - TOJDE, 11(4), 121-129.

Published
2017-06-13
How to Cite
Md Yusof, S., Lim, T. M., Png, L., Abd Khatab, Z., & Dharam Singh, H. K. (2017). Building an Efficient and Effective Test Management System in an ODL Institution. Journal of Learning for Development , 4(2). Retrieved from https://jl4d.org/index.php/ejl4d/article/view/200
Section
Case Studies