Evaluation of management information systems: a study at a further education and training college

Abstract

Management information systems (MIS) are pivotal in the efficient and effective running of Further Education and Training (FET) colleges. Therefore, the evaluation of MIS success is an essential spoke in the wheel of FET college success. Based on an extensive literature review it was concluded that no MIS success evaluation model for FET colleges in South Africa exists. The main objective was to propose a MIS evaluation model and evaluation tool (questionnaire), and verify the model empirically by evaluating the MIS at a selected FET college. The supporting objectives were firstly, to identify the most appropriate MIS evaluation models from literature. Secondly, to propose a MIS evaluation model for FET colleges based on the literature. Thirdly, to develop the evaluation tool (questionnaire) based on these models. Fourthly, to capture and analyse data from one FET college, in order to evaluate the performance of the MIS at the college. The final supporting objective was to evaluate the proposed model by triangulating the findings from the survey with the findings from the interviews. The proposed MIS evaluation model is based on the integration of three existing MIS evaluation models. The evaluation tool was developed by combining four empirically tested questionnaires that capture the constructs in the underlying models. A survey and semi-structured interviews were used as data collection methods. The statistical tests for consistency, scale reliability (Cronbach's alpha) and unidimensionality (Principal Component Analysis) were applied to explore the constructs in the model. Results from the empirical testing of the newly designed evaluation tool were used to refine the initial model. The qualitative data capturing and analysis added value in explaining and contextualising the quantitative findings. The main contribution is the SA-FETMIS success model and evaluation tool which managers can use to evaluate the MIS at an educational institution. The novelty of the research lies in using a mixed methods approach where previous MIS success evaluation studies mainly used quantitative methods.