6. QUALITY MANAGEMENT: QUALITY ASSESSMENT AND DEVELOPMENT
6.4 M EASUREMENT , A NALYSIS , AND I MPROVEMENT
6.4.3 Quality assurance of learning outcome
The study program's vision and mission are used as the basis for the preparation of study program objectives (Program Educational Objectives). Furthermore, to achieve the objectives of study program, an Intended Learning Outcome (ILO) of study program is prepared. ILO is created to measure the ability of graduates in either knowledges, skills, competencies or attitudes. Next, to achieve the ILO, a number of course modules are provided, each of which is equipped with a Course Learning Outcome (CLO) that is used to measure the achievements of ILO. Each course provides a handbook module to guide the lecture implementation of related courses (https://matematika.ub.ac.id/s1-matematika/en/module-handbook-2/). In addition, at each end of the semester, all lecturers are obliged to make a lecture implementation portfolio for the courses that they teach. The portfolio contains an explanation
3,8 3,9 4 4,1 4,2 4,3 4,4
Course initial implementation: Clarity of lesson plan Course initial implementation: Clarity of course goals (explanation of…
Course initial implementation: Clarity of assessment system Course initial implementation: Clarity of course rules delivered explicitly Course initial implementation: Clarity of references for the course…
Course initial implementation: References availability and accessibility Course implementation: Systematics and clarity in delivering lesson Course implementation: Lecturer’s handout/module/notes accessibility Course implementation: Interesting presentation by the lecturer during…
Course implementation: Lesson suitability with lesson plan and syllabus Course implementation: Lecturer’s attendance level and course time … Course implementation: Case examples that are relevant to the lesson
Course implementation: The frequency of assignment and exercises Course implementation: Allows to ask and have discussions during the…
Course implementation: Lecturer’s responses and explanation on … Course implementation: Class situation during lesson Course implementation: Lecturer’s attempt in giving motivations to …
Evaluation: Exercises/assignments and lesson suitability Evaluation: The suitability of exams (Quizzes, mid-semester exam, final…
Evaluation: Explanation, Discussion and Suggestions of final exams, mid-…
Evaluation: Lecturer reveal the score, answers of the quizzes, exams, etc.
Average Student's Response for 2019/2020 Academic Year
Even Semester 2019/2020 Odd Semester 2019/2020
72
of the lecture methods used, assessment system, class statistics, analysis of the outcome achievement (CLO and ILO), comments on the results of a student questionnaire, reflection on the lecture implementation, and proposed improvements on the next course. The ILO achievements profile of Bachelor Degree in Mathematics Study Program for 2019/2020 academic year can be seen in Error! Reference source not found. and
Table 6.1
Figure 6.4 The ILO achievement profile of the Undergraduate Program of Mathematics for the 2019/2020 academic year
Table 6.1 The level of ILO achievement based on weighted score Outcome Weighted
Score Level
ILO 1 70.75 SATISFACTORY
ILO 2 70.27 SATISFACTORY
ILO 3 70.28 SATISFACTORY
ILO 4 72.47 SATISFACTORY
ILO 5 71.66 SATISFACTORY
ILO 6 75.99 SATISFACTORY
ILO 7 80.2 EXCELLENT
ILO 8 79.83 SATISFACTORY
It is seen that the achievement of all ILOs are at a satisfactory level and excellent level (for ILO7). Nevertheless, the Mathematics Study Program always make effort to increase all ILOs, especially for a lower score than the others, for example, ILO1, ILO2 and ILO3. Based on ILO achievement for each course (academic year 2019/2020) in Appendix 6.1, we can see that ILO1, ILO2 and ILO3 have developing score level (with grey color) in some courses (Kalkulus I, Kalkulus III, Pengantar Analisis Real, Kapita Selekta Aljabar, Himpunan dan Logika, Aljabar Linear Elementer, Algoritma Pemrograman, and Pengantar Peluang). For most students, those courses are relatively difficult in its content. As an effort to increase the achievement of ILO1, ILO2 and ILO3, Mathematics Study Program encourage the lecturers for those courses to improve the performance in teaching as what written in portfolio (section proposed improvements on the next course), specific improvement for each course.
73
Information about the length of study of Mathematics Study Program graduates (2017- 2020) and the average cumulative grade point index (GPA) of Mathematics Study Program graduates can be seen in Error! Reference source not found. and Error! Reference source not found., respectively. Based on Error! Reference source not found. we can see that the percentage of graduates with the length of study 3.5 – 4 years (on-time graduates) is dominant. From this data, we can conclude that the curriculum constructed for 4 years is well applied. Regarding cumulative grade point index (GPA), we can see in Error! Reference source not found. that the average cumulative grade point index (GPA) is 3.338 in a scale 4, which shows satisfactory academic achievement.
Figure 6.5 The length of study Undergraduate Program of Mathematics graduates
Figure 6.6 The average cumulative grade point index (GPA) Undergraduate Program of Mathematics graduates
Figure 6.7 shows the number of new students and graduates of the Mathematics study program in 2017-2020 academic year. We can see that the number of new students and the
81%
0% 0%
19%
93%
7%
60%
22%
10% 8%
77%
2%
12% 9%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
3,5 - <=4 thn 4 - <= 4,5 thn 4,5 - <5 thn >=5 th
SUMMARY OF STUDENT
LENGHT OF STUDY
Length of Study of 2017-2020 Graduates
2017 2018 2019 2020
3,24 3,26 3,28 3,3 3,32 3,34 3,36 3,38
2016 2017 2018 2019 2020
Average GPA of Graduates
74
number of graduates is balanced for each year. Since 2019, there is university’s policy related to increasing new students leading to many new students compared with the previous years.
Figure 6.7 Statistical data regarding new students and graduates in Undergraduate Program of Mathematics
6.4.4 Quality assurance on academic activities and administrative service's procedures