i
AN ANALYSIS OF THE QUALITY OF TEACHER-MADE TEST IN EFL CLASSROOM AT GAMALIEL ELEMENTARY SCHOOL AND ITS
WASHBACK IN TEACHING AND LEARNING
THESIS
By:
DESRINLEBAGI S891508007
Written as a Partial Fulfillment of the Requirements for Graduate Education Degree of English Language Teaching
ENGLISH EDUCATION OF GRADUATE SCHOOL
TEACHER TRAINING AND EDUCATION FACULTY
SEBELAS MARET UNIVERSITY
iv
PRONOUNCEMENT
This is to certify that I myself write this thesis entitled “An Analysis of the Quality of Teacher-Made Test in EFL Classroom at Gamaliel Elementary School and Its Washback in Teaching and Learning”. It is not a product of plagiarism or made by others. Anything related to others’ works is written in quotation, the sources of which are listed on the list of references.
If then this pronouncement proves false, I am ready to accept any
academic punishment including the withdrawl or cancelation of my academic degree.
Surakarta, April 2017
v MOTTO
“Pura-pura ua puru ndaya I mPue, pura-pura tila kabangke nto’o Nda” “It’s only by His grace and only for His glory”
vi DEDICATION
This thesis is lovely dedicated to my beloved parents (Surya
Morianto Lebagi and Erma Mustapa) who always pray and support me on
and on. I could pass this process because of you. Thank to brother of mine,
Juan Pascal Ruutana, my lovelysiblings, my big family, DEAVID, AMAU,
D2A, and all of my friends. Last, but not least, thank to Martoria Alfonsus
vii ABSTRACT
DesrinLebagi. S891508007. 2017. An Analysis of the Quality of Teacher-Made Test in EFL Classroom at Gamaliel Elementary School and Its Washback in
Teaching and Learning. A Thesis. First Consultant: Dr. Sumardi, M.Hum;
Second Consultant: Dr. Sudjoko, M.A. English Education Department, Graduate School, Sebelas Maret University.
The main objective of this research is to describe: (1) the quality of test items including the difficulty index, the discrimination index, the distractor index, and the reliability of the test; (2) the washback of teacher-made test on teacher’s way of teaching; and (3) the washback of teacher-made test on students’ motivation in learning English.
This case study was conducted at Gamaliel Elementary school, Palu, Central Sulawesi in Academic Year of 2016-2017. The sampling used in this research was purposive sampling. In collecting the data, the researcher used interview, observation, and document analysis as the techniques of collecting data. The informants were an English teacher and students of Gamaliel Elementary School. The documents were students answer sheets that were analyzed using ITEMAN program. The data were analyzed by using Interactive Model.
Based on the analysis, it can be concluded that: (1) the teacher-made test administered in final examination overall can be classified as a good test; (2) the teacher-made test administered in final examination brought positive washback on teacher’s way of teaching including what teacher teaches and how teacher teaches; (3) the teacher made-test distributed in final examination brought both positive washback and negative washback on students’ motivation on learning. It influences what students learn and how students learn. Therefore, it is recommended for the English teacher to increase the awareness about the importance of conducting test analysis to know the quality of his made test. The students are suggested not only to study when they have examination, but also study when they do not have any examination. It is recommended for the school to instruct all teachers to analyze the quality of their test and the washback of test itself in their way of teaching. For the other researchers who intend to conduct similar research, the result of this research can be useful as an additional reference.
viii
ACKNOWLEDGEMENT
Praise The Lord Jesus Christ for all His abundant blessing, mercies, and guidance, hence the writer can complete the process of writing this thesis. First of all, the researcher would like to express the biggest thanks to LPDP-RI Scholarship. The completion of this thesis is due to valuable support and help from some people as mentioned below:
1. The Dean of Teacher Training and Education Faculty, Sebelas Maret University, Prof. Dr. Joko Nurkamto, M.Pd
2. The Head of English Department of Graduate Program, Dr. Ngadiso, M.Pd. 3. Dr. Sumardi, M.Hum, the first consultant for his kindly guidance, support, and
academic advice.
4. Dr. Sujoko, M.A, the second consultant for his support, patience and pray. 5. Ni Nyoman Suhermi, M.A., M.Pd, the Headmaster of Gamaliel Elementary
School, for her lovely support, guidance, advice, and permission in carrying out the research.
6. Irfan, S.Pd, the English teacher of Gamaliel Elementary School for his kindly cooperation and help in collecting the data.
7. The fifth grade students of Gamaliel Elementary school.
8. The writer’s family, all friends and everyone who have given help to the researcher in accomplishing this thesis.
Surakarta, April 2017
ix
TABLE OF CONTENT
TITTLE ... i
APROVAL ... ii
LEGITIMATION ... iii
PRONOUNCEMENT ... iv
MOTTO ... v
DEDICATION ... vi
ABSTRACT ... vii
ACKNOWLEDGEMENT ... viii
TABLE OF CONTENT ... ix
LIST OF TABLES ... xiii
LIST OF FIGURES ... xiv
LIST OF APPENDICES ... xv
CHAPTER I: INTRODUCTION A. Background of the Study ... 1
B. Problem Statements... 6
C. Objectives of the Study ... 7
D. Benefits of the Study ... 8
CHAPTER II: LITERATURE REVIEW A. Definition of Test ... 9
a. Standardized Test ... 11
x
B. Test Significances for Teaching and Learning ... 13
C. Characteristics of Good Test ... 14
1. Validity ... 14
a) Content Validity ... 15
b) Criterion-related Validity ... 16
c) Construct Validity ... 17
d) Face Validity ... 18
2. Reliability ... 19
3. Usability ... 20
D. Definition of Washback ... 21
a. Negative Washback in Teaching and Learning ... 27
b. Positive Washback in Teaching and Learning ... 29
E. Test Item Analysis Using ITEMAN ... 30
a. Reliability ... 36
b. Difficulty Index ... 39
c. Discrimination Index ... 39
d. Distractor Index ... 40
F. Related Studies ... 41
G. Research Framework ... 48
CHAPTER III: RESEARCH METHODOLOGY A. Time and Place of the Research ... 49
xi
C. Sources of the Data ... 51
a. Events ... 52
b. Informants ... 52
c. Documents ... 52
D. Techniques of Data Collection ... 53
a. Interview ... 53
b. Observation ... 54
c. Document Analysis ... 54
E. Trustworthiness ... 55
a. Triangulation ... 56
b. Member Checking ... 56
c. Rich and Thick Description ... 57
F. Technique of Data Analysis ... 57
a. Data Reduction ... 58
b. Data Display ... 58
c. Drawing Conclusion and Verification ... 58
CHAPTER IV: RESEARCH FINDINGS AND DISCUSSION A. Research Findings ... 59
1. The Quality of the Teacher-made Test ... 59
a) The Difficulty Index of the Test Items ... 67
b) The Discrimination Index of the Test Items ... 70
xii
d) Reliability of the Test ... 79
2. The Washback of Test on Teacher’s Way on Teaching ... 80
3. The Washback of Test on Students’ Motivation on Learning ... 82
B. Discussion ... 85
1. The Quality of the Teacher-made Test ... 85
a) The Difficulty Index of the Test Items ... 86
b) The Discrimination Index of the Test Items ... 88
c) The Distractor Index of Test Items ... 89
d) Reliability of the Test ... 90
2. The Washback of Test on Teacher’s Way on Teaching ... 92
3. The Washback of Test on Students’ Motivation on Learning ... 95
CHAPTER V: CONCLUSIONS, IMPLICATIONS AND SUGGESTIONS A. Conclusions ... 99
B. Implications ... 100
C. Suggestions ... 101
REFFERENCES ... 103
xiii
LIST OF TABLES
Table 2.1 The Differences between Standardized Test and Teacher-made Test 10
Table 3.1 Research Schedule... 49
Table 3.2 Research Mapping ... 55
Table 4.1 The Output of ITEMAN Analysis ... 60
Table 4.2 The Difficulty Index of Test Items ... 68
Table 4.3The Discrimination Index of Test Items ... 71
Table 4.4 The Distractor Index of Test Items ... 73
xiv
LIST OF FIGURES
Figure 2.1 Input Data in Notepad ... 33
Figure 2.2 ITEMAN Process ... 34
Figure 2.3 Result of ITEMAN... 35
Figure 2.4 Scale Statistics of ITEMAN Result ... 37
Figure 3.1 Interactive Model proposed by Miles and Huberman ... 57
xv
LIST OF APPENDICES
Appendix 1: Interview Transcript with the English Teacher ... 109
Appendix 2: Interview Transcript with the Students ... 118
Appendix 3: Observation ... 138
Appendix 4: English Test Items of Final Examination ... 149
Appendix 5: Students’ Answer Sheets ... 156
Appendix 6: List of Pictures ... 197
