In collecting data, the researcher used a test to collect the data. The data was conducted as follows:
1. Speaking test
a. Speaking test pre-test is given in the form of a speaking test orally. The researcher gave food products to students. Then students were asked to analyze and explain the label text of the product, such as the name, description, and ingredients. The researcher gave the students 3 minutes to speak up in front of the class.
b. Speaking test for post-test is given in the form of a speaking test orally.
The reseacher gave a product of drink to students. After that, students were asked to analyze and explain the label text of the product, such as the name, description, and ingredients. The researcher gave the students 3 minutes to speak up in front of the class.
2. Giving treatment.
After giving a pre-test, the researcher applied treatment for three meetings; the experimental class got treatment by using show and tell method in learning to speak. At the same time, the control class got conventional methods during the teaching and learning process.
In the first meeting, the researcher explained about label text of food. Afterwards, the researcher divided the class into groups of five students. The researcher prepared some product of food. Then, they discussed the label text of food products and then explained the label text of food products based on the generic structure of label text in front of the class.
In the second meeting, the researcher prepared some products of drinks. Then, the researcher gave the product to each group. Afterwards, each group discussed the label text of the drink and then explained it based on the generic structure of the label text in front of their classmate.
In the third meeting, the researcher prepared some products of medicine. Afterwards, the researcher divided the class into groups of five
students. Each group discussed the label text of that product and then explained it in front of the class.
3. Validity
Validity is a term that describes an instrument's ability to measure what it wants to measure.34 It means validity in talking about a measuring instrument to get data. There are many types of validity, namely, face and content validity. Construct validity and criterion validity.35 In this research, the researcher used content validity. The researchers asked the validators to perform the validity test in this research. The researcher asked the English lecturer from UIN KH. Achmad Siddiq Jember to conduct a validation test on this research. The validity sheet is adopted from a thesis by Dian Sinati Bhumi Paramitha (2016).
4. Reliability
Sugiyono (2005) stated that reliability is a series of measurements or measuring instruments with consistent results even though these measurements are carried out repeatedly. The reliability test of this research is inter-rater reliability to measure the speaking test. Creswell (2015) stated that inter-rater reliability is a procedure for observing behaviour. In this study, the researcher used inter-rater reliability to determine the degree to which various judges or raters agree on the assessment.
34 Ibid p.133
35 Hamed Taherdoost. 2016. Validity and Reliability of the Research Instrument: How to Test the Validation of a Questionnaire/Survey in a Research. International Jounal of Academic Research in Manageement.
The researcher understands that the teacher has more expertise in scoring students. So, the researcher saw the pattern of the teacher in giving the score and also asked for the teacher's suggestion in giving the appropriate score. The researcher used Cohen’s Kappa test on SPSS.
There was an interpretation from the result of Kappa by Mary L. McHugh in the following table36:
Table 3.3
Interpretation from result of Kappa by Mary L. McHugh Value of Kappa Level of
Agreement
% of Reliable Data
0 -,20 None 0-4%
,21 -,39 Minimal 4-15%
,40 -,59 Weak 15-35%
,60 -,79 Moderate 35-64%
,80 -,90 Strong 64-81%
Above,90 Almost Perfect 82-100%
In this study, the researcher adopted a scoring rubric in a speaking test from Douglass Brown, as follows :
Table 3.4
Scoring rubric adapted from Douglass Brown37
Aspect Score Criteria
Grammar 5 The grammar is clear and correct.
4 A few unclear or errors, but I still can understand them easily.
3 Some erorr but can still be understood.
2 Grammar frequently unintelligible.
1 Grammar errors are frequent.
Vocabulary 5 Used varied vocabularies which are appropriate with the context
4 A few vocabularies used which are inappropriate with the context
3 Able to speak with some various vocabulary
36 Mary L. McHugh, “ Interrater Reliability: the kappa statistic”, Lesson in biostatistics. 2012
37 Douglass Brown, 406-407.
2 Has speaking vocabulary sufficient to express themselves simply
1 Speaking vocabulary inadequate
Comprehension 5 Can explain the label text without any mistakes 4 Can explain the label text but still little mistakes 3 Can explain the label text but still there some
mistakes
2 Can explain the label text, but there are many mistakes
1 Can not explain the label text
Fluency 5 Speak fluently with only slight hesitations that do not interface with communication
4 Speak fluently with occasional hesitation
3 Speak hesitantly because of recalling and searching for words
2 Speak in single words, short and slow 1 No specific fluency description Pronounciation 5 Pronunciation is clear and correct
4 A few unclear or errors, but they still can understand easily.
3 Some errors, but still can be understood.
2 Pronunciation is frequently unintelligible.
1 Errors in pronunciation are frequent.
Note: maximum score = 25 Score =
x 100 E. Data Analysis
Some data analysis methods that the researcher carried out after giving a speaking test of the two classes are as follows:
1. The researcher conducted a normality test on the data obtained in the previous speaking test. The normality test in this research was conducted to qualify the absolute prior to statistical analysis. Saeful and Bahrudin (2014) stated that the normality test aims to assess the distribution of data in a group of data and variables and whether the distribution of the data is
usually distributed. Therefore, the participants of this research were around 59 students, and the researcher used the Kolmogorov-Smirnov test on SPSS.
2. After that, the researcher used the homogeneity test to determine the variance homogeneity of the two samples. Acting and Sambas stated that the homogeneity test aims to ensure that the data set is measured from a homogeneous population. In this study, the data used data from the post-test experimental class and control class. To post-test the homogeneity of data, the researcher used Levene’s test on SPSS.
3. The last step is the T-test. T-tests are used to know whether data from different samples have significant differences in the mean of students between the control class with the conventional method and the experimental class with show and tell method in the teaching and learning process. The independent t-test used SPSS 26 version.
37
CHAPTER IV
RESEARCH FINDINGS AND DISCUSSION A. The Description of data
In this section, the researcher discussed the description of the results of the research she conducted on the speaking ability of 9th-grade students at SMP Negeri 1 Jember. Two classes were the subjects of the study. The first class was IX-B as the experimental group, and the other class was IX-A as the control group. They were chosen by a purposive technique using the lottery method. In those classes, the researcher gave a speaking test in the form of a pre-test and a post-test. There are differences in the treatment of the two classes studied by the researcher; the researcher conducted a pre-test of the experimental group before giving the treatment and a post-test after the class was given treatment using the show and tell method. Besides, the researcher conducted a pre-test for the control class before being taught short functional text material using the conventional method. After that, the researcher gave the post-test.
The pre-test was held on 13th of September 2022 at 09.45-11.00 a.m. in the experimental class; meanwhile, in the control class, the pre-test was held on 14th of September 2022 at 08.00-9.15 a.m. In the pre-test, the researcher asked students to orally describe the label text of food (the product's name, product description, and ingredients). Each student only has 3 minutes to describe the direction of the researcher in front of the class. After conducting
the pre-test, the researcher gave the experimental class a treatment using show and tell method.
The researcher gave the treatment to the experimental class on 15 September 2022. The researcher gave the students a brief explanation of show and tell method in general and the material they would learn. The explanation of the material using show and tell method was divided into three sessions, the first was an explanation of the label text of food, the second was an explanation of the label text of drink, and the last session was an explanation of the label text of medicine. The researcher divided the class into some groups, and each group consisted of 5 students. The researcher prepared some products of food, drink, and medicine. After that, they discussed the product's label text and explained it in front of the class. The researcher prepared food products in the first treatment, and each group got one. After that, they discussed the label text of food products and then explained the label text of food products based on the generic structure of label text in front of the class.
The second treatment was held on 20th September 2022. In the second treatment, the researcher prepared a product of drink. After that, they discussed the label text of the drink product and then explained the label text of the product based on the generic structure of the label text in front of the class. The third treatment was held on 22nd September 2022. In the third treatment, the researcher prepared a product of medicine. After that, they discussed the label text of the medicine product and then explained the label
text of the medicine product based on the generic structure of the label text in front of the class.
After conducting the treatments, the researcher held a post-test of the experimental and control class. The post-test was held on 27th September 2022 in the experimental class, while the control class was held on 28th September 2022. The post-test was done by asking each student to describe the label text of the drink orally in front of the class. As was done in the pre-test, each student has 3 minutes to describe. The researcher assessed students’ speaking ability using the oral scoring rubric adopted by Douglass Brown.