CHAPTER III METHODOLOGY
D. Validity and Reliability
Table 3.4 The Blueprint of Reading Comprehension Test (adapted from Pearson in Israel, 2017)
Variable Aspect Indicator Number Total
Reading Comprehension
Recalling word meanings in context
The students are able to identify recalling word in a text
3, 5, 7, 10, 13, 19, 21, 25, 27, 32, 34, 38,
12
Formulating main idea
The students are able to identify the main idea of passage
1, 11, 18, 26, 31, 39
6
Answer specific text- based questions
The students are able to identify explicit of passage
2, 6, 9, 12, 16, 17, 20, 23, 28, 33, 37,
11
Draw inferences about content
The students are able to identify the conclusion of a text
4, 14, 22, 30, 35, 40,
6
Reference meaning of question
The students are able to identify reference
pronoun of a text
8, 15, 24, 29, 36, 5
Total 40
D. Validity and Reliability
Note:
r = Pearson product-moment correlation x = score item which its validity is answered y = total score gained by the sample
N = number of respondent
The instrument is valid when there are two criteria to determine validity of test items, as follows:
1) If rvalue > rtable at the level significance of 5%, it means that the instrument is valid.
2) If rvalue < rtable at the level significance of 5%, it means that the instrument is not valid.
Then, below are the index validity of each item interpreted as the following criteria:
Table 3.5
r Coefficient Correlation (Validity)
Score Interpretation
0.8—1.0 Very high
0.6—0.8 High
0.4—0.6 Moderate
0.2—0.4 Low
0.0—0.2 Very low
2. Reliability Test
This test is used to know the consistency of the instrument used in the study.
The Cronbach's Alpha formula is frequently used to measure reliability. This approach is extremely well-suited for usage with dichotomous scores (0 and 1). The formula is below:
Note:
pi = proportion of students passing the item 1 qi = proportion of students failing the item (q = 1-p)
∑ = sum the product of piqi for all items K = number of items
St2 = variance of the whole test (standard deviation squared)
The instrument is reliable when there are two criteria to determine validity of test items, as follows:
1) If alpha cronbach > rtable at the level significance of 5%, it means that the instrument is reliable.
2) If alpha cronbach < rtable at the level significance of 5%, it means that the instrument is not reliable.
Then, below is the index of reliability interpreted as follow:
Table 3.6
Classification of Reliability Coefficient Correlation Interpretation
0.0—0.20 Low
0.20—0.40 Moderate
0.40—0.70 High
0.70—1.00 Very High
3. The Result of Validity and Reliability Test
To get the validity and reliability of the test items, a piloting study was implemented at the English Education Program, UIN Bandung. The participants are those who are currently in the third semester. After reviewing the answers, 20 participants completed the test. Below is the result of the instrument's validity and reliability of each variable.
Table 3.7
The Validity of Morphological Competence Test
No. F table F value Status No. F table F value Status Item 1 .444 .690** Valid Item 16 .444 .572** Valid Item 2 .444 .224 Invalid Item 17 .444 .618** Valid Item 3 .444 .647** Valid Item 18 .444 .050 Invalid Item 4 .444 .639** Valid Item 19 .444 -.099 Invalid Item 5 .444 -.021 Invalid Item 20 .444 .639** Valid Item 6 .444 .454* Valid Item 21 .444 -.095 Invalid Item 7 .444 .639** Valid Item 22 .444 .409 Invalid Item 8 .444 .021 Invalid Item 23 .444 .639** Valid Item 9 .444 .559* Valid Item 24 .444 .494* Valid Item 10 .444 .040 Invalid Item 25 .444 .639** Valid Item 11 .444 .500* Valid Item 26 .444 .452* Valid Item 12 .444 .471* Valid Item 27 .444 .177 Invalid Item 13 .444 .649** Valid Item 28 .444 .469* Valid Item 14 .444 .733** Valid Item 29 .444 .445* Valid Item 15 .444 .321 Invalid Item 30 .444 .572** Invalid
Table 3.8
The Reliability of Morphological Competence Test
Based on the table 3.7 and 3.8, it reveals the result of morphological test after piloting study. From 30 questions administrated to the piloting participants, 19 questions are valid. These valid questions are already met with all indicators of morphological competence. The reliability value is in the range of 0.814 Cronbach’s Alpha which means it is very high reliable. As a result, 19 questions will be tested to the sample of study. Then, the table below shows the following validity of the other variables.
Table 3.9
The Validity of Self-Regulated Questionnaire
No. F table F value Status No. F table F value Status Item 1 .444 .507* Valid Item 16 .444 .296 Invalid Item 2 .444 .257 Invalid Item 17 .444 .582** Valid Item 3 .444 .755** Valid Item 18 .444 .555* Valid Item 4 .444 .646** Valid Item 19 .444 .450* Valid Item 5 .444 .478* Valid Item 20 .444 .565** Valid Item 6 .444 .201 Invalid Item 21 .444 .433 Invalid Item 7 .444 -.150 Invalid Item 22 .444 .296 Invalid Item 8 .444 .737** Valid Item 23 .444 .327 Invalid Item 9 .444 .520* Valid Item 24 .444 .447* Valid Item 10 .444 .627** Valid Item 25 .444 .571** Valid Item 11 .444 .476* Valid Item 26 .444 .480* Valid
Cronbach's Alpha N of Items
.814 30
Item 12 .444 .237 Invalid Item 27 .444 .463* Valid Item 13 .444 .020 Invalid Item 28 .444 .626** Valid Item 14 .444 .451* Valid Item 29 .444 .565** Valid Item 15 .444 .239 Invalid Item 30 .444 .433 Invalid
Table 3.10
The Reliability of Self-Regulated Questionnaire
According to the table 3.9 and 3.10, it shows the result of self-regulated learning after piloting test. From 30 questions administrated to the piloting participants, 20 questions are valid. These valid questions are already met with all indicators of self-regulated learning. Then, reliability value is in 0.845 Cronbach’s Alpha which means it is extremely high reliable. Therefore, 20 questions will be tested to the sample of study. Then, the table below is the following validity of the other variables.
Table 3.11
The Validity of Reading Comprehension Test
No F table F value Status No F table F value Status Item 1 .444 .710** Valid Item 21 .444 .176 Invalid Item 2 .444 .523* Valid Item 22 .444 .608** Valid Item 3 .444 .496* Valid Item 23 .444 .454* Valid Item 4 .444 .495* Valid Item 24 .444 .560* Valid Item 5 .444 .640** Valid Item 25 .444 .520* Valid Item 6 .444 .565** Valid Item 26 .444 .509* Valid Item 7 .444 .443 Invalid Item 27 .444 .527* Valid
Cronbach's Alpha N of Items
.845 30
Item 8 .444 .478* Valid Item 28 .444 .039 Invalid Item 9 .444 .493* Valid Item 29 .444 .578** Valid Item 10 .444 .329 Invalid Item 30 .444 .520* Valid Item 11 .444 .508* Valid Item 31 .444 .462* Valid Item 12 .444 .198 Invalid Item 32 .444 .520* Valid Item 13 .444 .535* Valid Item 33 .444 .482* Valid Item 14 .444 .520* Valid Item 34 .444 .389 Invalid Item 15 .444 .494* Valid Item 35 .444 .052 Invalid Item 16 .444 .188 Invalid Item 36 .444 .501* Valid Item 17 .444 .482* Valid Item 37 .444 .076 Invalid Item 18 .444 .711** Valid Item 38 .444 .447* Valid Item 19 .444 .689** Valid Item 39 .444 .212 Invalid Item 20 .444 .228 Invalid Item 40 .444 .440 Invalid
Table 3.12
The Reliability of Reading Comprehension Test
The tables 3.11 and 3.12 show the result of piloting test on reading comprehension. From 40 questions administrated to the piloting participants, 28 questions are valid. These valid questions are already met with all indicators of self- regulated learning. Then, reliability value is in 0.898 Cronbach’s Alpha which means it is very high reliable. As a result, 28 questions will be tested to the sample of study.