Appendix 3. Oral Proficiency Scoring Categories (Brown, 2001, pp.406-407)
Grammar Vocabulary
Comprehension
Fluency
Pronunciation
Task
0 Errors in grammar are frequent, and speaker cannot built sentences correctly
Speaking vocabulary are
poor to express anything
Cannot understand
simple question
and have limited
expression
Lack of confidence and
still confuse in speaking
Cannot
pronounce words
clearly
Cannot ask and answer
question although
familiar topic.
I Errors in grammarare frequent, but speaker used to dealing with foreigners attempting to speak his language. Speaking vocabulary inadequate to express anything but the most elementary needs
Within the scope of
his very limited
language
experience, can
understand simple
questions and
statements if
delivered with
slowed speech,
repetition, or
paraphrase.
(no specific fluency
description. Refer to
other four language
areas for implied level of
fluency.)
Errors in
pronunciation are
frequent but can
be understood by
a native speaker
used to dealing
with foreigners
attempting to
speak his
language
Can ask and answer
questions on topics
very familiar to him.
Able to satisfy routine
travel needs and
minimum courtesy
requirements. (Should
be able to order a
simple meal, ask for
shelter or lodging, ask
and give simple
directions, make
purchases, and tell
time.
II Can usually handle elementary constructions quite accurately but does not have thorough or confident control of the grammar.
Has speaking vocabulary sufficient to express himself simply with some circumlocutions.
Can get the gist of
most conversations
of non-technical
subjects (i.e.,
topics that require
no specialized
knowledge).
Can handle with
confidence but not with
facility most social
situations, including
introductions and casual
conversations about
current events, as well
as work, family, and
autobiographical
information.
Accent is
intelligible though
often quite faulty.
Able to satisfy routine
social demands and
work requirements;
needs help in handling
any complication or
difficulties.
III Control of grammar is good. Able to speak the language with sufficient structural accuracy to participate effectively in most formal and informal conversations on practical, social, and professional topics.
Able to speak the language with sufficient vocabulary to participate effectively in most formal and informal
conversations on practical, social, and professional topics. Vocabulary is broad enough that he rarely has to grope for a word.
Comprehension is
quite complete at a
normal rate of
speech.
Can discuss particular
interests of competence
with reasonable ease.
Rarely has to grope for
words.
Errors never
interfere with
understanding
and rarely disturb
the native
speaker. Accent
may be obviously
foreign
Can participate
effectively in most
formal and informal
conversations on
practical, social, and
professional topics.
IV Able to use the language accurately on all levels normally pertinent to professional needs. Errors in grammar are quite rare.
Can understand and participate in any conversation within the range of his experience with a high degree of precision of vocabulary.
Can understand
any conversation
within the range of
his experience.
Able to use the
language fluently on all
levels normally pertinent
to professional needs.
Can participate in any
conversation within the
range of this experience
with a high degree of
fluency.
Errors in
pronunciation are
quite rare.
Would rarely be taken
for a native speaker but
can respond
appropriately even in
unfamiliar situations.
Can handle informal
interpreting form and
into language
V Equivalent to that ofan educated native speaker.
Speech on all levels is fully accepted by educated native speakers in all its features including breadth of vocabulary and idioms, colloquialisms, and pertinent cultural references.
Equivalent to that
of an educated
native speaker.
Has complete fluency in
the language such that
his speech is fully
accepted by educated
native speakers.
Equivalent to and
fully accepted by
educated native
speakers.
Speaking proficiency
equivalent to that of an
educated native
speaker.
Appendix 4. Subcategories of Proficiency Scores
Subcategories of proficiency scores
Level Description
0
Unable to function in the spoken language
0+
Able to satisfy immediate needs using rehearsed utterances
1
Able to satisfy minimum courtesy requirements and maintain very
simple face-to face conversations on familiar topics
1+
Can initiate and maintain predictable face-to-face conversations and
satisfy limited social demands
2
Able to satisfy routine social demands and limited work requirements
2+
Able to satisfy most work requirements with language usage that is
often, but not always, acceptable and effective
3
Able to speak the language with sufficient structural accuracy and
vocabulary to participate effectively in most formal and informal
conversations on practical, social, and professional topics.
3+
Often able to use the language to satisfy professional needs in a wide
range of sophisticated and demanding tasks
4
Able to use the language fluency and accurately on all levels normally
pertinent to professional needs
4+
Speaking proficiency is regularly superior in all respects, usually
equivalent to that of a well-educated, highly articulate native speaker
5
Speaking proficiency is functionally equivalent to that of a highly
articulate, well-educated native speaker and reflects the cultural
standards of the country where the language is spoken.
Appendix 5. Pretest and Posttest Oral Interview Guideline
Pretest/Posttest
1. Warm up:
- How are you?
- What’s your name?
- Where are you come from?
(let me tell you about this interview)
2. Level Check
- How long have you been studying at your school?
- Tell me about your family?
- Do you have a hobby?
- Tell me about your hobbies or interests?
- I would like you to ask me some questions?
Please read the following paragraph. (test-taker reads aloud) what do you get from
this paragraph?
Ahmad Al Ghazali Kohler is a famous artist from Indonesia. He always called Al.
He is the eldest son from a famous musician Ahmad Dhani and Maia Estiyanti.
He is very handsome, so he has many fans. He was born on September, 01, 1997
in Jakarta. He began his career with his brothers in the Lucky Laki band. Their
first song was “Superman”. After that he tried to be a solo career and the first
single is “ku rayu bidadari.” And now he is a movie actor and also singer. His
films are RUNAWAY in 2014 and LDR in 2015.
3. Probe
- What are your goals with your hobbies?
- Do you have a best friend?
- Tell me about your best friend?
- Could u tell about your daily activity?
4. Wind-down:
- Did you feel okay about this interview?
- Tell me about your factor which affect your English speaking fluency?
- Any additional information?
Appendix 6. Syllabus
SILABUS
NAMA SEKOLAH : SMK N 1 Godean MATA PELAJARAN : BAHASA INGGRIS KELAS/SEMESTER : XI / 1-2
STANDAR KOMPETENSI : Berkomunikasi dengan Bahasa Inggris setara Level Elementary KODE KOMPETENSI :
ALOKASI WAKTU : 146 X 45 menit KOMPETENSI DASAR INDIKATOR MATERI PEMBELAJARAN KEGIATAN PEMBELAJARAN PENILAIAN
ALOKASI WAKTU SUMBER
BELAJAR TM PS PI 2.1. Memahami percakapan sederhana sehari-hari baik dalam konteks profesional maupun pribadi dengan orang bukan penutur asli Pertanyaan dengan pola yes-no questions dalam konteks kegiatan sehari-hari diperagakan dan dijawab dengan benar. Pertanyaan dengan pola question tags dalam konteks kegiatan sehari-hari diperagakan dengan benar.
Pertanyaan dengan pola question words dalam konteks kegiatan sehari-hari diperagakan dan dijawab dengan benar.
Talking about hobbies and interests
- Do you like fishing? - What do you like doing in
your spare time?
Guest handling
- What can I do for you, Sir? - Welcome to our hotel. - I hope you enjoy the food. Grammar Review
Yes – No questions - Are you a secretary?
Question tags
- The board meeting starts at seven, doesn’t it?
Questions with question words
- Where does the boss live? - Why do you come late?
Gerund as subjects and objects
- Smoking is dangerous. - I don’t like fishing.
Listening: − Answering questions based on recorded materials. − Dialogues about guest handling Speaking:
− Telling about one’s own daily activities. − Role playing about
guest handling
Reading:
− Answering questions about hobbies and interests Tes lisan − Dialog berpasang-an Tes tertulis − Melengkapi kalimat − Pilihan Ganda Practical English Usage Global Access to the World of Work Person to Person English for SMK (Ang-kasa)
2.2. Mencatat pesan-pesan sederhana baik dalam interaksi langsung maupun melalui alat
Berbagai bentuk dan ungkapan digunakan dengan tepat untuk membicarakan kegemaran /hobi dan minat.
Ungkapan untuk menangani tamu hotel, restoran, travel agency, dll.
diperagakan dengan benar.
Pesan (message) yang diterima lewat telepon dicatat dengan benar.
Pesan (message) yang diterima secara langsung dicatat dengan benar.
Gerund as complement: - Her job is sorting the mail.
Gerund after preposition: - Are you interested in
collecting stamps?
Constructions with ‘too’ and ‘enough’
- The soup is too salty for me.
- The hotel room is comfortable enough.
Expressions dealing with telephone conversations Grammar Review: Personal pronouns - I – me – my – mine - myself Reported speech - He said that you had to
pay for the tickets - He asked you to pay for
the tickets. - He wanted to know if
you would be available in the afternoon. - He wanted to know
where you put his umbrella. Adjective Clause
- Do you know the staff who will be promoted our new division manager? Writing: − Writing descriptions of other’s daily activities. − Writing sentences containing gerund . − Arranging sentences containing “too” and “ enough”
Listening: − Listening for information from recorded materials. − Understanding telephone conversations Speaking: − Telling the infomation obtained from recorded materials − Role playing on telephone conversations Writing: − Writing messages based on telephone conversations − Composing sentences using reported speech, personal pronouns Tes tertulis − Melengkapi kalimat − Membuat kalimat dengan reported speech − Mencatat pesan yang diterima Tes lisan − Menceritaka n pesan yang diterima Practical English Usage Global Access to the World of Work Person to Person English for SMK (Ang-kasa)
and adjective clause. 2.3. Merinci tugas pekerjaan dan latar belakang pendidikan yang dimilikinya secara lisan dan tulisan
Bentuk kata kerja digunakan dalam
Simple Present
dengan tepat untuk menerangkan tugas dan pekerjaan berbagai macam profesi.
Bentuk kata kerja digunakan dalam
Simple Past dengan
tepat untuk menerangkan latar belakang pendidikan berbagai macam profesi.
Curriculum Vitae yang sederhana ditulis dengan benar.
Berbagai ungkapan digunakan dengan tepat untuk menjelas-kan fakta dan angka (facts and figures) pada suatu sajian data.
Telling about people’s job using the Simple present tense:
- A cook prepares food. - Pilots fly aeroplanes.
Telling about people’s educational background using the Simple past tense.
- She graduated from SMKN 8 Bandung. - The new secretary
learned shorthand at the college.
Samples of curriculum vitae
Expressing facts and figures :
- The graph shows that population growth has been high this last decade.
- The latest data show that about three billion rupiahs have been spent for the construction of the factory. Listening: − Dictation − Answering dialogues given by the teacher Speaking − Explaining someone’s profession Reading − Understanding and discussing diagrams containing facts and figures Writing − Rewriting someone else’s curriculum vitae
− Writing one’s own curriculum vaitae Tes lisan − Menjelaskan profesi − Menjelaskan diagram Tes tertulis − Melengkapi kalimat/ form − Menulis curriculum vitae 20 Practical English Usage Global Access to the World of Work Person to Person English for SMK (Ang-kasa) English New Concept
2.4. Menceritakan pekerjaan di masa lalu dan rencana kerja yang akan datang Ungkapan tentang kegiatan masa lampau dikemukakan dengan benar. Ungkapan untuk mengemuka-kan kegiatan di masa datang digunakan dalam Tense yang benar.
Surat pribadi yang menceritakan tentang kehidupan masa lalu dan rencana di masa depan ditulis dengan benar.
Telling about past events - I saw the crowds were helping the accident victim.
- We had locked the room when she came.
Telling about future plans - The meeting will be over
at two PM.
- When you arrive at the office, I will be conducting a meeting.
Sample of a personal letter (telling about past and future events) Grammar review: - Relevant tenses. Listening − Answering questions of one’s past experiences. Speaking
− Telling one’s own plans (future) Reading − Reading for information: dialogues, passages Writing − Composing personal letters − Translation Tes lisan − Menceritaka n peristiwa masa lalu − Dialog Tes tertulis − Melengkapi kalimat − Membuat surat − Menerjemah kan Practic al English Usage Global Access to the World of Work Person to Person English for SMK (Ang-kasa) 2.5.
2.6. Mengungkapk an berbagai macam maksud hati Ungkapan-ungkapan untuk menyampaikan undangan digunakan dengan tepat. Ungkapan-ungkapan untuk melakukan tawar-menawar (bargaining) digunakan dengan tepat. Ungkapan-ungkapan untuk menyatakan kepastian (certainty) digunakan dengan tepat. Ungkapan-ungkapan untuk memberi dan merespon pujian digunakan dengan tepat. Ungkapan-ungkapan untuk menyatakan pendapat/opini digunakan dengan tepat. Ungkapan-ungkapan untuk menyatakan persetujuan (agreeiing-disagreeing) digunakan dengan tepat. Ungkapan-ungkapan untuk menyatakan argumentasi digunakan dengan benar. Giving invitations - Would you like to come
to my place for dinner tonight, please? - With pleasure. - I’m afraid I can’t, I’ve
already got an appointment.
Bargaining
- Is there any discount for this shirt?
- How about fifty thousand rupiahs?
Expressing certainty - I’m sure that it’s going to
rain this afternoon. - It must be him who
called.
Giving and responding to compliments
- Fantastic! - You look beautiful tonight.
- Thank you.
Expressing opinions - I think that’s not true. - What I have in my mind
is that ....
Expressing agreement/ disagreement:
You’re right.
I’m afraid you’ve got wrong information, Sir. Expressing argument
Yes, but don’t forget ...
That may be so but ...
Grammar review − Conjunctions / concessive relationship. Listening: − Answering questions based on dialogues about giving invitations, bargaining, expressing certainty, compliments, expressing opinions, agreeing/disagreeing , and arguing Speaking: − Performing dialogues based on given situations. Reading: − Answering questions based on written texts. Writing: − Writing dialogues based on given situations. Tes lisan melalui role play / dialog Tes tertulis Melengkapi dialog Menjawab pertanyaan Melengkapi kalimat Membuat dialog Practic al English Usage Global Access to the World of Work Person to Person English for SMK (Ang-kasa)
− Constructions with “used to”:
a) be/get used to + V-ing
b) used to + Verb 1 − Noun clause as object: - I never believe that there will be another Rationalization.
2.7. Memahami instruksi-instruksi sederhana Ungkapan-ungkapan untuk menggambarkan proses kerja dan atau berfungsinya suatu alat dikemukakan dengan benar.
Ungkapan-ungkapan untuk meminta dan memberi saran dan nasihat (suggestion and advice) digunakan secara tepat. Ungkapan-ungkapan untuk menyatakan keharusan dan kewajiban (necessity and obligation) digunakan dengan tepat. Ungkapan-ungkapan untuk meyakinkan dan membujuk orang lain (convincing and
persuading) agar
menerima pendapat atau usulan yang diajukan digunakan dengan tepat. Expressions used in describing processes: - First, ... - Next, ... - Then... - Finally ... Expressions used in asking for and giving suggestions and advice: - What do you
recommend for a headache? - You’d better see a
doctor.
Expressions used in asking necessity and obligation:
- We must be there before the boss comes. - It is necessary for us to
be there on time.
Expressions used in persuading and convincing:
- Why don’t you try our special drink bandrek to warm up your body. - If I were you, I would … - I’m sure you are on the
right track. - I bet you could do it.
Grammar review: − Degrees of comparison − Imperatives
- Don’t smoke at the petrol
station
- Keep silent; the baby is Sleeping
Listening − Listening for
information on how things work. − Dialogues about
asking for and giving suggestions and advice, necessity and obligations, convincing and persuading Speaking
− Telling about how things work. − Role playing how
to ask for and give suggestions and advice. − Interviewing dealing with convincing and persuading, necessity and oligations Reading − Reading for information: dialogue passages Writing − Making dialogues based on the situations provided. Tes lisan Menjelaskan proses kerja / cara meng-operasika n alat Tes tertulis Menjawab pertanyaa n Pilihan ganda Membuat dialog Practical English Usage Global Access to the World of Work Person to Person English for SMK (Ang-kasa) English New Concept
2.8. Membuat pesan-pesan pendek, petunjuk dan daftar dengan pilihan kata, ejaan dan tata tulis yang berterima
Kata-kata dipilih dengan tepat dan dirangkai menjadi pesan pendek, petunjuk atau daftar
Kesimpulan dari suatu pembicaraan ditulis dengan benar menjadi suatu pesan pendek, petunjuk, atau daftar
Samples of short messages, directory, and lists.
Content, punctuation, and spelling. Vocabulary game Rearranging words / sentences Composing short messages. Directions, or lists based on the situation given by the teacher. Tes lisan Menyamp aikan pesan secara lisan Tes tertulis Membuat pesan singkat dan atau petunjuk cara pengguna an alat secara tertulis. Practical English Usage Global Access to the World of Work Person to Person English for SMK (Ang-kasa) English New Concept Keterangan: TM : Tatapmuka
PS : Praktik di Sekolah (2 jam praktIk di sekolah setara dengan 1 jam tatap muka) PI : Praktek di Industri (4 jam praktIk di Du/Di setara dengan 1 jam tatap muka)
Appendix 8. Students’ Pretest Score
Name Grammar Vocabulary Comprehension Fluency Pronunciation Task Su m P1 0 0 1 1 0 0 2 P2 1 1 2 1 1 1 7 P3 1 1 1 0 0 0 3 P4 0 1 1 0 1 1 4 P5 0 1 1 0 1 0 3 P6 1 1 1 1 1 1 6 P7 1 2 0 1 0 1 5 P8 1 1 1 0 1 1 5 P9 1 1 2 2 1 2 9 P10 1 1 1 1 1 1 6 P11 1 1 1 1 0 1 5 P12 1 1 1 0 2 1 6 P13 1 1 0 0 1 0 3 P14 1 2 2 1 1 1 8 P15 1 1 1 0 1 1 5 P16 2 2 1 0 1 1 7 P17 2 2 2 2 1 2 11 P18 1 1 1 1 1 1 6 P19 1 2 1 1 1 1 7 P20 1 1 1 2 2 1 8 P21 1 2 2 1 2 1 9 P22 2 3 2 2 2 1 12 P23 2 3 1 1 2 1 10 P24 2 2 1 1 3 1 10 P25 1 1 2 2 1 2 9 P26 1 1 1 1 2 1 7 P27 1 1 1 3 1 2 9 P28 2 1 0 0 2 1 6 P29 1 2 1 1 1 1 7 P30 1 2 1 1 1 2 8 P31 2 2 1 1 1 1 8 P32 1 1 1 1 2 2 8
Appendix 9. Students’ Posttest Score
Name Grammar Vocabulary Comprehension Fluency Pronunciation Task Sum
p1 2 2 2 1 1 2 10 p2 2 1 2 2 1 1 9 p3 3 1 1 1 1 1 8 p4 2 1 2 2 3 2 12 p5 1 1 1 1 2 0 6 p6 1 2 3 3 3 2 14 p7 1 2 2 2 2 3 12 p8 2 3 3 1 3 1 13 p9 3 4 3 2 3 3 18 p10 3 3 2 2 3 3 16 p11 1 2 3 3 4 1 14 p12 2 2 3 2 1 1 11 p13 3 1 3 3 2 3 15 p14 4 3 2 3 4 2 18 p15 1 1 1 1 3 2 9 p16 4 4 3 4 3 2 20 p17 4 2 3 3 3 3 18 p18 3 2 3 2 2 3 15 p19 3 3 3 3 2 4 18 p20 3 3 3 2 3 2 16 p21 2 2 2 3 4 3 16 p22 3 4 3 3 3 4 20 p23 3 2 1 4 2 4 16 p24 2 4 3 3 4 3 19 p25 4 3 3 4 3 4 21 p26 3 3 4 4 4 4 22 p27 2 2 3 4 2 4 17 p28 2 4 2 3 4 2 17 p29 3 3 2 2 3 2 15 p30 3 2 2 3 3 2 15 p31 2 3 2 2 2 1 12 p32 3 2 2 2 2 1 12
Appendix 10. Effect Size for All Speaking Elements
Effect Size
=
√𝑡²√𝑡²+𝑑𝑓
Effect Size of Grammar
=
√𝑡²√𝑡²+𝑑𝑓
=
8,576² 8,576²+31=
73,548
104,548
= 0,704
Effect Size of Vocabulary
=
√𝑡² √𝑡²+𝑑𝑓=
5,750² 5,750²+31
=
33,0625
64,0625
= 0,517
Effect Size of comprehension =
√𝑡² √𝑡²+𝑑𝑓=
8,158² 8,158²+31
=
66,553
97,553
= 0,683
Effect Size of Fluency
=
√𝑡²√𝑡²+𝑑𝑓
=
9,321² 9,321²+31
=
86,882
117,882
= 0,738
Effect Size of Pronunciation =
√𝑡² √𝑡²+𝑑𝑓=
8,747² 8,747²+31
=
76,51001
107,51001
= 0,712
Effect Size of Task
=
√𝑡²√𝑡²+𝑑𝑓
=
6,682² 6,682²+31
=
44,6492