TRUONG DAI HOC DONG THAP Tap chl Khoa hoc sd 35 (12-2018) UTVG DUNG LY THUYET TRAC NGHIEM CO DIEN
TRONG PHAN TICH CAU HOI TRAC NGHIEM KHACH QUAN
• Nguyin Trung Hi^u'"', Nguyin Bich Nhu""
Tom tit
Bdi viit bdo cdo kit qud nghien cieu vd van dung Ly thuyit trac nghiem cd diin trong phdn tich cdu hoi trac nghiim khdch quan. Phuong phdp thdng ke todn hpc dupc sir dung di phdn tich mdt bo de trac nghiem khdch quan 30 cdu hdi vdi 85 bdi Idm cua sinh vien. Kit qud cho thdy ly thuyit ndy co thi dupc van dung de phdn tich cdc thdng sd cua cdu hdi trac nghiem nhu do kho, dp phdn biit, chdt lupng cua cdc phuong dn nhieu... Cdc thong sd ndy ddng vai trd quan trpng trong viec chudn hda vd ndng cao ddn chdt luang cua cdc cdu hdi thi. Viic su dung cdc cdu hoi da dupc chudn hoa giup cho hoat ddng him tra, ddnh gid kit qud hpc tap trong nhd trudng dupc chinh xdc, khdch quan vd cdng bdng han.
Tie khda Ly thuyit trac nghiem cd dien, cdu hoi trac nghiem khdch quan, ddnh gid kit qud hpc tap.
1. Dat van de chiing ta phai ed nhilu tdi lieu gidi thieu dl mdt Hudng tdi yeu eau danh gia cdng bang, khdch mat nang cao hieu biet ve phuong phap ndy cho ddi quan kit qud hgc tap eua ngudi hgc, viec da dgng ngd nha gido eiing nhu cdng ehiing, mat khde, gdp hoa cdc hinh thiic kiem tra dang duge tnen khai
rgng rai. Trong do, phai ke din la hinh thirc trie nghiem khdch quan Day Id phuong phap kilm tra, danh gid kit qud hoc tap cua ngudi hgc bing he thong eae eau hdi trie nghiem (CHTN). Tuy nhien, da so de thi trde nghiem dugc sir dung d eac trudng hien nay diu ehua duoc thir nghiem va tu chinh.
Chat luong ciia nhiing de thi nhu the van eon la mgt an so. Chinh vi vay, viec thiet ke va xay dyng nen nhiing bg de trac nghiem dgng tieu chugn hda dang trd thanh mgt yeu cau birc thiet. Cdc CHTN tieu ehuan hda duge sogn tiido, thir nghiem vd tu chinh mdt cdch chi tilt, ti mi Mdi mdt cau hdi diu phai duge phan tieh dl xem xet ede thuge tinh v l dd kho, do phdn biet ciing nhu cdc tham sd can thilt khae. Co sd khoa hge dl thuc hien nhiing phan tieh tien phdi kl den diu tien Id Ly thuyet trie nghiem co diln (Classical Test Theory). Mac dii xu the phat triln hien nay ciia khoa bgc do ludng, ddnh gid tren the gidi la thien ve cac ly thuyet do ludng hien dgi (co the kl din la ly thuyit Ung dap cau hdi - Item Response Theory); tuy nhien, d Viet Nam, cd mdt thuc te la viec tiep can eac hge thuyet do ludng danh gid ndi ehung van edn chdm hon nhieu so vdi the gidi Theo gido su Ldm Quang Thiep' Trong nha trudng, kl cd cae trudng dgi hoc su pham, ciing chua cd cac ehuong trinh dao tgo v l lmh vye nay mgt each bdi bdn... Tinh hinh ndi tren ddi hdi
'"> Trucmg Cao cang Sir pham S6c Trang
phan thuc day sy hinh thdnh ITnh vuc khoa hgc ve do ludng trong giao due d nude ta" [4].
Chinh vi vgy, de dua khoa hgc ndy timg bude phat trien trong nha trudng ndi rieng va xa hdi noi ehung, Ly thuyit trie nghiem cd diln ehinh id su lua ebon phu hgp dau tien de trien khai, bdi day la ly thuyit nen tang eiia khoa hoe do ludng, danh gia.
Dd ciing Id eo sd viing chic dl gido vien tiep can tdt bon vdi ly thuyet do ludng hien dai, bat kip xu hudng ehung cua thi gidi. Bdi vilt bdo cdo ket qua phan tich cdc CHTN cua mdt de kiem tra dya tren nen tang eua Ly thuyet trde nghiem ed dien nhdm gdp phan khdng dinh tinh khd thi vd hieu qud cua viec van dung ly thuyit nay vao trong thyc te kilm tra, danh gia d cdc trudng hien nay
2. Doi net ve Ly thuyet trac nghiem co dien Ly thuyet trac nghiem co dien (ggi tat Id CTT) cdn duge biet den vdi ten Id Ly thuyit ve diem sd thyc (true score theory), chi viec phdn tich ket qud cdc bdi kilm tra dya tren diem sd [5]. Ly thuyet CTT eho rang nang lue eua mdi thi sinh dugc xde dinh bdi mgt dilm thuc T Tuy nhien, trong thyc te, dilm thyc khdng bao gid cd thi thu duge mdt each true tiep ma ehi ed thi la mot diem quan sat X ndo dd. Vi vay, phuong trinh co bdn cua Ly thuyet CTT CO dang [1]:
X - T + E Trong dd"
X la dilm quan sat (dilm lam bai ciia thi sinh) T la dilm thuc eua thi sinh
E la sai sd , 1 1 1
TRUCiNG DAI HOC BONG T H A P Tap chi Khoa hpc so 35 (12-2018) Ly thuyet trSc nghiem co dien quan tam den
cac tham so sau day [5];
Bo kho ciia CHTN (gia tri p): duoc xac dinh bang ty so phan tram thi sinh lam dung cau hoi tren tong so thi sinh tham gia lam cau hoi do.
A' Trong dd:
p la dd khd cua cau hdi thii i n la sd tbi sinh ldm dimg cdu hdi thu i N Id tdng so thi smh tiiam gia Idm cau hdi tiiii i Theo Osteriind (1989), dd khd cua cdu hdi nen nim trong khodng tii 0,4 den 0,8 [3]. Cdu hdi ed do khd Idn hon 0,8 la qua dl; cd do khd nhd hon 0,4 Id qua kho
D I tinh do khd trung binh {pj eiia mdt cau hdi can phdi can cir sd phuong an trd ldi ciia cau hdi do. Ve ly thuyit, dd khd trung binh ciia mgt cau hdi cd k phuong dn ehgn la: [4]
1
P* '- (2)
Trong dd:
P,j^ Id do khd trung binh eua eau hdi k la so phuong dn tid ldi cd trong eau hdi Ngodi ra, gia tri p edn giiip ehi ra mgt so ldi eua eau bdi nhu: nham dap an, Idi do dimg tir, ngii phap lam thi sinh khdng hiiu hogc hilu nhim...
Khi dd, gia tri p se cd su bat thudng (ed the la dat qua cao d phuong dn nhieu va qud thap d phuong an dung ..).
Do phan biet cua CHTN (gia tri D): la kha nang cua CHTN thuc hien duoc sy phan biet nhdm tbi sinh thanh cdc nhdm ndng lue khdc nhau (nhu gidi, trung binh, kem.,.). Theo Ldm Quang Thiep (2008) [4], dl tinh dd phan biet, ngudi ta dya vdo Bang 1. Tong hop Ad khd
tdng dilm thd cua timg tiii sinh de taeh nhdm tiii sinh tiidnh 2 nhdm. mgt nhdm gidi (gom 27% thi sinh dat diem cao tir tren xuong) vd mgt nhdm kem (gdm 27% titi sinh dat dilm tiiap tir dudi len). Khi do, bilu thire tinh do phdn biet eua mdt CHTN duge Viet nhu sau.
D , - - ^ ^ ^ (3) S Trong dd:
D la do phdn bi^t ciia cau hdi thir i C la sd thi sinh ldm diing eau hdi thir i tiiugc nhdm gidi
T la so thi sinh ldm dimg eau hdi thir i thudc nhdm kem
S la sd luong thi sinh eua mdt trong hai nhom (27% tong so)
Ebel (1965) cho rdng cdc eau hdi eua bdi thi nen ed do phan bigt Idn hon hoac bdng 0,3 [2].
Ben egnh do khd va do phan biet cua CHTN, ly thuyit CTT edn quan tam den 2 dai lugng khdc Id dd tin cay va dd gid tri ciia d l trac nghiem. Ti^
nhien, bdi viet ndy ehi ban sau v l cae dai lugng gan liln vdi CHTN la dd khd va dg phan biet eua CHTN. ^
3. iTng dung Ly thuyet trie nghiem co dien trong phan tich CHTN
Dii heu duoe dung d l phan tich la 30 CHTN (4 phuong an lua ehgn) tirong bdi kilm tra mon Dgi sd tuyIn tinh do 85 sinh vien d 3 Idp Todn - Ly, Tin - Ly, Tin hge Khdg 16 cua Trudng Cao ddng Su pham Sdc Trdng thyc hien. Dii heu duge n h ^ vao ehuong trinh bdng tinh Excell vd kiem tra hai Ian dl dam bao do chirtii xac.
3.1. Ket qua phan tich do kho Dd khd (p) eua timg CHTN trong bai kilm tia nay dugc tinh todn theo cdng thiic (1), Ket qud ehi tilt duge trinh bay trong Bdng I.
cua 30 cdu boi trie nghiem CHTN
P CHTN
P CHTN
P Cau 6
0,91 Cau 13
0,78 Cau 29
0,62 Cau 26
0,91 Cau 28
0,76 Cau 20
0,60 Cau 27
0,89 Cau 5
0,72 Cau 15
0,53 Cau 22
0,88 C i u 8
0,72 Cau 24
0,47 C a u l
0,87 Cau 11
0,72 Cau 21
0,42 Cau 19
0,87 Cau 30
0,71 Cau 10
0,39 Cau 14
0,86 Cau 7
0,69 Cau 23
0,36 Cau 25
0.86 Cau 3
0,66 Cau 2
0,35 Cau 4
0,85 Cau 12
0,65 Cau 17
0,34 Cau 9
0,78 Cau 18
0,65 Cau 16
0,33
TRUCJNG DAI HOC DONG THAP Tap chl Khoa hoc sd 35 (12-2018) Bang 1 eho thay dg khd cua ede CHTN (dugc
s ^ xep theo thir tu tir Idn din be) trong bdi kilm tra nay nam trong khodng tir 0,33 din 0,91, hong dd:
p<0,4 cd 5 eau gdm: cau 16, 17, 2, 23 va cau 10, chiem 17%. Day Id cdc cdu hdi khd so vdi nang lyc cua smh vien. Khd nhit la eau 16, chi cd 33%
sinh vien trd ldi diing. Cdc cau nay vuot ra ngoai dp khd gidi han theo khuyin nghi eua Osteriind (1989) [3] nen niu cd the, can dugc dilu ehinh lgi eho phii hop. Tuy nhien, cin luu y la bat ky de kilm tra nao ciing phai ddm bao so luong cdc cau hoi kho theo quy djrtii de danh gia duge sinh vien a miic nang lyc eao.
0,4 < p < 0,8 ed 16 eau, ehiem phin Idn (53%) cac cau hdi trong de kilm tra nay. Dd Id eae eau 9, 13,28, 5, 8, 11, 30, 7, 3,12,18,29, 20,15,24, 21.
Theo Osteriind (1989) [3], day Id nhiing eau hdi codg kho phii hgp.
p>0,8 cd 9 cdu ehiem 30% cae cau hoi trong de kiem tia Do Id cae eau 6, 26, 27, 22, 1, 19,14, 25, 4. Day la eac cdu hdi de so vdi ndng lue cua sinh vien. Dac biet Id eau 6 vd 26 cd tren 90% sinh vien tia ldi dimg, D I tiii cin co cdu hdi de de danh gia ndng lyc ciia nhiing sinh vien yeu rtiiung khdng nen eo qua nhieu nhu de kiem tra ndy. Vi vay, cae cau hdi nay cin duge thilt k l lai eho phu hgp.
Bang 2. Tong hop cac gia tri chSnh lech giira
Them vao do, do khd trung binh (p^) cua ede CHTN (4 phuong an) trong de kilm tra nay ciing dugc tinh todn theo cdng thire (2):
P,* =
1 0 0 % + - 100%-
k - = 0,625 ~ 0,63 Doi chieu vdi cac kit qua tinh todn ve dg khd d Bdng 1, ta thiy, de kiem tra nay ed din 2/3 sd eau (66,7%) cd do khd Idn hon do khd tnmg binh vacbied 1/3 sd eau (33,3%) cd dp khd nhd hon do khd tnmg binh. Nhu vay, nhin ehung, cd thi ndi de kilm tra ndy ed nhieu eau de so vdi nang lyc cua sinh vien
3.2. Ket qua phan tich do phan biet Viec tinh todn do phdn biet eiia timg CHTN dugc tiln hanh theo trinh tu eae bude nhu Lam Quang Thiep (2008) [4] da de xuit Diu tien, ta can dya tren tdng diem bai lam eiia sinh vien de tdch thanh 2 nhdm. So lugng mdi rtiiom Id 23 sinh vien (27% trong tong sd 85 sinh vien). Sau khi sdp xep lai du lieu bai lam tiieo 2 nhdm, ta bit diu tinh toan cdc gid tn chenh leeh giua 2 nhom d timg phuong an theo cong thiic (3) Khi dd, do phan biet (D) ehinh la kit qua su chenh leeh giira hai nhdm ngay tai phuong dn dimg. Kit qua ehi tilt dugc trinh bdy trong Bang 2.
nhom tren vd nhom dir^ rf timg phuffug dn
Dap an Chenh lech ty le 6 phuong an A Chenh lech ty le d phucmg an B Chenh lech ty le d phuong an C Chenh lech ty le 6 phuong an D
Dap an Chenh lech ty le <^
phuong an A Chenh lech ty le 4 phuong an B
C a u l B 0,00
0,13
-0,13
0,00
Can 11 A 0,65
.0,30 Can 2
D -0,35
-0,04
-0,09
0,48 Cau 12 A 0,65
0,00 C i u 3
B -0,26
0,70
-0,22
-0,22 Cau 13 D -0,22
-0,13 Cau 4
D -0,09
0,00
-0,09
0,17 Cau 14 B -0,09
0,17 Cau 5
D -0.04
-0,17
-0,22
0,43 Cau 15 A 0,74
-0,30 Can 6
B 0,00
0.13
-0,13
0,00 Cau 16 B 0,00
0,35 Cau 7
B -0,17
0,57
-0,22
-0,17 Cau 17 B -0,26
0,43 Cau 8
A 0,43
-0,17
-0,17
-0,09 Cau 18 B -0,17
0,48 c a n 9
B -0,13
0.30
-0,13
-0,04 C4u 19 A 0,43
-0,22 CSulO
B -0,13
0,57
-0.30
-0,09
Can 20 C -0,04
0,04
1 1 3
TRUONG DAI HOC DONG THAP Tap chi Khoa hocso 35 (12-2018) Chenh lech ty le d
phuong an C Chenh lech ty le o phuong an D
Dap an Chenh lech ly le 0 phuong an A Chenh lech ly le dr phuong an B ChSnh lech t^ le d phuong an C Chenh lech ty le d phuong an D
-0,26
-0,09 Can 21 C -0,39
0,00
0,48
-0,09 -0,13
-0,52
can
22 B -0,13
0,22
0,00
-0,09 -0,22
0,57 Cau 23 A 0,65
-0,35
-0,17
-0,13 -0,04
-0,04 Can 24
C -0,09
-0,30
0,70
-0,30 -0,30
-0,13 CSu 25 C -0,26
-0,13
0,52
-0.13 -0,13
4),22 Can 26 A 0,09
-0,04
0.00
-0,04 -0,04
-0,13 Can 27 B -0,04
0,30
-0,17
-0,09 -0,13
-0,17 Cau 28 B -0,17
0,48
-0,04
-0.26 -0.13
-0,09 CSu 29 B -0,17
0,39
-0,13
-0,09 0,09
-0,09 Cau
30 C 0,00
-0,17
0,35
-0,17 Bang 3. Tong hop do phan biet ciia cau hoi
Dap an Bo phan biet
Dap an fid phan biet
Dap an Do phan biet
C S n l B 0,13 Cau 11
A 0,65 Cau 21 C 0,48
C i u 2 D 0,48 Can 12 A 0,65 Cau 22 B 0.22
Cau 3 B 0,70 CSu 13 D 0,57 Cau 23 A 0,65
Cau 4 D 0,17 Cau 14 B 0,17 Can 24 C 0,70
Cau 5 D 0,43 Cau 15 A 0.74 Cau 25
C 0,52
Cau 6 B 0,13 Cau 16 B 0,35 Cau 26 A 0,09
Cau 7 B 0,57 Cau 17 B 0,43 CSu 27 B 0,30
Can 8 A 0,43 Cau 18 B 0,48 Can 28
B 0,48
Can 9 B 0,30 Cau 19 A 0,43 C i u 29 B 0,39
Cau 10 B 0,57 Cau 20 C 0,09 Ciu 30 C 0,35 Theo Bang 3, ta thiy hau bet cae cdu trong
de kiem tra nay deu dgt do phan biet tdt (> 0,3).
Tuy nhien, vdn edn 7 eau (chilm 23%) cd do phan biet thap. Do la cdu 1, eau 4, cau 6, cdu 14, cau 20, eau 22, cau 26. Nhung eau nay can phdi duae dilu chinh de dat dd phan biet tot hon.
3.3. Cac k i t qua phan tich khac Kha nang nham dap an: Nhu da ndi, viec
Bang 4. Ti le lua chon cac phuvog
nham lan ed till de dang bi phdt hien khi xem xet gia tri p. ed su khac biet Idn giua phuong dn dung (p thudng nhd hon rit nhieu) so vdi cdc phuong dn cdn Igi Bang 4 eho thay, cac cau hdi trong de kilm tra ndy khdng ed dau hieu ciia viec nhim dap an. Cac phuong an dimg deu cd ti le smh vien ehgn cao hon cdc phuong an nhieu.
an ciia tung cau boi trie nghiem Ty le chon
A B
C a u l 0,05 0,87
Can 2 0,24 0,18
Cau 3 0,13 0,66
cau 4
0,06 0,05
Can 5 0,08 0,09
Cau 6 0,01 0,91
Cau 7 0,11 0,69
C i u 8 0,72 0,08
Can 9 0,08 0,78
Can 10 0,18 0,39
TRUCfNG DAI H O C D O N G T H A I Tap chf Khoa hoc SO 3 5 ( 1 2 - 2 0 1 8 )
C D Do kho p Ty 16 chon
A B C D Do kho p Ty le chon
A B C D D § k h 6 p
0,06 0,02 0,87 Can 11 0.72 0,08 0,12 0,08 0.72 Can 21
0,21 0,18 0,42 0,19 0,42
0,24 0,35 0,35 Can 12 0,65 0,04 0,05 0,27 0,65 Can 22
0,04 0,88 0,06 0,02 0,88
0,09 0,12 0.66 Cau 13 0,07 0,06 0,09 0,78 0,78 C i u 23
0,36 0,24 0,16 0,24 0,36
0,05 0,85 0,85 Cau 14 0,05 0,86 0,05 0,05 0,86 Can 24
0,14 0,11 0,47 0,27 0,47
0,11 0,72 0,72 Cau 15 0,53 0,14 0.18 0,15 0,53 Cau 25
0,07 0,04 0,86 0,04 0,86
0.07 0.01 0,91 Cau 16 0,21 0,33 0,25 0,21 0.33 Can 26
0.91 0.05 0,02 0,02 0,91
0,08 0,12 0,69 CSu 17 0,24 0,34 0,22 0,20 0,34 Cau 27
0,04 0,89 0,05 0,02 0,89
0,09 0,11 0,72 Can 18 0,13 0,65 0,09 0,13 0,65 Cau 28
0,07 0,76 0,06 0,11 0,76
0,08 0,06 0,78 Cau 19 0,87 0,07 0,04 0,02 0,87 Can 29
0,11 0,62 0,11 0,16 0,62
0,24 0,19 0,39 CSu 20 0,16 0,14 0,60 0,09 0,60 Cau 30
0,11 0,07 0,71 0,12 0,71 Bang 5. fie xuat viec dieu chinh
mdt si phuong an nhieu Ty le chon
A B C D fiap io Pkirffng dn
nhieu can dieu cliinh
Can 6 0,01 0.91 0,07 0,01 B A,D
Cau 12 0,65 0,04 0,05 0,27 A D
Can 20 0,16 0.14 0,6 0,09
C D
CSai 23 0,36 0,24 0,16 0,24 A C
Can 24 0,14 0,11 0,47 0,27 C
A,B
Chit lugng eua eac phuong an nhieu* Chat lugng phuong an nhieu duoc xem la ly tudng khi ti le sinh vien lua chon ehiing tuong doi dong deu Cae phuong an bi bd qua bode ehi cd mdt sd it lua chon chiing td dd la nhung phuong an sai qua Id lilu. Nhu vay, neu cdc phuong an nhilu CO ti le lya chon qua chenh leeh tbi can xem xet vathilt kelgi chimg. Bang 4 eho thiy: Trong de kiem trg nay cd nhieu eau dat yeu ciu ve phucmg an nhieu Ti le sinh vien lya chon chung kha dong diu. Diln hinh Id cau 1 (0,05: 0,06 0,02), cdu 3
(0,13 . 0,09 : 0,12), cdu 15 (0,14 • 0,18 : 0,15), Ngoai ra cdn cd cdu 7, 8, 9, 11, 13,.. Tuy nhien, de kiem tra ndy van edn mdt so cau can dugc dieu chinh d phuong an nhieu chang han nhu cau 6, 12, 20, 23, 24 (Bang 5),
4. Ket luan
Tdm lai, tren co sd viing chae eua Ly thuyit trie nghiem ed diln, bdi viet da tien hanh eac budc thyc nghiem de phan tieh thuge tinh ciia cac CHTN CO trong mgt de kiem tra Kit qud da danh gia duoc cac thdng sd ve do khd, dp phdn biet ciing nhu eae van dl lien quan din CHTN nhu chat lugng eae phuong an nhieu, kha nang nham ddp an Bdi viet mdt lin niia khing djnh tinh khd thi va hieu qua eua viec van dyng Iy thuyit trde nghiem ed diln vao trong thuc te kilm tra, ddnh gia d ede trudng.
Thdng qua kit qua cd duoc tir viec phan tich, gido vien, nha qudn ly cd thi dua ra nhimg kien nghi ehinh xae, tin cay nham gdp phan ndng eao chat lugng cau hdi thi Nhin xa hon, viee sii dung nhiing de thi vdi eac cau hoi da duoc tu chinh, chuan hda se danh gia duge ehinh xae nang lyc thyc sy cua ngudi hoc, tir do gdp phan nang eao chat lugng
gido due cua nha trudng./, i 1 1 5
T R U C N G S A I H O C DONG T H A P Tap chi Khoa hoc s o 35^12-2018) Tai lieu tham khao
[1]. Robert L Brennan (2011), "Generalizability Theory and Classical Test Theory", Applied Measurement in Education, 24: 1-21
[2]. Ebel, R. L. (1965), Measuring Educational Achievement, Englewood Cliffs: Prentice - Hall [3]. Osteriind, S L (1989), Constructing test items, Boston: Kluwer Academic.
[4]. Lam Quang Thiep (2008), Trac nghiem vd img dung, NXB Khoa hgc va Ky thuat. Ha Ngi [5]. Margaret Wu, Hak Ping Tam, Tsung-Hau Jen (2016), Educational Measurement for Applied Researchers: Theory into Practice, Springer Nature Singapore Pte Ltd.
USING CLASSICAL TEST THEORY TO ANALYZE MULTIPLE - CHOICE QUESTIONS
Summary
The article reports the result of using Classical Test Theory to analyze multiple - choice questions.
The statistical method was used to examine an already-used test of 30 items with 85 student responses The findings indicate that Classical Test Theory can be used to analyze test item parameters such as item difficulty, item discrimination, and distractor quality. These test item parameters play an important role in standardizing and enhancing the quality of multiple - choice questions. Standardized tests ensure the accuracy, objectiveness and faimess in assessing student leaming outcomes.
Keywords' Classical Test Theory, multiple-choice questions, assessing student leaming outcomes.
Ngdy nhdn bdi: 21/11/2017, Ngdy nhgn lgi 28/3/2018; Ngdy duyet ddng: 03/12/2018.
1 1 6