IMPLEMENTASI DAN PENGUJIAN
4.3 Pengujian Sistem
Untuk melakukan pemeriksaan pada sistem yang telah dibangun, maka dilakukan pengujian sistem untuk mengetahui apakah sistem telah berfungsi dengan baik sesuai dengan yang diharapkan. Data yang digunakan merupakan dataset review film yang dijelaskan pada bagian sebelumnya. Data review tersebut kemudian dipecah menjadi data per kalimat agar dapat diseleksi berdasarkan fitur yang dihasilkan. Kalimat yang dihasilkan kemudian diberi label secara manual berdasarkan isi pada kalimat tersebut.
Pemecahan data menghasilkan 24.482 kalimat dari 2.000 review. Berikut beberapa sampel data yang diambil dan disajikan pada tabel 4.1.
Tabel 4.1. Sampel Data yang Digunakan
No. Review Label
1 Once again Mr. Costner has dragged out a movie for far longer than necessary. Aside from the terrific sea rescue sequences, of which there are very few I just did not care about any of the characters. Most of us have ghosts in the closet, and Costner's character are realized early on, and then forgotten until much
Positif
36
Tabel 4.1. Sampel Data yang Digunakan (lanjutan)
No. Review Label
later, by which time I did not care. The character we should really care about is a very cocky, overconfident Ashton Kutcher.
The problem is he comes off as kid who thinks he's better thananyone else around him and shows no signs of a cluttered closet. His only obstacle appears to be winning over Costner.
Finally when we are well past the half way point of this stinker, Costner tells us all about Kutcher's ghosts. We are told why Kutcher is driven to be the best with no prior inkling or
foreshadowing. No magic here, it was all I could do to keep from turning it off an hour in.
Hasil Pemecahan Review menjadi Kalimat Once again Mr. Costner has dragged out a movie for far longer than necessary.
Negatif
Aside from the terrific sea rescue sequences, of which there are very few I just did not care about any of the characters.
Positif
Most of us have ghosts in the closet, and Costner's character are realized early on, and then forgotten until much later, by which time I did not care.
Negatif
The character we should really care about is a very cocky, overconfident Ashton Kutcher.
Positif
The problem is he comes off as kid who thinks he's better than anyone else around him and shows no signs of a cluttered closet.
Negatif
His only obstacle appears to be winning over Costner. Positif Finally when we are well past the half way point of this stinker,
Costner tells us all about Kutcher's ghosts.
Negatif
We are told why Kutcher is driven to be the best with no prior inkling or foreshadowing.
Positif
No magic here, it was all I could do to keep from turning it off an hour in.
Negatif
Tabel 4.1. Sampel Data yang Digunakan (lanjutan)
No. Review Label
2 This is an example of why the majority of action films are the same. Generic and boring, there's really nothing worth watching here. A complete waste of the then barely-tapped talents of Ice-T and Ice Cube, who've each proven many times over that they are capable of acting, and acting well. Don't bother with this one, go see New Jack City, Ricochet or watch New York Undercover for Ice-T, or Boyz n the Hood, Higher Learning or Friday for Ice Cube and see the real deal. Ice-T's horribly cliched dialogue alone makes this film grate at the teeth, and I'm still wondering what the heck Bill Paxton was doing in this film? And why the heck does he always play the exact same character? From Aliens onward, every film I've seen with Bill Paxton has him playing the exact same irritating character, and at least in Aliens his character died, which made it somewhat gratifying... Overall, this is second-rate action trash. There are countless better films to see, and if you really want to see this one, watch Judgement Night, which is practically a carbon copy but has better acting and a better script. The only thing that made this at all worth watching was a decent hand on the camera - the cinematography was almost refreshing, which comes close to making up for the horrible film itself - but not quite. 4/10.
Negatif
Hasil Pemecahan Review menjadi Kalimat This is an example of why the majority of action films are the same.
Netral
Generic and boring, there's really nothing worth watching here. Negatif A complete waste of the then barely-tapped talents of Ice-T and
Ice Cube, who've each proven many times over that they are capable of acting, and acting well.
Positif
38
Tabel 4.1. Sampel Data yang Digunakan (lanjutan)
No. Review Label
Don't bother with this one, go see New Jack City, Ricochet or watch New York Undercover for Ice-T, or Boyz n the Hood, Higher Learning or Friday for Ice Cube and see the real deal.
Positif
Ice-T's horribly cliched dialogue alone makes this film grate at the teeth, and I'm still wondering what the heck Bill Paxton was doing in this film?
Negatif
And why the heck does he always play the exact same character? Positif From Aliens onward, every film I've seen with Bill Paxton has
him playing the exact same irritating character, and at least in Aliens his character died, which made it somewhat gratifying.
Negatif
Overall, this is second-rate action trash. Netral There are countless better films to see, and if you really want to
see this one, watch Judgement Night, which is practically a carbon copy but has better acting and a better script.
Positif
The only thing that made this at all worth watching was a decent hand on the camera - the cinematography was almost refreshing, which comes close to making up for the horrible film itself - but not quite.
Positif
4/10. Netral
3 First of all I hate those moronic rappers, who could'nt act if they had a gun pressed against their foreheads. All they do is curse and shoot each other and acting like cliché'e version of gangsters. The movie doesn't take more than five minutes to explain what is going on before we're already at the warehouse There is not a single sympathetic character in this movie, except for the homeless guy, who is also the only one with half a brain.
Bill Paxton and William Sadler are both hill billies and Sadlers character is just as much a villain as the gangsters. I did'nt like
Negatif
Tabel 4.1. Sampel Data yang Digunakan (lanjutan)
No. Review Label
him right from the start. The movie is filled with pointless violence and Walter Hills specialty: people falling through windows with glass flying everywhere. There is pretty much no plot and it is a big problem when you root for no-one. Everybody dies, except from Paxton and the homeless guy and everybody get what they deserve. The only two black people that can act is the homeless guy and the junkie but they're actors by profession, not annoying ugly brain dead rappers. Stay away from this crap and watch 48 hours 1 and 2 instead. At lest they have characters you care about, a sense of humor and nothing but real actors in the cast.
Hasil Pemecahan Review menjadi Kalimat First of all I hate those moronic rappers, who could'nt act if they had a gun pressed against their foreheads.
Negatif
All they do is curse and shoot each other and acting like cliché'e version of gangsters.
Negatif
The movie doesn't take more than five minutes to explain what is going on before we're already at the warehouse There is not a single sympathetic character in this movie, except for the homeless guy, who is also the only one with half a brain.
Negatif
Bill Paxton and William Sadler are both hill billies and Sadlers character is just as much a villain as the gangsters.
Negatif
I did'nt like him right from the start. Positif
The movie is filled with pointless violence and Walter Hills specialty: people falling through windows with glass flying everywhere.
Negatif
There is pretty much no plot and it is a big problem when you root for no-one.
Negatif
Everybody dies, except from Paxton and the homeless guy and everybody get what they deserve.
Netral
40
Tabel 4.1. Sampel Data yang Digunakan (lanjutan)
No. Review Label
The only two black people that can act is the homeless guy and the junkie but they're actors by profession, not annoying ugly brain dead rappers.
Negatif
Stay away from this crap and watch 48 hours 1 and 2 instead. Negatif At lest they have characters you care about, a sense of humor and
nothing but real actors in the cast.
Positif
4 Cage plays a drunk and gets high critically praise. Elizabeth Shue Actually has to do a love seen with the most unattractive and overrated piece of dung flesh in Hollywood. I literally vomited while watching this film. Of course I had the flu, but that does not mean this film did not contribute to the vomit in the kamode. Why can't Nick Cage play something he can really pull off like a bad actor. Nick Cage who be brilliant in a role as a bad actor. Heck nobody could do it better. The search begins for Nick's contract with Lucifer or was it Lou Cipher from "Night Train To Terror".
Negatif
Hasil Pemecahan Review menjadi Kalimat
Cage plays a drunk and gets high critically praise. Positif Elizabeth Shue Actually has to do a love seen with the most
unattractive and overrated piece of dung flesh in Hollywood.
Positif
I literally vomited while watching this film. Netral Of course I had the flu, but that does not mean this film did not
contribute to the vomit in the kamode.
Negatif
Why can't Nick Cage play something he can really pull off like a bad actor.
Negatif
Nick Cage who be brilliant in a role as a bad actor. Positif
Heck nobody could do it better. Positif
The search begins for Nick's contract with Lucifer or was it Lou Cipher from "Night Train To Terror".
Negatif
Tabel 4.1. Sampel Data yang Digunakan (lanjutan)
No. Review Label
5 A big disappointment for what was touted as an incredible film.
Incredibly bad. Very pretentious. It would be nice if just once someone would create a high profile role for a young woman that was not a prostitute. We don't really learn anything about this character, except that he seems to be a hopeless alcoholic. We don't know why. Nicholas Cage turns in an excellent
performance as usual, but I feel that this role and this script let him down. And how, after not being able to perform for the whole film, can he have an erection on his deathbed? Really terrible and I felt like I needed a bath.
Negatif
Hasil Pemecahan Review menjadi Kalimat
A big disappointment for what was touted as an incredible film. Negatif
Incredibly bad. Negatif
Very pretentious. Netral
It would be nice if just once someone would create a high profile role for a young woman that was not a prostitute.
Positif
We don't really learn anything about this character, except that he seems to be a hopeless alcoholic.
Negatif
We don't know why. Netral
Nicholas Cage turns in an excellent performance as usual, but I feel that this role and this script let him down.
Positif
And how, after not being able to perform for the whole film, can he have an erection on his deathbed?
Netral
Really terrible and I felt like I needed a bath. Negatif Dapat dilihat pada tabel 4.1 data review terdiri dari beberapa kalimat yang memiliki sentimen yang berbeda-beda sehingga perlu pemecahan agar dapat mengindentifikasi keseluruhan isi pada review. Pemecahan data yang dihasilkan juga memiliki kalimat yang tidak diperlukan untuk analisis sentimen, maka diperlukan ektraksi fitur untuk identifikasi data berdasarkan topik pada sentimen.
42
4.3.1 Selecting Candidate
Selecting Candidate merupakan proses untuk memilih kata-kata yang akan menjadi fitur. Proses ini diperlukan untuk menghindarkan kata-kata seperti kata sifat, kata kerja dan lain-lain ikut diproses pada ekstraksi fitur. Fitur merupakan kata benda sehingga pada tahap selecting candidate hanya menyeleksi kata benda sebagai calon fitur. Hasil ekstraksi fitur menggunakan tahap selecting candidate dan tidak menggunakan tahap selecting candidate dapat dilihat pada tabel 4.2 dan 4.3 berikut.
Tabel 4.2. Hasil Ekstraksi Fitur menggunakan Tahap Selecting Candidate No. TF-IDF TextRank K-Means
1 movie film Man
2 film movie Way
3 time time (random)
4 character character Film
5 story story Movie
6 scene scene Title
7 people people Scene
8 way way Need
9 thing thing Film
10 life life Money
11 plot year Minute
12 actor actor Action
13 year plot Half
14 watch something Girl
15 something man Face
16 end show Year
17 director part Film
18 part director Story
19 show woman Plot
20 man work Thing
… … … …
Tabel 4.3. Hasil Ekstraksi Fitur Tidak Menggunakan Tahap Selecting Candidate No. TF-IDF TextRank K-Means
1 movie film Film
2 film movie Way
3 one one Like
4 like like Film
5 time even Good
6 character time Movie
7 get character Title
8 even get Scene
9 good story See
10 story would One
11 scene scene Need
12 make see Film
13 see really Budget
14 would make Money
15 really also (random)
16 well good Get
17 bad much Really
18 much well Man
19 people people Make
20 also thing Like
… … … …
4.3.2 Ektraksi Fitur
Ektraksi fitur adalah proses yang diterapkan untuk mendapatkan topik yang terdapat pada data nantinya. Sebelum memasuki proses ektraksi fitur, data harus melewati tahapan text-preprocessing berupa tokenizing, case folding, stopwords removal dan stemming serta tahapan selecting candidate. Metode ektraksi fitur yang digunakan, yaitu TF-IDF, TextRank dan K-Means. Dataset yang akan diproses sebanyak 24.482
44
kalimat. Adapun hasil pengujian metode ektraksi fitur dari masing-masing metode adalah sebagai berikut.
4.3.1.1 TF-IDF
Ektraksi fitur menggunakan TF-IDF menghasilkan 12.696 fitur yang diurutkan berdasarkan hasil perhitungan nilai IDF (Inverse Document Frekuensi) dari setiap fitur tersebut. Hasil dari TF-IDF dapat dilihat pada tabel 4.4 berikut.
Tabel 4.4. Hasil Ekstraksi Fitur TF-IDF
No. Fitur Nilai IDF No. Fitur Nilai IDF
1 movie 2.840084 6348 varies 10.007121
2 film 2.950946 6349 vargas 10.007121
3 time 4.055611 6350 vanity 10.007121
4 character 4.194983 6351 buyer 10.007121
5 story 4.259854 6352 vanish 10.007121
6 scene 4.325812 6353 vanilla 10.007121
7 people 4.583641 6354 byrne 10.007121
… … … …
6342 burk 10.007121 12691 insightful 10.412587 6343 burlesque 10.007121 12692 insider 10.412587 6344 burner 10.007121 12693 insecurity 10.412587 6345 burning 10.007121 12694 insecure 10.412587 6346 bury 10.007121 12695 instability 10.412587
6347 astley 10.007121 12696 ýs 10.412587
Fitur yang telah didapat kemudian masuk ke tahap similarity word untuk pengecekan kata bermakna sama atau kata bersinonim. Urutan 17 fitur teratas dianggap sebagai hasil dari ekstraksi fitur TF-IDF karena pada urutan 18 ke bawah sudah tidak mengandung kata-kata yang berhubungan dengan film. Hasil ekstraksi fitur TF-IDF dan similarity word dapat dilihat pada tabel 4.5 berikut.
Tabel 4.5. Hasil Ekstraksi Fitur TF-IDF dan Similarity Word
No. Fitur
1 movie, film, picture, pic, flick 2 time, clip, meter, sentence, clock
3 character, quality, role, part, persona, type, case, reference 4 story, narrative, narration, tale, floor, level, history, account, chr
onicle, report
5 scene, view, aspect, prospect, shot, fit, setting, scenery 6 people, multitude, mass
7 way, manner, mode, style, fashion, agency, direction, path, roo m
8 thing, matter, affair
9 life, living, animation, lifetime, lifespan, spirit, biography 10 plot, game, patch
11 actor, player, doer, worker 12 year, yr, class
13 watch, lookout, scout, observe, follow, see, catch, determine, ch eck, learn
14 something
15 end, terminal, goal, destruction, death, conclusion, close, closin g, remainder, stop, finish, cease
16 director, manager
17 show, display, appearance, demo, exhibit, present, demonstrate, prove, evidence, depict, express, evince, indicate, point, read, r egister, record
Bukan Fitur
18 man, human, gentleman, piece, world, humanity, humankind, m ankind
19 work, employment, study, workplace, oeuvre, act, function, ope rate, go, run, process, exercise, make, bring, play, crop, influenc e, shape, form, mold, mould, forge, exploit, solve, lick, turn 20 day, daytime, daylight
21 woman
22 performance, execution, operation
46
Tabel 4.5. Hasil Ekstraksi Fitur TF-IDF dan Similarity Word (lanjutan)
No. Fitur
23 lot, batch, deal, flock, heap, mess, mint, mountain, peck, pile, pl enty, pot, raft, sight, slew, spate, set, circle, band, fortune, desti ny, fate, luck, portion, draw, bunch, distribute, administer, allot 24 guy, cat, hombre, ridicule, rib
25 look, expression, face, tone, feel, feeling, flavor, flavour, smell, seem, search, front, attend, expect, wait, count, bet, reckon
… …
9339 insider 9340 insecurity 9341 insecure 9342 ýs
Kalimat kemudian diseleksi berdasarkan fitur yang dihasilkan, sehingga kalimat yang terseleksi tidak akan diproses. Kalimat yang telah diseleksi kemudian akan menjadi input untuk analisis sentimen. Hasil penyeleksian dapat dilihat pada tabel 4.6.
Tabel 4.6. Hasil penyeleksian berdasarkan fitur TFIDF
No. Fitur Jumlah kalimat
1 movie, film, picture, pic, flick 8.110
2 time, clip, meter, sentence, clock 1.370 3 character, quality, role, part, persona, type, case,
reference
2.660
4 story, narrative, narration, tale, floor, level, history, account, chronicle, report
9 life, living, animation, lifetime, lifespan, spirit, biography
634
Tabel 4.6. Hasil penyeleksian berdasarkan fitur TFIDF (lanjutan)
No. Fitur Jumlah kalimat
10 plot, game, patch 784
11 actor, player, doer, worker 642
12 year, yr, class 805
13 watch, lookout, scout, observe, follow, see, catch, determine, check, learn
3.567
14 something 410
15 end, terminal, goal, destruction, death, conclusion, close, closing, remainder, stop, finish, cease
2.531
16 director, manager 386
17 show, display, appearance, demo, exhibit, present, demonstrate, prove, evidence, depict, express, evince, indicate, point, read, register, record
2.238
Total 32.291
Total kalimat dari 17 fitur sebanyak 32.291, hal itu disebabkan oleh kalimat yang memiliki lebih dari satu fitur. Kalimat yang tidak terseleksi ke dalam 17 fitur yang dihasilkan dapat dilihat pada tabel 4.7 berikut.
Tabel 4.7. Kalimat yang tidak terseleksi fitur TFIDF
No. Kalimat