• Tidak ada hasil yang ditemukan

Applicaition : The EEG study on neural responses of human during watching movie

N/A
N/A
Protected

Academic year: 2023

Membagikan "Applicaition : The EEG study on neural responses of human during watching movie"

Copied!
76
0
0

Teks penuh

Of these, neurocinematics is the applied field of research of a manual brain-computer interface that attempts to understand the changes in the viewer's cognitive or emotional state while watching a movie. As a result, throughout the running time of the film, researchers noticed that there were parts where a significant correlation between the subjects' band strength increased.

PUBLICATIONS

CONTENTS Table of Contents

47 Figure 19 An illustration of the temporal changes in the intersubject correlations of low beta.

LIST OF TABLES

Introduction

  • Measuring brain activity for Brain-computer interfaces
  • Brain computer interfaces for non-medical uses
  • Neurocinematics : An application of passive BCI
  • Research Objectives
  • Thesis Organization

There was a clear correlation between neural activity in response to certain scenes and the extent to which those scenes were encoded in viewers' memories (Hasson et al., 2008a). A study that measured electrical brain activity via EEG estimated the concentration levels of viewers watching movie trailers (Wang, Huang, & Tsai, et al., 2014).

Figure 1 Overview of BCI measurement methods.
Figure 1 Overview of BCI measurement methods.

Investigation of Engagement to movie through

  • Objective
  • Method
    • Participants and Materials
    • Experimental paradigm
    • Experimental apparatus
    • Data Analysis
  • Results
  • Discussion

The experiment consisted of nine sessions in which participants were each shown one of the eight movie trailers or the control video clip (Figure 4). In the middle of the video presentation, a tactile stimulus was given to the tip of the left index finger of participants to measure STRT (Baumann et al., 2007; Cepeda, 1996). The video clip played continuously until the end of the trailer, regardless of the case. stimulation.

Indeed, as highlighted in Figure 6 below, reaction time was not significantly correlated with any of the self-report data (ie, anticipation, fun, attention, and rank scores). Note that the movie trailers (S1 – S8) were arranged horizontally in the ascending order of the raking of preference that resulted from the survey; S7 was least preferred and S2 most preferred. The dark bars and vertical lines represent the mean and standard error of the reaction time for each trailer.

The NEI results for each trailer and its relationship with STRT are shown in Figure 8. Note that the NEI represented changes in the neural correlate of engagement (ie, the difference between beta and alpha band power) from trailer onset to mid- trailer shortly before the tactile stimulus was delivered (see Methods for more details). However, according to Parra et al., television drama evaluation in laboratory settings was successfully applied to population evaluation. (Dmochowski, Bezdek, & Abelson, 2014).

It is anticipated that the experimental results of NEI in this present study may have a potential application for a population-level assessment.

Table 2  The title, official poster, genre and running time of the eight movie trailers selected in the  study.
Table 2 The title, official poster, genre and running time of the eight movie trailers selected in the study.

Investigation of group- wise neural responses during

Coherent neural responses of human population during watching movie

  • Objective
  • Method
    • Experimental Procedure
    • Data Analysis
  • Result
  • Conclusion

We found several periods during the running time of the movie in which the ISCs of all frequency bands exhibited significant changes (P<0.05). Our results show that the spectral inter-subject correlation analysis of EEG signals recorded simultaneously in multiple people can provide insights into how a movie elicits general brain responses consistent with the content of the movie. Since all participants were native Koreans, we chose a Korean movie as stimuli to remove the influence of the subtitle.

We calculated the ISC of a pair of participants between the temporal patterns of the spectral power within each band ( Figure 10 , left). We performed a nonparametric permutation analysis to test the significance of the ISC in each window. We observed that the ISC seemed to increase when the scene was likely to evoke emotional responses or provide key information for understanding the plot of the movie.

5 depicted the murder occurring for the first time on film; the victim begged the killer for his life. Increases in ISC were observed during scenes that elicit emotional arousal or provide key information about the film's plot.

Figure 9 Experimental design
Figure 9 Experimental design

Investigation of group-wise neural responses during watching movie in different conditions

  • Objective
  • Method
  • Result
  • Discussion

Two groups watched this film in a real theater with other viewers who did not participate in this experiment simultaneously. After watching the film, participants examined the most and least impressive scene in this film. In the gray box in Figure 17, blue line shows raw data and red line shows data removed EOG.

We calculated the ISC of a pair of participants in each group between temporal samples of spectral power within each band. We found that the number of scenes that showed significant changes (P<0.05) was greater among the group that watched the movie together than alone. The number of participants in group A and group B who chose the same scene as the most impressive scene is greater than that of each group.

In this experiment, we investigated group-wise neural responses during movie viewing in different two conditions, watching the movie together or alone. According to the result, we suspect that the assimilation of cognitive and emotional state of viewers increases a lot when the viewers watch movies together than watching alone.

Figure 15 Different condition of watching movie; watching together(left) or watching alone(right)
Figure 15 Different condition of watching movie; watching together(left) or watching alone(right)

Conclusion

Overall Discussion

First, it proved that the absorption rate of the film can be objectively verified by measuring the brain waves of the existing audience, not through the traditional research, but through psychophysical methods. In this, people can give their opinion about measuring the absorption rate with the human brain wave, how meaningful it would be in choosing the movie based on subjective judgment. The reliability on that score is quite low because even people who have not seen the film can participate in the evaluation since most films are rated with a subjective evaluation.

Next, we checked the synchronization levels of the brainwave standard by simultaneously measuring the brainwaves of several people watching movies. According to a study, audience responsiveness is an important factor that determines the success of the film in the genre of horror, thriller and action films. In this study, we could check that the scenes for many viewers are synchronized, the important scenes in the story development of the movie, which corresponded to the scene for not a subject, but many movie viewers remember that it is the main scene based on a review of a large portal site.

Also, we can check that the synchronization levels of many spectators have increased in the main stage from this study. Finally, we can check that levels of brainwave synchronization vary across viewing conditions.

Limitations and Further Work

The chrono-architecture of the human brain - natural viewing conditions reveal a time-based anatomy of the brain. Brain responses to movie trailers predict individual preferences for movies and their population-wide commercial success. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics, including independent component analysis.

At the International Conference on Applied Bionics and Biomechanics ICABB 2010-Workshop W1 "Brain-Computer Interfacing and Virtual Reality". Graimann, B., Allison, B. Affective brain-computer interfaces: Psychophysiological markers of emotion in healthy people and in persons with amyotrophic lateral sclerosis. Attention and control of posture and gait: A review of an emerging field of research.

Towards passive brain-computer interfaces: applying brain-computer interface technology to human-machine systems in general.

APPENDIX

APPENDIX : 국문요약

STRT는 피험자가 주어진 주과제를 수행하는 동안 추가적인 촉각 자극에 대한 반응 속도를 측정하며, 주과제에 대한 몰입도가 높을수록 반응 속도가 느려지는 것으로 알려져 있습니다. 본 실험에서 피험자는 개봉 예정인 영화 8편의 예고편을 시청하면서 STRT와 NEI를 측정하고 각 예고편을 시청한 후 설문조사를 완료했습니다. 그 결과, STRT와 NEI 간에는 유의한 상관관계가 발견되었으나, 조사에서는 STRT와 NEI 간에 유의한 상관관계가 나타나지 않았다.

또한 도출된 상관관계의 유의성을 검증하기 위해 비모수적 순열분석을 통해 각 윈도우별 평균 상관계수와 타임시프트된 데이터의 95% 범위를 확인하였고, 각 밴드 상관계수가 나타나는 특정 기간을 확인하였다. 유의미하게 관찰되었다. 그 결과, 영화 상영시간 동안 대상 밴드 강도 간의 상관관계가 부분적으로 크게 증가하는 부분이 관찰되었다. 특히, 영화 전개의 중요한 장면이자, 많은 관객들이 핵심 장면으로 꼽은 장면들에 해당하는 감정이 고조된 부분에서 매우 유의미한 상관관계가 검출되었다.

세 번째 실험에서는 두 번째 실험 결과를 바탕으로 같은 영화 콘텐츠를 시청할 때 관객의 공감 반응이 시청 조건에 따라 달라지는지 알아보기 위해 뇌파 기반 공감 반응 모델을 적용했다. 관람 조건은 동시에 영화를 관람하는 관객 집단과 동일한 영화를 별도의 공간에서 개별적으로 관람하는 관객 집단으로 구분하였다.

Gambar

Figure 1 Overview of BCI measurement methods.
Figure 1 shows an overview of BCI measurement methods (Nicolas, 2012). fMRI and NIRS  have a high spatial resolution but they have a poor time resolution
Figure 2 Brain responses while watching the ‘Avatar’ teaser trailer from Mindsign neuromarketing  (San Diego, USA)
Table 2  The title, official poster, genre and running time of the eight movie trailers selected in the  study.
+7

Referensi

Dokumen terkait

Pricing did not reflect the ________________________ 1University Researcher, Community Innovations Studies Center, College of Public Affairs and Development CPAf, University of the