lmmersive Assisting Tool and Application for Visually ... - UTPedia

lmmersive Assisting Tool and Application for Visually Impaired People :

Audio Frequency Segmentation in producing different rate of vibrations

by

ZURIA TI AZHAN BINTI ZULKIFLI

Dissertation submitted in partial fulfilment of the requirements for the

Bacheior of Technology (Hons) (Information Communication Technology)

MAY20ll

Universiti Teknologi PETRONAS Bandar Seri Iskandar

31750 Tronoh Perak Darul Ridzuan

CERTIFICATION OF APPROVAL Immersive Assisting Tool and Application

for Visually Impaired People :

Audio Frequency Segmentation in producing different rate of vibrations

by

ZURIA TI AZHAN BINTI ZULKIFLI

Dissertation submitted to the

Computer and Information Sciences Programme Universiti Teknologi PETRONAS

in

partial fulfilment of the requirements for the BACHELOR OF TECHNOLOGY (Hons)

(INFORMATION COMMUNICATION TECHNOLOGY)

Approved by,

~

(~ABI

BIN"HAsBULLAH)

UNIVERSITI TEKNOLOGI PETRONAS TRONOH, PERAK

MAY2011

CERTIFICATION OF ORIGINALITY

This is to certify that I am responsible for the work submitted in this project, that the original work is my own concept as specified in the references and acknowledgements, and that original wo~k contained herein have not been. undertaken or done by unspecified sources or persons

Zuriati Azhan Zulkifli

-3-

,t\BSTRACT

Jbis project addresses the problems and limitations that the visually impaired people faced, especially in the area of sports and entertainment. With the advancement ofiCT, an immersive assisting tools and application is to be developed to fill in the gap between the impaired people and the society. Other objectives of the project are to develop an assisting tool and application for the visually impain:d people so that th<jy can immerse and engage into a specific game of his/her interest, to look into the impact of using audio as the aid . ..in.representing the 'real~, to experiment on audio segmentation into different frequencies and tones as a result of different kinds of vibration as well as to compare and benchmark the studies of this project with related works. The project will be specifically conducted on football game with the motivation to continue the facilities. prll¥ided fur- the visually impaired people by the FIF A World Cup 2010, South Africa. The approach proposed is on audio, video and haptics. But this project focuses on audio or sound as it is indeed the best element in assisting the visually impaired people to get immerse and feel just like they are really 'watching' the football game; Assuming the-football:- match wilt be-in the type of playback video to resolve the issues of synchronization and noise of live football match, and 11; will then being extracted to both audio and video file. The main contribution of this project is to produce the low and high tones and frequencies which will then being used as the input for various types of vibrations by using Smartphone.

-4-

(,

f

i\CKNOWLEDGEMENT

First of all, I would like to give my special thanks for those who have in any way made possible for me to complete the Final Year Project.

In particular, I would like to express my highest gratitude to God for giving me the strength, good health in completing this final year prj:>ject. A highly appreciation expressed to my supervisor, Dr Halabi bin Hasbullah, the Senior Lecturer of Computer Science Department. Also, for the time spent for evaluating and supervising the author all this while. Thank you.

The author is indebted to University Teknologi PETRONAS for giving the author the experience in doing the Final Year Project, being exposed to the presentation, VIVA and SED EX which exhibition presentation style.

Last but not least to the author's family and friends fo~ their invaluable supports and encouragement to me from the beginning of the projeCt until the end.

-5-

TABLE OF CONTENTS

CERTIFICATION OF·ORIGINALITY ... , ....••..••...••..•.•...••... .2

J\JJ~1rllJlC:1r

.•.•..•.••.•...••••.•••.•.•.•..••..•••••...•••.•••.•..••..••••..•••..•••.•••..•..••.

3

ACKNOWLEDGEME. _- -- ·-. ' --- ' ' - - - -- . . NT ... , ....•...•...• 4

TABLE·OF CONTENTS ...•... 4

LIST OF FIGlJRES ...•... 5

CHAPTERl INTRODlJCTION ···-··· ... 6

1.1 Background ... _, ... 8

1.2 Problem Statement ... 9

1.3 Objectives ... 10

1.4 Scope of Study .. ·-··· .. ·----···.:··· 10

1.5 Relevancy and Feasibility of the Project ... ~., ... 11

' CHAPTER2 LITERA TlJRE REVIEW AND THEORY ...•... 12

CHAPTER3 METHODOLOGY.-·-···---··· .. ·• .. 19

3.1 Whole System Model ... -···~··· 19

·3.2 Audio System Model ... 21

3.3 Research/Data Gathering ... 24

3.4 Result and Discussioo, ... - ... 26

3.5 Project Activities ... ,., ... 28

3.6 Key Milestone & Gantt Chart ...•... 28

3. 7

Tool & Equipments ...

27

CBAPTER4

DISCUSSION

.,.-;i . . .

·28

3.7 Analysis & Result.. ... 28

. 6-

J.7 Discussion ... 49

CHAPTERS CONCLUSION & RECOMMENDATIONS ... 56

REFERENCES ... ··-···· ... 59

APPENDICES ... -... ·-·-... -... -... ·-· ... -... 63

-7-

LIST OF- FIGURES

f,

Figure 1: The proposed methodology for the system._ ... -~ ... 20

f

Figure 2: The audio system modeL ... 21

Figure 3: Flowchart for FFT frequency Analysis of full playback ... 23

Figure 4: The analysis of full playback ... __ ... __ ... , ... 30

Figure 5: The analysis of the first portion ... 30

Figure 6: The FFT of football playback ... 31

Figure 7: The.amplitudeofthe goal sound ... 32

Figure 8: The analysis ofamp1itude over time ... .32

Figure 9: The FFT of the goal sound ... 33

Figure 10: The analysis ofthe whistle sound ... _ ... .33

Figure 11: The amplitude over time of the whistle audio file ... 34

Figure 12: The FFT of the whistle sound ... 34

Figure 13: The spectral analysis ofthe full playback ... .36

Figure 14: The frequency analysis of the full playback ... 37

Figure 15: Autocorrelation functions to see it clearer ... .37

Figure 16: The amp1itudeof1he goal sound ... 38

Figure 17: The frequency analysis of the goal sound ... .38

Figure 18: The enhanced autocorrelation view ... 39 -8-