UNIVERSITI MALAYSIA PERLIS
FAKULTI TEKNOLOGI KEJURUTERAAN ELEKTRIK FACULTY OF ELECTRICAL ENGINEERING TECHNOLOGY
CADANGAN PROJEK TAHUN AKHIR
FINAL YEAR PROJECT PROPOSAL
SEMESTER/SESI:
SEMESTER/SESSION:
2022 / 2023
………
PROJECT PROPOSAL Project Title
Using Augmented Reality based interface to monitor parameter and output of chip pick &
place machine (SOFTWARE)
Student’s Name
SHAHRUL KHAIRI BIN MOHD RADZI
Student’s Matrix Num.
:202060374 Programme: MECHATRONIC ENGINEERING
Supervisor’s Name: KAPT PUBALAN A/L NADARAJA
Co - Supervisor’s Name (if any) : -
………... ………...
(Student’s Signature) (Supervisor’s Signature) Name : SHAHRUL KHAIRI BIN MOHD
RADZI
Official
Stamp :
Date : 17 AUGUST 2022
Date : ………....
INTRODUCTION
Introduction related to the proposed project.
1) INTRODUCTION
The complexity of the simulations of industrial processes rises substantially as computer technology offers a crucial advantage in the industrial world competitiveness more than before. In automated manufacturing systems used to carry out production activities, industrial robots are crucial components. A robot programme is often created by teaching it one concept at a time using a teach pendant. This method takes a lot of time, and mistakes can occur during teaching. Off-line programming methods are one option for overcoming these constraints.
Virtual Reality (VR) technologies are the basic foundation for these kinds of systems. Due to the limitations, it is necessary to simulate a virtual world beforehand that includes all the data relevant to the actual working environment.
As a result, only those apps and operating environments are available that can recreate a virtual version of the working environment. A relatively recent area of research called augmented reality (AR) enables the creation of an interactive virtual environment that is integrated into the real world. AR users observe the virtual objects and the actual world coexisting in the same place, as opposed to VR users who are fully submerged in the virtual environment (co-located). Instead of totally replacing reality like in traditional VR applications, augmented reality (AR) aims to enhance it.
In addition, the usage of augmented reality (AR) technology improves perception and interaction with the real world by providing helpful information about the surroundings. Both actual and virtual things can be moved by the user. The use of AR technologies has expanded to include industries like manufacturing, healthcare, the military, education, and entertainment. However, computer graphics, image processing, and computer visualisation are the same components used in all augmented reality systems, regardless of the application.
Robotics is one of the key industries where augmented reality technologies are being used.
When programming robots with augmented reality technologies, the user receives better visual feedback, increasing process efficiency, and it becomes unnecessary to create a virtual representation of the workspace. These days, there are several ways to programme robots utilising augmented reality.
PROBLEM STATEMENTS
Please state the problem to be studied in PARAGRAPH. Use additional sheets if necessary.
1.1) PROBLEM STATEMENT
Chip pick and place machine need big space to monitor and set up the machine. The programme controller needs to be constructed close to the machine. Consequently, some room was lost. Companies today must conserve space since every square foot has an impact on revenue. As an illustration, several new machines that can function simultaneously could replace the machine's controller. Why then do we still require a physical controller? Using augmented reality is the answer.
A lot of employee movement is required to operate the machine. Employees must move around while keeping an eye on the controller and the machine's operation at all times. Due to this circumstance, the individual is forced to concentrate in two or three areas. Employee might need to monitor the first project at the controller, for instance, before moving to stand alert in front of the machine. This circumstance will recur. Therefore, it must be upgraded for industry today.
PROJECT OBJECTIVES
Please state the problem to be studied of the proposed project in concise term (with explanation).
Use additional sheets if necessary.
1.2) PROJECT OBJECTIVES
- To save work space that can use to another machine. So, more products can be produced at one time
- To keep workers from coming into direct personal touch with equipment. From that, worker bumping the machine and stressing any programmes on the machine are examples of carelessness that can be avoided.
- To reduce employee's movement. Employees can therefore perform additional tasks concurrently.
PROJECT SCOPES
Please state the scopes of the proposed project in PARAGRAPH. Use additional sheets if necessary.
1.3) PROJECT SCOPES
The scope of this project is to design software that employees may use to see the data of the machine around 15 meters away only. This is done to stop the software from simultaneously detecting another machine. The machine will be detected by the program, such as a board parameter, will then appear in augmented reality (AR). Every output and data layout depends on the software that was developed.
The software's capacity to detect motion is the second scope. This is carried out to stop data loss or vibration at the machine's location as nearby humans or robots pass by. It built to make sure employee can take and get the data clearly.
Lastly, the third scope is the data display period lasts for 2 minutes when viewed directly. When we go to another machine, the data from the old machine will be missing. It is done in order to shorten project usage times and conserve energy.
LITERATURE REVIEW
At least 5 related papers. Use additional sheets if necessary.
2) LITERATURE REVIEW
The use of augmented reality in modern industry has been thoroughly investigated.
Here are a few research projects.
Costa, G.d.M.; Petry, M.R.; Moreira, A.P, (2022) mentioned that a smooth human-robot interaction is essential to creating a production line that is more adaptable, effective, and efficient, the need for collaborative robot use in industry has grown along with it.
Augmented Reality (AR) has been used in several human-robot collaboration and cooperative industrial applications as a significant and promising technique to help the human operator understand and communicate with robots. In order to identify the primary AR technologies used, describe the current state of the art of augmented reality for human- robot collaboration and cooperation, and highlight future developments for this research field, a systematic literature review of 32 papers published between 2016 and 2021 was conducted. Results indicate that this is still a growing area of study, especially in light of recent developments in head-mounted displays (HMDs). Additionally, despite the fact that HMDs still require additional ergonomic development, projector-based and HMD-developed techniques are demonstrating favourable effects on operator-related elements like
performance, task awareness, and safety feeling. The target audience for the solution should be included in large-scale assessments of the suggested solutions in industrial settings, and additional research should concentrate on generating standards and recommendations for creating AR aid systems.
Moritz Quandz, 2021, shows that through the location- and context-specific superimposition of real objects with virtual data, augmented reality (AR) can complement work processes and provide cognitive relaxation for employees in the context of industrial labour. Product development, manufacture, assembly, maintenance, and training are all covered by the AR- based support of industrial work processes. Numerous location-based AR support functions are being prototypically implemented in all of these fields with the goal of enhancing work productivity, enhancing communication in mobile work settings, or enhancing employee qualification in the work process. Contrary to the rise of developed AR solutions in recent
years, these solutions are not widely employed in industrial practise. User approval, which has not been fully taken into account during the system development process, is directly tied to the success of the adoption of AR systems. Usability and user interface design are crucial for user adoption in addition to enhancing the ergonomics of AR technology. Increasing employee engagement can be referred to as a success factor, particularly in the context of employee qualification. Individual user acceptance aspects have only been included in prior user studies of industrial AR systems.
Chin-Hsing Chu, 2020, said that an old Eastern architectural invention is the Dougong structure. Its construction approach is intricate and difficult to understand from drawings.
Scale models were created in order to maintain this historically distinctive architectural method by teaching through the construction process. In this research, augmented reality (AR)-based solutions supporting manual Dougong model assembly with rapid interactions were created. The first goal was to create brand-new AR-assisted features that get beyond assembly instructions on paper's current drawbacks. The second goal was to establish through trials whether or not AR could increase the operational effectiveness or quality of the manual assembly process. The assembly efficiency, correctness, and workload of these functions were assessed using both qualitative and quantitative criteria after the experimental data had been processed. The findings showed vital criteria for enhancing the systems' functional design. Additionally, they demonstrated how AR has the potential to be a powerful human interface tool for facilitating the hand construction of complicated things.
Riccardo Palmarini, 2018, share some information like since over 50 years ago, augmented reality (AR) technologies have been a subject of academic study in relation to aiding maintenance operations. Significant advancements have been made over the past ten years, and the AR technology is growing closer to being used in industry. Key Performance Indicators (KPI) for industrial maintenance have been used in this article to explore and quantify the benefits and drawbacks of AR. Regrettably, there are still technical obstacles preventing AR from being used in industrial settings. In order to demonstrate the current state of the art of AR in maintenance and the most pertinent technological constraints, this presentation will present the findings of a thorough literature review. Filtering from a huge number of articles to 30 primary studies published between 1997 and 2017 was part of the analysis. The findings point to significant hardware, software, and augmented reality
solution fragmentation, which makes choosing and creating augmented reality systems very difficult. The study's findings highlight the areas where AR technology is still in its infancy.
Future directions for study in hardware, tracking, and user-AR interaction in industrial maintenance are also suggested.
Arindam Dey, 2018, shows that over the past few decades, augmented reality (AR)
interfaces have been thoroughly investigated, with an increasing number of user-based trials.
In this article, we thoroughly examine 10 years' worth of the most significant augmented reality user studies, from 2005 to 2014. 369 distinct user studies from a total of 291 papers have been examined and categorised based on their application areas. The review's main contribution is to provide the overall state of user-based augmented reality research and to show how it has evolved. We give samples of the most significant user studies and provide a summary of the major contributions made by each type of publications. We also point out potential areas for further research as well as places where there haven't been many user studies. We also point out potential areas for further research as well as places where there haven't been many user studies. We discover, among other things, that there is an increasing trend toward handheld AR user research and that the majority of studies are carried out in lab settings without the use of pilot testing. This study will be helpful to augmented reality researchers that want to adopt best practises while creating their own augmented reality user studies.
METHODOLOGY
Describe the procedures and methods to be used to achieve the objectives of the proposed project.
Use additional sheets if necessary.
3) PROJECT METHODOLOGY
When augmented reality is turned on, it will scan the machine in front of it. If the device hasn't been registered, it won't produce any data at all. For instance, the machine in front of him, which is a different pick-and-place machine, will display same image without any output data.
A pick and place machine will be detected and verified by AR when it comes into near with one. then, information about the machine, such as material parameters, will be output.
Once the AR is out of the pick and place machine's field of view, the data will once more vanish from view. This will go on, and the AR can be updated to scan additional machine-program data.
FLOWCHART:
Application Flowchart
START
Detect the machine
No output will appear
The machine registered to AR system?
The data and output about mechine will
appear
END
NO
YES
Design Flowchart
REFERENCES (APA Style):
1. Chu, C.H.; Cheng, C.H.; Wu, H.S.; Kuo, C.C. A Cloud Service Framework for Virtual Try-on of Footwear in Augmented Reality. J. Comput. Inf. Sci. Eng.
2019
2. Syberfeldt, A.; Danielsson, O.; Holm, M.; Wang, L. Visual assembling guidance using augmented reality.Procedia Manuf. 2015
3. Young, T.C.; Smith, S. An interactive augmented reality furniture customization system. In Proceedings of the International Conference on Virtual, Augmented and Mixed Reality, Toronto, ON, Canada, 17–22 July 2016
4. Korn, O.; Schmidt, A.; Hörz, T. Augmented manufacturing: A study with impaired persons on assistive systems using in-situ projection. In Proceedings of the 6th International Conference on Pervasive Technologies, Rhodes, Greece, 29–31 May 2013
5. Hou, L.; Wang, X. A study on the benefits of augmented reality in retaining working memory in assembly tasks: A focus on differences in gender. Autom.
Constr. 2013
List major activities involved in the proposed project. Indicate duration of each activity to the related month(s).
MONTH
WEEK 1 2 3 4 1 2 3 4 1 2 3 4 1 2 3 4 1 2 3 4 1 2 3 4 1 2 3 4
UniMAP WEEKS 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20
PLAN ACTUAL PLAN ACTUAL PLAN ACTUAL PLAN ACTUAL
PLAN 1-2
ACTUAL PLAN ACTUAL PLAN ACTUAL PLAN ACTUAL PLAN ACTUAL PLAN ACTUAL PLAN ACTUAL PLAN ACTUAL PLAN ACTUAL PLAN ACTUAL PLAN ACTUAL PLAN ACTUAL PLAN ACTUAL PLAN ACTUAL PLAN ACTUAL PLAN ACTUAL
PLAN Presentation Day 21st
ACTUAL
PLAN 16
NOVEMBER DECEMBER
JUNE JULY AUGUST SEPTEMBER OCTOBER
METHODOLOGY - buy hardware for prototype
Logbook Submission (Half Semester)
1st Draft of final report
METHODOLOGY - buying component (Shopee)
METHODOLOGY - receive the component
update final report and logbook PROJECT ACTIVITY
METHODOLOGY - Learn the function of each component
METHODOLOGY - learn the coding used for each sensor
METHODOLOGY - meeting with supervisor and updating the project progress METHODOLOGY - design the prototype (AutoCAD)
Project title selection
Detail discussion With Supervisor
Literature Work Discussion with Supervisor
Proposal Submission Report
Proposal Presentation
Final Draft of the project and Logbook to Supervisor (2 Copies)
Final Presentation
Final Report Submission
METHODOLOGY - create the prototype (hardware)
METHODOLOGY - create the electrical circuit
METHODOLOGY - build and test the coding
METHODOLOGY - testing circuit in the prototype
