Laurea specialistica in Ingegneria Meccanica
Virtual,
Augmented,
Mixed Reality
Ing. Michele Fiorentino Ing. Giuseppe di Gironimo m.fiorentino@poliba.it
Laurea specialistica in Ingegneria Meccanica
Corso di Simulazione e prototipazione virtuale
Politecnico di Bari
Sommario
Il reality-virtuality
Continuum
Interfacce Multimodali
La realtà virtuale
La realtà virtuale
Virtual Reality
Immergere l’utente in un modo simulato e quindi 3D.
Ci sono diverse tecniche, compromesso tra:
compromesso tra:
•livello di immersione •sensi coinvolti
Virtual Reality: the story
Caratteristiche della VR:
Virtual Reality
•
Navigation is the ability to move around and explore a 3D scene.• Interaction is the ability to select and move objects in the scene.
• Immersion is achieved by stereoscopic vision.
• Immersion increase the sensation of presence within the virtual world.
Real-time graphics
High-speed rendering
and
interactivity
is vital to a VR
system: if there is any delay in the images seen by the
user, the illusion is quickly lost.
Virtual Reality hardware
3. Output devices
– Force
Feedback 1. Stereo Viewing
– Shutter Glasses
– HMD
4. Displays
2. Input devices
– Hand Tracking
– Gloves Wands
– Gestures, Speech
4. Displays
– Projection Walls
– Projection Tables
– Full Immersion
– Autostereoscopic displays
Virtual Reality: Stereo viewing
VR is that things are presented in three dimensions.
Humans see using stereoscopic vision. stereoscopic vision.
In stereoscopic 3D perception, we use two eyes that are set apart from each other.
The brain uses this to re-create depth information.
Virtual Reality: Stereo viewing
We perceive as objects at specific locations in the space around us.
3D graphics display means to 3D graphics display means to render two images from slightly different eye points and present them separately to each eye:
– Shutter Glasses
Evoluzione
Infinitec
super-anaglyph glasses
Virtual Reality: Shutter Glasses
Shutter glasses allow displaying stereo images. The display alternates rapidly between the left and right eye images.
Each eye only saw the image intended for it by opening a shutter in front of the eye when its image is being displayed.
front of the eye when its image is being displayed.
Shutter glasses typically use electronic shutters made with liquid crystals.
Head Mounted Display
Another way to present a separate image to each eye is to use a separate monitor for each eye
This can be done by mounting small monitors in some sort of head gear.
Virtual Retina Display
Auto-stereoscopic Displays
Sharp Electronics
Actius RD3D
www.sharp.com
Dimension
Technologies, Inc.
(The price for the 15" model is $1,699. The 18" model costs $6,999. )
Autostereoscopic
Altri sistemi
Actuality Perspecta® display
works by projecting thousands of 2D images per second onto a rotating screen.
http://actuality-systems.com/
The Reachin Display
Virtual Reality: Input devices
Motion sensors can to track the position of fingers.
Fingers actions can be used to control a program.
This means pushing virtual menu buttons, or grabbing an object and buttons, or grabbing an object and moving it around with hands.
Hands and fingers position and
Virtual Reality: Input devices
Tracking System: ART Dtrack
System Specifications
Optical (IR) 2 Cameras
> 4 markers per body Volume: 2 x 1.5 x 1.5 m Volume: 2 x 1.5 x 1.5 m Cost $$$
Validation
Virtual Reality: Output devices
•haptic devices
return force to the user as feedback through the tactile senses. Thus it is possible to touch, weigh and grasp virtual objects.• The cables and pulleys on the glove are used to "push back" at the user under
Object Collision Feedback
vibrating proximity sensor
two different effects
(in/out)
Projection
Walls
Projection Walls
Projection Walls
Projection Tables
• Single (Small group ) viewing
Rooms – Cave Systems
•Single (Small group ) viewing
VR Applications
• VRCAD
• Education • Training • Training
• Virtual Prototypes • Spatial Visualization • Heritage
Virtual Reality: Training
VR is used to use expensive equipment or when the cost of a mistake is very high.
• aircraft simulators to train pilots
• military flight simulators
A Boeing 737-800 fullflight simulator for Lufthansa.
• medicine (virtual surgery)
Virtual Reality: Virtual Prototypes
• Reduce physical prototypes
• Improve ergonomics and functionality.
• Provide manufacturing with early access
to product details.
• Collaborative design.
•understanding of complex 3D assemblies
•present product configuration and
aesthetics.
Manufacturing Visualization
VR for exploring 3D environments.
Can solve problems as factory construction or reorganization:
overall efficiency
machine accessibility health and safety
Virtual Reality: Education
3D graphics is a powerful
VR enables a sense and motion learning process, more natural than the symbolic-reconstructive way (ie. writing).
3D graphics is a powerful tool for visualizing and understanding complex
Heritage
VR allows:
•access to "monuments" that risk to be damaged
•reconstruction of "scenarios" that do not exist anymore
exist anymore •Time travel
• interaction and avatars
Scientific Visualization
VR vs AR
Arbeiten mit
digitalen Produktdaten
Arbeiten am realen Produkt
Produkt Produkt--definition
definition DesignDesign AnalyseAnalyse
Produk
tion BetriebBetrieb WartungWartung RecyclingRecycling
Augmented vs. Virtual Reality
Augmented Reality
System augments the
real world scene
User maintains a sense
of presence in real
Virtual Reality:
Totally immersive
environment
Visual senses are
of presence in real
world
Needs a mechanism to
combine virtual and
Combining Real and Virtual
Needs:
Precise models
Calibration
Locations and properties of camera and display
Locations and properties of camera and display
Registration
Problems
Tracking the objects
Registration
Objects to behave in
physically plausible
manners when
manners when
manipulated
Occlusion
Performance Issues
Augmented Reality must:
Run in real-time so that
the user can move in
the environment
the environment
Show a properly
Display Technologies
Monitor Based
Pico-Projection
Head Mounted Displays:
Head Mounted Displays:
Monitor Based AR
Simplest available
Little feeling of being
immersed in
Optical see-through HMD
Pros:
HMD evolution
Applications
Medical
Entertainment
Military Training
Engineering Design
Manufacturing,
Maintenance, and
Repair
Consumer Design
Engineering Design
Robotics and
Telerobotics
Manufacturing & Maintenance
Present to the user: name of parts Function
maintenance or manufacturing records
Etc.. Etc..
highlighting parts and showing the path of extraction.
Augmented-Reality Application
Laboratorio di Realtà Virtuale
CRCT
Attrezzature:
3 proiettori BARCO 3200x2560 pixel; Schermo BARCO CADWALL,
6.20x2.20m (il più grande d’europa!!)
occhiali stereoscopici CRYSTALEYE™
CRYSTALEYE™
SGI ONYX300 12x CPU- 12 GB RAM Tracking INTERSENSE IS-900
Sistema di controllo
