Vision for the Blind
Vision for the Blind
.
.
Stat 19 SEM 2. 263057202. Talk
Stat 19 SEM 2. 263057202. Talk
1.
1.
Alan Yuille. yuille@stat.ucla.edu
Alan Yuille. yuille@stat.ucla.edu
UCLA. Dept. Statistics and
UCLA. Dept. Statistics and
Psychology.
Psychology.
Goal of the Course.
Goal of the Course.
•
How can technology and neuroscience How can technology and neuroscience help the blind and disabled?help the blind and disabled?
•
(A) Artificial Intelligence systems.(A) Artificial Intelligence systems.•
(B) Brain Implants. Neural Prostheses.(B) Brain Implants. Neural Prostheses.•
Introduce and review the state of the art.Introduce and review the state of the art.Course Mechanisms.
Course Mechanisms.
•
Maximum work load is 3 hours per week.Maximum work load is 3 hours per week.•
Grading: Pass/Fail.Grading: Pass/Fail.•
Requirement. Don’t miss more than 2 Requirement. Don’t miss more than 2 lectures.lectures.
My Research Interests are:
My Research Interests are:
•
Designing computer vision systems
Designing computer vision systems
(artificial intelligence).
(artificial intelligence).
•
Understanding how biological vision
Understanding how biological vision
systems work.
systems work.
•
I also work with a company that builds
I also work with a company that builds
prototype systems for the blind.
prototype systems for the blind.
•
Collaborate with the Smith-Kettlewell
Collaborate with the Smith-Kettlewell
Eye Research Institute (San Francisco).
What is Vision?
What is Vision?
•
Aristotle “to know what is where by looking”.Aristotle “to know what is where by looking”.•
Vision is information processingVision is information processing. .•
Light rays that reach your eyes carry Light rays that reach your eyes carry information about the external world. information about the external world.•
Vision decodes the light rays and Vision decodes the light rays and reconstructs the world.reconstructs the world.
What would you miss most if
What would you miss most if
you went blind?
you went blind?
•
Probably the ability to
Probably the ability to
detect and read
detect and read
text.
text.
•
Navigation
Navigation
is possible using a cane
is possible using a cane
and/or
and/or
guide dog.
guide dog.
Recognize people
Recognize people
by their
by their
voices.
voices.
Hear oncoming traffic.
Hear oncoming traffic.
Experiment
Experiment
:
:
Spend an hour with your
Spend an hour with your
eyes closed.
What can blind people see if
What can blind people see if
they recover their sight?
they recover their sight?
•
Mike May is one of the very few people
Mike May is one of the very few people
who attained his sight after being blind.
who attained his sight after being blind.
•
(Successful businessman & skier).
(Successful businessman & skier).
•
But how well can he use vision to get
But how well can he use vision to get
information about the world?
information about the world?
•
Infant’s vision systems develop in
Infant’s vision systems develop in
stages. Some abilities develop at 1
stages. Some abilities develop at 1
month, others at 3 months, etc.
Mike May
Mike May
•
Mike May can see light, but required Mike May can see light, but required extensive training before he could extensive training before he coulddistinguish a cube from a sphere. distinguish a cube from a sphere.
•
He cannot recognize faces (even his wife He cannot recognize faces (even his wife and children).and children).
•
It took two years before his vision helped It took two years before his vision helped his skiing.his skiing.
•
Handout.Handout. Interview with Mike May. Interview with Mike May.•
Mike Mays’ Journal: Mike Mays’ Journal:www.sendergroup.com/mike.htm
www.sendergroup.com/mike.htm
How Big is the Problem?
How Big is the Problem?
•
Legally Blind population of the US is 600-Legally Blind population of the US is 600-900,000. (20/200 best correctly acuity). 900,000. (20/200 best correctly acuity).•
At least, 3,000,000 people have low At least, 3,000,000 people have low vision.vision.
•
These numbers are predicted to double These numbers are predicted to double in the next ten years!in the next ten years!
•
Eyesight gets worse with age – and Eyesight gets worse with age – and people live longer.Artificial Intelligence
Artificial Intelligence
Solutions.
Solutions.
•
Navigation: Global Navigation: Global PositioningPositioning
Computer Vision
Computer Vision
•
Digital Camera + Digital Camera + Portable Computer Portable Computer+ +
Speech Speech
Brain Implants.
Brain Implants.
•
Artificial Retina:Artificial Retina:•
Connected to (i) Connected to (i) the retina, (ii) the the retina, (ii) theoptic nerve, or (iii) optic nerve, or (iii)
the cortex. the cortex.
•
Dr. Dobelle.Dr. Dobelle.Vision to Tactile.
Vision to Tactile.
• Dr. Bach y Rita. (Ex: Smith-Dr. Bach y Rita. (Ex: Smith-Kettlewell).
Kettlewell).
• 1970. Project an image 1970. Project an image onto the back of a blind onto the back of a blind person. Claim: could
person. Claim: could recognize faces.
recognize faces.
• Few tactile receptors on Few tactile receptors on back. Better to use
back. Better to use
fingertips, lips, or tongue. fingertips, lips, or tongue.
• Erik Weihenmayer. Climber.Erik Weihenmayer. Climber.
Neural Prostheses:
Neural Prostheses:
•
Control by Control by Thought. Thought.•
Movement MovementPlanning Neurons. Planning Neurons.
•
Clint Eastwood Clint Eastwood film. Firefox.Summary.
Summary.
•
The course will describe these artificial The course will describe these artificial intelligence and biological techniques. intelligence and biological techniques.•
Can describe other topics: e.g. Cochlear Can describe other topics: e.g. Cochlear implants.implants.
•
Mike Mays’s handout. Web journal:Mike Mays’s handout. Web journal:•
www.sendergroup.com/mike.htmwww.sendergroup.com/mike.htm•
Radio Interview: Radio Interview: http://http://psy.ucsd.edupsy.ucsd.edu/~fine/~fine