Novel deep learning-powered diagnostics hardware for assessing retinal health. The impact of deep learning and artificial intelligence for the design practice itself is covered better in https://algorithms.design/ and the focus of this presentation is in the visual function diagnostics. How is the future looking for your high-street optician's (e.g. Specsavers, Boots) vision exam going beyond simple refraction correction, and how possibly in the future AR glasses could allow design of "smarter" every-day eyewear also for health monitoring. Talk given for “Future of Eyecare: How we see and how we want to be seen” organized by Flora McLean. Royal College of Art - London UK

1. Petteri Teikari, PhD
http://petteri-teikari.com/
Singapore Eye Research Institute (SERI)
Visual Neurosciences / Advanced Ocular Imaging
Future of Retinal
Diagnostics
Novel deep learning-
powered diagnostics
hardware for assessing
retinal health
Talk given for “Future of Eyecare:
How we see and how we want to be
seen” organized by Flora McLean
Royal College of Art - London UK
Tue 23 October 2018

2. Petteri
Teikari
PhD
M.Sc. 2008
Electrical Engineering
“Illumination Engineering, circadian
effects of light”
Aalto University, Helsinki, FI
Intern I 2007
Chronobiology
“Image analysis for pupillometry”
University of Groningen, NL
PhD 2012
Neuroscience
“Melanopsin bistability with PLR”
INSERM / Lyon I, Lyon, FR
Intern II 2012
School of Physics
“Adaptive optics for in vivo retinal
imaging”
University College Dublin, Ireland
Postdoc I 2014
School of Architecture
“EEG responses to light, and
development of portable dosimeters”
Rensselaer Polytechnic University, NY
Postdoc II 2016
Biophysics Department
“Neuromodulation with focused
ultrasound and two-photon
microscopy”
University of Toronto, CA

3. Hardware for
Eye
Diagnostics
with deep
learning
Embedded deep learninginophthalmology:
Making ophthalmic imaging smarter
https://arxiv.org/abs/1810.05874
arXiv:1810.05874

4. Portable
Visual
Diagnostics
#1: Structure+
Function
”Moorfields
London,UK”
By Pearse Keane and Alexander Walsh
MoorfieldsEyeHospital, Envision DiagnosticsInc.,RetinaVitreousAssociates
https://theophthalmologist.com/issues/0116/the-eye-exams-quantum-leap/
Test 1: Introduction to the
Examination and Initial Ocular
Alignment
Test 2: Whole-Eye Swept-Source
OCT Imaging
Test 3: Ocular Motility
Test 4: Visual Acuity
Test 5: Suprathreshold
Perimetry
Test 6: Pupillometry
Reena Chopra; Pádraig J. Mulholland; Adam M. Dubis; Roger S. Anderson; Pearse A. Keane
Translational Vision Science & Technology August 2017, Vol.6, 16. doi: 10.1167/tvst.6.4.16

5. Portable
Visual
Diagnostics
#2 Function
Electrophysiology
”Osaka, JP”(2016) Visual Field Testing with Head-Mounted Perimeter
‘imo’. PLoS ONE 11(8): e0161974.
https://doi.org/10.1371/journal.pone.0161974
”San Diego, US”JAMA Ophthalmol. 2017;135(6):550-557. doi:
10.1001/jamaophthalmol.2017.0738
nGoggle
RETeval®, adhesive
electrodes for ERG

6. Portable
Visual
Diagnostics
#3: Refraction
”MIT MediaLab
Boston, USA”
https://eyenetra.com/

7. ‘Eye
Fitbits’
Contactlens
sensors
https://labiotech.eu/
features/contact-lens
-glucose-diabetes/ https://www.wareable.com/ar/virtual-reality-blind-
visually-impaired-contact-lenses-191

8. Wearable
’Smartglasses’
Compactform the iOptik eyewear for immersive virtual reality
https://www.reviewofoptometry.com/article/cls-beyond-vision-correc
tion-connecting-to-the-internet-of-things
Kopin’s Lightning Microdisplay Modules Unlock a
New World of Light and Comfortable Mobile VR
Systems
https://www.businesswire.com/news/home/20170104005430/en/Kopin-Debuts-Lightning-
OLED-Microdisplay-2k-2k

9. Wearable
’Smartglasses’
See-throughwith
diffractivethin-film
waveguides https://uploadvr.com/waveguides-smartglasses/
https://usblogs.pwc.com/emerging-technology/
breakthroughs-in-optics-that-are-reshaping-
augmented-reality/
Thalmic Lab's patent filing for a “wearable
heads-up display with integrated eye tracker.
https://www.therecord.com/news-story/8915316-thalmic-labs-gets-patents-for-
smart-glasses/
http://www.eenewsembedded.com/news/micro-display-vr-
and-ar-wearable-products

10. “Convergence”
of consumer
electronics and
visualdiagnostics
Karl Guttag on Technology:
Magic Leap’s diffractive
waveguides
https://www.kguttag.com/2018/02/22/magic-lea
p-one-tunnel-vision/
Eye tracking for foveated rendering +
AdHawk Microsystems
http://www.adhawkmicrosystems.com/
https://www.tobiipro.com/fields-of-
use/psychology-and-neuroscience/

11. AI for
Diagnostics
whichsignals
(structureand
function oftheeye)
areabnormals
(pathological) and
which arenot
Clinically applicable deep learning for diagnosis
and referral in retinal disease
https://doi.org/10.1038/s41591-018-0107-6

12. AI for
‘Functional
Design’
end-to-enddesign
of theopticsand
imageprocessing
pipeline
https://vsitzmann.github.io/deepoptics/
https://doi.org/10.1145/3197517.3201333

13. AI does not
solve all your
problems
inacademicprojects,
oftennodesigners
are involvedleadingto
poor usability and
patientacceptance
https://arxiv.org/abs/1810.05874
“AI”can
automatethe
acquisition
Virtual clinics in
ophthalmology: The
Glaucoma Monitoring
Service at Moorfields Eye
Hospital, Old Street,
London, UK
https://www.kingsfund.org.uk/sites/de
fault/files/media/Aachal_Kotecha.pdf