An overview of the available digital eyewear, including Google Glass, Vuzix M100, Epson Moverio BT-200, and Optinvent ORA-1, and the SDK's and development environments available for each.

1. Digital Eyewear SDK Overview
Augmented World Expo, May 27, 2014
Patrick O’Shaughnessey
Founder and Chief Developer
@patchedreality
patrick@patchedreality.com
http://patchedreality.com

2. Patched Reality
Custom Augmented Reality
and Digital Eyewear Solutions
http://patchedreality.com

3. Patched Reality
Using Best-in-Breed Technologies
http://patchedreality.com

4. Video and Slides from AWE 2013
http://bit.ly/SDKTutorialAWE2013

5. Mobile AR SDKs Short List
SDK Purpose Tracking Platform Graphics Cloud GP
S
License
Qualcomm
Vuforia
2D Images,
Cylinders,
Markers,
Text
NFT+Ext,
Cylinder,
Marker,
Text
iOS, Android Unity3D &
Alt.
yes no Free
$99-
499/mo
Cloud
Metaio
SDK
2D Images,
3D, GEO,
QR
NFT+Ext,
GPS,
3D, SLAM
iOS, Android,
Eyewear
Unity3D &
Proprietary
yes yes $0-5,500
$235-
680/mo
Cloud
Total Imm.
D’fusion
2D Images,
Faces
NFT, Face iOS, Android
Dev: MS
only
Proprietary no no $0-7,800
Wikitude
SDK
2D Images,
GEO
GPS, NFT iOS, Android,
Blackberry,
Eyewear
HTML,
Proprietary
yes yes $0-2,300
Layar SDK 2D images,
Geo
NFT, QR iOS, Android Proprietary yes no $3,250/ap
p/yr +
$60/page

6. Mobile AR SDKs Short List
SDK Purpose Tracking Platform Graphics Cloud GP
S
License
13th Lab
Point Cloud
2D Images,
3D,
Anywhere
NFT, 3D,
SLAM
iOS, Android Unity3D &
Alt.
no no 0-$5,000
HP
Aurasma
SDK
VFX, Videos
on 2D
Images
NFT iOS, Android Proprietary yes yes Per click
Obvious
Engine
2D images,
Cylinders
NFT,
Cyl.
iOS, Android Unity3D &
Alt.
no no $8000/ap
p/plaform
String Framed 2D
images
Framed
Image
iOS Unity3D &
Alt.
no no $499
-
$8000/ap
p/year
Orbotix Robotic AR Sphero iOS, Android Unity3D no no Free
catchoom 2D Images NFT iOS, Android Proprietary yes no $0-2000
+$135-
835/mo

7. Eyewear Reviewed
Google Glass
Optinvent ORA-1
Vuzix M100
Epson Moverio BT-200

8. Programming Environment
3rd-Party SDKs
User Interaction, Tracking, Rendering
Vendor SDKs
Hardware Support, UI Paradigm
OS SDK
Standard Mobile Dev

9. Eyewear Vendor SDKs
SDK OS Features in SDK Input
types
Display Cost
Vuzix M100 Android 4.04 M100 Emulator
(Std Android SDK)
Gesture (*)
Voice (*)
Camera
Buttons
Sensors (*)
428x240
Offset
Monocular
Opaque
$999.99 hw
+ $199.99
for SDK
Google Glass Android
4.4.2
Gestures
Voice
Camera
UI Widgets
Mirror API
Touchpad
Voice
Camera
Sensors
Wink
640x360
Offset
Monocular
Transparent
$1,500 hw
Epson
Moverio BT-
200
Android
4.0.4
Tablet UI
Hand|Head
sensors
2D|3D view
Display Control
Touchpad
Buttons
Sensors x2
Camera
960x540
Inline
Stereo
Transparent
$699.99 hw
Optinvent
ORA-1
Android
4.2.2
Bluetooth Client
Bluetooth Server
Touchpad
Camera
640x480
Inline | Offset
Monocular
Transparent
$949.00 hw

10. 3rd Party SDKs
SDK Eyewear
Platforms
Eyewear
Specific Features
Programming
Environment
License
Metaio BT-200 Stereo AR
See through AR
Geo POI AR
Native Android $0-5,500
$235-680/mo
Cloud
Wikitude BT-200
M100
Glass (**)
Stereo AR
See through AR
Geo POI AR
Native Android +
HTML+Javascript
$0-2,300
Wearscript Glass AR
Camera
Sensors
Eye tracking (*)
Arduino (*)
HTML+
Javascript
In PC browser
Free Open Source
ARPA Glass Image
Recognition
GEO POI AR
Native Android $1,495
* Requires additional hardware
** Broken in XE17, so couldn’t review

11. 3rd Party SDKs
SDK Eyewear
Platforms
Eyewear
Specific Features
Programming
Environment
License
Catchoom Glass Image Search
Region of Interest
Selection
Native Android $120/mo - 100 images
$340/mo - 1K images
$680/mo – 10K images
Layar Glass Video AR
Panoramas
GEO POI AR
Layar Creator or
Web Service API
$60/page
OTG Ari Glass, BT-200,
M100
Hand Gestures Native Android $0 trial
$120/yr/app 25K DL
$240/yr/app 250K DL*
Enterprise /OEM varies

12. Native Development On Ramp
1) Set up Dev Environment
• Android Developer Kit (ADK) or Android Studio
• Eyewear vendor SDK
2) Enable debug mode on eyewear
3) If necessary - Add vendor ID to
~usr/.android/adb_usb.ini
4) Optional - Download 3rd-Party SDK
5) Optional - Install and run samples

13. 3rd-Party SDKs
User Interaction, Tracking, Rendering
Vendor SDKs
Hardware Support, UI Paradigm
OS SDK
Standard Mobile Dev

14. Google Glass

15. Google Glass

16. Google Glass Development
Pick an app paradigm:
1. Native GDK based (APK)
• Ongoing Task - “Live Card” on timeline
• Immersion – Runs outside of timeline
2. Mirror API (web server based)
• Manipulate cards on timeline

17. Google Glass – Mirror API Setup
1) Create Google App Engine instance
2) Create Google APIs Console project
3) Enable the Google Mirror API in Services
4) Create OAuth 2.0 Client ID
5) Get a Quick Start project and add API secret
6) Deploy project to cloud using App Engine
Launch GUI or command-line

18. Google Glass – GDK Setup

19. Google Glass GDK – Voice Trigger

20. Google Glass GDK – Voice Trigger

21. Google Glass GDK – Voice Trigger

22. Google Glass – Swipe Gestures

23. Google Glass GDK – Card
Use created view in Activity or CardScrollView

24. Google Glass GDK – Card

25. Vuzix M-100

26. Vuzix M-100

27. Vuzix M100 - Setup
1) Purchase SDK license and register a user id
2) Install Smart Glass Manager on Android
Phone
– provides keyboard and touchpad
3) Use Smart Glass Manager to Enable Debug
mode
4) Download SDK to use emulator
5) Add vendor ID to
~usr/.android/adb_usb.ini

28. Vuzix M100 – Smart Glass App

29. Vuzix M100 - Emulator

30. Vuzix M100 - Gestures*
Android Sensor API with a sensor type of 15.
Gestures returned in event.values[0]:
1 = left (swiping backward)
2 = right (swiping forward)
9 = near (moving perpendicular toward the sensor)
10 = far (moving perpendicular away from the sensor)
Generates key events as well:
1 = KEYCODE_DPAD_LEFT
2 = KEYCODE_DPAD_RIGHT
9 = KEYCODE_ENTER
10 = KEYCODE_ESCAPE
*Stick to buttons or Smart Glass app for now

31. Vuzix M100
Some current limitations to note:
– No Google Play Services
– No Location provider for GPS
– Gesture sensor is overly sensitive IMO
– Voice commands limited to home screen

32. Epson Moverio BT-200

33. Epson Moverio BT-200

34. Epson Moverio BT-200 Setup
Super easy to get up-and-running:
1) Use touchpad to turn on USB debugging
2) Add vendor ID to
~usr/.android/adb_usb.ini
3) Optional – Download SDK
4) Write application using Android Tablet UI

35. Epson Moverio BT-200
Some currently known limitations to note:
– GPS Location Provider issue
– No Google Play Services
– Alignment issues with AR SDKs

36. Optinvent ORA-1

37. Optinvent ORA-1

38. Optinvent ORA-1 Setup
Easiest to get up-and-running:
1) Use touchpad to turn on USB debugging
2) Optional – Download SDK for Smartphone
Communication via Bluetooth
3) Write application using Android Tablet UI

39. Optinvent ORA-1

40. Optinvent ORA-1
Some currently known limitations to note:
– Gyroscope gravity vector issue

41. 3rd-Party SDKs
User Interaction, Tracking, Rendering
Vendor SDKs
Hardware Support, UI Paradigm
OS SDK
Standard Mobile Dev

42. metaio + Epson Moverio BT-200
Stereo See-Through AR!*
* Content appeared farther away than target

43. metaio + Epson Moverio BT-200
Stereo See-Through AR!*
* NOTE: Not available yet via Unity plug-in

44. Wikitude + Epson Moverio BT-200
Stereo See-Through AR!*
* Content appeared shifted left and down

45. Hand-eye Calibration

46. Wikitude – Compiling Examples
Make sure to uncheck “Force error…”

47. Wikitude + Vuzix M100
Video-based AR

48. FOV2Go + Unity + Moverio BT-200
Stereo VR!

49. FOV2GO

50. FOV2GO

51. OTG Platforms - Gesture Input

52. OTG Platforms - Gesture Input

53. OTG Platforms - Gesture Input

54. Catchoom
Cloud-based Image recognition

55. Wearscript for Google Glass

56. Wearscript for Google Glass
1) Install APK’s and Authenticate
curl -L http://goo.gl/nRjW6y > install.py
&& python install.py
2) Scan QR Code at api.wearscript.com
3) Auth with Google and Github
4) “Okay Glass” … “Wear a Script”
5) “Playground”
6) Edit HTML and Javascript in Playground
7) Rinse and Repeat

57. Wearscript for Google Glass

58. Wearscript for Google Glass

59. Wearscript for Google Glass
See through AR

60. Layar for Glass
1) Download Layar for Glass .APK
2) Install via ADB
3) Author content in Layar using Creator or
Layar Developer API (on server)
4) “Okay Glass”… “Scan this”
- Takes a static picture and pulls content

61. ARPA Glass SDK

62. ARPA Glass GPS SDK

63. Watch this Space!

64. Thank You!
Patrick
O’Shaughnessey
@patchedreality
patrick@patchedreality.com
http://patchedreality.com