Barcamp London 7 Mobile AR Guide

Barcamp London 7
25.10.2009

Innovative (Mobile) Interactivity
(Augmented Reality and more…)

Inspirational snippets of information,
gathered from the web by Carin Campanario
(updated from Barcamp London 6, 09.03.2009)

1

Index

1 INTRODUCTION 4

2 AUGMENTED AND VIRTUAL REALITY - INFO 5

2.1 VIRTUAL REALITY (VR) ............................................................................................................5
2.2 AUGMENTED REALITY (AR) ......................................................................................................6
2.3 AR - TRAINING .........................................................................................................................7
2.4 AR – GAME WORKSHOP ..........................................................................................................7
2.5 MAGICSYMBOL ........................................................................................................................7
2.6 HOLOTRONICA .........................................................................................................................7
2.7 ARTOOLKIT.............................................................................................................................8
2.8 FLARTOOLKIT .........................................................................................................................8
2.9 PAPERVISION (3D AND X).........................................................................................................9
2.10 PURE DATA (PD) ....................................................................................................................9
2.11 OPENFRAMEWORKS ..............................................................................................................9
2.12 STEREOVISION.....................................................................................................................10
2.13 VIDEO GLASSES ...................................................................................................................11
2.14 3D WITHOUT GLASSES .........................................................................................................13
2.15 VR GLOVES .........................................................................................................................14
2.16 ARDUINO .............................................................................................................................14

3 NEW MOBILE INTERACTIONS - INFO 16

3.1 TOUCH ..................................................................................................................................16
3.2 SPEECH ................................................................................................................................16
3.3 MOBILE TV ............................................................................................................................16
3.4 LIVE VIDEO STREAMING FROM MOBILE TO MOBILE ....................................................................17
3.5 CAMERA VALUES ...................................................................................................................17
3.6 CAMERA MOTION TRACKING ...................................................................................................17
3.7 CAMERA CAPTURE RECOGNITION ...........................................................................................17
3.8 DEVICE MOTION .....................................................................................................................18

4 AR - GAME CONSOLE APPLICATIONS 19

4.1 NINTENDO - WII .....................................................................................................................19
4.2 MICROSOF XBOX - PROJECT NATAL .......................................................................................19
4.3 SONY PLAYSTATION 3 - EYE PET ............................................................................................20
4.4 SONY PLAYSTATION 3 - MOTION CONTROLLER + EYE CAMERA ................................................22

5 AR - MOBILE APPLICATIONS & IDEAS 23

5.1 INTRO ABOUT MOBILE AR APPLICATIONS .................................................................................23
5.2 MOBILIZY - WIKITUDE .............................................................................................................23
5.3 HP - MEDIASCAPES ...............................................................................................................24
5.4 NOKIA - AR WITH IMAGE COMPARISSON ..................................................................................24
5.5 LAYAR – AR BROWSER APP....................................................................................................25
5.6 NOKIA - AR CONCEPT ............................................................................................................26
5.7 ACROSSAIR - NEAREST TUBE .................................................................................................26
5.8 WORKSNUG ...........................................................................................................................26
5.9 IKEA - AR APPS......................................................................................................................26

2

5.10 GOOGLE - SKY MAP .............................................................................................................27
5.11 TAT - ID MAPPING................................................................................................................27
5.12 CONNECTED - SECOND SIGHT .............................................................................................27
5.13 METAIO - CEREAL BOX AR INTERACTION...............................................................................27
5.14 GE - INTERACTIVE 3D MAGAZINE COVER...............................................................................28
5.15 TOTAL IMMERSION - COMMERCIAL AR APPS..........................................................................28
5.16 ARTHUR - ARCHITECTURE TOOL .........................................................................................29
5.17 WHITEAPP - CUSTOMISEABLE AR IPHONE APPS ....................................................................29
5.18 ACROSSAIR - BESPOKE AR IPHONE APPS .............................................................................30
5.19 MEHMET (AKA MEMO) AKTEN - GOLD DUST – INSTALLATION & IPHONE VERSIONS .................30
5.20 MEHMET (AKA MEMO) AKTEN - REINCARNATION - INSTALLATION VERSION .............................30
5.21 TREEHUGGER - AR IDEAS FOR SUSTAINABLY LIVING ..............................................................31
5.22 RACHEL CLARKE - HISTORY AR IDEA ....................................................................................31

6 MOBILE PHONE AS REMOTE CONTROL 32

6.1 UNIQUE AUTOMATION - BATH-O-MATIC ..................................................................................32

7 DATA TRANSFER AND CONNECTION 33

7.1 CONTENT TRANSFER - FROM WEB/LOCATION TO MOBILE (EASY & FREE) ...................................33
7.2 TELEMETRY ...........................................................................................................................33
7.3 BLUETOOTH...........................................................................................................................33
7.4 WIFI & 3G .............................................................................................................................33
7.5 INFRARED ..............................................................................................................................33
7.6 CAMERA ................................................................................................................................33
7.7 RADIO-FREQUENCY IDENTIFICATION (RFID) ............................................................................34

8 EXAMPLES OF GADGETS 35

8.1 EREADER ..............................................................................................................................35
8.2 ECHATTER.............................................................................................................................35
8.3 SCRIBBLER FRIDGE MAGNET..................................................................................................36
8.4 BAMBOOTABLET ....................................................................................................................36
8.5 NABAZTAG.............................................................................................................................37
8.6 LINUX PINGUIN ......................................................................................................................37
8.7 AIBO .....................................................................................................................................37
8.8 PRADA WATCH ......................................................................................................................37

9 MOBILE FLASH (LITE) WIDGETS 38

9.1 WIDGET ADVANTAGE (COMPARED TO NATIVE APPS) ................................................................38
9.2 FLASH(LITE) ADVANTAGE (MULTI-PLATFORM & HIGH PERFORMANCE IN RICH MEDIA) .................38
9.3 DEVICE SERVICES IN FLASHLITE WIDGETS ..............................................................................38
9.4 WIDGET LAUNCH BUTTONS ON N97 HOMESCREEN ..................................................................39

3

1 Introduction
This document lists all the information I gathered during 2 intensive web surfing sessions in March and
October 2009, when I was trying to find answers to e.g. following questions:

Will Gadgets (small smart devices) and Widgets (small single-purpose web-based programs) invade our
daily lives?

Will we expect our widgets to be scattered across all kinds of device platforms?

Will we expect all our devices to connect continuously, globally, silently, wireless and free of (extra) charge
via Wi-Fi, RFID, Bluetooth, Infrared, USB, etc. to the internet, GPS, and to all kinds of other devices, like
mobile phones, watches, video glasses, earphones, PDAs, laptops, desktop computers, billboards, shop
displays, pay machines, club entrances, restaurant menus, loud speakers, lighting systems, projectors (of
screens, keyboards, avatars, etc.), TVs, fridges, Nabastacs, etc.?

Will we expect them to interact with us via touch (soft keys, hard keys, touch screens, device housing
haptics), sound (speech and noise), motion (of the device itself), camera tracking (target motion, gesture,
shape or colour; or recognition of camera content via data comparison), received values (GPS position,
RFID identity, light intensity, etc.), according to our (manually set up and automatically expanded) user
profile?

What role will virtual and augmented reality play on these gadgets and widgets? Will they become an
integral part of our reality?

Will different gadgets replace our mobile phones, or will our mobile phones be(come) our main (integral)
gadget?

What kind of gadgets, widgets, applications, services, platforms, technologies and interactions are there
around in 2009, and what could the future bring?

This document is not meant to be exhaustive or 100% accurate, but merely holds together little snippets of
the information I was able to find and compile within a very short time, with the links to the sites where I
found that information.

During my web-surf I also saved many images and screenshots. They are not included in this doc, but I
could point you to them...

Have fun!

Carin Campanario

4

2 Augmented and Virtual Reality - Info

2.1 Virtual Reality (VR)
Jonathan Strickland wrote “How Virtual Reality Works”
(http://electronics.howstuffworks.com/gadgets/other-gadgets/virtual-reality.htm/printable)

Kevin Bonsor mentions following in “How Augmented Reality Will Work”
(http://www.howstuffworks.com/augmented-reality.htm): << On the spectrum between virtual reality, which
creates immersible, computer-generated environments, and the real world, augmented reality is closer to
the real world. Augmented reality adds graphics, sounds, haptics and smell to the natural world as it
exists. >>

Virtual Reality (http://dictionary.zdnet.com/definition/virtual+reality.html ) is an artificial reality that projects
the user into a 3D space generated by the computer. A virtual reality system uses stereoscopic goggles
that provide the 3D imagery and some sort of tracking device, which may be the goggles themselves for
tracking head and body movement, or a "data glove" that tracks hand movements. The glove lets you
point to and manipulate computer-generated objects displayed on tiny monitors inside the goggles.

Serious Work or Entertainment
Virtual reality (VR) can be used to create an illusion of reality or imagined reality and is used both for
amusement as well as serious training. Flight simulators for training airplane pilots and astronauts were
the first form of this technology, which provided a very realistic and very expensive simulation.

Spatially Immersive Environments
Virtual reality has other variants. Spatially immersive displays use multi-sided rooms that you walk into,
and an "immersive theatre" or "immersive wall" uses a large flat or curved screen (8-24' long) that
completely fills your peripheral vision. Desktop virtual reality (desktop VR) uses a computer to play games
and view environments that you move around in, although they lack the 3D reality of true VR systems.
See head mounted display, 6DOF, cyberspace, VRML, mixed reality, virtual world and Second Life.

Virtual Reality at the Dentist
In this application, the child is looking through the goggles and manipulating the scenes that he sees with
a game controller. (Image courtesy of I-O Display Systems, www.i-glasses.com)

Fakespace Systems' CAVE products simulate a VR environment for various purposes, such as testing the
design of a new building (train station above) or learning how to operate a Caterpillar bulldozer (below). In
the latter, the steering wheel on the left meets the real steering wheel on the right in virtual space. CAVE
was developed by the Electronic Visualization Laboratory at the University of Illinois in the early 1990s.
(Images courtesy of Fakespace Systems Inc., a subsidiary of Mechdyne Corporation,
www.mechdyne.com)

5

The 6 Degrees of Freedom or 6DOF (http://dictionary.zdnet.com/definition/6DOF.html ) are the amount of
motion supported in a robotics or virtual reality system. Six degrees provides X, Y and Z (horizontal,
vertical and depth) and pitch, yaw and roll. Three degrees of freedom (3DOF) provides X, Y and Z only.
See pitch-yaw-roll.

Virtual Reality Modelling Language or VRML (http://dictionary.zdnet.com/definition/VRML.html) is a 3D
graphics language used on the Web. After downloading a VRML page, its contents can be viewed, rotated
and manipulated. Simulated rooms can be "walked into." The VRML viewer is launched from within the
Web browser. The first VRML viewer was WebSpace from SGI, whose Open Inventor graphics library was
the basis for developing VRML. Cosmo Player, WorldView and Cortona are other popular Windows
viewers, and SimVRML and Virtus Voyager are well known Mac viewers.

See also: http://en.wikipedia.org/wiki/Virtual_reality

VR products: http://www.vrealities.com/
Head mounted displays: http://www.vrealities.com/hmd.html
Displays: http://www.vrealities.com/stereoscopicdisplays.html
Gloves: http://www.vrealities.com/5dtglove14.html

2.2 Augmented Reality (AR)
Kevin Bonsor mentions following in “How Augmented Reality Will Work”: << Augmented-reality displays
overlay computer-generated graphics onto the real world and adds graphics, sounds, haptics and smell to
the natural world as it exists. >>
Article: http://www.howstuffworks.com/augmented-reality.htm
Other links: http://computer.howstuffworks.com/augmented-reality6.htm
Printable: http://www.howstuffworks.com/augmented-reality.htm/printable

Mixed Reality (http://dictionary.zdnet.com/definition/mixed+reality.html ) is a type of virtual reality that
combines real and imagined images. In "augmented reality," most of the images are real. For example,
using transparent headsets, you could see how that new sofa would look in your own living room, or view
the 3D schematic of a jet engine while you work on the engine itself. With "augmented virtuality," most of
the imagery is computer-generated. For example, you might see something real, perhaps even yourself,
projected into an imaginary environment. See virtual reality.

Game idea:
Augmented reality software could allow a group of mobile users to film each other, while each of them
manipulates a specific 2D graphic. This could be just fun or educational as well. If only the others can see
(on their mobile screens) what your card represents in the application, then they could explain what the
object is (for) and you could guess its name, so that each person in the group trains his knowledge on the
related subject (e.g. medieval times). The films (with the users and their interactive 3D video objects)
could be shared, reviewed and commented afterwards.

6

2.3 AR - Training
The Virtual Reality Lab (VRlab), EPFL in Lausanne (http://vrlab.epfl.ch/About/about_index.html ) was
founded in July 1988 by its director, Professor Daniel Thalmann. The laboratory is mainly involved in the
modelling and animation of Three-Dimensional Inhabited Virtual Worlds. VRlab is a world leader
laboratory in real-time Virtual Humans and a key player in the area of multi-modal interaction, immersive
Virtual Environments, and Augmented Reality.

One of Vrlab’s Project European project is STAR (http://vrlab.epfl.ch/Projects/projects_index.html), which
covers various aspects of augmented reality applied to enhance animations concerning virtual actors
manipulating objects for the purpose of training operability of industrial equipments.

2.4 AR – Game Workshop
Mediamatic (http://www.mediamatic.net/ ) organizes exhibitions, presentations, workshops and much more
(related to New Media, Art and Society). Its site freely mixes news, theory and people:
http://www.mediamatic.net/index.php?lang=en

Mediamatic organizes workshops in Amsterdam (http://www.mediamatic.net/page/9832) on new
developments in interactive (media) technologies, with a cultural approach. The courses offer effective
hands-on training along with sharp conceptual exploration and are about experimenting, playing, testing
and having fun! Recent courses included focus on hybridity, the integration of digital components in
material objects, workshops around the Fablab machinery, the (Lilypad) Arduino, game based
technologies & Machinima, PureData, RFID & the Internet of Things, location based media, mobtagging,
radio experiences, Interactive film & Korsakow and anyMedia documentaries.

In workshop “Augmented Reality Games” in 2, 3 and 4 June 2008
(http://www.mediamatic.net/page/36632 and http://www.mediamatic.net/page/37778/en) participants
conceptualise and construct a prototype of their own Augmented Reality Game in 3 days.

2.5 MagicSymbol
MagicSymbol™ (demo: http://www.magicsymbol.com/) is the next generation of 'reveal' technology,
providing a unique experience. On filming themselves with a (2D) card, participants will see themselves on
screen and on their cards will appear a (3D) video animation (with sound and interaction). Move and spin
the card around, and the (3D) video clip stays magically glued to the surface.

You can create such augmented reality (also) with (F)LARToolkit and Papervision. Demos:
Smart Grid: http://ge.ecomagination.com/smartgrid/?c_id=Huff#/augmented_reality
John Lindquist: http://pv3d.org/2009/03/12/augmented-reality-flartoolkit-demo-reel/
Seb Lee-Delisle: http://www.sebleedelisle.com/?p=383

2.6 Holotronica
Holotronica (from holographic and electronica) describes all artistic holotronic works.

7

2.7 ARToolKit
ARToolKit (http://artoolkit.sourceforge.net/ and http://www.hitl.washington.edu/artoolkit/)
is a software library for building Augmented Reality (AR) applications. These are applications that involve
the overlay of virtual imagery on the real world. For example, in the image to the right a three-dimensional
virtual character appears standing on a real card. It can be seen by the user in the head set display they
are wearing. When the user moves the card, the virtual character moves with it and appears attached to
the real object.

One of the key difficulties in developing Augmented Reality applications is the problem of tracking the
users viewpoint. In order to know from what viewpoint to draw the virtual imagery, the application needs to
know where the user is looking in the real world.

ARToolKit uses computer vision algorithms to solve this problem. The ARToolKit video tracking libraries
calculate the real camera position and orientation relative to physical markers in real time. This enables
the easy development of a wide range of Augmented Reality applications.

Some of the features of ARToolKit include:
* Single camera position/orientation tracking.
* Tracking code that uses simple black squares.
* The ability to use any square marker patterns.
* Easy camera calibration code.
* Fast enough for real time AR applications.
* SGI IRIX, Linux, MacOS and Windows OS distributions.
* Distributed with complete source code.

ARToolKit was originally developed by Dr. Hirokazu Kato, and its ongoing development is being supported
by the Human Interface Technology Laboratory (HIT Lab) at the University of Washington, HIT Lab NZ at
the University of Canterbury, New Zealand, and ARToolworks, Inc, Seattle.

ARToolKit is made available freely for non-commercial use under the GNU General Public License.
Commercial licenses to a professional implementation of ARToolKit are available for users for whom the
GPL is not suitable, or who require a higher level of support, or who require customisation or other
specialist modifications. Commercial licenses are administered by ARToolworks, Inc., Seattle, WA, USA.

2.8 FLARToolkit
FLARToolkit (http://www.libspark.org/wiki/saqoosha/FLARToolKit/en) detects the marker from an input
image and calculates the camera position in the three-dimension space.
libspark (FLARToolKit) site: http://www.libspark.org/wiki/WikiStart/en

8

2.9 Papervision (3D and X)
PapervisionX (http://blog.papervision3d.org/ ) is the next version of Papervision3D, based on Flash10’s
new 3D API. Papervision3D (http://code.google.com/p/papervision3d/ ) is an open source 3D engine for
the Flash platform. Flash allows animation and interaction in the 3D augmented reality. The user could
e.g. blow or speak into the microphone to trigger actions (blow out candles, blow on wind turbines, speak-
command objects, etc.).

2.10 Pure Data (Pd)
Pure Data or Pd (http://en.wikipedia.org/wiki/Pure_Data ) is a graphical programming language developed
for the creation of interactive computer music and multimedia works. Pd is an open source project and has
a large developer base working on new extensions to the program.

Pure Data or Pd (http://puredata.info/) is a real-time graphical programming environment for audio, video,
and graphical processing, which is easy to extend by writing object classes ("externals") or patches
("abstractions"). The work of many developers is already available as part of the standard Pd packages
and the Pd developer community is growing rapidly. Recent developments include a system of
abstractions for building performance environments; a library of objects for physical modelling; and a
library of objects for generating and processing video in real-time.

Pd is free software and can be downloaded either as an OS-specific package, source package, or directly
from CVS. Pd was written to be multi-platform and therefore is quite portable; versions exist for Win32,
IRIX, GNU/Linux, BSD, and MacOS X running on anything from a PocketPC to an old Mac to a brand new
PC. It is possible to write externals and patches that work with Max/MSP and Pd using flext and cyclone.

Example: http://doboxrecordings.com/db/index.php/2007/05/10/maker-faire-2007-pd-osc-processing-
quartz-composer/

2.11 OpenFrameworks
OpenFrameworks is an open source C++ toolkit for creative coding, and includes e.g. motion tracking
code.

OpenFrameworks: http://www.openframeworks.cc/
iPhone Development with openFrameworks and ofxiPhone: http://www.memo.tv/ofxiphone

9

2.12 Stereovision
Stereovision is actually the normal way almost everyone sees in the real world. We all have two eyes and
perceive depth by a mental interpretation of the world we view through those two eyes. Each eye gives a
slightly different perspective on the objects viewed and this slight difference provides depth cues to our
brain. Objects which are relatively close will shift a larger distance horizontally when viewed from one eye
and then switching eyes. Objects which are relatively far away shift a smaller amount. Hold your finger up
about 6 inches in front of your nose. Close one eye, then switch back and forth quickly. See the image
shift? That left and right slightly shifted perspective is what creates the depth perception that your brain
interprets. That's why you have 2 eyes!

The E-D software and drivers automatically convert the images on your monitor into a left and right
perspective. Each image flickers back and forth so fast on your monitor that it is not noticeable to the
human eye.

Working synergistically with our advanced active glasses, the flickering of each image is precisely timed
with flickering of the left and right lens of the glasses, again faster than can be perceived. Thus,
stereovision as it pertains to viewing a virtual world means that you have the capability to produce two
separate images and that each eye sees only one of the two images. If this is done correctly, your mind
will combine the two images in such a way that you actually have the perception of being "in" the virtual
world rather than just viewing a picture of the virtual world. This adds a level of realism and immersion to
games and other images that is otherwise unattainable. In addition to perceiving depth "into" the monitor it
is also possible to make objects appear to come "out of" the monitor. Almost all fairly recent computers
and games come pre-equipped with the necessary tools for proper viewing.

It's important to note that eDimensional 3D images are in full colour and do not use the old fashioned
red/blue effect. The colours below are just to emphasize the difference in perspective.

Info: http://www.edimensional.com/category_info.php?cPath=21

Products:
http://www.edimensional.com/index.php?cPath=21&osCsid=bc3398d46fd89e2313262f316ade7b3d&ref=7
3&gclid=COD62Zadw5kCFRCdnAod7W-Dtg

E-D Wireless 3D Glasses for the PC $99.95
Set yourself free of wires and view amazing 3D gaming action through our wireless 3D glasses.
* Works on virtually all PC games
* Supports virtually any PC
* Supports both CRT and LCD monitors
* Comfortable and adjustable

E-D Wired 3D Glasses for the PC $69.95

10

Works just like our critically acclaimed wireless glasses and comes with everything you need to play all of
your favourite games in stunning 3D. Sleek and stylish -- you won't believe your eyes!

Vuzix - VR920 Head Mounted Display $399.95
If you're looking for a head mounted display with built-in screens, we now offer the Vuzix VR920. Features
3D, head tracking, audio, mic and more in a compact and portable display device.

3D Combine 2D to 3D Photo Software $39.95
Convert your own pictures into real 3D instantly. 3DCombine gives you a new and fun way to take your
digital photos and images and view them in amazing 3D with our wired or wireless 3D glasses.

3D Glasses for Samsung and Mitsubishi Televisions $149.95
Did you know that the latest DLP and Plasma TVs from Samsung and Mitsubishi now offer high resolution
3D as a standard option? If you've got one of these televisions, you'll need our new viewing systems to
unleash the full 3D potential.

Long Range Viewing Equipment for Stereo Projection $295.00
Specially designed stereoscopic viewing equipment for use in conjunction with stereoscopic projection, our
powerful custom emitter and shutter glasses view 3D images up to 20' away. Laboratory tested for
exceptional performance at a fraction of the price.

2.13 Video glasses
Head Mounted Display (http://dictionary.zdnet.com/definition/head+mounted+display.html ) is a display
system built and worn like goggles that gives the illusion of a floating monitor in front of the user's face.
The head mounted display (HMD) is a critical component of a body-worn computer (wearable computer).
Single-eye units are used to display hands-free instructional material, and dual-eye, stereoscopic units are
used for virtual reality applications. See heads-up display, body-worn computer and CAVE.

EEYE (http://www.eeye.hk/product.asp) has 3 types of video glasses:
- TV viewing
- Film viewing
- Film viewing & capturing

Vuzix (http://www.vuzix.co.uk/) has many types of video glasses:

Vuzix Wrap 920AV (January 2009: http://www.vuzix.com/UKSITE/iwear/reviews.html )
The Wrap 920AV is the world’s “first in class” Video Eyewear that takes the form of a standard pair of
fashionable sunglasses with revolutionary ‘see-thru’ Quantum optics technology that doesn’t block out the
world around you. Its unique ‘see-thru’ lens design allows you to stay grounded in the real world while
watching your private video display or experiencing augmented or mixed reality on mobile devices such as
the iPhone. A revolutionary patent pending electronic IPD system enables adjustment for virtually all facial
structures and optional prescription lens inserts provide the ultimate solution for eyeglass wearers.

11

The Wrap 920AV provides a 60-inch monitor as seen from 9 feet and has available expansion options – all
in a lightweight package that is less than 3 ounces.
Coming Autumn of 2009

Vuzix AV230 XL
The AV230 XL is a wearable display that transforms your small portable video player screen into a
personal home cinema with a virtual 44-inch screen as viewed from nine feet. Dual displays provide crisp
images and vivid colours through optics aligned to military specifications. Worn like regular glasses, the
AV230 XL includes separate focus adjustments for each eye and removable high-quality stereo
earphones. A single removable AA battery affords up to 17 hours of viewing enjoyment. Price: £149.99 /
€169.99 (Including VAT at 15%)

Vuzix iWear VR920
Step inside with the Vuzix iWear VR920, the world’s most popular virtual reality and gaming solution that
incorporates immersive big-screen 3D video, head tracking, microphone and audio. You can move, look
around, listen, and communicate with others - almost like being in the ‘real’ world. The iWear VR920
opens amazing new doors to the World Wide Web. Price: £299.99 / €349.99 (Including VAT at 15%)

YouTube videos:

Vuzix mobile TV:
http://www.youtube.com/watch?v=907Z__2ohKw

Vuzix augmented reality:
Lego - http://www.youtube.com/watch?v=SYbUJJDpcs8
Virtual Reality Fishing - http://www.youtube.com/watch?v=k3l5YD_FOfQ&feature=related

Vuzix widescreen video glasses:
http://www.youtube.com/watch?v=jyjOG39jsDc
http://www.youtube.com/watch?v=-uxqO2AkfAc

Vuzix full review (mentioning 3D stereoscopic option, pros + cons):
http://www.youtube.com/watch?v=4MR3AxwpZsI&feature=related

12

2.14 3D without glasses
Wazabee (http://wazabee.net/) is a registered brand of Spatial View Inc.

3DeeShell
Wazabee 3DeeShell is the world’s first protective case designed for viewing glasses-free 3D content on
the Apple iPhone and iPod Touch. Create and share relevant stereo 3D images with friends, family or
anyone using an iPhone. Enjoy the visual excitement of truly vibrant 3D content and access content from
online sources or upload your own 3D imagery. Watch clips and play games in 3D in the palm of your
hand without the need for special glasses or an external display. Easily removable for enjoying both
regular 2D and vivid 3D content. 49.99 EUR / 49.99 USD Excluding VAT and shipping,.

3DeeCamera
3DeeCamera enables you to create 3D images using your built-in iPhone camera. Take two side-by-side
photographs or choose two stereo-pairs from storage to easily generate stunning 3D images by shifting,
rotating and scaling the image pairs. Immediately create and share 3D images with friends, family or
anyone using an iPhone.

3DeeVUsion
The ultimate 3D viewing application for the iPod Touch. 3DeeVUsion allows you to select a pair of images
from the Photo Library for 3D viewing. Experience and view any stereo 3D content including images
generated with your iPhone or any other stereo 3D Camera.

3Dee!oadr
An easy and simple way to connect with your Yahoo Flickr account. The 3Dee!oadr is available to search
and view over 500,000 pre-existing stereoscopic 3D images. Furthermore, it allows you to upload your
own content to a Flickr! Account.

3DeeFlector (Available Spring 2009)
Introducing the Wazabee 3DeeFlector - A removable overlay screen designed for viewing glasses-free 3D
content on all 13.3 inch notebooks! Enjoy the excitement of truly vibrant content by turning your notebook
into 3D. Watch clips, play games in 3D and experience a perfect 3D impression without loss of image
quality. Build your professional 3D business presentation without the need for special glasses or an
external display. Create and share relevant stereo 3D images with friends, family or anyone using a 13.3
inch notebook.

13

2.15 VR Gloves
The 5DT Data Glove 14 Ultra (http://www.vrealities.com/5dtglove14.html ) has been designed to satisfy
the stringent requirements of modern Motion Capture and Animation Professionals. It offers comfort, ease
of use, a small form factor and multiple application drivers. The high data quality, low cross-correlation and
high data rate make it ideal for realistic real-time animation. The 5DT Data Glove 14 Ultra measures finger
flexure (2 sensors per finger) as well as the abduction between fingers. The system interfaces with the
computer via a cable to the USB Port (Platform Independent). It features an auto-calibration function, 8-bit
flexure and abduction resolution, extreme comfort, low drift and an open architecture. The optional
Wireless Kit interfaces with the computer via Bluetooth technology (up to 20m distance) for high speed
connectivity for up to 8 hours on a single battery. Right- and left-handed models are available. One size
fits many (stretch lycra).

SPECIFICATIONS
Bend Sensing Method: Fully enclosed fibre optic bend sensors
Number of Sensors: (two per finger) as well as abduction between fingers
Resolution: 8-bits (256 positions/finger)
Output Interface: USB 1.1, Minimum 75hz sampling rate, 200hz per finger Tracking, Integrated pitch and
roll sensor
Glove fitting: RH & LH versions; "One size fits many"
Calibration Routine: Open & close hand; each user

5DT Data Glove 5 Ultra (NOT 14 Ultra):
5DT Data Glove 5 Ultra, Right Handed - $895.00
5DT Data Glove 5 Ultra, Left Handed - $895.00
Wireless Glove Kit - $1495.00

2.16 Arduino
The LilyPad Arduino (http://www.arduino.cc/en/Main/ArduinoBoardLilyPad) is a micro-controller board
designed for wearables and e-textiles. It can be sewn to fabric and similarly mounted power supplies,
sensors and actuators with conductive thread.

Tutorials, etc: http://www.arduino.cc/playground/

Pguino is e.g. a real world application based on the Arduino, which measures the MPG (miles/gal) of a
driver to provide feedback to the driver so they may change their driving habits and conserve on gas. This
application encompasses the use of an LCD, button menu, and data input and manipulation.

The CyberEmotions consortium (http://www.cyberemotions.eu/ ) began in February 2009 for a period of
four years. The project focuses on the role of collective emotions in creating, forming and breaking-up e-
communities. The project involves nine partners in six different countries in Europe, including experts in
the psychology of emotions, complexity, web data collection, artificial intelligence and virtual reality.

14

The main aims of the project are:
To understand the role of collective emotions in creating, forming and breaking-up ICT mediated
communities as a spontaneous emergent behaviour occurring in complex techno-social networks
To understand the relationship between emotions of individuals as revealed by subjective experience,
behaviour, physiological responses, and expressions with online emotional behaviours of ICT mediated
dyads and groups in an integrative multi-level approach
To create decentralized adaptive tools which allow the amplification of positive or the suppression of
negative collective emotions in e-societies and will take into account the heterogeneity of interacting
humans
To prepare the theoretical background for the development of the next generation emotionally-intelligent
ICT services using models of self-organized active agents and sociophysics methods.

Understanding these phenomena is important in view of the growing role of ICT-mediated social
interactions and some specific features of e-communities. The challenge of this interdisciplinary project is
to combine psychological models of emotional interactions and algorithmic methods for detection and
classification of human emotions in the Internet with probabilistic models of complex systems and data
driven simulations based on heterogeneous emotionally-reacting agents. The theoretical foundations will
be mainly based on statistical physics applied to the study of the emergent properties of many-object
systems interacting in self-organized evolving networks.

Empirically, we concentrate on the issue of how to support and maintain the emotional climates of
security, trust, hope, and freedom in future techno-social communities and how to prevent or resolve
conflicts within them. Data on human emotions and their influence on the structure of sustainable
cooperative communities will be collected from the Blogosphere, newsgroups and Internet discussion
forums and compared to computer simulations based on active agent models. Finally, we plan to develop
artificial agents that can help to assess the emotional states of the members of e-communities and can act
as cyberadvisers in e-communities. The results of the project will build the foundations for the next
generation of socially- and emotionally-intelligent ICT services.

Partners (http://www.cyberemotions.eu/partners.html) :
Poland: Warsaw University of Technology (WUT), Centre of Excellence for Complex Systems Research
[Project leader]
Poland: Gemius SA, online research agency
Switzerland: EPFL, Virtual Reality Lab
UK: University of Wolverhampton, School of Computing and IT, Statistical Cybermetrics Research Group
Austria: Österreichische Studiengesellschaft für Kybernetik (The Austrian Research Institute for Artificial
Intelligence - OFAI)
Switzerland: ETH Zurich, Chair of Systems Design
Slovenia: Jozef Stefan Institute (JSI) Ljubljana, Department of Theoretical Physics
Germany: Jacobs University, Bremen, TU Berlin, Faculty of Computer Science, IKM Research Group

15

3 New Mobile Interactions - Info

3.1 Touch
Interesting exchange on MOMOLO mailing list (February/March 2009):
Touchscreens - a herd mentality?
(http://tech.groups.yahoo.com/group/momolondon/msearch?query=Touchscreens+-
+a+herd+mentality%3F&submit=Search&charset=UTF-8 )

HAPI (haptic interaction for mobile devices):
Haptic research: http://www.hapi-project.com/
Blog: http://www.partly-cloudy.com/

When digital objects can be manipulated directly by hand, the interaction principles of conventional
mouse-keyboard-interfaces are not valid any longer. In order to be able to develop applications for
sensitive surfaces, it’s therefore necessary to first create adequate interaction principles for these novel
computer interfaces. Tangent (http://www.hapi-project.com/posts/view/21), an interactive multitouch
surface, enables us to transfer interactions with physical objects known from everyday life to the digital
medium.

Multitouch Jazzmutant Instruments:
Video: http://www.jazzmutant.com/videos/lemurlight.mov
Site: http://www.jazzmutant.com/

Scribbler mobile application (http://www.mobiletipstricks.com/scrible-on-your-windows-mobile-with-
scribbler/ ) is designed specially for Symbian UIQ (user interface quartz) 3 phones. What good about UIQ
series phones is the inherent support for touch screen functionality and Scribbler makes full use of this
technology by enabling you to create or write what ever you want to on the screen of your mobile phone.
From: Scrible On Your Windows Mobile with Scribbler (Nov 28, 2008).

3.2 Speech
Spinvox (http://www.spinvox.com/) captures spoken messages, converts them into written text and
delivers these to destinations of choice (e.g. inbox, blog, wall, space…).

SpinVox will be opening up access to its Voice Message Conversion System (VMCS™) via SpinVox
Create (https://www.spinvox.com/developer), a simple interface to quickly build and monetise server
based or mobile speech applications.

3.3 Mobile TV
Gadget show video (Korean mobile TV after 50 sec):
http://www.youtube.com/watch?v=cIcFUKL9r-
g&feature=PlayList&p=D49A28DCA1CFC60F&playnext=1&playnext_from=PL&index=3

16

3.4 Live video streaming from mobile to mobile
LTE (http://www.dailynet.de/Fusion-Akquisation-Uebernahmen/12122.php) is a next generation wireless
technology that delivers seamless mobile broadband connectivity making applications like streaming HD
Video, interactive gaming, and video conferencing as accessible on mobile devices as they are at home or
the office.

Floobs (http://www.floobs.com) is a Finish startup, which develops a live streaming platform that enables
live streaming from mobile phones, web cams, and dv-cams to other mobile phones and web.

Live video from mobile to mobile could enable great use experiences, e.g.:
- one user could see where the other is going and guide him in the right direction
- one user could give a virtual tour to another mobile user at home (and check out what the second one
requests)

3.5 Camera values
Camera software values for distance, light, shake, etc. could be used as interaction inputs in mobile
applications. The user could e.g. zoom in/out on elements on his screen by raising/lowering his mobile,
using the distance measure feature of his phone’s camera.

3.6 Camera motion tracking
Emma Persky (www.travellerwithatale.com), Grant Skinner and others developed applications that allow a
web cam to focus on (‘grab’) one or several targets, trace their movements, and use these movements as
interaction inputs. Microsoft and Sony have integrated this technology for their video game console
systems, with Project Natal and Eye Pet.

Such software could allow the user to point his phone camera to specific targets (e.g. on billboards, in
shops, at events, or throughout the city), interact with these targets (by moving the targets or the camera),
and trigger specific reactions on his phone’s screen in real time.

3.7 Camera capture recognition
Nestor - Ar live recognition system

Nestor is a real-time shape recognition and pose estimation system for natural shapes. The system runs
on an N95 mobile phone and tracks solid blobs and curves. Nestor was developed by the Human
Interface Technology Laboratory New Zealand (HIT Lab NZ) is developing and commercialising
technology that improves human computer interaction and by doing so unlocks the power of human
intelligence.

17

The HIT Lab NZ conducts research with new emerging technologies such as Augmented Reality, Next
Generation Video Conferencing, Immersive Visualization and Perceptual User Interfaces. Interaction
Design techniques are used to adapt these technologies to the needs of end users and solve real world
problems. The end goal is to improve the user experience with technology.

Video - Augmented Reality on Natural Shapes (live recognition):
http://www.youtube.com/watch?v=je8SihypYA4

Hitlabnz Site: http://www.hitlabnz.org/wiki/Home

Microsoft and Sony have integrated this technology for their video game console systems, with Project
Natal and Eye Pet.

3.8 Device motion
Nokia’s accelerometer sensor values for e.g. shake (double tapping) and x, y and z axis and rotation can
be used as interaction inputs in mobile applications. Such inputs demand much less precision,
concentration and dexterity than conventional mobile interaction with soft and hard keys (buttons).

The Flash Lite Developer's Library 1.3 on forum.nokia now supports Service APIs (like the Sensor Service
API) which allow Flash Lite 3.0 applications to use the S60 5th Edition device sensor values:
http://library.forum.nokia.com/index.jsp?topic=/Flash_Lite_Developers_Library/GUID-46EABDC1-37CB-
412A-ACAD-1A1A9466BB68.html

The user could e.g.
- lift the right/left side of the device upwards for the next/previous screen
- lift the top/bottom side of a device upwards for a view-mode toggle (e.g. text/image)
- rotate the device clockwise/anti-clockwise to steer a screen object, pull a virtual lever (switch), move a
slider up/down, etc.
- shake the device to reset the application or return to the home screen

Reuters Slideshow widget (in progress):http://clients.tui.co.uk/reuters_slideshow
iPhone demo with sensor apps: http://www.apple.com/uk/ipodtouch/gallery/ads/index.html

18

4 AR - Game Console Applications

4.1 Nintendo - Wii
Wii is Nintendo's home video game console that targets a broader demographic than Microsoft's Xbox 360
and Sony's PlayStation 3 (and sold more than them worldwide, in December 31, 2008). It shows the
player’s customized avatar on the screen, which moves exactly as the player in real-time.

- Wii Remote is a wireless motion-sensing handheld remote controller, for 3D motion detection and
pointing.
- Wii MotionPlus is a controller that tracks players' movements in finer detail and with greater accuracy,
replicating the slightest twist of the wrist or turn of the body exactly on the TV screen, allowing users to
become even more immersed in Wii game play.
- Wii Balance Board is a flat board with multiple pressure sensors that measure the user's weigh and
centre of balance (the location of the intersection between an imaginary line drawn vertically through the
centre of mass and the surface of the Balance Board), which it transmits to the Wii through Bluetooth.
- WiiConnect24 enables Wii to receive messages and updates over the Internet while in standby mode.

Wiki:
http://en.wikipedia.org/wiki/Wii
http://en.wikipedia.org/wiki/Wii_MotionPlus
http://en.wikipedia.org/wiki/Wii_Balance_Board

Amazon:
http://www.amazon.co.uk/Wii-Motion-Plus-Accessory/dp/B001TOQ8NO

4.2 Microsof Xbox - Project Natal
Microsoft announced ‘Project Natal’, the controller-free interaction experience for their Xbox 360 video
game platform at E3 2009 (the annual gathering for interactive entertainment), on June 1, 2009.

Project Natal enables users to control and interact with the Xbox 360 by using gestures, spoken
commands, or presented objects and images, without the need for a game controller.

See a ball? Kick it, hit it, trap it or catch it. If you know how to move your hands, shake your hips or speak,
you and your friends can jump into the fun - the only experience needed is life experience.

Project Natal’s sensor features an RGB camera, depth sensor, multi-array microphone, and custom
processor running proprietary software, which provides full-body (skeleton) 3D motion capture, facial
recognition, and voice recognition capabilities, for up to 4 people at the time.

The microphone enables the Xbox 360 to conduct acoustic source localization and ambient noise
suppression, allowing for things such as headset-free party chat over Xbox Live.

19

The depth sensor consists of an infrared projector combined with a monochrome CMOS sensor, and
allows to see in 3D under any ambient light conditions. The sensing range of the depth sensor is
adjustable, and will be automatically calibrated based on gameplay and the player's physical environment,
such as the presence of chairs.

The skeletal mapping technology shown at E3 2009 was capable of simultaneously tracking up to four
users for motion analysis, with a feature extraction of 48 skeletal points on a human body at a frame rate
of 30 hertz. Depending on the person's distance from the sensor, Project Natal is capable of tracking
models that can identify individual fingers.

Wikipedia:
http://en.wikipedia.org/wiki/Project_Natal

Site:
http://www.xbox.com/en-US/live/projectnatal/

Project Natal Video:
http://www.youtube.com/watch?v=p2qlHoxPioM

Meet Milo video:
http://www.youtube.com/watch?v=HluWsMlfj68

4.3 Sony Playstation 3 - Eye Pet
Eye Pet is a new game for Sony’s Playstation 3 (PS3) game console, featuring a virtual pet monkey
‘EyePet’, with which the player has to interact in certain ways (e.g. feeding and bathing it) to score points
and gain rewards (new pet objects and outfits for new interactions), and with which the player can just
have fun in mini games (e.g. balloon popping, or driving cars that EyePet has drawn).

The player can:
- Interact with EyePet by moving his hand, body or a printed card - The card is included with the game and
has a unique printing that is identified by the PS3 Eye webcam, so that virtual, animated and interactive
objects can be mapped onto the card in real-time, such as shower heads, soap bottles and hair dryers to
shower EyePet with.
- Customize EyePet - Modify fur length, color and pattern and choose from over 250 unique outfits.
- Draw New Toys for Your EyePet - Watch as they transform into 3D toys in-game.
- Create and Share With Friends - Record your favourite EyePet moments and creations, and then share
them online.

EyePet reacts to every movement and command:
- it leaps towards your fingers as you waggle them in the air

20

- it pounces across the ground when you move your arm down
- it purrs when you pet it
- it laughs when you tickle it
- it chases a ball when you roll it
- etc.

Through the game’s ‘Pet Programme’ challenges you can earn gold medals by completing increasingly
difficult challenges over a 14 day period. The game always feels fresh and constantly rewards, because
every time you do something well you’ll win a new EyePet costume, and every time you complete Pet
Programme section you’ll earn a new object, so that you’ll have a host of objects, toys and costumes to
play with, extending the experience even further while you try everything out.

Besides the ‘Pet Programme’ you can also play ‘Mini games’, like popping balloons, teaching him songs,
sending him for check-ups, or driving cars that he has drawn (you can draw objects for EyePet with a
thick pen, scan them into the Playstation Eye, see EyePet re-draw them, see the objects become 3D, and
then interact with them!)

It would be around 5-8 hours before you’ve seen everything.

You interact via the Playstation Eye camera, which is pointed towards the ground, giving EyePet an area
to move. The game is constantly storing the footage of yourself interacting with EyePet , and shows you
this footage when EyePet sleeps and dreams about previous events.

Pushsquare review:
http://www.pushsquare.com/7466/eye-pet-on-playstation-3-review/

Sony article:
http://uk.playstation.com/games-media/news/articles/detail/item227474/Love-your-EyePet/

Videos:
Trailer: http://www.youtube.com/watch?v=_ZQpqfzDgOk
Pushsquare: http://www.youtube.com/watch?v=Pa8KKSH1ZE0&feature=player_embedded
With children: http://www.eurogamer.net/videos/eye-pet-in-the-wild

Amazon:
Eye Pet: http://www.amazon.com/EyePet-Playstation-
3/dp/B002OOVJUA/ref=sr_1_1?ie=UTF8&s=videogames&qid=1256229166&sr=1-1
Eye Pet Bundle: http://www.amazon.com/EyePet-Bundle-Playstation-
3/dp/B002Q7KWAI/ref=sr_1_2?ie=UTF8&s=videogames&qid=1256229166&sr=1-2
PS3: http://www.amazon.com/PlayStation-3-120-GB/dp/B002I0J4VQ/ref=dp_ob_title_vg
PS3 Eye: http://www.amazon.com/PlayStation-3-
Eye/dp/B000VTQ3LU/ref=sr_1_3?ie=UTF8&s=videogames&qid=1256229166&sr=1-3

21

4.4 Sony Playstation 3 - Motion Controller + Eye camera
Sony announced their new motion controller for the PS3 (Playstation 3) at E3 (the annual gathering for
interactive entertainment) on June 2, 2009. The prototype looks like a wand with a colour-changing ball on
top, which can be tracked by the PlayStation Eye (camera), to overlay on-screen objects (e.g. weapons,
tools, characters, hands, etc.), for actions like:
- Sport (mapping rackets, bats, etc, and calculating trigger force, distance and direction)
- Fighting (mapping characters, hands, weapons)
- Drawing (pencil, spray, object drawing)
- Building (manipulating objects)

The player can
- define the force, distance and direction of his actions, and the moment of triggering (when only pointing,
and when actually drawing/shooting)
- change the screen’s viewpoint (to his or his object’s/wand’s viewpoint)
- change the wand’s purpose (by changing its colour -> which drawing mode/sport tool/weapon/etc.)
- hold up to 4 controllers (with different colours), but realistically 1 or 2 controllers (e.g. 1 for the bow and 1
for the arrow)

The Motion Controller features an orb at the end which can glow in any of a full range of colours. The
uniform spherical shape and known size of the light allows the system to simply determine the wand's
distance from the PlayStation Eye, through the light's image size, thus enabling the wand's position to be
tracked in three dimensions with high precision and accuracy.

The PlayStation Eye is Sony's webcam device for its PlayStation 3 video game console. Its microphone
enables multi-directional voice location tracking, echo cancellation, and background noise suppression,
which allows speech recognition and audio chat in noisy environments without the use of a headset.

Wiki:
http://en.wikipedia.org/wiki/PlayStation_Motion_Controller
http://en.wikipedia.org/wiki/PlayStation_Eye

Article:
http://www.engadget.com/2009/06/02/sony-announces-new-ps3-motion-controller/

Video:
http://www.youtube.com/watch?v=cnuyaIIOyz8

22

5 AR - Mobile Applications & Ideas

5.1 Intro about mobile AR applications
While it may be some time before these types of applications become mainstream on mobile phones, the
current prediction for smartphone sales suggests this will be sooner than you think. Smartphone sales that
support AR apps account for less than 20% of the overall global market (in October 2009) but are growing
fast and are predicted to reach 50% of the mobile market within the next five years.

Article: http://mobverge.blogspot.com/2009/10/ikea-augmented-reality-concept-coming.html
Many AR articles and apps: http://www.engadget.com/tag/augmented+reality/

5.2 Mobilizy - Wikitude
Wikitude is a mobile travel guide for the Android platform based on location-based Wikipedia, Qype and
Lonely PLanet content. It is a handy application for planning a trip or to find out about landmarks in your
surroundings.

Search 350,000 world-wide points of interests based on your current GPS location and address and
display them in a list view, map view or cam view. To get started as easily as possible, two search options
have been provided:
- Simple Search allows users to initiate a search just by pressing "Start Search"
- Advanced Search offers users additional search options (category, distance, and search term)

Search results are displayed on a map (normal or satellite mode) as orange dots. There is a text bubble
containing a short description next to the selected point of interest.

The truly compelling feature is the augmented reality cam view, users may hold the phone’s camera
against a spectacular mountain range and see the names and heights displayed as overlay mapped with
the mountains in the camera. Users may look out of an airplane window to see what is down there. Users
may walk through a city like Seville, Spain, holding the phone’s camera against a building and Wikitude
tells what it is.

WIKITUDE World Browser presents the user with data about their surroundings, nearby landmarks, and
other points of interest by overlaying information on the real-time camera view of a smart-phone.

WIKITUDE.me is a community of mobile augmented reality users and shapers, empowered with a
powerful tool to embed unique points of interest (POI) and location-specific, hyperlinked media content
which can be viewed on the WIKITUDE World Browser.

WIKITUDE DRIVE is a fully-functional, light weight navigational system which overlays point-to-point
directions on a camera-view, without the need for maps.

23

WIKITUDE API is a powerful application programming interface which allows for the open development of
markerless AR experiences, providing developers with the tools to either create their own android
augmented reality applications, or enhance their existing Android applications with an AR camera-view
engine.

Site:
http://www.wikitude.org/
(http://www.mobilizy.com/wikitude.php )

Wikitude Videos:
http://www.youtube.com/watch?v=8EA8xlicmT8
http://www.youtube.com/watch?v=tpaJBu4BEuA&feature=related

WikiDrive Video:
http://www.youtube.com/watch?v=PdmSVCDmJGA

5.3 HP - Mediascapes
The free Mscape Suite enables the creation of Mediascapes, which are applications with mobile, location–
based interactive media (video, audio, images and text) that can be games, stories, experiences, tours,
guides, tools, and more.

With more than 436 million mobile phones with GPS capabilities, Mscape has a vast potential audience.
While most of today’s mediascapes work with GPS (on specific Windows devices:
http://wiki.mscapers.com/bin/view/Main/SupportedDevices), the Mscape plug-in architecture allows for
expansion to other sensors such as infrared, Bluetooth™ wireless technology, and bio sensors, which
enable even more user options (http://www.mscapers.com/about-mscapers/).

Site: http://www.mscapers.com
Mediascapes: http://www.mscapers.com/browse
Demos:
http://www.youtube.com/watch?v=BUOHfVXkUaI
http://www.mscapers.com/what-is-a-mediascape
Mscape demo (after 5:48 min):
http://h30418.www3.hp.com/?rf=sitemap&fr_story=9bab5d9298338617c81e7b85fc0491de0826a439&jum
pid=reg_R1002_USEN

5.4 Nokia - AR with image comparisson
Nokia had a similar research project with augmented reality:
http://www.youtube.com/watch?v=0HOO80RitVI&feature=related

24

When the user takes a mobile picture in the Nokia AR project, it is compared against the pictures in a
database, so that its point of interest will be recognized, so that the POI name and details (like active
telephone link) can be displayed on the mobile screen.

5.5 Layar – AR browser app
Layar is an AR browser developed by Layar. It is a free Android application on your mobile phone which
shows what is around you by displaying real time digital information on top of reality through the camera of
your mobile phone. By holding the phone in front of you like a camera, information is displayed on top of
the camera display view. For all points of interest which are displayed on the screen, information is shown
at the bottom of the screen.

On top of the camera image (displaying reality) Layar adds content layers. Layers are the equivalent of
webpages in normal browsers. Just like there are thousands of websites there will be thousands of layers.
One can easily switch between layers by selecting another via the menu button, pressing the logobar or
by swiping your finger across the screen.

Layar Reality Browser 2.0 features:
* Unique layer specific icons/markers
* Featured and Popular section
* Search function
* Add layer to favorites
* Map view and list view
* Enhanced AR view
* Accuracy information
* “Take me There” function
* “Share layer” and “screen shot” function in layar 2.1 update

Site:http://layar.com/
List of 163 layers:http://layar.com/layers/#health
Layer video:http://www.youtube.com/watch?v=b64_16K2e08&NR=1
Article:http://www.svennerberg.com/2009/06/mobile-first-person-user-interfaces/

Layer Images:
Qype: http://de.hoppala.eu/artikel/wp-content/uploads/2009/08/layar_meets_qype.png
BrightKite: http://blog.brightkite.com/wp-content/uploads/2009/08/layar-screenshot.jpg
Architecture:http://layar.com/wp-content/uploads/2009/07/layar-service-archtecture-blog-and-
pressrelease.png
Large Layar images in Amsterdam:
http://layar.com/wp-content/uploads/2009/07/layar_dreamcatcher_keynote09_template003.png
http://media.svennerberg.com/2009/06/layar-app.jpg

25

5.6 Nokia - AR concept
Nokia’s AR concept involves a new user experience with e.g.wireless:
- Earphones
- See-through AR goggles
- Eye tracking, to select elements on the goggle display
- Bracelet with accelerometer, to confirm selected elements on the goggle display, and trigger actions

Video: http://www.youtube.com/watch?v=CGwvZWyLiBU

5.7 Acrossair - Nearest Tube
One of the first augmented reality apps to go live in the iPhone AppStore. When you load the app, holding
it flat, all 13 lines of the London underground are displayed in coloured arrows. By tilting the phone
upwards, you will see the nearest stations: what direction they are in relation to your location, how many
kilometres and miles away they are and what tube lines they are on. If you continue to tilt the phone
upwards, you will see stations further away, as stacked icons.

Site: http://www.acrossair.com/apps_nearesttube.htm
Video: http://www.youtube.com/watch?v=5fZk0HaIs4s&feature=player_embedded

5.8 Worksnug
WorkSnug uses Augmented Reality to connect mobile workers to the nearest and best places to get some
work done in the city. Users simply hold up and point their iPhone, and the potential connection spots float
alongside the real-life, real-time image of the users’ environment. To help users find the best workspace
for their needs, the WorkSnug team has discovered and reviewed hundreds of places to work – from
family-run cafés to formal co-working spaces – and offers personal observations, including a guide to
power provision, atmosphere, noise levels, and even the quality of the coffee. In addition, WorkSnug users
can suggest new places, review their favourite workspaces and will soon be able to connect with other
local users and create ad-hoc co-working communities. Best of all, the application and all of these
services are completely free of charge.

Presentation: http://www.mashupevent.com/event/augmented-reality
Website: www.worksnug.com
Video: http://www.worksnug.com/
Library: http://connectedpr.eu/worksnug/worksnug-media-library/
Contact: Richard Leyland

5.9 Ikea - AR apps
Try out Ikea furniture within your own space by vmapping it nto what you see through yout phone camera
in your space.

Blog Article: http://mobverge.blogspot.com/2009/10/ikea-augmented-reality-concept-coming.html

26

Video of concept - manual in 3D: http://www.youtube.com/watch?v=V4b4ArHZupM
Video of concept - Catalogue & My.ikea site: http://www.youtube.com/watch?v=OjavjTvzIMw

5.10 Google - Sky Map
Sky Map is Google's stargazer Android application which allows a user to identify constellations by simply
pointing their phone at the night sky.

Site (with download option): http://www.google.com/sky/skymap.html

5.11 TAT - ID mapping
Map your social network contact details around your face so that people can click and use them when they
look at you through their mobile camera. UI product & design company TAT

Blog with innovative UX experiments: http://mobileuserinterfaces.blogspot.com/
Site: http://tat.se/
Video about AR ID mapping: http://mobileuserinterfaces.blogspot.com/

5.12 ConnectED - Second Sight
The camera is aimed at a symbol, to identify the subject. The student can then download the given
information in video/audio/image/text and upload its own information in video/audio/image/text. All content
is stored on a server and can be shared and discussed in a group later on.

Second Sight enables teachers to blend the use of their established text books, display materials and
audio visual content in a way that has not been easy to deploy in the classroom before. Second Sight
comprises a PC based content creation suite and a Second Sight viewer application for the SONY PSP.

“Interactive multimedia content is very important. Students are used to playing and reviewing rich media
files in audio, video and in gaming, anytime and anywhere. They expect a richer experience. PSP™ helps
fulfil that need. It is easy to use, extremely robust and portable, and most importantly PSP™ is very
engaging and interesting to the students”. Andy Goff, Education Director, ConnectED.

Site: http://www.connectededucation.com/index.php?option=com_content&view=article&id=153

Image:
http://www.flickr.com/photos/dlivingstone/3947127965/

5.13 Metaio - Cereal box AR interaction
Interact and play with packaging... Developped by AR agency Metaio. Pioneer in the area of augmented
reality technology, metaio develops software products for systems driven by visual interaction in both real
and virtual worlds.

27

As a pioneer in the area of Augmented Reality technology, metaio develops software products for visual
interactive solutions between the real and virtual world. Based on the software platform Unifeye SDK, 3D-
animations can be integrated seamlessly into live-video streams respectively into pictures of the real-
user’s environment. Founded in February 2003, metaio currently employs 50 people at three different
locations. The head office of the company is based in Munich. The subsidiaries metaio Inc. located in San
Francisco, CA and metaio Asia respectively in Seoul. At the moment metaio has over 140 renowned
customers out of different branches and areas. Among them are: BMW, Daimler, Siemens, Toyota,
Peugeot, EADS, Bertelsmann, KUKA, LEGO, MINI, Universal Home Entertainment and Volkswagen.

Site: http://www.metaio.com/
Video: http://www.youtube.com/watch?v=b1naY762FHc
Contact: Jan Schlink

5.14 GE - Interactive 3D magazine cover
Point your webcam to the magazine cover to see an interactive 3D object mapped onto it in the webcam
capture on your screen.

Site: http://ge.ecomagination.com/smartgrid/popsci/
Cover: http://ge.ecomagination.com/smartgrid/popsci/res/cover.pdf
Video: http://www.youtube.com/watch?v=broaO24jkJg

5.15 Total Immersion - Commercial AR apps
Myles Peyton is UK Sales Director for Total Immersion. Total Immersion is the global leader in augmented
reality. Through its patented D’Fusion® technology, Total Immersion blurs the line between the virtual
world and the real world by integrating real time interactive 3D graphics into a live video stream. Leading
the augmented reality category since 1999, the company maintains offices in Europe (France and UK),
Asia and in the U.S., and supports a network of more than 50 partners worldwide. Find the latest news
concerning Total Immersion projects at: http://augmented-reality-news.com.

Site: www.t-immersion.com
Videos: http://www.t-immersion.com/en,video-gallery,36.html
Contact: Myles Peyton

28

5.16 ARTHUR - Architecture tool
The ARTHUR (Augmented Round Table for Architecture and Urban Planning) project has developed an
augmented reality interface for round table design meetings. Using see through augmented reality glasses
developed by Ericsson Saab Avionics the ARTHUR round table generates virtual models of the design
scheme being discussed. Twin cameras fitted to the glasses and computer vision techniques provide head
tracking for the users, as well as tracking real world placeholder objects on the table that allow the users
to interact with the virtual model.

The virtual model is manipulated by moving the placeholders. This manipulation may entail movement of
components or building blocks tied to the placeholders, or the placeholders may be linked to control points
in a more complex parametric building object. In this way moving placeholders can alter the complex
curves of a three dimensional surface or adjust the series of parametric construction components that
would make that surface constructible. The see through glasses and the real world placeholders mean
that all members of the round table have equal access to the design user interface.

ARTHUR will also develop a series of simulations and visualisations of aspects of building performance,
so that the consequences of design changes can be evaluated while the design is being manipulated. In
this way, the effects of moving building blocks relative to each other on patterns of pedestrian movement
could be visualised through a real time simulation of pedestrians flows on the ARTHUR tabletop.

Dates: 2001-2004
Value: £405,000 (total value £2.23m)
Principal Investigator: Professor AR Penn
Other Investigators:
Recognised Researchers: Chiron Mottram, Ava Fatah gen. Schieck, Stefan Kueppers
Project Partners: Fraunhofer-FIT, Foster and Partners, Ericsson Saab Avionics, Linie 4, Aalborg University
Department: Bartlett
Organisation: University College London

Site: http://www.vr.ucl.ac.uk/projects/arthur/

5.17 whiteapp - Customiseable AR iPhone apps
Whiteapp is a directory of mobile applications that serve as building blocks for yours. Starting from an
existing application saves a lot of creative and production cost. It has an AR iPhone app, which is an
augmented reality engine that can function as a stand-alone app or as part of a larger proposition. Display
any location-based information over a live video feed from the user's iPhone camera. Data can be from a
local source stored in the app or from the cloud.

Site: http://www.whiteapp.com/directory/apps/augmented_reality.php

29

5.18 Acrossair - Bespoke AR iPhone apps
Acrossair is an iPhone development company specialising in Augmented Reality. Ravi Damani is the co-
founder of Acrossair and is a constant innovator and entrepreneur with involvement in digital publishing to
ecommerce.

Site: http://www.acrossair.com/
Contact: Ravi Damani

5.19 Mehmet (aka Memo) Akten - Gold Dust – Installation & iPhone Versions
Tent London - installation version:
Shiny gold particles on a large screen move according to motion tracking. Without motion, the gold dust
falls still on all the outlines it can trace of the people standing in front of the screen, defining their faces,
hands, bodies, etc. in shiny gold outlines.
“Gold” is an interactive installation which explores our obsession with super-stardom, and the
extravagance that accompanies it. Through a ‘magic mirror’, revel in a world of excess where you are the
super-star. Shower in glittery gold, experience almost omnipotent powers as you materialize, morph and
dematerialize into pure sparkling gold dust. Immortalize yourself as a shimmering golden statue, before
you collapse and fade away.

iPhone app:
Shiny gold particles move according to your finger swipes, and according to the device angle (they fall
downwards). It was written with a custom version of openFrameworks (pre-006) and an early version of
the ofxiPhone addon.

Tent London version - Info + Videos: http://www.vimeo.com/2281077 and http://www.msavisuals.com/gold
PDF: http://www.msavisuals.com/sites/default/files/Gold%20by%20Mehmet%20Akten%20print.pdf
Made with openFrameworks: http://www.openframeworks.cc/
iPhone version - Info + Video: http://memo.tv/iphone/gold_dust
Developed for iPhone using openFrameworks and ofxiPhone: http://www.memo.tv/ofxiphone

5.20 Mehmet (aka Memo) Akten - Reincarnation - Installation Version
A large screen shows abstract visual layers (flames), containing subtle hints of human forms and motion,
following the movement of dancers on stage.

Site + Video: http://memo.tv/reincarnation
Made with openFrameworks: http://www.openframeworks.cc/

30

5.21 Treehugger - AR ideas for sustainably living
From the Treehugger site:
<< Imagine walking down the street and seeing emissions data for the companies/businesses simply by
pointing your phone at them. Or pointing at machinery and seeing schematics, lifecycle emissions data,
or… the options are limitless!
- What if you could aim the mobile at a row of restaurants and see their food sustainability practices before
making a decision on where to eat?
- How about scanning a shelf of products and seeing the carbon footprint data of each option so you can
make a low impact purchasing decision despite the tricky labels and packaging the manufacturers use?
- How might you want to see this kind of software used to make living sustainably an easier part of our
daily lives? >>

Site: http://www.treehugger.com/files/2009/07/using-augmented-reality-to-change-the-way-we-see-our-
green-world.php

5.22 Rachel Clarke - History AR idea
From Rachel Clarke's Blog :
<< I want a history tool. I want to be able to walk around London and know that Marble Arch used to be
Tyburn. That this is the path of the Fleet. That Trafalgar Square used to be the Royal Mews. Point my
phone at something and it would offer me the chance to move back and forward in time, giving me
information about what it was. In some places, where the images are there, I want to see what it looked
like. A perfect example is the paintings on the walls of one of the Tube tunnels at Charing Cross, which
gives you street plans and drawings of buildings of the area. Let’s put that on the phone.

This isn’t a simple mash-up, it’s not pulling ready-made data together, because as far as I know, it’s not
there. We’ll have to build the database, turn into historians to pull it together. I think that Layer is a
possibility, with the ability to create data sets. This is what I want, but I have no idea how to build
it..anyone out there doing it already?

Update:
I went along to Mobile Monday London yesterday and ended up chatting about this app. A few more ideas
got developed:
* The database element and app itself appears to be fairly simple. It needs to use the location and retrieve
the data for that location, and then be able to move through the different time layers.
* Collecting content is more difficult. There could be ways of partnering with museums, ie Museum of
London, or other local museums. A great source would be local history groups, that often have specialised
archives. It should be possible to allow users to develop the content, around a specific location. >>

Rachel Clarke's Blog entree - Augmented Reality – the History application, 10. October 2009:
http://blog.bibrik.com/

31

6 Mobile phone as Remote Control

6.1 Unique Automation - Bath-o-matic
Bathomatic from Unique Automation, can lower your bathtub's motorized plug, and fill the tub to the exact
temperature, depth, aromas and bubbles that you have chosen through your wall, PC, laptop or (free)
iPhone app interface. It can save 9 favourite combinations (of temperature, depth and aromas) and store a
preset for each member of the family. It is suitable for new and retro installations, including whirlpools,
without drilling or other invasive alterations. The only visible parts are a drain and overflow/filler available
in variety of 9 finishes from chrome to gold.

Article: http://www.pocket-lint.com/news/25003/iphone-bathomatic-bathovision-remote-control
Website: http://www.bath-o-matic.com/
Images: http://www.bath-o-matic.com/html/EN/press/images_01.html
Flash Demo: http://www.bath-o-matic.com/flash/BOM_Demo_Popup.swf
App store: http://www.appstorehq.com/bathomatic-iphone-36373/app

32

7 Data Transfer and Connection

7.1 Content transfer - from web/location to mobile (easy & free)
FuturLink (http://www.futurlink.com/) establishes communication from specific locations (Wilico Access
Points) or websites (with content published in the Wimob Suite) to the mobile (through Bluetooth, Infrared,
USB or Wi-Fi, depending on the case), enabling the mobile to receive content for free, or to send
information to Wilico APs (with or without special client applications, depending on the case).

Wimob -> web to mobile: http://www.wimob.com/overview.html
The glossy and customizable Wimob web button invites the user to click and explore it. A friendly interface
then opens, allowing him to receive the web content on his mobile phone easily and for free. This is a
great way to promote content and brand, to familiarize users with (the download of) mobile content and
mobile applications (from the web), and to establish a multi platform reach.

Wilico -> location to mobile: http://www.futurlink.com/en/location_to_mobile.php
To promote the new BBC America series “Robin Hood”, a 15 second video was sent via Bluetooth from 2
outdoor billboards in LA and NYC to customers and bystanders mobile phones during 4 weeks. The ones
that had their Bluetooth device switched on could receive the video spot in a matter of seconds, after
accepting an invitation on their mobile phones via Bluetooth. Results: Huge success for BBC America,
with over 6,100 downloads and a 39.7% acceptance rate with a positive engagement rate of 87.3%.

7.2 Telemetry
Telemetry (according to Wikipedia) typically refers to wireless communications (i.e. using a radio system
to implement the data link), but can also refer to data transferred over other media, such as a telephone or
computer network or via an optical link or when making a robot it can be over a wire.

7.3 Bluetooth
Ian Volans wrote an interesting article:
Bluetooth - accentuating the generation gap (http://vodafone.com/flash/receiver/05/articles/index08.html )

7.4 WiFi & 3G
Wifi establisheds fast internet connection. Will 3G replace Wifi, because it doesn’t requiere a hotspot?

7.5 Infrared
Wii and Xbox are using infrared for their video game consoles.

7.6 Camera
Microsoft and Sony use their smart video game console camera to capture data for Project Natal and Eye
Pet.

33

7.7 Radio-frequency identification (RFID)
Radio-frequency identification (according to Wikipedia) is the use of an object (typically referred to as an
RFID tag) applied to or incorporated into a product, animal, or person for the purpose of identification and
tracking using radio waves. Some tags can be read from several meters away and beyond the line of sight
of the reader.

Most RFID tags contain at least two parts. One is an integrated circuit for storing and processing
information, modulating and demodulating a radio-frequency (RF) signal, and other specialized functions.
The second is an antenna for receiving and transmitting the signal.

There are generally two types of RFID tags: active RFID tags, which contain a battery and thus can
transmit its signal autonomously, and passive RFID tags, which have no battery and require an external
source to initiate signal transmission.

Current uses:
Race Timing, Passports, Transportation payments, RFID and asset management, Product tracking,
Transportation and logistics, Lap scoring, Animal identification,Inventory systems, Human implants,
Libraries, Schools and universities, Museums, Social retailing,Miscellaneous

Potential uses: Replacing barcodes, Telemetry, Identification of patients and hospital staff, etc.

The two main privacy concerns regarding RFID are:
1. Since the owner of an item will not necessarily be aware of the presence of an RFID tag and the tag can
be read at a distance without the knowledge of the individual, it becomes possible to gather sensitive data
about an individual without consent.
2. If a tagged item is paid for by credit card or in conjunction with use of a loyalty card, then it would be
possible to indirectly deduce the identity of the purchaser by reading the globally unique ID of that item
(contained in the RFID tag).

Most concerns revolve around the fact that RFID tags affixed to products remain functional even after the
products have been purchased and taken home and thus can be used for surveillance and other purposes
unrelated to their supply chain inventory functions. The concerns raised by the above may be addressed
in part by use of the Clipped Tag.

The Clipped Tag is an RFID tag designed to increase consumer privacy. The Clipped Tag has been
suggested by IBM researchers Paul Moskowitz and Guenter Karjoth. After the point of sale, a consumer
may tear off a portion of the tag. This allows the transformation of a long-range tag into a proximity tag that
still may be read, but only at short range – less than a few inches or centimeters. The modification of the
tag may be confirmed visually. The tag may still be used later for returns, recalls, or recycling.

34

8 Examples of Gadgets

8.1 eReader
The Home E-Reader for Windows Vista (Prototype stage) : http://www.ricavision.com

The Home E-Reader is a small handheld portable Windows SideShow device that connects wirelessly to a
Windows Vista PC. It combines the convenience of electronic documents with wireless access to
Windows Vista. It has a reflective eInk type display that is optimized for reading documents so that reading
with the Home E-Reader is as comfortable as it is on paper. It can cache a large number of pages on the
device so that it can also be used offline. It also includes stylus capability.

As small and lightweight as a single book, the Home E-Reader allows users to download and take along
newspapers, books, and documents, or upload them to share with family, friends, or co-workers. In
addition, the stylus capability enables the user to make notes that can be easily transferred to a PC. As
electronics become more integrated into our contemporary lifestyle, a device like the Home E-Reader may
become essential to access the computers with the ease of ordinary pen and paper. For personal or
professional use, the Home E-Reader can add significant value to Windows Vista experience.

The Home E-Reader uses the SideShow as the primary GUI and Windows Vista as the means by which
pages are actually rendered for display on the device.

Kindle and Sony have widely distributed eBooks..

8.2 eChatter
The MK140 eChatter for Windows Vista (Prototype stage) : http://www.ricavision.com

The MK140 eChatter is a small handheld portable Windows SideShow device that connects wirelessly to a
Windows Vista PC. With the MK140 eChatter, a user can compose emails and instant messages on the
5.0" WQVGA LCD display with a QWERTY-layout thumb keyboard. The device can also be used as an
audio headset for voice communication.

The MK140 eChatter comes with an internal battery with a 16-hour minimum lifetime in normal use as well
as an external AC adapter/charger through a mini-USB.
Small and lightweight, sleek and handsome, the MK140 eChatter is designed to provide Windows Vista
users with enhanced wireless email/chatting experience and significant value.

35

8.3 Scribbler Fridge Magnet
Windows Vista SideShow Fridge Magnet (Wednesday, 16 May 2007)
http://www.automatedhome.co.uk/New-Products/Windows-Vista-SideShow-Fridge-Magnet.html

The Home Scribbler Fridge Magnet from Ricavision is a small handheld portable device wirelessly
connected to a PC running Windows Vista that functions as a normal enhanced device for Windows
SideShow. The scribbler enables the user to create handwritten notes on the device’s 3.5” QVGA LCD
display using a stylus, and these notes may then be retained on the device or sent to the Windows Vista-
based PC for further processing.

The MK 140 FM Fridge Magnet/Scribbler Device for Windows Vista (Prototype stage):
http://www.ricavision.com

The MK140 FM Magnet/Scribbler is a portable device that functions like an electronic note pad with
Windows SideShow capability. It combines the convenience of sticky notes with wireless access to
Windows Vista. It can be easily attached to a refrigerator or wherever it is needed for maximum
convenience.

The MK140 FM Fridge Magnet/Scribbler is a portable enhanced Windows SideShow device wirelessly
connected to a Windows Vista PC. It enables a user to create handwritten notes on the 3.5" QVGA LCD
display using a stylus, which may be retained on the device or sent to a Windows Vista PC for further
processing.

The MK140 FM Fridge Magnet/Scribbler is powered by an internal battery with a 16-hour minimum lifetime
in normal use and an external AC adapter and charger.

With close coordination with Microsoft, the MK140 FM Fridge Magnet/Scribbler can provide users with a
convenient wireless communication capability to Windows Vista and significant value.

8.4 BambooTablet
The BambooTablet (http://www.wacom.com/BambooTablet/bamboo.php) works with any software. Many
software applications have special features and tools that are designed to be used with a pen.

Touch the pen tip to the tablet to handwrite notes and emails (to enter text by hand anywhere typed text is
accepted), to mark up digital documents, sign your name, navigate your desktop with a flick of the pen,
and make quick sketches in a simple, easy, and more natural way than with a mouse or keyboard.
Alternating among input devices such as a mouse, a keyboard, and a pen is an effective way to reduce
strain on delicate muscles, tendons, and nerves.

The pressure sensitivity of such a pen would be nice to have on mobile screens.

36

8.5 Nabaztag
Nabaztag (Armenian for "rabbit") is a Wi-Fi enabled ambient electronic device in the shape of a rabbit.
It is an internet connected RSS reader in cute bunny shape, with customizable feeds (email, weather,
news, etc.), voices, timings, etc.

Website: http://www.nabaztag.com/en/index.html
Wiki: http://en.wikipedia.org/wiki/Nabaztag

8.6 Linux Pinguin
Wireless internet connected RSS reader in cute pinguin shape, with customizeable feeds (email,
wheateer, news, etc.), voices, timings, etc.

8.7 Aibo
Smart and cute robot dog that reacts to voice and gestures, and learns specific behaviours from its owner.

Website: http://support.sony-europe.com/aibo/
Wiki: http://en.wikipedia.org/wiki/AIBO

8.8 Prada Watch
Watch that can be connected to the mobile phone by Bluetooth, to pass on information about incoming
emails, calls, etc.

Info + Video:
http://www.phonesreview.co.uk/2009/02/21/video-lg-prada-2-and-lg-prada-watch-at-mwc-2009/

Info + Images:
http://www.cellphones.ca/news/post004974/
http://www.newlaunches.com/archives/lg_kf900_prada_ii_phone_is_boxed_with_bluetooth_prada_watch.
php

37

9 Mobile Flash (Lite) widgets

9.1 Widget advantage (compared to native apps)
Widgets are mostly light weight wrapper applications for up-to-date internet content, which are easy to:
- build (with standard web development tools and languages)
- install (to be retrieved among the other mobile applications)
- use (since they are mostly single-purpose)
- monetise (ads, banners, sponsors, click-through to paid content or websites, etc.)
- track (where, when, how long and how it’s used)
- update (new versions can be detected and installed automatically, with user’s consent).

9.2 Flash(Lite) advantage (multi-platform & high performance in rich media)
Widgets can contain Flash(Lite) applications, which can embed, load, manipulate and/or animate
interactive and optimized video, audio, bitmaps and vector graphics very well on mobile devices. A SWF
file can be used in many ways, e.g.:
- embedded in an S60 widget, with Miniview enabled on the N97
- embedded in a SIS package, to become a native Symbian file
- embedded in an AIR package, to become a desktop application that resembles a customized widget or
(Vista) gadget
- embedded in a web page, on the Internet, Extranet, Intranet
- embedded in web pages for digital TV (depends on set top box)
- as standalone or embedded applications and presentations on PC, CD-Rom and DVD (http://www.flash-
on-tv.com/flash-to-dvd.html, http://www.armchair-travel.com/first/index.htm)

This allows giving the users a similar (familiar) and good experience on different platforms.
The application(s) should be optimized for each platform use.

9.3 Device services in FlashLite widgets
The Flash Lite Developer's Library 1.3 on forum.nokia now supports Service APIs which allow Flash Lite
3.0 applications to use powerful platform services on S60 5th Edition devices:
- Access and launch applications on a device using the AppManager Service API
- Access and manage calendar information using the Calendar Service API
- Access and manage information about contacts using the Contacts Service API
- Access and manage information about landmarks using the Landmarks Service API
- Access device logging events using the Logging Service API
- Access device location information and perform location-based calculations using the Location Service
API
- Access information about media files stored on a device using the Media Management Service API
- Send, retrieve, and manage messages such as SMS and MMS using the Messaging Service API
- Access data from the physical sensors of a device using the Sensor Service API
- Access and modify system information on a device using the SystemInfo Service API

38

Forum.nokia: http://library.forum.nokia.com/index.jsp?topic=/Flash_Lite_Developers_Library/GUID-
46EABDC1-37CB-412A-ACAD-1A1A9466BB68.html

9.4 Widget launch buttons on N97 homescreen
The N97 allows the user to add Miniview buttons for widgets on the device’s home screen, which offer
widget previews (from the internet or static) and shortcuts (1 click to launch it), making widget use more
appealing.

Flash Lite applications can also be wrapped in SIS files (native Symbian applications), but considerable
time and money is then needed for SIS licensing for new each application version.

39

Barcamp London 7 Mobile AR Guide

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Ähnlich wie Barcamp London 7 Mobile AR Guide

Ähnlich wie Barcamp London 7 Mobile AR Guide (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (9)

Barcamp London 7 Mobile AR Guide