SlideShare ist ein Scribd-Unternehmen logo
1 von 26
AwToolkit:
Attention-Aware User Interface
Widgets
Attention-Aware User Interface
Widgets
Juan E. Garrido, Victor M. R. Penichet, Maria D. Lozano
Computer Science Research Institute,
University of Castilla-La Mancha
Aaron Quigley, Per Ola Kristensson
SACHI, School of Computer Science,
University of St Andrews
2AVI’14: AwToolkit Slide of 20
The problem
3AVI’14: AwToolkit Slide of 20
The opportunity
• Determine which display a user is attending to
• Determine what changes are occurring on a non-
attended display and where
• Determine a means to notify a user of these changes
• either on the display they are currently attending to or
• in-situ, when they return their gaze to a previously
unattended display
• Determine the granularity to notify of change
• Determine if this has an impact on performance.
4AVI’14: AwToolkit Slide of 20
Overview
• Related work
• AwToolkit concept and features in widgets
• Spectrum of change notification
• Properties
• AWPanel and change notification techniques
• AwButton, AwLabel, AwTextBox, AwComboBox and
AwPlayer
• Evaluation: User’s View
• Evaluation: Developer’s View
• Conclusions and future work
5AVI’14: AwToolkit Slide of 20
Related work
MAUI Toolkit, CSCW 2004 Mnemonic rendering, UIST 2006
DiffDisplays, IUI 2014TeleEye, CollaborateCom 2008
6AVI’14: AwToolkit Slide of 20
DiffDisplays: Gaze dependent
techniques for visualizing display
changes (IUI 2013)
Jakub Dostal, Per Ola Kristensson, and Aaron Quigley. 2013. Subtle gaze-dependent techniques for visualising display changes in multi-display environments.
In Proceedings of the 2013 international conference on Intelligent user interfaces (IUI '13). ACM, New York, NY, USA, 137-148.
7AVI’14: AwToolkit Slide of 20
DiffDisplays
Jakub Dostal, Per Ola Kristensson, and Aaron Quigley. 2013. Subtle gaze-dependent techniques for visualising display changes in multi-display environments.
In Proceedings of the 2013 international conference on Intelligent user interfaces (IUI '13). ACM, New York, NY, USA, 137-148.
8AVI’14: AwToolkit Slide of 20
DiffDisplays
PixMap Aura
WindowMap
9AVI’14: AwToolkit Slide of 20
DiffDisplays
10AVI’14: AwToolkit Slide of 20
SpiderEyes
QuickTime™ and a
H.264 decompressor
are needed to see this picture.
Dostal, J., Hinrichs, U., Kristensson, P.O. and Quigley, A. 2014. SpiderEyes: designing attention- and proximity-aware collaborative interfaces for wall-sized
displays. In Proceedings of the 19th
ACM International Conference on Intelligent User Interfaces (IUI 2014).
11AVI’14: AwToolkit Slide of 20
Overview
• Related work
• AwToolkit concept and features in widgets
• Spectrum of change notification
• Properties
• AWPanel and change notification techniques
• AwButton, AwLabel, AwTextBox, AwComboBox and
AwPlayer
• Evaluation: User’s View
• Evaluation: Developer’s View
• Conclusions and future work
12AVI’14: AwToolkit Slide of 20
Widgets
http://www.eclipse.org/swt/widgets/
13AVI’14: AwToolkit Slide of 20
AWToolkit concept
• Goal: generate change notifications
upon return of gaze to display
• Approach: Gaze-aware user interface
components (widgets)
• subtle change within widgets
• Three categories: entire screen, part
of screen, mirroring techniques
• AwToolkit C# toolkit for developers for
gaze sensitive user interface controls
• Examples: panel, button, label, textbox, comboBox and
media player
14AVI’14: AwToolkit Slide of 20
AWToolkit features
• Toolkit for detection and reaction
• Objective: preserve look and feel of existing
components as in, for example, Visual Studio
• Detection based on the Diff Displays system (widgets
connected to server)
• Two gaze aware states
• Properties of each widget allow the developer to
modify the visual appearance and behaviour ie. the
degree of saliency in change notification.
15AVI’14: AwToolkit Slide of 20
Spectrum of change notification
• Disruptive:
• the user is alerted and the current activity is disrupted
• Intrusive:
• the user is alerted and the goal is clearly to avert their gaze to the
location of the displayed change notification
• Subtle:
• the user is alerted with less obvious visual cues. The goal is to
draw their gaze to the display change notification
• Unnoticeable:
• the user is alerted in such a subtle manner, that they may not even
notice the display change notification.
16AVI’14: AwToolkit Slide of 20
Properties
• Developer can specify
• Choice of display change notifications
• Appearance of graphic elements
• Length of time for change notification
• Or use AwDefaultTechnique to automate level selection
• default selection of visual change elements
• based on user study discussed later
• Three methods for localisation of widget content change
• Widget screenshot, widget text, state change.
17AVI’14: AwToolkit Slide of 20
AWPanel
• Based on standard panel control
• Typically used to organise application content
• Polygon with content and margin (a continuous line)
• Widget detects changes by comparing screen-shots over
time (on a pixel level)
• This allows AWPanel to be content agnostic
18AVI’14: AwToolkit Slide of 20
3 Change notification techniques
• Modifying the widget margin:
colour, line stippling pattern, corner marks
• Choice of these vs standard margin can range
from unnoticeable to intrusive
• Quadrant view:
panel conceived as four
regions tied to the four
corners (change and where)
• Book mode:
dependent on the number of changes
series of navigable screen shots.
18
19AVI’14: AwToolkit Slide of 20
AwButton, AwLabel, AwTextBox,
AwComboBox and AwPlayer
• Modifying the widget margin: colour or line stippling
pattern
• Highlight changes within
the active area of the
widget
• AwPlayer offers a
disruptive notification
connected to a media player
stopping or restarting a
video depending on a users
gaze.
20AVI’14: AwToolkit Slide of 20
Ubi4health
tasks to be performed
alert control
21AVI’14: AwToolkit Slide of 20
Evaluation: User’s View
• Evaluation was performed with
12 participants (5m, 7f: age 21-48,
avg 36) with Ubi4health
• a healthcare application with a three-screen configuration
• used to manage essential tasks in residential care homes
• typical use case: left screen (tasks to be performed),
centre screen (alert control), right screen (staff
management)
• two versions of Ubi4health
• One with AwPanel, AwButton, AwLabel, AwTextBox and
AwComboBox (and one without).
QuickTime™ and a
AVC Coding decompressor
are needed to see this picture.
22AVI’14: AwToolkit Slide of 20
Evaluation: Tasks
• Scenario: a user responsible for the completion of pending
tasks, staff organisation and the immediate attention of
emergencies in a real residential care home
• Task 1: start of shift, task progression monitoring, resident
alert monitoring, moving to staff allocation (as tasks not
performed in time)
• Task 2: staff organisation (single screen focus 15 sec),
move to alter monitoring
• Task 3: staff reorganisation while monitoring emergencies
(25 sec), return to pending tasks
• Task 4: task monitoring (15 sec), move to staff organisation.
23AVI’14: AwToolkit Slide of 20
Evaluation: Results
• Within-subjects design with toolkit as the independent
variable, accuracy as the dependent variable
• Conditions made it difficult for the participants to compare the
current state of a screen with a previous one
• Improvement in tasks 1, 3 and 4 (p < 0.0001; RM-ANOVA,
Bonferroni corrected)
• Task 2, Ubi4health
already has a clear
visual change on the
screen
• (1,3,4) without AwToolkit:
11-23% accuracy With 83-100% accuracy.
24AVI’14: AwToolkit Slide of 20
Evaluation: Developer’s View
• 12 developers (good knowledge of C# and Visual Studio)
• Task 1: import the library with AwToolkit to be able to
see and use its items in the toolbar
• Task 2: insert AwButton and AwPanel into an application
and define how widgets behave when user is not looking
• Task 3: insert a 10-seconds timer to be run when Aw-
Button is pressed
• Task 4: disable the button after the 10-second timeout
and introduce any change in the AwPanel
• Avg accuracy 100% on tasks 1 and 2, 83% on task 3
and 92% on task 4.
25AVI’14: AwToolkit Slide of 20
Conclusions and future work
• A novel toolkit for developers to support notifying users of
changes that appear in the user interface when users are
not looking at the display
• Awareness of changes at the widget level at varying
degrees of subtly
• Future:
• extensions of the toolkit to further interface components
• exploration of mirroring and multi-screen notifications
• exploration of spectrum of change in multi-display
environments including mobile interface elements.
Thank you
aquigley@st-andrews.ac.uk

Weitere ähnliche Inhalte

Ähnlich wie AwToolkit: Attention-Aware User Interface Widgets

Image Detection and Count Using Open Computer Vision (Opencv)
Image Detection and Count Using Open Computer Vision (Opencv)Image Detection and Count Using Open Computer Vision (Opencv)
Image Detection and Count Using Open Computer Vision (Opencv)IJERA Editor
 
Tips and tricks of the 2021.4 release
Tips and tricks of the 2021.4 releaseTips and tricks of the 2021.4 release
Tips and tricks of the 2021.4 releaseCristina Vidu
 
[PBO] Pertemuan 12 - Pemrograman Android
[PBO] Pertemuan 12 - Pemrograman Android[PBO] Pertemuan 12 - Pemrograman Android
[PBO] Pertemuan 12 - Pemrograman Androidrizki adam kurniawan
 
How to Implement a Navigation MUI Drawer in Your React App
How to Implement a Navigation MUI Drawer in Your React AppHow to Implement a Navigation MUI Drawer in Your React App
How to Implement a Navigation MUI Drawer in Your React AppRonDosh
 
Oniro project, the new IoT platform from Eclipse Foundation.
Oniro project, the new IoT platform from Eclipse Foundation. Oniro project, the new IoT platform from Eclipse Foundation.
Oniro project, the new IoT platform from Eclipse Foundation. Agustin Benito Bethencourt
 
Vb net xp_14
Vb net xp_14Vb net xp_14
Vb net xp_14Niit Care
 
How WSO2 API Manager helps to open the Quby Smart Thermostat and Energy Monit...
How WSO2 API Manager helps to open the Quby Smart Thermostat and Energy Monit...How WSO2 API Manager helps to open the Quby Smart Thermostat and Energy Monit...
How WSO2 API Manager helps to open the Quby Smart Thermostat and Energy Monit...Yenlo
 
2016 04-28-fiware@eclipse-io t-event
2016 04-28-fiware@eclipse-io t-event2016 04-28-fiware@eclipse-io t-event
2016 04-28-fiware@eclipse-io t-eventGilles Privat
 
Augmented reality in the smart factory
Augmented reality in the smart factoryAugmented reality in the smart factory
Augmented reality in the smart factoryhanaskuliah
 
Unmoderated, Online Usability Testing for Web (Brandon Kopp & BIll Mockovak)
Unmoderated, Online Usability Testing for Web (Brandon Kopp & BIll Mockovak)Unmoderated, Online Usability Testing for Web (Brandon Kopp & BIll Mockovak)
Unmoderated, Online Usability Testing for Web (Brandon Kopp & BIll Mockovak)uxpa-dc
 
Why MOVO? Insights into the new beta community.
Why MOVO? Insights into the new beta community.Why MOVO? Insights into the new beta community.
Why MOVO? Insights into the new beta community.Marie-Pier Faucher
 
WSO2Con EU 2015: Implementing an Open API for Smart Thermostats with WSO2′s A...
WSO2Con EU 2015: Implementing an Open API for Smart Thermostats with WSO2′s A...WSO2Con EU 2015: Implementing an Open API for Smart Thermostats with WSO2′s A...
WSO2Con EU 2015: Implementing an Open API for Smart Thermostats with WSO2′s A...WSO2
 
Accessibility Testing Approach
Accessibility Testing ApproachAccessibility Testing Approach
Accessibility Testing ApproachJatin Kochhar
 
Beginning iOS6 Development CH06 Multiview Applications
Beginning iOS6 Development CH06 Multiview ApplicationsBeginning iOS6 Development CH06 Multiview Applications
Beginning iOS6 Development CH06 Multiview ApplicationsAbdulrazzaq Alnajjar
 
Public/Private Interactive Wearable Projection Display (VRCAI2018)
Public/Private Interactive Wearable Projection Display (VRCAI2018)Public/Private Interactive Wearable Projection Display (VRCAI2018)
Public/Private Interactive Wearable Projection Display (VRCAI2018)sugiuralab
 
AEGIS SP3 story - building an accessible web application
AEGIS SP3 story - building an accessible web applicationAEGIS SP3 story - building an accessible web application
AEGIS SP3 story - building an accessible web applicationAEGIS-ACCESSIBLE Projects
 

Ähnlich wie AwToolkit: Attention-Aware User Interface Widgets (20)

Image Detection and Count Using Open Computer Vision (Opencv)
Image Detection and Count Using Open Computer Vision (Opencv)Image Detection and Count Using Open Computer Vision (Opencv)
Image Detection and Count Using Open Computer Vision (Opencv)
 
Tips and tricks of the 2021.4 release
Tips and tricks of the 2021.4 releaseTips and tricks of the 2021.4 release
Tips and tricks of the 2021.4 release
 
[PBO] Pertemuan 12 - Pemrograman Android
[PBO] Pertemuan 12 - Pemrograman Android[PBO] Pertemuan 12 - Pemrograman Android
[PBO] Pertemuan 12 - Pemrograman Android
 
How to Implement a Navigation MUI Drawer in Your React App
How to Implement a Navigation MUI Drawer in Your React AppHow to Implement a Navigation MUI Drawer in Your React App
How to Implement a Navigation MUI Drawer in Your React App
 
Oniro project, the new IoT platform from Eclipse Foundation.
Oniro project, the new IoT platform from Eclipse Foundation. Oniro project, the new IoT platform from Eclipse Foundation.
Oniro project, the new IoT platform from Eclipse Foundation.
 
Vb net xp_14
Vb net xp_14Vb net xp_14
Vb net xp_14
 
How WSO2 API Manager helps to open the Quby Smart Thermostat and Energy Monit...
How WSO2 API Manager helps to open the Quby Smart Thermostat and Energy Monit...How WSO2 API Manager helps to open the Quby Smart Thermostat and Energy Monit...
How WSO2 API Manager helps to open the Quby Smart Thermostat and Energy Monit...
 
Wmc lab (1)
Wmc lab (1)Wmc lab (1)
Wmc lab (1)
 
2016 04-28-fiware@eclipse-io t-event
2016 04-28-fiware@eclipse-io t-event2016 04-28-fiware@eclipse-io t-event
2016 04-28-fiware@eclipse-io t-event
 
iOS Development (Part 2)
iOS Development (Part 2)iOS Development (Part 2)
iOS Development (Part 2)
 
Augmented reality in the smart factory
Augmented reality in the smart factoryAugmented reality in the smart factory
Augmented reality in the smart factory
 
Unmoderated, Online Usability Testing for Web (Brandon Kopp & BIll Mockovak)
Unmoderated, Online Usability Testing for Web (Brandon Kopp & BIll Mockovak)Unmoderated, Online Usability Testing for Web (Brandon Kopp & BIll Mockovak)
Unmoderated, Online Usability Testing for Web (Brandon Kopp & BIll Mockovak)
 
Why MOVO? Insights into the new beta community.
Why MOVO? Insights into the new beta community.Why MOVO? Insights into the new beta community.
Why MOVO? Insights into the new beta community.
 
WSO2Con EU 2015: Implementing an Open API for Smart Thermostats with WSO2′s A...
WSO2Con EU 2015: Implementing an Open API for Smart Thermostats with WSO2′s A...WSO2Con EU 2015: Implementing an Open API for Smart Thermostats with WSO2′s A...
WSO2Con EU 2015: Implementing an Open API for Smart Thermostats with WSO2′s A...
 
Accessibility Testing Approach
Accessibility Testing ApproachAccessibility Testing Approach
Accessibility Testing Approach
 
Beginning iOS6 Development CH06 Multiview Applications
Beginning iOS6 Development CH06 Multiview ApplicationsBeginning iOS6 Development CH06 Multiview Applications
Beginning iOS6 Development CH06 Multiview Applications
 
Public/Private Interactive Wearable Projection Display (VRCAI2018)
Public/Private Interactive Wearable Projection Display (VRCAI2018)Public/Private Interactive Wearable Projection Display (VRCAI2018)
Public/Private Interactive Wearable Projection Display (VRCAI2018)
 
Technology Trend 2018
Technology Trend 2018Technology Trend 2018
Technology Trend 2018
 
AEGIS SP3 story - building an accessible web application
AEGIS SP3 story - building an accessible web applicationAEGIS SP3 story - building an accessible web application
AEGIS SP3 story - building an accessible web application
 
Framework for Agile Living Labs - FALL
Framework for Agile Living Labs - FALLFramework for Agile Living Labs - FALL
Framework for Agile Living Labs - FALL
 

Mehr von Aaron Quigley

NASA Webserver Big Data InfoVis Summer School presentation
NASA Webserver Big Data InfoVis Summer School presentation NASA Webserver Big Data InfoVis Summer School presentation
NASA Webserver Big Data InfoVis Summer School presentation Aaron Quigley
 
Enron Email visulisation at the Big Data InfoVis summer school
Enron Email visulisation at the Big Data InfoVis summer schoolEnron Email visulisation at the Big Data InfoVis summer school
Enron Email visulisation at the Big Data InfoVis summer schoolAaron Quigley
 
Migration Data at the Big Data InfoVis summer school
Migration Data at the Big Data InfoVis summer schoolMigration Data at the Big Data InfoVis summer school
Migration Data at the Big Data InfoVis summer schoolAaron Quigley
 
Visual Analysis and Historical Discovery
Visual Analysis and Historical DiscoveryVisual Analysis and Historical Discovery
Visual Analysis and Historical DiscoveryAaron Quigley
 
Summer School on Big Data Information Visulisation
Summer School on Big Data Information Visulisation Summer School on Big Data Information Visulisation
Summer School on Big Data Information Visulisation Aaron Quigley
 
Mapping Commodity Trading
Mapping Commodity TradingMapping Commodity Trading
Mapping Commodity TradingAaron Quigley
 
Social Networking: Visualizing Twitter
Social Networking: Visualizing Twitter Social Networking: Visualizing Twitter
Social Networking: Visualizing Twitter Aaron Quigley
 

Mehr von Aaron Quigley (7)

NASA Webserver Big Data InfoVis Summer School presentation
NASA Webserver Big Data InfoVis Summer School presentation NASA Webserver Big Data InfoVis Summer School presentation
NASA Webserver Big Data InfoVis Summer School presentation
 
Enron Email visulisation at the Big Data InfoVis summer school
Enron Email visulisation at the Big Data InfoVis summer schoolEnron Email visulisation at the Big Data InfoVis summer school
Enron Email visulisation at the Big Data InfoVis summer school
 
Migration Data at the Big Data InfoVis summer school
Migration Data at the Big Data InfoVis summer schoolMigration Data at the Big Data InfoVis summer school
Migration Data at the Big Data InfoVis summer school
 
Visual Analysis and Historical Discovery
Visual Analysis and Historical DiscoveryVisual Analysis and Historical Discovery
Visual Analysis and Historical Discovery
 
Summer School on Big Data Information Visulisation
Summer School on Big Data Information Visulisation Summer School on Big Data Information Visulisation
Summer School on Big Data Information Visulisation
 
Mapping Commodity Trading
Mapping Commodity TradingMapping Commodity Trading
Mapping Commodity Trading
 
Social Networking: Visualizing Twitter
Social Networking: Visualizing Twitter Social Networking: Visualizing Twitter
Social Networking: Visualizing Twitter
 

Kürzlich hochgeladen

A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 

Kürzlich hochgeladen (20)

A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 

AwToolkit: Attention-Aware User Interface Widgets

  • 1. AwToolkit: Attention-Aware User Interface Widgets Attention-Aware User Interface Widgets Juan E. Garrido, Victor M. R. Penichet, Maria D. Lozano Computer Science Research Institute, University of Castilla-La Mancha Aaron Quigley, Per Ola Kristensson SACHI, School of Computer Science, University of St Andrews
  • 2. 2AVI’14: AwToolkit Slide of 20 The problem
  • 3. 3AVI’14: AwToolkit Slide of 20 The opportunity • Determine which display a user is attending to • Determine what changes are occurring on a non- attended display and where • Determine a means to notify a user of these changes • either on the display they are currently attending to or • in-situ, when they return their gaze to a previously unattended display • Determine the granularity to notify of change • Determine if this has an impact on performance.
  • 4. 4AVI’14: AwToolkit Slide of 20 Overview • Related work • AwToolkit concept and features in widgets • Spectrum of change notification • Properties • AWPanel and change notification techniques • AwButton, AwLabel, AwTextBox, AwComboBox and AwPlayer • Evaluation: User’s View • Evaluation: Developer’s View • Conclusions and future work
  • 5. 5AVI’14: AwToolkit Slide of 20 Related work MAUI Toolkit, CSCW 2004 Mnemonic rendering, UIST 2006 DiffDisplays, IUI 2014TeleEye, CollaborateCom 2008
  • 6. 6AVI’14: AwToolkit Slide of 20 DiffDisplays: Gaze dependent techniques for visualizing display changes (IUI 2013) Jakub Dostal, Per Ola Kristensson, and Aaron Quigley. 2013. Subtle gaze-dependent techniques for visualising display changes in multi-display environments. In Proceedings of the 2013 international conference on Intelligent user interfaces (IUI '13). ACM, New York, NY, USA, 137-148.
  • 7. 7AVI’14: AwToolkit Slide of 20 DiffDisplays Jakub Dostal, Per Ola Kristensson, and Aaron Quigley. 2013. Subtle gaze-dependent techniques for visualising display changes in multi-display environments. In Proceedings of the 2013 international conference on Intelligent user interfaces (IUI '13). ACM, New York, NY, USA, 137-148.
  • 8. 8AVI’14: AwToolkit Slide of 20 DiffDisplays PixMap Aura WindowMap
  • 9. 9AVI’14: AwToolkit Slide of 20 DiffDisplays
  • 10. 10AVI’14: AwToolkit Slide of 20 SpiderEyes QuickTime™ and a H.264 decompressor are needed to see this picture. Dostal, J., Hinrichs, U., Kristensson, P.O. and Quigley, A. 2014. SpiderEyes: designing attention- and proximity-aware collaborative interfaces for wall-sized displays. In Proceedings of the 19th ACM International Conference on Intelligent User Interfaces (IUI 2014).
  • 11. 11AVI’14: AwToolkit Slide of 20 Overview • Related work • AwToolkit concept and features in widgets • Spectrum of change notification • Properties • AWPanel and change notification techniques • AwButton, AwLabel, AwTextBox, AwComboBox and AwPlayer • Evaluation: User’s View • Evaluation: Developer’s View • Conclusions and future work
  • 12. 12AVI’14: AwToolkit Slide of 20 Widgets http://www.eclipse.org/swt/widgets/
  • 13. 13AVI’14: AwToolkit Slide of 20 AWToolkit concept • Goal: generate change notifications upon return of gaze to display • Approach: Gaze-aware user interface components (widgets) • subtle change within widgets • Three categories: entire screen, part of screen, mirroring techniques • AwToolkit C# toolkit for developers for gaze sensitive user interface controls • Examples: panel, button, label, textbox, comboBox and media player
  • 14. 14AVI’14: AwToolkit Slide of 20 AWToolkit features • Toolkit for detection and reaction • Objective: preserve look and feel of existing components as in, for example, Visual Studio • Detection based on the Diff Displays system (widgets connected to server) • Two gaze aware states • Properties of each widget allow the developer to modify the visual appearance and behaviour ie. the degree of saliency in change notification.
  • 15. 15AVI’14: AwToolkit Slide of 20 Spectrum of change notification • Disruptive: • the user is alerted and the current activity is disrupted • Intrusive: • the user is alerted and the goal is clearly to avert their gaze to the location of the displayed change notification • Subtle: • the user is alerted with less obvious visual cues. The goal is to draw their gaze to the display change notification • Unnoticeable: • the user is alerted in such a subtle manner, that they may not even notice the display change notification.
  • 16. 16AVI’14: AwToolkit Slide of 20 Properties • Developer can specify • Choice of display change notifications • Appearance of graphic elements • Length of time for change notification • Or use AwDefaultTechnique to automate level selection • default selection of visual change elements • based on user study discussed later • Three methods for localisation of widget content change • Widget screenshot, widget text, state change.
  • 17. 17AVI’14: AwToolkit Slide of 20 AWPanel • Based on standard panel control • Typically used to organise application content • Polygon with content and margin (a continuous line) • Widget detects changes by comparing screen-shots over time (on a pixel level) • This allows AWPanel to be content agnostic
  • 18. 18AVI’14: AwToolkit Slide of 20 3 Change notification techniques • Modifying the widget margin: colour, line stippling pattern, corner marks • Choice of these vs standard margin can range from unnoticeable to intrusive • Quadrant view: panel conceived as four regions tied to the four corners (change and where) • Book mode: dependent on the number of changes series of navigable screen shots. 18
  • 19. 19AVI’14: AwToolkit Slide of 20 AwButton, AwLabel, AwTextBox, AwComboBox and AwPlayer • Modifying the widget margin: colour or line stippling pattern • Highlight changes within the active area of the widget • AwPlayer offers a disruptive notification connected to a media player stopping or restarting a video depending on a users gaze.
  • 20. 20AVI’14: AwToolkit Slide of 20 Ubi4health tasks to be performed alert control
  • 21. 21AVI’14: AwToolkit Slide of 20 Evaluation: User’s View • Evaluation was performed with 12 participants (5m, 7f: age 21-48, avg 36) with Ubi4health • a healthcare application with a three-screen configuration • used to manage essential tasks in residential care homes • typical use case: left screen (tasks to be performed), centre screen (alert control), right screen (staff management) • two versions of Ubi4health • One with AwPanel, AwButton, AwLabel, AwTextBox and AwComboBox (and one without). QuickTime™ and a AVC Coding decompressor are needed to see this picture.
  • 22. 22AVI’14: AwToolkit Slide of 20 Evaluation: Tasks • Scenario: a user responsible for the completion of pending tasks, staff organisation and the immediate attention of emergencies in a real residential care home • Task 1: start of shift, task progression monitoring, resident alert monitoring, moving to staff allocation (as tasks not performed in time) • Task 2: staff organisation (single screen focus 15 sec), move to alter monitoring • Task 3: staff reorganisation while monitoring emergencies (25 sec), return to pending tasks • Task 4: task monitoring (15 sec), move to staff organisation.
  • 23. 23AVI’14: AwToolkit Slide of 20 Evaluation: Results • Within-subjects design with toolkit as the independent variable, accuracy as the dependent variable • Conditions made it difficult for the participants to compare the current state of a screen with a previous one • Improvement in tasks 1, 3 and 4 (p < 0.0001; RM-ANOVA, Bonferroni corrected) • Task 2, Ubi4health already has a clear visual change on the screen • (1,3,4) without AwToolkit: 11-23% accuracy With 83-100% accuracy.
  • 24. 24AVI’14: AwToolkit Slide of 20 Evaluation: Developer’s View • 12 developers (good knowledge of C# and Visual Studio) • Task 1: import the library with AwToolkit to be able to see and use its items in the toolbar • Task 2: insert AwButton and AwPanel into an application and define how widgets behave when user is not looking • Task 3: insert a 10-seconds timer to be run when Aw- Button is pressed • Task 4: disable the button after the 10-second timeout and introduce any change in the AwPanel • Avg accuracy 100% on tasks 1 and 2, 83% on task 3 and 92% on task 4.
  • 25. 25AVI’14: AwToolkit Slide of 20 Conclusions and future work • A novel toolkit for developers to support notifying users of changes that appear in the user interface when users are not looking at the display • Awareness of changes at the widget level at varying degrees of subtly • Future: • extensions of the toolkit to further interface components • exploration of mirroring and multi-screen notifications • exploration of spectrum of change in multi-display environments including mobile interface elements.

Hinweis der Redaktion

  1. Pick and Drop Mark Maybury
  2. I’ve always believed that one of the greatest strengths of the university is that it provides space and resources for people to seek answers to questions that society has not even begun to ask. I say again, if computers are to aid our intelligence, then we need all the sciences and humanities to consider how best bridge the two with new research in human computer interaction. In Emerson’s 19th oration on the &amp;quot;American Scholar&amp;quot; he extols that - &amp;quot;Man thinking must not be subdued by his instruments&amp;quot;, and this is our challenge in HCI. Thank you.