SlideShare ist ein Scribd-Unternehmen logo
1 von 25
Early Lessons from Building Sensor.Network:
An Open Data Exchange for the Web of Things
Vipul Gupta, Poorna Udupi, Arshan Poursohi
{vipul.x.gupta, poorna.udupi, arshan.poursohi}@oracle.com




                      First International Workshop on the Web of Things (WoT 2010), PerCom 2010
                                                                                                  1
Overview

• The Internet is now the Internet of Things ...




                            data storage




                                                   2
Overview

• The Internet is now the Internet of Things ...




                            data analysis




                                                   2
Overview

• The Internet is now the Internet of Things ...




                              insights




                                                   2
Overview

• The Internet is now the Internet of Things ...




                                actions




                                                   2
Overview

• The Internet is now the Internet of Things ...




       Sensor.Network: an open data-exchange for the Web of Things
                                                                     2
Motivation

• Interactions with many SPOTs customers - Sun Modular Data Center, MIT,
  Warren Wilson College, USGS, Vodafone


• Common set of issues:
  - Data collection
  - Sharing
  - Privacy
  - Search
  - Collaborative analysis
  - Notifications




• Bring social networking technologies (e.g. tags, annotations, fine-grained
  access control, web-hooks) to this problem space
                                                                              3
Motivation

• Interactions with many SPOTs customers - Sun Modular Data Center, MIT,
  Warren Wilson College, USGS, Vodafone


• Common set of issues:
  - Data collection
  - Sharing
  - Privacy
  - Search
  - Collaborative analysis
  - Notifications




• Bring social networking technologies (e.g. tags, annotations, fine-grained
  access control, web-hooks) to this problem space
                                                                              3
Motivation

• Interactions with many SPOTs customers - Sun Modular Data Center, MIT,
  Warren Wilson College, USGS, Vodafone


• Common set of issues:
  - Data collection
  - Sharing
  - Privacy
  - Search
  - Collaborative analysis
  - Notifications




• Bring social networking technologies (e.g. tags, annotations, fine-grained
  access control, web-hooks) to this problem space
                                                                              3
Motivation

• Interactions with many SPOTs customers - Sun Modular Data Center, MIT,
  Warren Wilson College, USGS, Vodafone


• Common set of issues:
  - Data collection
  - Sharing
  - Privacy
  - Search
  - Collaborative analysis
  - Notifications




• Bring social networking technologies (e.g. tags, annotations, fine-grained
  access control, web-hooks) to this problem space
                                                                              3
Benefits

• Enables investigations into correlations that would otherwise be missed


• Enables easy sharing of data and analytical algorithms


• Enables data-centric collaboration: editing, annotation, discussion


• Frees up domain experts from the chore of setting up and managing an IT
  infrastructure




                                                                            4
Sensor.Network Overview

• Embrace heterogenous
  devices


• Lower barrier to usage


   • Easy, RESTful API


   • Fine-grained access
     control


• General platform for
  specialized applications



                             5
“Datastream” Abstraction

                           • A time-series of sensor values
                             sampled together.


                           • Decouples physical sensor from
                             high-level phenomenon of interest.


                           • A datastream may be fed by
                             different sensors at different times


                           • Has associated metadata and
                             privacy controls




                                                                    6
REST-based API

• Sensor.Network operations may be accessed via a browser or
  programmatically using HTTP operations


• Most operations require authentication--either password or API Key

Datastream creation example:

% curl –dump-header hdrs.txt –header “X-SensorNetworkAPIKey: apiKey” –request POST –header “Content-
type: application/xml” –data-binary “@Datastream.xml” “http://sensor.network.com/rest/resources/datastreams/”




<?xml version=”1.0”?>
<datastream>
  <name>My Pothos Plant</name>
  <description>Light and temperature readings from my office plant. </description>
  <tag>light</tag>
  <tag>temperature</tag>
  <value><name>light</name> <type>int</type> <units>lumen</units></value>
  <value><name>temperature</name> <type>float</type> <units>celsius</units> <min>-50.0</min>
<max>50.0</max></value>
</datastream>                                                                                                   7
REST-based API (more examples)

• Data insertion

 % curl –dump-header hdrs.txt –header “X-SensorNetworkAPIKey: apiKey” –request POST –header “Content-
 type: application/xml” –data-binary “@Data.xml” “http://sensor.network.com/rest/resources/datastreams/id/data”



                <?xml version=”1.0”?>
                <sampleData>
                  <sensorNodeId>0014.4F01.0000.01AB</sensorNodeId>
                  <timestamp>2009-07-30T13:31:37.459Z</timestamp>
                  <value>700</value>
                  <value>29.4</value>
                </sampleData>



• Data retrieval

 % curl –dump-header hdrs.txt –header “X-SensorNetworkAPIKey: apiKey” “http://sensor.network.com/rest/
 resources/datastreams/id/data” –header “Accept: text/plain”



                                                                                                                  8
Security

• Authentication


   • username/password for browser-based access


   • API key for programmatic access


• Authorization uses UNIX-like model based on user classes and access types




• HTTPS for confidentiality


• Target verification to avoid “alert spamming”

                                                                              9
“Task specific” Views (Dashboard)

• At-a-glance information on datastreams -- health, permissions




                                                                  10
“Task specific” Views (Map)

• Identifies geographical location with additional information in tabbed windows




                                                                              11
Visualizations
• LivePlots: Interactive visualizations, embeddable
  in external web pages


• Includes standard visualization types: line plots,
  bar charts, scatter plots


• Support for custom visualizations, e.g. dynamic
  map trace




                                                       12
Visualization (cont’d)

• Investigating


   • “Composite” visualizations


   • Privacy-enhanced visualizations
     (time-delayed, low-fidelity)




                                       13
Event Notifications

                     • Provides “push” functionality


                     • User can receive email, SMS or
                       HTTP Post (webhook) on events of
                       interest


                     • Events need not be data related,
                       e.g. “alert me when someone adds
                       me to a group”


                     • POST to .../notifications creates a
                       subscription request and returns Id


                     • Target verification
                                                        14
Ongoing Work

• Data-centric collaboration:
  - richer, privacy-aware visualizations,
  - visual annotation and editing


• Integration of statistical packages (e.g. R) as pluggable analysis modules


• Expansion of “bi-directional” capabilities:
  - Device management
  - General m2m communication, sleep-proxy (IETF CoRE)


• Sensor.Network as an application platform: third-party access to user data
  (delegated authorization)



                                                                               15
Lessons Learned

• Enable investigations into correlations that would otherwise be missed

      • Support device heterogeneity

      • Open API. Support both PUSH/PULL

• Enable easy sharing of data and analytical algorithms

      • Address privacy concerns

      • Provide tools for data-centric collaboration, sharing

• Lower barrier to usage by domain experts

      • Hide complex IT infrastructure behind a simple API

      • Provide simple abstractions
                                                                           16
Sun SPOT Giveaway

• 2 Sun SPOT kits (see http://www.sunspotworld.com) available


• Email a short (less than 2 pages) proposal to
  sensor.network@sun.com with the title
  “PerCom Giveaway” before noon Mar 31, 2010


   • Describe your project


   • Why Sun SPOTs would be a good match


   • How you’d share the results (e.g. report,
     open source, post on http://sunspotworld.com/forums)


• What would you do with the kit long term, e.g. rotate among members of a JUG,
  use to teach a class etc.
                                                                                  17
Q&A




      18

Weitere ähnliche Inhalte

Ähnlich wie Building Sensor Networks: An Open Data Exchange

Dist sniffing & scanning project
Dist sniffing & scanning projectDist sniffing & scanning project
Dist sniffing & scanning projectRishu Seth
 
Building the Web of Things with Sun SPOTs
Building the Web of Things with Sun SPOTsBuilding the Web of Things with Sun SPOTs
Building the Web of Things with Sun SPOTsbenaam
 
Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)
Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)
Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)Globus
 
Continuum Analytics and Python
Continuum Analytics and PythonContinuum Analytics and Python
Continuum Analytics and PythonTravis Oliphant
 
Lecture 1-big data engineering (Introduction).pdf
Lecture 1-big data engineering (Introduction).pdfLecture 1-big data engineering (Introduction).pdf
Lecture 1-big data engineering (Introduction).pdfahmedibrahimghnnam01
 
Research Data (and Software) Management at Imperial: (Everything you need to ...
Research Data (and Software) Management at Imperial: (Everything you need to ...Research Data (and Software) Management at Imperial: (Everything you need to ...
Research Data (and Software) Management at Imperial: (Everything you need to ...Sarah Anna Stewart
 
Simplified Research Data Management with the Globus Platform
Simplified Research Data Management with the Globus PlatformSimplified Research Data Management with the Globus Platform
Simplified Research Data Management with the Globus PlatformGlobus
 
The Big Data Stack
The Big Data StackThe Big Data Stack
The Big Data StackZubair Nabi
 
DOXLON November 2016 - Data Democratization Using Splunk
DOXLON November 2016 - Data Democratization Using SplunkDOXLON November 2016 - Data Democratization Using Splunk
DOXLON November 2016 - Data Democratization Using SplunkOutlyer
 
An Architecture for Privacy-Sensitive Ubiquitous Computing at Mobisys 2004
An Architecture for Privacy-Sensitive Ubiquitous Computing at Mobisys 2004An Architecture for Privacy-Sensitive Ubiquitous Computing at Mobisys 2004
An Architecture for Privacy-Sensitive Ubiquitous Computing at Mobisys 2004Jason Hong
 
Week 1 lecture material cc
Week 1 lecture material ccWeek 1 lecture material cc
Week 1 lecture material ccAnkit Gupta
 
Utilising Cloud Computing for Research through Infrastructure, Software and D...
Utilising Cloud Computing for Research through Infrastructure, Software and D...Utilising Cloud Computing for Research through Infrastructure, Software and D...
Utilising Cloud Computing for Research through Infrastructure, Software and D...David Wallom
 
_Cloud_Computing_Overview.pdf
_Cloud_Computing_Overview.pdf_Cloud_Computing_Overview.pdf
_Cloud_Computing_Overview.pdfTyStrk
 
Week 1 Lecture_1-5 CC_watermark.pdf
Week 1 Lecture_1-5 CC_watermark.pdfWeek 1 Lecture_1-5 CC_watermark.pdf
Week 1 Lecture_1-5 CC_watermark.pdfJohn422973
 
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...Mihai Criveti
 
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016Grid Protection Alliance
 

Ähnlich wie Building Sensor Networks: An Open Data Exchange (20)

Dist sniffing & scanning project
Dist sniffing & scanning projectDist sniffing & scanning project
Dist sniffing & scanning project
 
Building the Web of Things with Sun SPOTs
Building the Web of Things with Sun SPOTsBuilding the Web of Things with Sun SPOTs
Building the Web of Things with Sun SPOTs
 
Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)
Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)
Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)
 
Intro to RDM
Intro to RDMIntro to RDM
Intro to RDM
 
Continuum Analytics and Python
Continuum Analytics and PythonContinuum Analytics and Python
Continuum Analytics and Python
 
Lecture 1-big data engineering (Introduction).pdf
Lecture 1-big data engineering (Introduction).pdfLecture 1-big data engineering (Introduction).pdf
Lecture 1-big data engineering (Introduction).pdf
 
Research Data (and Software) Management at Imperial: (Everything you need to ...
Research Data (and Software) Management at Imperial: (Everything you need to ...Research Data (and Software) Management at Imperial: (Everything you need to ...
Research Data (and Software) Management at Imperial: (Everything you need to ...
 
Simplified Research Data Management with the Globus Platform
Simplified Research Data Management with the Globus PlatformSimplified Research Data Management with the Globus Platform
Simplified Research Data Management with the Globus Platform
 
The Big Data Stack
The Big Data StackThe Big Data Stack
The Big Data Stack
 
DOXLON November 2016 - Data Democratization Using Splunk
DOXLON November 2016 - Data Democratization Using SplunkDOXLON November 2016 - Data Democratization Using Splunk
DOXLON November 2016 - Data Democratization Using Splunk
 
Analytics&IoT
Analytics&IoTAnalytics&IoT
Analytics&IoT
 
An Architecture for Privacy-Sensitive Ubiquitous Computing at Mobisys 2004
An Architecture for Privacy-Sensitive Ubiquitous Computing at Mobisys 2004An Architecture for Privacy-Sensitive Ubiquitous Computing at Mobisys 2004
An Architecture for Privacy-Sensitive Ubiquitous Computing at Mobisys 2004
 
Week 1 lecture material cc
Week 1 lecture material ccWeek 1 lecture material cc
Week 1 lecture material cc
 
Utilising Cloud Computing for Research through Infrastructure, Software and D...
Utilising Cloud Computing for Research through Infrastructure, Software and D...Utilising Cloud Computing for Research through Infrastructure, Software and D...
Utilising Cloud Computing for Research through Infrastructure, Software and D...
 
_Cloud_Computing_Overview.pdf
_Cloud_Computing_Overview.pdf_Cloud_Computing_Overview.pdf
_Cloud_Computing_Overview.pdf
 
Week 1 Lecture_1-5 CC_watermark.pdf
Week 1 Lecture_1-5 CC_watermark.pdfWeek 1 Lecture_1-5 CC_watermark.pdf
Week 1 Lecture_1-5 CC_watermark.pdf
 
Convergence Best Poster Award
Convergence Best Poster AwardConvergence Best Poster Award
Convergence Best Poster Award
 
Prototype Design of Open Access Institutional Repository
Prototype Design of Open Access Institutional RepositoryPrototype Design of Open Access Institutional Repository
Prototype Design of Open Access Institutional Repository
 
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...
 
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016
 

Kürzlich hochgeladen

DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DaySri Ambati
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfPrecisely
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 

Kürzlich hochgeladen (20)

DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 

Building Sensor Networks: An Open Data Exchange

  • 1. Early Lessons from Building Sensor.Network: An Open Data Exchange for the Web of Things Vipul Gupta, Poorna Udupi, Arshan Poursohi {vipul.x.gupta, poorna.udupi, arshan.poursohi}@oracle.com First International Workshop on the Web of Things (WoT 2010), PerCom 2010 1
  • 2. Overview • The Internet is now the Internet of Things ... data storage 2
  • 3. Overview • The Internet is now the Internet of Things ... data analysis 2
  • 4. Overview • The Internet is now the Internet of Things ... insights 2
  • 5. Overview • The Internet is now the Internet of Things ... actions 2
  • 6. Overview • The Internet is now the Internet of Things ... Sensor.Network: an open data-exchange for the Web of Things 2
  • 7. Motivation • Interactions with many SPOTs customers - Sun Modular Data Center, MIT, Warren Wilson College, USGS, Vodafone • Common set of issues: - Data collection - Sharing - Privacy - Search - Collaborative analysis - Notifications • Bring social networking technologies (e.g. tags, annotations, fine-grained access control, web-hooks) to this problem space 3
  • 8. Motivation • Interactions with many SPOTs customers - Sun Modular Data Center, MIT, Warren Wilson College, USGS, Vodafone • Common set of issues: - Data collection - Sharing - Privacy - Search - Collaborative analysis - Notifications • Bring social networking technologies (e.g. tags, annotations, fine-grained access control, web-hooks) to this problem space 3
  • 9. Motivation • Interactions with many SPOTs customers - Sun Modular Data Center, MIT, Warren Wilson College, USGS, Vodafone • Common set of issues: - Data collection - Sharing - Privacy - Search - Collaborative analysis - Notifications • Bring social networking technologies (e.g. tags, annotations, fine-grained access control, web-hooks) to this problem space 3
  • 10. Motivation • Interactions with many SPOTs customers - Sun Modular Data Center, MIT, Warren Wilson College, USGS, Vodafone • Common set of issues: - Data collection - Sharing - Privacy - Search - Collaborative analysis - Notifications • Bring social networking technologies (e.g. tags, annotations, fine-grained access control, web-hooks) to this problem space 3
  • 11. Benefits • Enables investigations into correlations that would otherwise be missed • Enables easy sharing of data and analytical algorithms • Enables data-centric collaboration: editing, annotation, discussion • Frees up domain experts from the chore of setting up and managing an IT infrastructure 4
  • 12. Sensor.Network Overview • Embrace heterogenous devices • Lower barrier to usage • Easy, RESTful API • Fine-grained access control • General platform for specialized applications 5
  • 13. “Datastream” Abstraction • A time-series of sensor values sampled together. • Decouples physical sensor from high-level phenomenon of interest. • A datastream may be fed by different sensors at different times • Has associated metadata and privacy controls 6
  • 14. REST-based API • Sensor.Network operations may be accessed via a browser or programmatically using HTTP operations • Most operations require authentication--either password or API Key Datastream creation example: % curl –dump-header hdrs.txt –header “X-SensorNetworkAPIKey: apiKey” –request POST –header “Content- type: application/xml” –data-binary “@Datastream.xml” “http://sensor.network.com/rest/resources/datastreams/” <?xml version=”1.0”?> <datastream> <name>My Pothos Plant</name> <description>Light and temperature readings from my office plant. </description> <tag>light</tag> <tag>temperature</tag> <value><name>light</name> <type>int</type> <units>lumen</units></value> <value><name>temperature</name> <type>float</type> <units>celsius</units> <min>-50.0</min> <max>50.0</max></value> </datastream> 7
  • 15. REST-based API (more examples) • Data insertion % curl –dump-header hdrs.txt –header “X-SensorNetworkAPIKey: apiKey” –request POST –header “Content- type: application/xml” –data-binary “@Data.xml” “http://sensor.network.com/rest/resources/datastreams/id/data” <?xml version=”1.0”?> <sampleData> <sensorNodeId>0014.4F01.0000.01AB</sensorNodeId> <timestamp>2009-07-30T13:31:37.459Z</timestamp> <value>700</value> <value>29.4</value> </sampleData> • Data retrieval % curl –dump-header hdrs.txt –header “X-SensorNetworkAPIKey: apiKey” “http://sensor.network.com/rest/ resources/datastreams/id/data” –header “Accept: text/plain” 8
  • 16. Security • Authentication • username/password for browser-based access • API key for programmatic access • Authorization uses UNIX-like model based on user classes and access types • HTTPS for confidentiality • Target verification to avoid “alert spamming” 9
  • 17. “Task specific” Views (Dashboard) • At-a-glance information on datastreams -- health, permissions 10
  • 18. “Task specific” Views (Map) • Identifies geographical location with additional information in tabbed windows 11
  • 19. Visualizations • LivePlots: Interactive visualizations, embeddable in external web pages • Includes standard visualization types: line plots, bar charts, scatter plots • Support for custom visualizations, e.g. dynamic map trace 12
  • 20. Visualization (cont’d) • Investigating • “Composite” visualizations • Privacy-enhanced visualizations (time-delayed, low-fidelity) 13
  • 21. Event Notifications • Provides “push” functionality • User can receive email, SMS or HTTP Post (webhook) on events of interest • Events need not be data related, e.g. “alert me when someone adds me to a group” • POST to .../notifications creates a subscription request and returns Id • Target verification 14
  • 22. Ongoing Work • Data-centric collaboration: - richer, privacy-aware visualizations, - visual annotation and editing • Integration of statistical packages (e.g. R) as pluggable analysis modules • Expansion of “bi-directional” capabilities: - Device management - General m2m communication, sleep-proxy (IETF CoRE) • Sensor.Network as an application platform: third-party access to user data (delegated authorization) 15
  • 23. Lessons Learned • Enable investigations into correlations that would otherwise be missed • Support device heterogeneity • Open API. Support both PUSH/PULL • Enable easy sharing of data and analytical algorithms • Address privacy concerns • Provide tools for data-centric collaboration, sharing • Lower barrier to usage by domain experts • Hide complex IT infrastructure behind a simple API • Provide simple abstractions 16
  • 24. Sun SPOT Giveaway • 2 Sun SPOT kits (see http://www.sunspotworld.com) available • Email a short (less than 2 pages) proposal to sensor.network@sun.com with the title “PerCom Giveaway” before noon Mar 31, 2010 • Describe your project • Why Sun SPOTs would be a good match • How you’d share the results (e.g. report, open source, post on http://sunspotworld.com/forums) • What would you do with the kit long term, e.g. rotate among members of a JUG, use to teach a class etc. 17
  • 25. Q&A 18