SlideShare ist ein Scribd-Unternehmen logo
1 von 18
Downloaden Sie, um offline zu lesen
Digital Enterprise Research Institute                                                             www.deri.ie




                     SemWebbers, LODers:
               What PubSubHubbub can do for you
                                                                   Alexandre Passant
                                                                               DERI, NUI Galway




Seminar @ Talis
23 Sept 2010, Birmingham, U.K.
© Copyright 2009 Digital Enterprise Research Institute. All rights reserved.
A *real-time* Web
Digital Enterprise Research Institute                                    www.deri.ie




           Information is no longer static
                  The Web becomes an information stream
                  New trends in ubiquitous computing, plus IoT
                     –  Even the @towerbridge is Tweeting !
                  Twitter, Foursquare, Gowalla, Qik, etc.


           Citizen Sensing
                  Earthquake detection on Twitter (WWW2010 paper)
                  Emergency management, reporting and monitoring
                   (Mumbai attacks on Flickr, Twitter, etc.)
                  Opinion and trends mining (Box office prediction on
                   Twitter – HP labs)


                                            2 of XYZ
Pull versus Push approaches
Digital Enterprise Research Institute                                         www.deri.ie




           What if …
                  I want to know when a friend of mine is checking-in in a
                   pub in Ireland
                  I want to get an alert when a wikipedia page about a punk-
                   rock band from the 80’s is edited


           Pull
                  Going to websites every minute to see what’s new
                  Useless HTTP calls (API/RSS), risks of being banned (TOS)
           Push
                  Websites let me know when they have something relevant
                  Wait. Receive. Consume

                                          3 of XYZ
PubSubHubbub (PuSH) at a glance
Digital Enterprise Research Institute                                           www.deri.ie




           Google’s Push approach
                  http://code.google.com/p/pubsubhubbub
                  Using Atom / RSS
                     –  link rel=“hub” header for identifying Hub from a feed
                  Simple registration / notification approach
                     –  API available in various languages
                  Broadcasting data through public hubs
                     –  Use Google’s one, or host your own




                                             4 of XYZ
Semantics and the real-time Web
Digital Enterprise Research Institute                                          www.deri.ie




           Semantics can help making sense of online content,
            by combining raw information and structured data
                  What’s happening right now, sport-wise, 25km around
                   here ?
                     –  Geonames, Twitter, Dbpedia, etc.
                  Which of my social network contact, whatever the website,
                   is visiting Europe next month
                     –  FOAF, Geonames, etc.

           New architectures are required
                  Enabling pro-active notification (PuSH) based on triggers
                  Triggers can be semantically defined with SPARQL !



                                               5 of XYZ
PubSubHubbub, SemWeb and LOD ?
Digital Enterprise Research Institute                                    www.deri.ie




           Using PubSubHubbub to register / get notifications
            about structured data
                  Dynamic triggers identifying relevant data changes
                  Defined as SPARQL queries
                  Combined with other data sources from the LOD cloud


           A friend of mine checking-in in a pub in Ireland
              <http://apassant.net/alex> foaf:knows ?friend ;!
              ?friend ex:checksIn ?pub ;!
              ?pub foaf:based_near ?location ;!
              ?location skos:subject
                dbpedia:Cities_in_the_Republic_ofIreland .!

                                         6 of XYZ
Our approach: sparqlPuSH
Digital Enterprise Research Institute                                       www.deri.ie




           sparqlPuSH
                  Combining SPARQL, SPARQL Update and PubSubHubbub
                   for proactive notifications of changes in RDF stores
                  An interface that can be plugged on the top of any RDF
                   store - http://code.google.com/p/sparqlpush/


           Based on
                  SPARQL and SPARQL Update to register feeds and launch
                   actions when content of the RDF store changes
                  Atom and RSS to get feeds of related changes
                  PubSubHubbub for broadcasting changes (benefiting from
                   public hubs such as Google’s one)


                                         7 of XYZ
sparqlPuSH
Digital Enterprise Research Institute                                       www.deri.ie




           A two-steps approach
                  Query registration
                  Change notification


           Both steps are independent of the RDF store
            implementation
                  Registration can be done remotely, with an HTTP request
                   sent to a sparqlPuSH interface
                  Notification is triggered as soon as relevant data appears in
                   the store, loaded with SPARQL Update through sparqlPuSH
                  Clients must understand the rel=“hub” link in the feed
                   header, and interpret notification from PuSH hubs


                                          8 of XYZ
Query registration
Digital Enterprise Research Institute              www.deri.ie




                                        9 of XYZ
Example of query registration
Digital Enterprise Research Institute                    www.deri.ie




           Identifying changes on a particular object
                  Using the Changeset vocabulary




                                        10 of XYZ
Query registration
Digital Enterprise Research Institute               www.deri.ie




                                        11 of XYZ
Conventions in query registration
Digital Enterprise Research Institute                                          www.deri.ie




           Using conventions to get a well-formatted Atom /
            RSS feed
                  Easier to read in standard aggregators

           Mandatory elements
                  ?uri - their URI of the element(s) to be retrieved
                  ?date - their creation / modification date
                  Can be used to retrieve named graphs if content itself is
                   not dated
           Optional elements
                  ?label - their label
                  ?author - their author

                                            12 of XYZ
Browsing available feeds
Digital Enterprise Research Institute                                          www.deri.ie




           The sparqlPuSH UI
                  Lists available feeds, including timestamp of last update
                  Ability to create feeds from the interface




                                          13 of XYZ
Notification
Digital Enterprise Research Institute               www.deri.ie




                                        14 of XYZ
Notification on data update
Digital Enterprise Research Institute                                                www.deri.ie




           SPARQL Update support
                  New data has to be HTTP POST-ed to sparqlPuSH
                     –  Then loaded in the underlying RDF store
                     –  Allows *real-time* identification (as opposed to cron-job)


           Identifying relevant changes
                  Applying all registered queries to the updated dataset
           Broadcasting changes
                  Using PubSubHubbub ! (Ensures scalability)




                                             15 of XYZ
Implementation
Digital Enterprise Research Institute                                     www.deri.ie




           Source code (PHP)
                  http://code.google.com/p/sparqlpush/ (BSD license)


           Server
                  Connection to any SPARQL endpoint
                  Additional connector for ARC2 using the ARC2 API
                  Generating RSS or Atom feeds
           Demo client
                  Registering / unregistering queries to remote sparqlPuSH
                   interfaces
                  Receiving updates from registered feeds


                                         16 of XYZ
Use-cases
Digital Enterprise Research Institute                                       www.deri.ie




           Simple sparqlPuSH use
                  http://vimeo.com/11023983
           Advanced query using DBpedia
                  http://vimeo.com/11023983


           Twarql
                  Twitter data extraction, interlinking and notification
                  http://wiki.knoesis.org/index.php/Twarql
           SMOB
                  In-progress: Broadcasting SPARQL-Update using PuSH
                  http://smob.me


                                          17 of XYZ
Questions ?
Digital Enterprise Research Institute                                   www.deri.ie




           sparqlPuSH source
                  http://code.google.com/p/sparqlpush/ (BSD license)


           Details on sparqlPuSH
                  SFSW2010 paper (w/ @pablomendes)


           Contact
                  alexandre.passant@deri.org
                  http://apassant.net
                  @terraces




                                         18 of XYZ

Weitere ähnliche Inhalte

Andere mochten auch

:me owl:sameAs flickr:33669349@N00 .
:me owl:sameAs flickr:33669349@N00 .:me owl:sameAs flickr:33669349@N00 .
:me owl:sameAs flickr:33669349@N00 .Alexandre Passant
 
sparqlPuSH: Proactive notification of data updates in RDF stores using PubSub...
sparqlPuSH: Proactive notification of data updates in RDF stores using PubSub...sparqlPuSH: Proactive notification of data updates in RDF stores using PubSub...
sparqlPuSH: Proactive notification of data updates in RDF stores using PubSub...Alexandre Passant
 
Social Web - The Next Generation
Social Web - The Next GenerationSocial Web - The Next Generation
Social Web - The Next GenerationAlexandre Passant
 
Towards an Interlinked Semantic Wiki Farm
Towards an Interlinked Semantic Wiki FarmTowards an Interlinked Semantic Wiki Farm
Towards an Interlinked Semantic Wiki FarmAlexandre Passant
 
Hello Open World - The Web of Data for the Pragmatic Developer
Hello Open World - The Web of Data for the Pragmatic DeveloperHello Open World - The Web of Data for the Pragmatic Developer
Hello Open World - The Web of Data for the Pragmatic DeveloperAlexandre Passant
 
Dbrec - Music recommendations using DBpedia
Dbrec - Music recommendations using DBpediaDbrec - Music recommendations using DBpedia
Dbrec - Music recommendations using DBpediaAlexandre Passant
 
Introduction to the Semantic Web
Introduction to the Semantic WebIntroduction to the Semantic Web
Introduction to the Semantic WebAlexandre Passant
 
A user-friendly interface to browse and find DOAP project with doap:store
A user-friendly interface to browse and find DOAP project with doap:storeA user-friendly interface to browse and find DOAP project with doap:store
A user-friendly interface to browse and find DOAP project with doap:storeAlexandre Passant
 
DRC2500_Mémoire de plaidoirie_APPELANTS ÉQUIPE 5 FINAL note de bas de page
DRC2500_Mémoire de plaidoirie_APPELANTS ÉQUIPE 5 FINAL note de bas de pageDRC2500_Mémoire de plaidoirie_APPELANTS ÉQUIPE 5 FINAL note de bas de page
DRC2500_Mémoire de plaidoirie_APPELANTS ÉQUIPE 5 FINAL note de bas de pageDavid Leclair
 
Tendances Social Media 2014
Tendances Social Media 2014 Tendances Social Media 2014
Tendances Social Media 2014 Vanksen
 

Andere mochten auch (13)

:me owl:sameAs flickr:33669349@N00 .
:me owl:sameAs flickr:33669349@N00 .:me owl:sameAs flickr:33669349@N00 .
:me owl:sameAs flickr:33669349@N00 .
 
sparqlPuSH: Proactive notification of data updates in RDF stores using PubSub...
sparqlPuSH: Proactive notification of data updates in RDF stores using PubSub...sparqlPuSH: Proactive notification of data updates in RDF stores using PubSub...
sparqlPuSH: Proactive notification of data updates in RDF stores using PubSub...
 
Social Web - The Next Generation
Social Web - The Next GenerationSocial Web - The Next Generation
Social Web - The Next Generation
 
Towards an Interlinked Semantic Wiki Farm
Towards an Interlinked Semantic Wiki FarmTowards an Interlinked Semantic Wiki Farm
Towards an Interlinked Semantic Wiki Farm
 
Hello Open World - The Web of Data for the Pragmatic Developer
Hello Open World - The Web of Data for the Pragmatic DeveloperHello Open World - The Web of Data for the Pragmatic Developer
Hello Open World - The Web of Data for the Pragmatic Developer
 
Dbrec - Music recommendations using DBpedia
Dbrec - Music recommendations using DBpediaDbrec - Music recommendations using DBpedia
Dbrec - Music recommendations using DBpedia
 
Introduction to the Semantic Web
Introduction to the Semantic WebIntroduction to the Semantic Web
Introduction to the Semantic Web
 
A user-friendly interface to browse and find DOAP project with doap:store
A user-friendly interface to browse and find DOAP project with doap:storeA user-friendly interface to browse and find DOAP project with doap:store
A user-friendly interface to browse and find DOAP project with doap:store
 
FOAF & SIOC applications
FOAF & SIOC applicationsFOAF & SIOC applications
FOAF & SIOC applications
 
MOAT: Meaning Of A Tag
MOAT: Meaning Of A TagMOAT: Meaning Of A Tag
MOAT: Meaning Of A Tag
 
DRC2500_Mémoire de plaidoirie_APPELANTS ÉQUIPE 5 FINAL note de bas de page
DRC2500_Mémoire de plaidoirie_APPELANTS ÉQUIPE 5 FINAL note de bas de pageDRC2500_Mémoire de plaidoirie_APPELANTS ÉQUIPE 5 FINAL note de bas de page
DRC2500_Mémoire de plaidoirie_APPELANTS ÉQUIPE 5 FINAL note de bas de page
 
ergonomie
ergonomieergonomie
ergonomie
 
Tendances Social Media 2014
Tendances Social Media 2014 Tendances Social Media 2014
Tendances Social Media 2014
 

Ähnlich wie Semwebbers, LODers: What PubSubHubbub can do for you

SMOB - A Framework for Semantic Microblogging
SMOB - A Framework for Semantic MicrobloggingSMOB - A Framework for Semantic Microblogging
SMOB - A Framework for Semantic MicrobloggingAlexandre Passant
 
Fsw2011 smob
Fsw2011 smobFsw2011 smob
Fsw2011 smobjuanaya
 
Koalas: Unifying Spark and pandas APIs
Koalas: Unifying Spark and pandas APIsKoalas: Unifying Spark and pandas APIs
Koalas: Unifying Spark and pandas APIsTakuya UESHIN
 
Apache-Flink-What-How-Why-Who-Where-by-Slim-Baltagi
Apache-Flink-What-How-Why-Who-Where-by-Slim-BaltagiApache-Flink-What-How-Why-Who-Where-by-Slim-Baltagi
Apache-Flink-What-How-Why-Who-Where-by-Slim-BaltagiSlim Baltagi
 
Hello Open World - Semtech 2009
Hello Open World - Semtech 2009Hello Open World - Semtech 2009
Hello Open World - Semtech 2009Alexandre Passant
 
SpagoBI and Big Data: next Open Source Information Management suite, OW2con'1...
SpagoBI and Big Data: next Open Source Information Management suite, OW2con'1...SpagoBI and Big Data: next Open Source Information Management suite, OW2con'1...
SpagoBI and Big Data: next Open Source Information Management suite, OW2con'1...OW2
 
Rethinking Microblogging: Open Distributed Semantic
Rethinking Microblogging: Open Distributed SemanticRethinking Microblogging: Open Distributed Semantic
Rethinking Microblogging: Open Distributed SemanticAlexandre Passant
 
Overview of Apache Flink: the 4G of Big Data Analytics Frameworks
Overview of Apache Flink: the 4G of Big Data Analytics FrameworksOverview of Apache Flink: the 4G of Big Data Analytics Frameworks
Overview of Apache Flink: the 4G of Big Data Analytics FrameworksDataWorks Summit/Hadoop Summit
 
Overview of Apache Fink: The 4G of Big Data Analytics Frameworks
Overview of Apache Fink: The 4G of Big Data Analytics FrameworksOverview of Apache Fink: The 4G of Big Data Analytics Frameworks
Overview of Apache Fink: The 4G of Big Data Analytics FrameworksSlim Baltagi
 
Overview of Apache Fink: the 4 G of Big Data Analytics Frameworks
Overview of Apache Fink: the 4 G of Big Data Analytics FrameworksOverview of Apache Fink: the 4 G of Big Data Analytics Frameworks
Overview of Apache Fink: the 4 G of Big Data Analytics FrameworksSlim Baltagi
 
Hadoop/Spark Non-Technical Basics
Hadoop/Spark Non-Technical BasicsHadoop/Spark Non-Technical Basics
Hadoop/Spark Non-Technical BasicsZitao Liu
 
How to Share and Reuse Learning Resources: the ARIADNE Experience
How to Share and Reuse Learning Resources: the ARIADNE ExperienceHow to Share and Reuse Learning Resources: the ARIADNE Experience
How to Share and Reuse Learning Resources: the ARIADNE ExperienceJoris Klerkx
 
Sticking between: mashup in libraries
Sticking between: mashup in librariesSticking between: mashup in libraries
Sticking between: mashup in librariesBonaria Biancu
 
Real time stock processing with apache nifi, apache flink and apache kafka
Real time stock processing with apache nifi, apache flink and apache kafkaReal time stock processing with apache nifi, apache flink and apache kafka
Real time stock processing with apache nifi, apache flink and apache kafkaTimothy Spann
 
Open Source Lambda Architecture for deep learning
Open Source Lambda Architecture for deep learningOpen Source Lambda Architecture for deep learning
Open Source Lambda Architecture for deep learningPatrick Nicolas
 
Produce and Consume Linked Data with Drupal!
Produce and Consume Linked Data with Drupal!Produce and Consume Linked Data with Drupal!
Produce and Consume Linked Data with Drupal!scorlosquet
 
NY Open Source Data Meetup Feb 8 2024 Building Real-time Pipelines with FLaNK...
NY Open Source Data Meetup Feb 8 2024 Building Real-time Pipelines with FLaNK...NY Open Source Data Meetup Feb 8 2024 Building Real-time Pipelines with FLaNK...
NY Open Source Data Meetup Feb 8 2024 Building Real-time Pipelines with FLaNK...Timothy Spann
 

Ähnlich wie Semwebbers, LODers: What PubSubHubbub can do for you (20)

SMOB - A Framework for Semantic Microblogging
SMOB - A Framework for Semantic MicrobloggingSMOB - A Framework for Semantic Microblogging
SMOB - A Framework for Semantic Microblogging
 
Fsw2011 smob
Fsw2011 smobFsw2011 smob
Fsw2011 smob
 
Koalas: Unifying Spark and pandas APIs
Koalas: Unifying Spark and pandas APIsKoalas: Unifying Spark and pandas APIs
Koalas: Unifying Spark and pandas APIs
 
Apache-Flink-What-How-Why-Who-Where-by-Slim-Baltagi
Apache-Flink-What-How-Why-Who-Where-by-Slim-BaltagiApache-Flink-What-How-Why-Who-Where-by-Slim-Baltagi
Apache-Flink-What-How-Why-Who-Where-by-Slim-Baltagi
 
Hello Open World - Semtech 2009
Hello Open World - Semtech 2009Hello Open World - Semtech 2009
Hello Open World - Semtech 2009
 
Big data apache spark + scala
Big data   apache spark + scalaBig data   apache spark + scala
Big data apache spark + scala
 
SpagoBI and Big Data: next Open Source Information Management suite, OW2con'1...
SpagoBI and Big Data: next Open Source Information Management suite, OW2con'1...SpagoBI and Big Data: next Open Source Information Management suite, OW2con'1...
SpagoBI and Big Data: next Open Source Information Management suite, OW2con'1...
 
Rethinking Microblogging: Open Distributed Semantic
Rethinking Microblogging: Open Distributed SemanticRethinking Microblogging: Open Distributed Semantic
Rethinking Microblogging: Open Distributed Semantic
 
Overview of Apache Flink: the 4G of Big Data Analytics Frameworks
Overview of Apache Flink: the 4G of Big Data Analytics FrameworksOverview of Apache Flink: the 4G of Big Data Analytics Frameworks
Overview of Apache Flink: the 4G of Big Data Analytics Frameworks
 
Overview of Apache Fink: The 4G of Big Data Analytics Frameworks
Overview of Apache Fink: The 4G of Big Data Analytics FrameworksOverview of Apache Fink: The 4G of Big Data Analytics Frameworks
Overview of Apache Fink: The 4G of Big Data Analytics Frameworks
 
Overview of Apache Fink: the 4 G of Big Data Analytics Frameworks
Overview of Apache Fink: the 4 G of Big Data Analytics FrameworksOverview of Apache Fink: the 4 G of Big Data Analytics Frameworks
Overview of Apache Fink: the 4 G of Big Data Analytics Frameworks
 
Hadoop/Spark Non-Technical Basics
Hadoop/Spark Non-Technical BasicsHadoop/Spark Non-Technical Basics
Hadoop/Spark Non-Technical Basics
 
How to Share and Reuse Learning Resources: the ARIADNE Experience
How to Share and Reuse Learning Resources: the ARIADNE ExperienceHow to Share and Reuse Learning Resources: the ARIADNE Experience
How to Share and Reuse Learning Resources: the ARIADNE Experience
 
Sticking between: mashup in libraries
Sticking between: mashup in librariesSticking between: mashup in libraries
Sticking between: mashup in libraries
 
nwesp 2011
nwesp 2011nwesp 2011
nwesp 2011
 
Real time stock processing with apache nifi, apache flink and apache kafka
Real time stock processing with apache nifi, apache flink and apache kafkaReal time stock processing with apache nifi, apache flink and apache kafka
Real time stock processing with apache nifi, apache flink and apache kafka
 
Open Source Lambda Architecture for deep learning
Open Source Lambda Architecture for deep learningOpen Source Lambda Architecture for deep learning
Open Source Lambda Architecture for deep learning
 
Produce and Consume Linked Data with Drupal!
Produce and Consume Linked Data with Drupal!Produce and Consume Linked Data with Drupal!
Produce and Consume Linked Data with Drupal!
 
NY Open Source Data Meetup Feb 8 2024 Building Real-time Pipelines with FLaNK...
NY Open Source Data Meetup Feb 8 2024 Building Real-time Pipelines with FLaNK...NY Open Source Data Meetup Feb 8 2024 Building Real-time Pipelines with FLaNK...
NY Open Source Data Meetup Feb 8 2024 Building Real-time Pipelines with FLaNK...
 
How to Publish Open Data
How to Publish Open DataHow to Publish Open Data
How to Publish Open Data
 

Mehr von Alexandre Passant

seevl: Cloud computing, the Semantic Web and Music Discovery
seevl: Cloud computing, the Semantic Web and Music Discoveryseevl: Cloud computing, the Semantic Web and Music Discovery
seevl: Cloud computing, the Semantic Web and Music DiscoveryAlexandre Passant
 
seevl: Data-driven music discovery
seevl: Data-driven music discoveryseevl: Data-driven music discovery
seevl: Data-driven music discoveryAlexandre Passant
 
Seevl - SemTech lightning talk
Seevl - SemTech lightning talkSeevl - SemTech lightning talk
Seevl - SemTech lightning talkAlexandre Passant
 
SPARQL 1.1 - Quoi de neuf pour manipuler les données sur le Web
SPARQL 1.1 - Quoi de neuf pour manipuler les données sur le WebSPARQL 1.1 - Quoi de neuf pour manipuler les données sur le Web
SPARQL 1.1 - Quoi de neuf pour manipuler les données sur le WebAlexandre Passant
 
Ontologies et Web 2.0 : une Expérimentation en Entreprise
Ontologies et Web 2.0 : une Expérimentation en EntrepriseOntologies et Web 2.0 : une Expérimentation en Entreprise
Ontologies et Web 2.0 : une Expérimentation en EntrepriseAlexandre Passant
 
Folksonomies, Ontologies and Corporate Blogging
Folksonomies, Ontologies and Corporate BloggingFolksonomies, Ontologies and Corporate Blogging
Folksonomies, Ontologies and Corporate BloggingAlexandre Passant
 
Using Ontologies to Strengthen Folksonomies and Enrich Information Retrieval ...
Using Ontologies to Strengthen Folksonomies and Enrich Information Retrieval ...Using Ontologies to Strengthen Folksonomies and Enrich Information Retrieval ...
Using Ontologies to Strengthen Folksonomies and Enrich Information Retrieval ...Alexandre Passant
 
Technologies du Web Sémantique pour l'Entreprise 2.0
Technologies du Web Sémantique pour l'Entreprise 2.0Technologies du Web Sémantique pour l'Entreprise 2.0
Technologies du Web Sémantique pour l'Entreprise 2.0Alexandre Passant
 
Semantic Enterprise 2.0 - Enabling Semantic Web technologies in Enterprise 2...
Semantic Enterprise 2.0 - Enabling Semantic Web technologies in Enterprise 2...Semantic Enterprise 2.0 - Enabling Semantic Web technologies in Enterprise 2...
Semantic Enterprise 2.0 - Enabling Semantic Web technologies in Enterprise 2...Alexandre Passant
 
Federating Distributed Social Data to Build an Interlinked Online Information...
Federating Distributed Social Data to Build an Interlinked Online Information...Federating Distributed Social Data to Build an Interlinked Online Information...
Federating Distributed Social Data to Build an Interlinked Online Information...Alexandre Passant
 
Social Media: Why and how to take advantage of it
Social Media:  Why and how to take advantage of itSocial Media:  Why and how to take advantage of it
Social Media: Why and how to take advantage of itAlexandre Passant
 
Du Web 2.0 au Web Sémantique avec FOAF et SIOC
Du Web 2.0 au Web Sémantique avec FOAF et SIOCDu Web 2.0 au Web Sémantique avec FOAF et SIOC
Du Web 2.0 au Web Sémantique avec FOAF et SIOCAlexandre Passant
 
The Social Semantic Web and Linked Data
The Social Semantic Web and Linked DataThe Social Semantic Web and Linked Data
The Social Semantic Web and Linked DataAlexandre Passant
 

Mehr von Alexandre Passant (16)

seevl: Cloud computing, the Semantic Web and Music Discovery
seevl: Cloud computing, the Semantic Web and Music Discoveryseevl: Cloud computing, the Semantic Web and Music Discovery
seevl: Cloud computing, the Semantic Web and Music Discovery
 
seevl: Data-driven music discovery
seevl: Data-driven music discoveryseevl: Data-driven music discovery
seevl: Data-driven music discovery
 
Seevl - SemTech lightning talk
Seevl - SemTech lightning talkSeevl - SemTech lightning talk
Seevl - SemTech lightning talk
 
SPARQL 1.1 - Quoi de neuf pour manipuler les données sur le Web
SPARQL 1.1 - Quoi de neuf pour manipuler les données sur le WebSPARQL 1.1 - Quoi de neuf pour manipuler les données sur le Web
SPARQL 1.1 - Quoi de neuf pour manipuler les données sur le Web
 
i-Semantics panel
i-Semantics paneli-Semantics panel
i-Semantics panel
 
Ontologies et Web 2.0 : une Expérimentation en Entreprise
Ontologies et Web 2.0 : une Expérimentation en EntrepriseOntologies et Web 2.0 : une Expérimentation en Entreprise
Ontologies et Web 2.0 : une Expérimentation en Entreprise
 
Folksonomies, Ontologies and Corporate Blogging
Folksonomies, Ontologies and Corporate BloggingFolksonomies, Ontologies and Corporate Blogging
Folksonomies, Ontologies and Corporate Blogging
 
Using Ontologies to Strengthen Folksonomies and Enrich Information Retrieval ...
Using Ontologies to Strengthen Folksonomies and Enrich Information Retrieval ...Using Ontologies to Strengthen Folksonomies and Enrich Information Retrieval ...
Using Ontologies to Strengthen Folksonomies and Enrich Information Retrieval ...
 
The Social Web
The Social WebThe Social Web
The Social Web
 
Technologies du Web Sémantique pour l'Entreprise 2.0
Technologies du Web Sémantique pour l'Entreprise 2.0Technologies du Web Sémantique pour l'Entreprise 2.0
Technologies du Web Sémantique pour l'Entreprise 2.0
 
Semantic Enterprise 2.0 - Enabling Semantic Web technologies in Enterprise 2...
Semantic Enterprise 2.0 - Enabling Semantic Web technologies in Enterprise 2...Semantic Enterprise 2.0 - Enabling Semantic Web technologies in Enterprise 2...
Semantic Enterprise 2.0 - Enabling Semantic Web technologies in Enterprise 2...
 
Federating Distributed Social Data to Build an Interlinked Online Information...
Federating Distributed Social Data to Build an Interlinked Online Information...Federating Distributed Social Data to Build an Interlinked Online Information...
Federating Distributed Social Data to Build an Interlinked Online Information...
 
Social Media: Why and how to take advantage of it
Social Media:  Why and how to take advantage of itSocial Media:  Why and how to take advantage of it
Social Media: Why and how to take advantage of it
 
Du Web 2.0 au Web Sémantique avec FOAF et SIOC
Du Web 2.0 au Web Sémantique avec FOAF et SIOCDu Web 2.0 au Web Sémantique avec FOAF et SIOC
Du Web 2.0 au Web Sémantique avec FOAF et SIOC
 
The Social Semantic Web and Linked Data
The Social Semantic Web and Linked DataThe Social Semantic Web and Linked Data
The Social Semantic Web and Linked Data
 
Social Media and Web 2.0
Social Media and Web 2.0Social Media and Web 2.0
Social Media and Web 2.0
 

Semwebbers, LODers: What PubSubHubbub can do for you

  • 1. Digital Enterprise Research Institute www.deri.ie SemWebbers, LODers: What PubSubHubbub can do for you Alexandre Passant DERI, NUI Galway Seminar @ Talis 23 Sept 2010, Birmingham, U.K. © Copyright 2009 Digital Enterprise Research Institute. All rights reserved.
  • 2. A *real-time* Web Digital Enterprise Research Institute www.deri.ie   Information is no longer static   The Web becomes an information stream   New trends in ubiquitous computing, plus IoT –  Even the @towerbridge is Tweeting !   Twitter, Foursquare, Gowalla, Qik, etc.   Citizen Sensing   Earthquake detection on Twitter (WWW2010 paper)   Emergency management, reporting and monitoring (Mumbai attacks on Flickr, Twitter, etc.)   Opinion and trends mining (Box office prediction on Twitter – HP labs) 2 of XYZ
  • 3. Pull versus Push approaches Digital Enterprise Research Institute www.deri.ie   What if …   I want to know when a friend of mine is checking-in in a pub in Ireland   I want to get an alert when a wikipedia page about a punk- rock band from the 80’s is edited   Pull   Going to websites every minute to see what’s new   Useless HTTP calls (API/RSS), risks of being banned (TOS)   Push   Websites let me know when they have something relevant   Wait. Receive. Consume 3 of XYZ
  • 4. PubSubHubbub (PuSH) at a glance Digital Enterprise Research Institute www.deri.ie   Google’s Push approach   http://code.google.com/p/pubsubhubbub   Using Atom / RSS –  link rel=“hub” header for identifying Hub from a feed   Simple registration / notification approach –  API available in various languages   Broadcasting data through public hubs –  Use Google’s one, or host your own 4 of XYZ
  • 5. Semantics and the real-time Web Digital Enterprise Research Institute www.deri.ie   Semantics can help making sense of online content, by combining raw information and structured data   What’s happening right now, sport-wise, 25km around here ? –  Geonames, Twitter, Dbpedia, etc.   Which of my social network contact, whatever the website, is visiting Europe next month –  FOAF, Geonames, etc.   New architectures are required   Enabling pro-active notification (PuSH) based on triggers   Triggers can be semantically defined with SPARQL ! 5 of XYZ
  • 6. PubSubHubbub, SemWeb and LOD ? Digital Enterprise Research Institute www.deri.ie   Using PubSubHubbub to register / get notifications about structured data   Dynamic triggers identifying relevant data changes   Defined as SPARQL queries   Combined with other data sources from the LOD cloud   A friend of mine checking-in in a pub in Ireland <http://apassant.net/alex> foaf:knows ?friend ;! ?friend ex:checksIn ?pub ;! ?pub foaf:based_near ?location ;! ?location skos:subject dbpedia:Cities_in_the_Republic_ofIreland .! 6 of XYZ
  • 7. Our approach: sparqlPuSH Digital Enterprise Research Institute www.deri.ie   sparqlPuSH   Combining SPARQL, SPARQL Update and PubSubHubbub for proactive notifications of changes in RDF stores   An interface that can be plugged on the top of any RDF store - http://code.google.com/p/sparqlpush/   Based on   SPARQL and SPARQL Update to register feeds and launch actions when content of the RDF store changes   Atom and RSS to get feeds of related changes   PubSubHubbub for broadcasting changes (benefiting from public hubs such as Google’s one) 7 of XYZ
  • 8. sparqlPuSH Digital Enterprise Research Institute www.deri.ie   A two-steps approach   Query registration   Change notification   Both steps are independent of the RDF store implementation   Registration can be done remotely, with an HTTP request sent to a sparqlPuSH interface   Notification is triggered as soon as relevant data appears in the store, loaded with SPARQL Update through sparqlPuSH   Clients must understand the rel=“hub” link in the feed header, and interpret notification from PuSH hubs 8 of XYZ
  • 9. Query registration Digital Enterprise Research Institute www.deri.ie 9 of XYZ
  • 10. Example of query registration Digital Enterprise Research Institute www.deri.ie   Identifying changes on a particular object   Using the Changeset vocabulary 10 of XYZ
  • 11. Query registration Digital Enterprise Research Institute www.deri.ie 11 of XYZ
  • 12. Conventions in query registration Digital Enterprise Research Institute www.deri.ie   Using conventions to get a well-formatted Atom / RSS feed   Easier to read in standard aggregators   Mandatory elements   ?uri - their URI of the element(s) to be retrieved   ?date - their creation / modification date   Can be used to retrieve named graphs if content itself is not dated   Optional elements   ?label - their label   ?author - their author 12 of XYZ
  • 13. Browsing available feeds Digital Enterprise Research Institute www.deri.ie   The sparqlPuSH UI   Lists available feeds, including timestamp of last update   Ability to create feeds from the interface 13 of XYZ
  • 14. Notification Digital Enterprise Research Institute www.deri.ie 14 of XYZ
  • 15. Notification on data update Digital Enterprise Research Institute www.deri.ie   SPARQL Update support   New data has to be HTTP POST-ed to sparqlPuSH –  Then loaded in the underlying RDF store –  Allows *real-time* identification (as opposed to cron-job)   Identifying relevant changes   Applying all registered queries to the updated dataset   Broadcasting changes   Using PubSubHubbub ! (Ensures scalability) 15 of XYZ
  • 16. Implementation Digital Enterprise Research Institute www.deri.ie   Source code (PHP)   http://code.google.com/p/sparqlpush/ (BSD license)   Server   Connection to any SPARQL endpoint   Additional connector for ARC2 using the ARC2 API   Generating RSS or Atom feeds   Demo client   Registering / unregistering queries to remote sparqlPuSH interfaces   Receiving updates from registered feeds 16 of XYZ
  • 17. Use-cases Digital Enterprise Research Institute www.deri.ie   Simple sparqlPuSH use   http://vimeo.com/11023983   Advanced query using DBpedia   http://vimeo.com/11023983   Twarql   Twitter data extraction, interlinking and notification   http://wiki.knoesis.org/index.php/Twarql   SMOB   In-progress: Broadcasting SPARQL-Update using PuSH   http://smob.me 17 of XYZ
  • 18. Questions ? Digital Enterprise Research Institute www.deri.ie   sparqlPuSH source   http://code.google.com/p/sparqlpush/ (BSD license)   Details on sparqlPuSH   SFSW2010 paper (w/ @pablomendes)   Contact   alexandre.passant@deri.org   http://apassant.net   @terraces 18 of XYZ