SlideShare ist ein Scribd-Unternehmen logo
1 von 25
Downloaden Sie, um offline zu lesen
Using Trust
in Recommender Systems:
  an experimental analysis

            Paolo Massa
         University of Trento

(joint work with Bobby Bhattacharjee, UMD)
Motivation:
1. Recommender Systems recommends
   items the user might like, based on
   past ratings.
2. Now, Decentralized publishing of info:
  – Ratings on Items
  – Trust on Principals
     [Semantic Web]
3. New issues (sparseness, scalability,
   trust, attacks, ...)
           ... Trust-aware Decentralized RS
Summary
1. Recommender Systems (RSs)
  – Weaknesses
2. Solution: trust-awareness
  – Trust and trust metrics
3. Experiments on Epinions.com
  – Evidence trust solves RSs problems
  – (~50.000 users!)
4. Future works
Collaborative Filtering (CF)
1.       Input: ratings given by users to items
     ●     I like “ Titanic” as 4/5
2.       I ask recommendation
3.       RS computes the similarity of me
         against every other user
     ●     Pearson correlation coefficient
4.       RS find similar users and suggests to
         me items liked by them.
Item 1
                         It e m 2
                                    It e m 3
                                               It e m 4
                   I
   User1       2 5 ? 5
               2 5 5 5
   User2       5                    1          3
   User3       5         5                     1
   User4       2
               2         5
                         5          5
                                    5          4
                                               4

It does not consider the content of the items, only
     the ratings given by users.
It works independently of the domain (also jokes)
                             BUT
Overlapping of rated items required!
RSs weaknesses
1. Ratings Matrix sparseness (95-99%)
  – Low or No overlapping (users not comparable)
2. Cold start
  – New users have 0 ratings (->not comparable)
3. Easy Attacks by Malicious Users
  – Copy profile and become the most similar
4. Hard to understand and control
  – Black box (bad recs -> user gives up)

                Solution? Trust of course!
Trust-awareness
1. Trust statement =Rating by human to
   human about her usefulness (ex: in
   providing good movie reviews)
2. Explicitly provided
3. Trust is subjective! T(A,Z)=1 & T(B,Z)=0
  – No Global BAD principals!!!
4. Trust is asymmetric! I trust Bill Gates.
5. FOAF (Friend-Of-A-Friend) is an XML
   format to express relationships
  – Some millions files out there...
Trust Networks




     ME




6 degrees of separation
“ theorem”
Trust metrics
1. Task: based on known trust edges,
   predict trustworthiness of principals
2. Trust propagation (A->B,B->C|A-?->C)
3. Global (pagerank, ebay, ...)
4. Local (personalized)


                                  ME
Trust solves RS problems
1.   Trust solves CF sparseness problem
   – trust propagation and “ 6 degrees” -> reach many
2. Trust solves Cold Start problem
   – “ just add 1 friend”
3. Trust metrics resistant to copy-profile-attack.
   – “ you can be similar but if no trust path to you ...”
4. Trust easier to understand and control
     –    trust nets supports Explanation (HCI tests needed)

              EVIDENCE of 1 and 2 provided by analyzing a
                 REAL, VAST community (Epinions.com)
Experiment: Epinions.com
1. Epinions.com' users can
  –   Review and rate items (from 1 to 5)
  –   Keep web of trust (trust=1) and block list (trust=0).
  –   “ Reviewers whose reviews and ratings you have
      consistently found to be valuable” (Epinions FAQ)
2. Dataset (by crawling site):
  – ~50K users, ~140K items, ~660K ratings.
  – ~500K trust statements.
      •   No block list (not shown on site)
Epinions' recommendations
Taken one user “ ME” , we can
- use CF on ratings and compute
    “ similarity” of other users
- use Trust Metric and compute
    “ trustworthiness” of other users
Then we can suggest items liked by similar
    or trustable users.

          On how many users are they
               computable?
Statistics (1)




#Ratings expressed by Users
(#rev<5) = 52.82%! [Cold start users]
Statistics (2)




#Trust statements expressed by Users
(#trust<5) = 70.18%!
User Similarity Computability
1. Ideally, every user should be
   comparable against every other user.
2. BUT ratings sparseness = 99.99135%
   -> tiny overlapping between 2 users
3. Pearson correlation coefficient
   meaningful only if overlapping(A,U)>1
4. Question: taken one user, how many
   users are comparable?
US computability (cont.)
1. Taken one user, we computed all the
   comparable users.
  – On average an user has 161 comparable
    users (ideally ~50.000!)
2. We have averaged
   #comparable_users over users who
   expressed a certain number of
   reviews.
US computability (cont.)




         Cold Start Users


Ex: users with 40 reviews have ~800 comparable users.
                            BUT users (y axis) are ~50.000!
             And for Cold Start Users (>50%) this is 2.74
Trust computability
1. Trust metrics predict trust in unknown
   users based on known trust
   statements.
2. Distance from ME to U is a first
   measure of Trust computability
3. On average,
  – In 2 steps, reach 400 users
  – In 3 steps, reach 4386 users
Mean # Reachable Users (in k steps) for users
   expressing X trust statements
    In few steps, you can predict trust in every user!
                         Even for Cold Start Users!!!
Trust and US computability
                  comparison
  Mean number of Comparable                Mean number of Comparable
      users for All users                   users for Cold Start users
     Propagating Trust             Using        Propagating Trust      Using
Dist 1   Dist 2   Dist 3   Dist 4 Pearson Dist 1 Dist 2 Dist 3 Dist 4 Pearson

9.88     400      4386 16334      161    2.14 94.54 1675       9121    2.74
Contribution
Experimental evidence that
  – CF is ineffective in real world scenarios
     •   Especially for Cold Start users.
  – Trust can solve CF problems
     •   Sparseness
     •   Cold Start
     •   Attacks (self-evident)


  Trust is computable on many more users than
     user similarity
     Especially for cold start users (the majority!)
Future works
1. US and Trust correlate? Contradict?
  – US over trusted is higher than usual?
2. Distrust?
  – Propagation? Properties?
3. Design a Trust Metric (for RS)
  – Create and evaluate a Trust-aware RS
     •   Input data
Thanks for your attention!



   Questions?

                                    Paolo Massa
                             Email: massa@itc.it
   Blog: http://moloko.itc.it/paoloblog/index.html
Collaborative Filtering
Similarity measure: Pearson Correlation
Coefficient of user a and u
                         m
                    ∑i=1 r a ,i −r a r u ,i −r u 
   w a , u=
               ∑    m
                     i=1
                         r a , i −r u 
                                           2      m
                                               ∑i=1 r u , i −r u 
                                                                      2



 Prediction of rating given by user a to ite
                         n
                    ∑u=1  r u , i −ru ∗w a , u
   p a , i =r a 
                                n
                             ∑u=1 w a , u
Hard Trust and Soft Trust
1. Vocabulary:
  – Hard Trust: about security, identity of
    something (user, device, information)
     •   Public key cryptography
  – Soft Trust: appreciation of some principal
    (explicitly provided by another principal)
     •   Social Networks and Trust Metrics

Weitere ähnliche Inhalte

Ähnlich wie Using Trust in Recommender Systems: an experimental analysis

Controversial Users demand Local Trust Metrics: an Experimental Study on Epin...
Controversial Users demand Local Trust Metrics: an Experimental Study on Epin...Controversial Users demand Local Trust Metrics: an Experimental Study on Epin...
Controversial Users demand Local Trust Metrics: an Experimental Study on Epin...Paolo Massa
 
Trustlet, Open Research on Trust Metrics
Trustlet, Open Research on Trust MetricsTrustlet, Open Research on Trust Metrics
Trustlet, Open Research on Trust MetricsPaolo Massa
 
Estimating the Magic Barrier of Recommender Systems: A User Study
Estimating the Magic Barrier of Recommender Systems: A User StudyEstimating the Magic Barrier of Recommender Systems: A User Study
Estimating the Magic Barrier of Recommender Systems: A User StudyAlan Said
 
Alleviating cold-user start problem with users' social network data in recomm...
Alleviating cold-user start problem with users' social network data in recomm...Alleviating cold-user start problem with users' social network data in recomm...
Alleviating cold-user start problem with users' social network data in recomm...Eduardo Castillejo Gil
 
The Magic Barrier of Recommender Systems - No Magic, Just Ratings
The Magic Barrier of Recommender Systems - No Magic, Just RatingsThe Magic Barrier of Recommender Systems - No Magic, Just Ratings
The Magic Barrier of Recommender Systems - No Magic, Just RatingsAlan Said
 
Rated Ranking Evaluator (RRE) Hands-on Relevance Testing @Chorus
Rated Ranking Evaluator (RRE) Hands-on Relevance Testing @ChorusRated Ranking Evaluator (RRE) Hands-on Relevance Testing @Chorus
Rated Ranking Evaluator (RRE) Hands-on Relevance Testing @ChorusSease
 
IRJET- Fake Review Detection using Opinion Mining
IRJET- Fake Review Detection using Opinion MiningIRJET- Fake Review Detection using Opinion Mining
IRJET- Fake Review Detection using Opinion MiningIRJET Journal
 
The Wisdom of the Few @SIGIR09
The Wisdom of the Few @SIGIR09The Wisdom of the Few @SIGIR09
The Wisdom of the Few @SIGIR09Xavier Amatriain
 
IJCAI Workshop Presentation
IJCAI Workshop PresentationIJCAI Workshop Presentation
IJCAI Workshop PresentationNeal Lathia
 
Collaborative Filtering 1: User-based CF
Collaborative Filtering 1: User-based CFCollaborative Filtering 1: User-based CF
Collaborative Filtering 1: User-based CFYusuke Yamamoto
 
A Reliable Peer-to-Peer Platform for Adding New Node Using Trust Based Model
A Reliable Peer-to-Peer Platform for Adding New Node Using Trust Based Model    A Reliable Peer-to-Peer Platform for Adding New Node Using Trust Based Model
A Reliable Peer-to-Peer Platform for Adding New Node Using Trust Based Model IJECEIAES
 
Telefonica Lunch Seminar
Telefonica Lunch SeminarTelefonica Lunch Seminar
Telefonica Lunch SeminarNeal Lathia
 
Enhancing Multi-Aspect Collaborative Filtering for Personalized Recommendation
Enhancing Multi-Aspect Collaborative Filtering for Personalized RecommendationEnhancing Multi-Aspect Collaborative Filtering for Personalized Recommendation
Enhancing Multi-Aspect Collaborative Filtering for Personalized RecommendationNurfadhlina Mohd Sharef
 
Computing Ratings and Rankings by Mining Feedback Comments
Computing Ratings and Rankings by Mining Feedback CommentsComputing Ratings and Rankings by Mining Feedback Comments
Computing Ratings and Rankings by Mining Feedback CommentsIRJET Journal
 
Recommender Systems! @ASAI 2011
Recommender Systems! @ASAI 2011Recommender Systems! @ASAI 2011
Recommender Systems! @ASAI 2011Ernesto Mislej
 
Collective Opinion Spam Detection Bridging Review Networks and Metadata
Collective Opinion Spam Detection Bridging Review Networks and MetadataCollective Opinion Spam Detection Bridging Review Networks and Metadata
Collective Opinion Spam Detection Bridging Review Networks and MetadataShebuti Rayana
 
A Survey on Evaluating Sentiments by Using Artificial Neural Network
A Survey on Evaluating Sentiments by Using Artificial Neural NetworkA Survey on Evaluating Sentiments by Using Artificial Neural Network
A Survey on Evaluating Sentiments by Using Artificial Neural NetworkIRJET Journal
 
IAC22 Safe Tech Audit Presentation Noreen Whysel.pptx
IAC22 Safe Tech Audit Presentation Noreen Whysel.pptxIAC22 Safe Tech Audit Presentation Noreen Whysel.pptx
IAC22 Safe Tech Audit Presentation Noreen Whysel.pptxNoreen Whysel
 
Endorphin. Making sense of social data
Endorphin. Making sense of social dataEndorphin. Making sense of social data
Endorphin. Making sense of social dataArtem Zavyalov
 
Rating System Algorithms Document
Rating System Algorithms DocumentRating System Algorithms Document
Rating System Algorithms DocumentScandala Tamang
 

Ähnlich wie Using Trust in Recommender Systems: an experimental analysis (20)

Controversial Users demand Local Trust Metrics: an Experimental Study on Epin...
Controversial Users demand Local Trust Metrics: an Experimental Study on Epin...Controversial Users demand Local Trust Metrics: an Experimental Study on Epin...
Controversial Users demand Local Trust Metrics: an Experimental Study on Epin...
 
Trustlet, Open Research on Trust Metrics
Trustlet, Open Research on Trust MetricsTrustlet, Open Research on Trust Metrics
Trustlet, Open Research on Trust Metrics
 
Estimating the Magic Barrier of Recommender Systems: A User Study
Estimating the Magic Barrier of Recommender Systems: A User StudyEstimating the Magic Barrier of Recommender Systems: A User Study
Estimating the Magic Barrier of Recommender Systems: A User Study
 
Alleviating cold-user start problem with users' social network data in recomm...
Alleviating cold-user start problem with users' social network data in recomm...Alleviating cold-user start problem with users' social network data in recomm...
Alleviating cold-user start problem with users' social network data in recomm...
 
The Magic Barrier of Recommender Systems - No Magic, Just Ratings
The Magic Barrier of Recommender Systems - No Magic, Just RatingsThe Magic Barrier of Recommender Systems - No Magic, Just Ratings
The Magic Barrier of Recommender Systems - No Magic, Just Ratings
 
Rated Ranking Evaluator (RRE) Hands-on Relevance Testing @Chorus
Rated Ranking Evaluator (RRE) Hands-on Relevance Testing @ChorusRated Ranking Evaluator (RRE) Hands-on Relevance Testing @Chorus
Rated Ranking Evaluator (RRE) Hands-on Relevance Testing @Chorus
 
IRJET- Fake Review Detection using Opinion Mining
IRJET- Fake Review Detection using Opinion MiningIRJET- Fake Review Detection using Opinion Mining
IRJET- Fake Review Detection using Opinion Mining
 
The Wisdom of the Few @SIGIR09
The Wisdom of the Few @SIGIR09The Wisdom of the Few @SIGIR09
The Wisdom of the Few @SIGIR09
 
IJCAI Workshop Presentation
IJCAI Workshop PresentationIJCAI Workshop Presentation
IJCAI Workshop Presentation
 
Collaborative Filtering 1: User-based CF
Collaborative Filtering 1: User-based CFCollaborative Filtering 1: User-based CF
Collaborative Filtering 1: User-based CF
 
A Reliable Peer-to-Peer Platform for Adding New Node Using Trust Based Model
A Reliable Peer-to-Peer Platform for Adding New Node Using Trust Based Model    A Reliable Peer-to-Peer Platform for Adding New Node Using Trust Based Model
A Reliable Peer-to-Peer Platform for Adding New Node Using Trust Based Model
 
Telefonica Lunch Seminar
Telefonica Lunch SeminarTelefonica Lunch Seminar
Telefonica Lunch Seminar
 
Enhancing Multi-Aspect Collaborative Filtering for Personalized Recommendation
Enhancing Multi-Aspect Collaborative Filtering for Personalized RecommendationEnhancing Multi-Aspect Collaborative Filtering for Personalized Recommendation
Enhancing Multi-Aspect Collaborative Filtering for Personalized Recommendation
 
Computing Ratings and Rankings by Mining Feedback Comments
Computing Ratings and Rankings by Mining Feedback CommentsComputing Ratings and Rankings by Mining Feedback Comments
Computing Ratings and Rankings by Mining Feedback Comments
 
Recommender Systems! @ASAI 2011
Recommender Systems! @ASAI 2011Recommender Systems! @ASAI 2011
Recommender Systems! @ASAI 2011
 
Collective Opinion Spam Detection Bridging Review Networks and Metadata
Collective Opinion Spam Detection Bridging Review Networks and MetadataCollective Opinion Spam Detection Bridging Review Networks and Metadata
Collective Opinion Spam Detection Bridging Review Networks and Metadata
 
A Survey on Evaluating Sentiments by Using Artificial Neural Network
A Survey on Evaluating Sentiments by Using Artificial Neural NetworkA Survey on Evaluating Sentiments by Using Artificial Neural Network
A Survey on Evaluating Sentiments by Using Artificial Neural Network
 
IAC22 Safe Tech Audit Presentation Noreen Whysel.pptx
IAC22 Safe Tech Audit Presentation Noreen Whysel.pptxIAC22 Safe Tech Audit Presentation Noreen Whysel.pptx
IAC22 Safe Tech Audit Presentation Noreen Whysel.pptx
 
Endorphin. Making sense of social data
Endorphin. Making sense of social dataEndorphin. Making sense of social data
Endorphin. Making sense of social data
 
Rating System Algorithms Document
Rating System Algorithms DocumentRating System Algorithms Document
Rating System Algorithms Document
 

Mehr von Paolo Massa

Monitoraggio - Alternanza Scuola Lavoro - 2016 (Slides del Ministro)
Monitoraggio - Alternanza Scuola Lavoro - 2016 (Slides del Ministro)Monitoraggio - Alternanza Scuola Lavoro - 2016 (Slides del Ministro)
Monitoraggio - Alternanza Scuola Lavoro - 2016 (Slides del Ministro)Paolo Massa
 
Manypedia: Comparing Language Points of View of Wikipedia Communities
Manypedia: Comparing  Language Points of View  of Wikipedia CommunitiesManypedia: Comparing  Language Points of View  of Wikipedia Communities
Manypedia: Comparing Language Points of View of Wikipedia CommunitiesPaolo Massa
 
Gamification Features 4 Fitcity
Gamification Features 4 FitcityGamification Features 4 Fitcity
Gamification Features 4 FitcityPaolo Massa
 
Rete e Reti: Per-che' e per-chi?
Rete e Reti: Per-che' e per-chi?Rete e Reti: Per-che' e per-chi?
Rete e Reti: Per-che' e per-chi?Paolo Massa
 
Social fitness (fitcity project)
Social fitness (fitcity project)Social fitness (fitcity project)
Social fitness (fitcity project)Paolo Massa
 
DESIGN PRINCIPLES OF WIKIS AND THEIR IMPACT ON KNOWLEDGE EXCHANGE PROCESSES
DESIGN PRINCIPLES OF WIKIS AND THEIR IMPACT ON KNOWLEDGE EXCHANGE PROCESSES  DESIGN PRINCIPLES OF WIKIS AND THEIR IMPACT ON KNOWLEDGE EXCHANGE PROCESSES
DESIGN PRINCIPLES OF WIKIS AND THEIR IMPACT ON KNOWLEDGE EXCHANGE PROCESSES Paolo Massa
 
Reputation: local or global?
Reputation: local or global?Reputation: local or global?
Reputation: local or global?Paolo Massa
 
Collective Memory building in Wikipedia: the case of North African uprisings
Collective Memory building in Wikipedia: the case of North African uprisingsCollective Memory building in Wikipedia: the case of North African uprisings
Collective Memory building in Wikipedia: the case of North African uprisingsPaolo Massa
 
Social networks of Wikipedia - Paolo Massa - Presentation at (2011). ACM Hype...
Social networks of Wikipedia - Paolo Massa - Presentation at (2011). ACM Hype...Social networks of Wikipedia - Paolo Massa - Presentation at (2011). ACM Hype...
Social networks of Wikipedia - Paolo Massa - Presentation at (2011). ACM Hype...Paolo Massa
 
Social net-work 4 your business
Social net-work 4 your businessSocial net-work 4 your business
Social net-work 4 your businessPaolo Massa
 
An Empirical Analysis on Social Capital and Enterprise 2.0 Participation in a...
An Empirical Analysis on Social Capital and Enterprise 2.0 Participation in a...An Empirical Analysis on Social Capital and Enterprise 2.0 Participation in a...
An Empirical Analysis on Social Capital and Enterprise 2.0 Participation in a...Paolo Massa
 
Supporting Collaborative Networks in Organizational Settings using an Enterpr...
Supporting Collaborative Networks in Organizational Settings using an Enterpr...Supporting Collaborative Networks in Organizational Settings using an Enterpr...
Supporting Collaborative Networks in Organizational Settings using an Enterpr...Paolo Massa
 
Combining Ridesharing& Social Networks
Combining Ridesharing& Social NetworksCombining Ridesharing& Social Networks
Combining Ridesharing& Social NetworksPaolo Massa
 
The Simplicity Cycle by Dan Ward
The Simplicity Cycle by Dan WardThe Simplicity Cycle by Dan Ward
The Simplicity Cycle by Dan WardPaolo Massa
 
Invited talk at Future Networked Technologies / FIT-IT research calls opening...
Invited talk at Future Networked Technologies / FIT-IT research calls opening...Invited talk at Future Networked Technologies / FIT-IT research calls opening...
Invited talk at Future Networked Technologies / FIT-IT research calls opening...Paolo Massa
 
The Future of Work, Fun, and Being Social: an introduction to the nascent adv...
The Future of Work, Fun, and Being Social: an introduction to the nascent adv...The Future of Work, Fun, and Being Social: an introduction to the nascent adv...
The Future of Work, Fun, and Being Social: an introduction to the nascent adv...Paolo Massa
 
Feedback Effects Between Similarity And Social Influence In Online Communities
Feedback Effects Between Similarity And Social Influence In Online CommunitiesFeedback Effects Between Similarity And Social Influence In Online Communities
Feedback Effects Between Similarity And Social Influence In Online CommunitiesPaolo Massa
 
Bowling Alone and Trust Decline in Social Network Sites
Bowling Alone and  Trust Decline in  Social Network SitesBowling Alone and  Trust Decline in  Social Network Sites
Bowling Alone and Trust Decline in Social Network SitesPaolo Massa
 
Social Networking 4 your business
Social Networking 4 your businessSocial Networking 4 your business
Social Networking 4 your businessPaolo Massa
 
OMG Girlz Don't Exist on teh Intarweb!!!!1
OMG Girlz Don't Exist on teh Intarweb!!!!1OMG Girlz Don't Exist on teh Intarweb!!!!1
OMG Girlz Don't Exist on teh Intarweb!!!!1Paolo Massa
 

Mehr von Paolo Massa (20)

Monitoraggio - Alternanza Scuola Lavoro - 2016 (Slides del Ministro)
Monitoraggio - Alternanza Scuola Lavoro - 2016 (Slides del Ministro)Monitoraggio - Alternanza Scuola Lavoro - 2016 (Slides del Ministro)
Monitoraggio - Alternanza Scuola Lavoro - 2016 (Slides del Ministro)
 
Manypedia: Comparing Language Points of View of Wikipedia Communities
Manypedia: Comparing  Language Points of View  of Wikipedia CommunitiesManypedia: Comparing  Language Points of View  of Wikipedia Communities
Manypedia: Comparing Language Points of View of Wikipedia Communities
 
Gamification Features 4 Fitcity
Gamification Features 4 FitcityGamification Features 4 Fitcity
Gamification Features 4 Fitcity
 
Rete e Reti: Per-che' e per-chi?
Rete e Reti: Per-che' e per-chi?Rete e Reti: Per-che' e per-chi?
Rete e Reti: Per-che' e per-chi?
 
Social fitness (fitcity project)
Social fitness (fitcity project)Social fitness (fitcity project)
Social fitness (fitcity project)
 
DESIGN PRINCIPLES OF WIKIS AND THEIR IMPACT ON KNOWLEDGE EXCHANGE PROCESSES
DESIGN PRINCIPLES OF WIKIS AND THEIR IMPACT ON KNOWLEDGE EXCHANGE PROCESSES  DESIGN PRINCIPLES OF WIKIS AND THEIR IMPACT ON KNOWLEDGE EXCHANGE PROCESSES
DESIGN PRINCIPLES OF WIKIS AND THEIR IMPACT ON KNOWLEDGE EXCHANGE PROCESSES
 
Reputation: local or global?
Reputation: local or global?Reputation: local or global?
Reputation: local or global?
 
Collective Memory building in Wikipedia: the case of North African uprisings
Collective Memory building in Wikipedia: the case of North African uprisingsCollective Memory building in Wikipedia: the case of North African uprisings
Collective Memory building in Wikipedia: the case of North African uprisings
 
Social networks of Wikipedia - Paolo Massa - Presentation at (2011). ACM Hype...
Social networks of Wikipedia - Paolo Massa - Presentation at (2011). ACM Hype...Social networks of Wikipedia - Paolo Massa - Presentation at (2011). ACM Hype...
Social networks of Wikipedia - Paolo Massa - Presentation at (2011). ACM Hype...
 
Social net-work 4 your business
Social net-work 4 your businessSocial net-work 4 your business
Social net-work 4 your business
 
An Empirical Analysis on Social Capital and Enterprise 2.0 Participation in a...
An Empirical Analysis on Social Capital and Enterprise 2.0 Participation in a...An Empirical Analysis on Social Capital and Enterprise 2.0 Participation in a...
An Empirical Analysis on Social Capital and Enterprise 2.0 Participation in a...
 
Supporting Collaborative Networks in Organizational Settings using an Enterpr...
Supporting Collaborative Networks in Organizational Settings using an Enterpr...Supporting Collaborative Networks in Organizational Settings using an Enterpr...
Supporting Collaborative Networks in Organizational Settings using an Enterpr...
 
Combining Ridesharing& Social Networks
Combining Ridesharing& Social NetworksCombining Ridesharing& Social Networks
Combining Ridesharing& Social Networks
 
The Simplicity Cycle by Dan Ward
The Simplicity Cycle by Dan WardThe Simplicity Cycle by Dan Ward
The Simplicity Cycle by Dan Ward
 
Invited talk at Future Networked Technologies / FIT-IT research calls opening...
Invited talk at Future Networked Technologies / FIT-IT research calls opening...Invited talk at Future Networked Technologies / FIT-IT research calls opening...
Invited talk at Future Networked Technologies / FIT-IT research calls opening...
 
The Future of Work, Fun, and Being Social: an introduction to the nascent adv...
The Future of Work, Fun, and Being Social: an introduction to the nascent adv...The Future of Work, Fun, and Being Social: an introduction to the nascent adv...
The Future of Work, Fun, and Being Social: an introduction to the nascent adv...
 
Feedback Effects Between Similarity And Social Influence In Online Communities
Feedback Effects Between Similarity And Social Influence In Online CommunitiesFeedback Effects Between Similarity And Social Influence In Online Communities
Feedback Effects Between Similarity And Social Influence In Online Communities
 
Bowling Alone and Trust Decline in Social Network Sites
Bowling Alone and  Trust Decline in  Social Network SitesBowling Alone and  Trust Decline in  Social Network Sites
Bowling Alone and Trust Decline in Social Network Sites
 
Social Networking 4 your business
Social Networking 4 your businessSocial Networking 4 your business
Social Networking 4 your business
 
OMG Girlz Don't Exist on teh Intarweb!!!!1
OMG Girlz Don't Exist on teh Intarweb!!!!1OMG Girlz Don't Exist on teh Intarweb!!!!1
OMG Girlz Don't Exist on teh Intarweb!!!!1
 

Kürzlich hochgeladen

Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxfnnc6jmgwh
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI AgeCprime
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationKnoldus Inc.
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...itnewsafrica
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024TopCSSGallery
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfNeo4j
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Nikki Chapple
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesBernd Ruecker
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Mark Goldstein
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesManik S Magar
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructureitnewsafrica
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 

Kürzlich hochgeladen (20)

Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI Age
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog Presentation
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdf
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdf
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architectures
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 

Using Trust in Recommender Systems: an experimental analysis

  • 1. Using Trust in Recommender Systems: an experimental analysis Paolo Massa University of Trento (joint work with Bobby Bhattacharjee, UMD)
  • 2. Motivation: 1. Recommender Systems recommends items the user might like, based on past ratings. 2. Now, Decentralized publishing of info: – Ratings on Items – Trust on Principals [Semantic Web] 3. New issues (sparseness, scalability, trust, attacks, ...) ... Trust-aware Decentralized RS
  • 3. Summary 1. Recommender Systems (RSs) – Weaknesses 2. Solution: trust-awareness – Trust and trust metrics 3. Experiments on Epinions.com – Evidence trust solves RSs problems – (~50.000 users!) 4. Future works
  • 4. Collaborative Filtering (CF) 1. Input: ratings given by users to items ● I like “ Titanic” as 4/5 2. I ask recommendation 3. RS computes the similarity of me against every other user ● Pearson correlation coefficient 4. RS find similar users and suggests to me items liked by them.
  • 5. Item 1 It e m 2 It e m 3 It e m 4 I User1 2 5 ? 5 2 5 5 5 User2 5 1 3 User3 5 5 1 User4 2 2 5 5 5 5 4 4 It does not consider the content of the items, only the ratings given by users. It works independently of the domain (also jokes) BUT Overlapping of rated items required!
  • 6. RSs weaknesses 1. Ratings Matrix sparseness (95-99%) – Low or No overlapping (users not comparable) 2. Cold start – New users have 0 ratings (->not comparable) 3. Easy Attacks by Malicious Users – Copy profile and become the most similar 4. Hard to understand and control – Black box (bad recs -> user gives up) Solution? Trust of course!
  • 7. Trust-awareness 1. Trust statement =Rating by human to human about her usefulness (ex: in providing good movie reviews) 2. Explicitly provided 3. Trust is subjective! T(A,Z)=1 & T(B,Z)=0 – No Global BAD principals!!! 4. Trust is asymmetric! I trust Bill Gates. 5. FOAF (Friend-Of-A-Friend) is an XML format to express relationships – Some millions files out there...
  • 8. Trust Networks ME 6 degrees of separation “ theorem”
  • 9. Trust metrics 1. Task: based on known trust edges, predict trustworthiness of principals 2. Trust propagation (A->B,B->C|A-?->C) 3. Global (pagerank, ebay, ...) 4. Local (personalized) ME
  • 10. Trust solves RS problems 1. Trust solves CF sparseness problem – trust propagation and “ 6 degrees” -> reach many 2. Trust solves Cold Start problem – “ just add 1 friend” 3. Trust metrics resistant to copy-profile-attack. – “ you can be similar but if no trust path to you ...” 4. Trust easier to understand and control – trust nets supports Explanation (HCI tests needed) EVIDENCE of 1 and 2 provided by analyzing a REAL, VAST community (Epinions.com)
  • 11. Experiment: Epinions.com 1. Epinions.com' users can – Review and rate items (from 1 to 5) – Keep web of trust (trust=1) and block list (trust=0). – “ Reviewers whose reviews and ratings you have consistently found to be valuable” (Epinions FAQ) 2. Dataset (by crawling site): – ~50K users, ~140K items, ~660K ratings. – ~500K trust statements. • No block list (not shown on site)
  • 12. Epinions' recommendations Taken one user “ ME” , we can - use CF on ratings and compute “ similarity” of other users - use Trust Metric and compute “ trustworthiness” of other users Then we can suggest items liked by similar or trustable users. On how many users are they computable?
  • 13. Statistics (1) #Ratings expressed by Users (#rev<5) = 52.82%! [Cold start users]
  • 14. Statistics (2) #Trust statements expressed by Users (#trust<5) = 70.18%!
  • 15. User Similarity Computability 1. Ideally, every user should be comparable against every other user. 2. BUT ratings sparseness = 99.99135% -> tiny overlapping between 2 users 3. Pearson correlation coefficient meaningful only if overlapping(A,U)>1 4. Question: taken one user, how many users are comparable?
  • 16. US computability (cont.) 1. Taken one user, we computed all the comparable users. – On average an user has 161 comparable users (ideally ~50.000!) 2. We have averaged #comparable_users over users who expressed a certain number of reviews.
  • 17. US computability (cont.) Cold Start Users Ex: users with 40 reviews have ~800 comparable users. BUT users (y axis) are ~50.000! And for Cold Start Users (>50%) this is 2.74
  • 18. Trust computability 1. Trust metrics predict trust in unknown users based on known trust statements. 2. Distance from ME to U is a first measure of Trust computability 3. On average, – In 2 steps, reach 400 users – In 3 steps, reach 4386 users
  • 19. Mean # Reachable Users (in k steps) for users expressing X trust statements In few steps, you can predict trust in every user! Even for Cold Start Users!!!
  • 20. Trust and US computability comparison Mean number of Comparable Mean number of Comparable users for All users users for Cold Start users Propagating Trust Using Propagating Trust Using Dist 1 Dist 2 Dist 3 Dist 4 Pearson Dist 1 Dist 2 Dist 3 Dist 4 Pearson 9.88 400 4386 16334 161 2.14 94.54 1675 9121 2.74
  • 21. Contribution Experimental evidence that – CF is ineffective in real world scenarios • Especially for Cold Start users. – Trust can solve CF problems • Sparseness • Cold Start • Attacks (self-evident) Trust is computable on many more users than user similarity Especially for cold start users (the majority!)
  • 22. Future works 1. US and Trust correlate? Contradict? – US over trusted is higher than usual? 2. Distrust? – Propagation? Properties? 3. Design a Trust Metric (for RS) – Create and evaluate a Trust-aware RS • Input data
  • 23. Thanks for your attention! Questions? Paolo Massa Email: massa@itc.it Blog: http://moloko.itc.it/paoloblog/index.html
  • 24. Collaborative Filtering Similarity measure: Pearson Correlation Coefficient of user a and u m ∑i=1 r a ,i −r a r u ,i −r u  w a , u= ∑ m i=1 r a , i −r u  2 m ∑i=1 r u , i −r u  2 Prediction of rating given by user a to ite n ∑u=1  r u , i −ru ∗w a , u p a , i =r a   n ∑u=1 w a , u
  • 25. Hard Trust and Soft Trust 1. Vocabulary: – Hard Trust: about security, identity of something (user, device, information) • Public key cryptography – Soft Trust: appreciation of some principal (explicitly provided by another principal) • Social Networks and Trust Metrics