Suche senden
Hochladen
Keynote: Bias in Search and Recommender Systems
•
1 gefällt mir
•
1,880 views
Catalyst
Folgen
Ricardo Baeza-Yates's slides from TechSEO Boost 2019
Weniger lesen
Mehr lesen
Marketing
Melden
Teilen
Melden
Teilen
1 von 55
Jetzt herunterladen
Downloaden Sie, um offline zu lesen
Empfohlen
Fair Recommender Systems
Fair Recommender Systems
Sharmistha Chatterjee
Tutorial on Bias in Rec Sys @ UMAP2020
Tutorial on Bias in Rec Sys @ UMAP2020
Mirko Marras
Tutorial on Advances in Bias-aware Recommendation on the Web @ WSDM 2021
Tutorial on Advances in Bias-aware Recommendation on the Web @ WSDM 2021
Mirko Marras
Fairness and Popularity Bias in Recommender Systems: an Empirical Evaluation
Fairness and Popularity Bias in Recommender Systems: an Empirical Evaluation
Cataldo Musto
Déjà Vu: The Importance of Time and Causality in Recommender Systems
Déjà Vu: The Importance of Time and Causality in Recommender Systems
Justin Basilico
Recommendation engines
Recommendation engines
Georgian Micsa
An introduction to Recommender Systems
An introduction to Recommender Systems
David Zibriczky
Recommendation System Explained
Recommendation System Explained
Crossing Minds
Empfohlen
Fair Recommender Systems
Fair Recommender Systems
Sharmistha Chatterjee
Tutorial on Bias in Rec Sys @ UMAP2020
Tutorial on Bias in Rec Sys @ UMAP2020
Mirko Marras
Tutorial on Advances in Bias-aware Recommendation on the Web @ WSDM 2021
Tutorial on Advances in Bias-aware Recommendation on the Web @ WSDM 2021
Mirko Marras
Fairness and Popularity Bias in Recommender Systems: an Empirical Evaluation
Fairness and Popularity Bias in Recommender Systems: an Empirical Evaluation
Cataldo Musto
Déjà Vu: The Importance of Time and Causality in Recommender Systems
Déjà Vu: The Importance of Time and Causality in Recommender Systems
Justin Basilico
Recommendation engines
Recommendation engines
Georgian Micsa
An introduction to Recommender Systems
An introduction to Recommender Systems
David Zibriczky
Recommendation System Explained
Recommendation System Explained
Crossing Minds
Crafting Recommenders: the Shallow and the Deep of it!
Crafting Recommenders: the Shallow and the Deep of it!
Sudeep Das, Ph.D.
Missing values in recommender models
Missing values in recommender models
Parmeshwar Khurd
Session-Based Recommender Systems
Session-Based Recommender Systems
Eötvös Loránd University
Sentiment Analysis of Social Media Content: A multi-tool for listening to you...
Sentiment Analysis of Social Media Content: A multi-tool for listening to you...
Eirini Ntoutsi
Sequential Decision Making in Recommendations
Sequential Decision Making in Recommendations
Jaya Kawale
Recommendation Systems Basics
Recommendation Systems Basics
Jarin Tasnim Khan
Bpr bayesian personalized ranking from implicit feedback
Bpr bayesian personalized ranking from implicit feedback
Park JunPyo
Recent advances in deep recommender systems
Recent advances in deep recommender systems
NAVER Engineering
Introduction to Recommendation Systems
Introduction to Recommendation Systems
Trieu Nguyen
Deep Learning for Recommender Systems
Deep Learning for Recommender Systems
Justin Basilico
Reward Innovation for long-term member satisfaction
Reward Innovation for long-term member satisfaction
Jiangwei Pan
Recommendation Systems
Recommendation Systems
Robin Reni
MyrrorBot: a Digital Assistant Based on Holistic User Models forPersonalize...
MyrrorBot: a Digital Assistant Based on Holistic User Models forPersonalize...
Cataldo Musto
Past, Present & Future of Recommender Systems: An Industry Perspective
Past, Present & Future of Recommender Systems: An Industry Perspective
Justin Basilico
Tutorial on Deep Learning in Recommender System, Lars summer school 2019
Tutorial on Deep Learning in Recommender System, Lars summer school 2019
Anoop Deoras
A Multi-Armed Bandit Framework For Recommendations at Netflix
A Multi-Armed Bandit Framework For Recommendations at Netflix
Jaya Kawale
Past, present, and future of Recommender Systems: an industry perspective
Past, present, and future of Recommender Systems: an industry perspective
Xavier Amatriain
Recommender system algorithm and architecture
Recommender system algorithm and architecture
Liang Xiang
Recommender Systems from A to Z – Model Training
Recommender Systems from A to Z – Model Training
Crossing Minds
Overview of recommender system
Overview of recommender system
Stanley Wang
Webinar - Harness the Power of Data with Tableau - 2016-02-18
Webinar - Harness the Power of Data with Tableau - 2016-02-18
TechSoup
What is the Value of SAS Analytics?
What is the Value of SAS Analytics?
SAS Canada
Weitere ähnliche Inhalte
Was ist angesagt?
Crafting Recommenders: the Shallow and the Deep of it!
Crafting Recommenders: the Shallow and the Deep of it!
Sudeep Das, Ph.D.
Missing values in recommender models
Missing values in recommender models
Parmeshwar Khurd
Session-Based Recommender Systems
Session-Based Recommender Systems
Eötvös Loránd University
Sentiment Analysis of Social Media Content: A multi-tool for listening to you...
Sentiment Analysis of Social Media Content: A multi-tool for listening to you...
Eirini Ntoutsi
Sequential Decision Making in Recommendations
Sequential Decision Making in Recommendations
Jaya Kawale
Recommendation Systems Basics
Recommendation Systems Basics
Jarin Tasnim Khan
Bpr bayesian personalized ranking from implicit feedback
Bpr bayesian personalized ranking from implicit feedback
Park JunPyo
Recent advances in deep recommender systems
Recent advances in deep recommender systems
NAVER Engineering
Introduction to Recommendation Systems
Introduction to Recommendation Systems
Trieu Nguyen
Deep Learning for Recommender Systems
Deep Learning for Recommender Systems
Justin Basilico
Reward Innovation for long-term member satisfaction
Reward Innovation for long-term member satisfaction
Jiangwei Pan
Recommendation Systems
Recommendation Systems
Robin Reni
MyrrorBot: a Digital Assistant Based on Holistic User Models forPersonalize...
MyrrorBot: a Digital Assistant Based on Holistic User Models forPersonalize...
Cataldo Musto
Past, Present & Future of Recommender Systems: An Industry Perspective
Past, Present & Future of Recommender Systems: An Industry Perspective
Justin Basilico
Tutorial on Deep Learning in Recommender System, Lars summer school 2019
Tutorial on Deep Learning in Recommender System, Lars summer school 2019
Anoop Deoras
A Multi-Armed Bandit Framework For Recommendations at Netflix
A Multi-Armed Bandit Framework For Recommendations at Netflix
Jaya Kawale
Past, present, and future of Recommender Systems: an industry perspective
Past, present, and future of Recommender Systems: an industry perspective
Xavier Amatriain
Recommender system algorithm and architecture
Recommender system algorithm and architecture
Liang Xiang
Recommender Systems from A to Z – Model Training
Recommender Systems from A to Z – Model Training
Crossing Minds
Overview of recommender system
Overview of recommender system
Stanley Wang
Was ist angesagt?
(20)
Crafting Recommenders: the Shallow and the Deep of it!
Crafting Recommenders: the Shallow and the Deep of it!
Missing values in recommender models
Missing values in recommender models
Session-Based Recommender Systems
Session-Based Recommender Systems
Sentiment Analysis of Social Media Content: A multi-tool for listening to you...
Sentiment Analysis of Social Media Content: A multi-tool for listening to you...
Sequential Decision Making in Recommendations
Sequential Decision Making in Recommendations
Recommendation Systems Basics
Recommendation Systems Basics
Bpr bayesian personalized ranking from implicit feedback
Bpr bayesian personalized ranking from implicit feedback
Recent advances in deep recommender systems
Recent advances in deep recommender systems
Introduction to Recommendation Systems
Introduction to Recommendation Systems
Deep Learning for Recommender Systems
Deep Learning for Recommender Systems
Reward Innovation for long-term member satisfaction
Reward Innovation for long-term member satisfaction
Recommendation Systems
Recommendation Systems
MyrrorBot: a Digital Assistant Based on Holistic User Models forPersonalize...
MyrrorBot: a Digital Assistant Based on Holistic User Models forPersonalize...
Past, Present & Future of Recommender Systems: An Industry Perspective
Past, Present & Future of Recommender Systems: An Industry Perspective
Tutorial on Deep Learning in Recommender System, Lars summer school 2019
Tutorial on Deep Learning in Recommender System, Lars summer school 2019
A Multi-Armed Bandit Framework For Recommendations at Netflix
A Multi-Armed Bandit Framework For Recommendations at Netflix
Past, present, and future of Recommender Systems: an industry perspective
Past, present, and future of Recommender Systems: an industry perspective
Recommender system algorithm and architecture
Recommender system algorithm and architecture
Recommender Systems from A to Z – Model Training
Recommender Systems from A to Z – Model Training
Overview of recommender system
Overview of recommender system
Ähnlich wie Keynote: Bias in Search and Recommender Systems
Webinar - Harness the Power of Data with Tableau - 2016-02-18
Webinar - Harness the Power of Data with Tableau - 2016-02-18
TechSoup
What is the Value of SAS Analytics?
What is the Value of SAS Analytics?
SAS Canada
Audit Webinar: Surefire ways to succeed with Data Analytics
Audit Webinar: Surefire ways to succeed with Data Analytics
CaseWare IDEA
Managing Data Science | Lessons from the Field
Managing Data Science | Lessons from the Field
Domino Data Lab
Big Data: Setting Up the Big Data Lake
Big Data: Setting Up the Big Data Lake
Caserta
A Brief Introduction to Enterprise Architecture
A Brief Introduction to Enterprise Architecture
Daljit Banger
Predictive Analytics - Big Data Warehousing Meetup
Predictive Analytics - Big Data Warehousing Meetup
Caserta
Balancing Data Governance and Innovation
Balancing Data Governance and Innovation
Caserta
Introduction to Data Science (Data Summit, 2017)
Introduction to Data Science (Data Summit, 2017)
Caserta
Leadership beyond Agile XP2015
Leadership beyond Agile XP2015
samililja
Building Information Governance Policies and Workflows
Building Information Governance Policies and Workflows
kCura_Relativity
Simplifying Analytics - by Novoniel Deb
Simplifying Analytics - by Novoniel Deb
Novoniel Deb
Part 2 - 20 Years in Healthcare Analytics & Data Warehousing: What did we lea...
Part 2 - 20 Years in Healthcare Analytics & Data Warehousing: What did we lea...
Health Catalyst
Measuring Impact: Towards a data citation metric
Measuring Impact: Towards a data citation metric
Edward Baker
The Data Lake - Balancing Data Governance and Innovation
The Data Lake - Balancing Data Governance and Innovation
Caserta
Cerias talk on testing and evaluation
Cerias talk on testing and evaluation
International Center for Biometric Research
Audit: Breaking Down Barriers to Increase the Use of Data Analytics
Audit: Breaking Down Barriers to Increase the Use of Data Analytics
CaseWare IDEA
Earley Executive Roundtable on Data Analytics - Session 2 - Mining Business I...
Earley Executive Roundtable on Data Analytics - Session 2 - Mining Business I...
Earley Information Science
The State of Streaming Analytics: The Need for Speed and Scale
The State of Streaming Analytics: The Need for Speed and Scale
VoltDB
Introduction to Data Science
Introduction to Data Science
Caserta
Ähnlich wie Keynote: Bias in Search and Recommender Systems
(20)
Webinar - Harness the Power of Data with Tableau - 2016-02-18
Webinar - Harness the Power of Data with Tableau - 2016-02-18
What is the Value of SAS Analytics?
What is the Value of SAS Analytics?
Audit Webinar: Surefire ways to succeed with Data Analytics
Audit Webinar: Surefire ways to succeed with Data Analytics
Managing Data Science | Lessons from the Field
Managing Data Science | Lessons from the Field
Big Data: Setting Up the Big Data Lake
Big Data: Setting Up the Big Data Lake
A Brief Introduction to Enterprise Architecture
A Brief Introduction to Enterprise Architecture
Predictive Analytics - Big Data Warehousing Meetup
Predictive Analytics - Big Data Warehousing Meetup
Balancing Data Governance and Innovation
Balancing Data Governance and Innovation
Introduction to Data Science (Data Summit, 2017)
Introduction to Data Science (Data Summit, 2017)
Leadership beyond Agile XP2015
Leadership beyond Agile XP2015
Building Information Governance Policies and Workflows
Building Information Governance Policies and Workflows
Simplifying Analytics - by Novoniel Deb
Simplifying Analytics - by Novoniel Deb
Part 2 - 20 Years in Healthcare Analytics & Data Warehousing: What did we lea...
Part 2 - 20 Years in Healthcare Analytics & Data Warehousing: What did we lea...
Measuring Impact: Towards a data citation metric
Measuring Impact: Towards a data citation metric
The Data Lake - Balancing Data Governance and Innovation
The Data Lake - Balancing Data Governance and Innovation
Cerias talk on testing and evaluation
Cerias talk on testing and evaluation
Audit: Breaking Down Barriers to Increase the Use of Data Analytics
Audit: Breaking Down Barriers to Increase the Use of Data Analytics
Earley Executive Roundtable on Data Analytics - Session 2 - Mining Business I...
Earley Executive Roundtable on Data Analytics - Session 2 - Mining Business I...
The State of Streaming Analytics: The Need for Speed and Scale
The State of Streaming Analytics: The Need for Speed and Scale
Introduction to Data Science
Introduction to Data Science
Mehr von Catalyst
Closing the Gap: Adopting Omnichannel Strategies for Stronger Brand-Consumer ...
Closing the Gap: Adopting Omnichannel Strategies for Stronger Brand-Consumer ...
Catalyst
TechSEO Boost 2021 - Cultivating a Product Mindset for Success
TechSEO Boost 2021 - Cultivating a Product Mindset for Success
Catalyst
TechSEO Boost 2021 - SEO Experimentation
TechSEO Boost 2021 - SEO Experimentation
Catalyst
TechSEO Boost 2021 - Rendering Strategies: Measuring the Devil’s Details in C...
TechSEO Boost 2021 - Rendering Strategies: Measuring the Devil’s Details in C...
Catalyst
TechSEO Boost 2021 - The Future Is The Past: Tagging And Tracking Through The...
TechSEO Boost 2021 - The Future Is The Past: Tagging And Tracking Through The...
Catalyst
10 Trends Changing Programmatic
10 Trends Changing Programmatic
Catalyst
New Commerce Conference: Charting a Course to Success with Your Retail Media ...
New Commerce Conference: Charting a Course to Success with Your Retail Media ...
Catalyst
The New Commerce Conference: The Omni-channel Imperative
The New Commerce Conference: The Omni-channel Imperative
Catalyst
New Commerce Commerce: All Things Instacart
New Commerce Commerce: All Things Instacart
Catalyst
The Power of SEO: Protect Your Bottom Line & Future Proof Your Brand
The Power of SEO: Protect Your Bottom Line & Future Proof Your Brand
Catalyst
The Era of Omni-Commerce: New Insights for Dominating the Digital Shelf and B...
The Era of Omni-Commerce: New Insights for Dominating the Digital Shelf and B...
Catalyst
Reignite Your Business with Performance Marketing: 4 Ways to Fuel Your Reopening
Reignite Your Business with Performance Marketing: 4 Ways to Fuel Your Reopening
Catalyst
Reignite Your Business with Performance Marketing: 4 Ways to Dial-Up Brand In...
Reignite Your Business with Performance Marketing: 4 Ways to Dial-Up Brand In...
Catalyst
Evolve Your Social Commerce Strategy: Thinking Beyond Facebook
Evolve Your Social Commerce Strategy: Thinking Beyond Facebook
Catalyst
B2B SEO: Increase Traffic & Leads in 2020
B2B SEO: Increase Traffic & Leads in 2020
Catalyst
TechSEO Boost 2019: Research Competition
TechSEO Boost 2019: Research Competition
Catalyst
NLP Powered Outreach Link Building
NLP Powered Outreach Link Building
Catalyst
Generating Qualitative Content with GPT-2 in All Languages
Generating Qualitative Content with GPT-2 in All Languages
Catalyst
Automate, Create Tools, & Test Ideas Quickly with Google Apps Script
Automate, Create Tools, & Test Ideas Quickly with Google Apps Script
Catalyst
NLP for SEO
NLP for SEO
Catalyst
Mehr von Catalyst
(20)
Closing the Gap: Adopting Omnichannel Strategies for Stronger Brand-Consumer ...
Closing the Gap: Adopting Omnichannel Strategies for Stronger Brand-Consumer ...
TechSEO Boost 2021 - Cultivating a Product Mindset for Success
TechSEO Boost 2021 - Cultivating a Product Mindset for Success
TechSEO Boost 2021 - SEO Experimentation
TechSEO Boost 2021 - SEO Experimentation
TechSEO Boost 2021 - Rendering Strategies: Measuring the Devil’s Details in C...
TechSEO Boost 2021 - Rendering Strategies: Measuring the Devil’s Details in C...
TechSEO Boost 2021 - The Future Is The Past: Tagging And Tracking Through The...
TechSEO Boost 2021 - The Future Is The Past: Tagging And Tracking Through The...
10 Trends Changing Programmatic
10 Trends Changing Programmatic
New Commerce Conference: Charting a Course to Success with Your Retail Media ...
New Commerce Conference: Charting a Course to Success with Your Retail Media ...
The New Commerce Conference: The Omni-channel Imperative
The New Commerce Conference: The Omni-channel Imperative
New Commerce Commerce: All Things Instacart
New Commerce Commerce: All Things Instacart
The Power of SEO: Protect Your Bottom Line & Future Proof Your Brand
The Power of SEO: Protect Your Bottom Line & Future Proof Your Brand
The Era of Omni-Commerce: New Insights for Dominating the Digital Shelf and B...
The Era of Omni-Commerce: New Insights for Dominating the Digital Shelf and B...
Reignite Your Business with Performance Marketing: 4 Ways to Fuel Your Reopening
Reignite Your Business with Performance Marketing: 4 Ways to Fuel Your Reopening
Reignite Your Business with Performance Marketing: 4 Ways to Dial-Up Brand In...
Reignite Your Business with Performance Marketing: 4 Ways to Dial-Up Brand In...
Evolve Your Social Commerce Strategy: Thinking Beyond Facebook
Evolve Your Social Commerce Strategy: Thinking Beyond Facebook
B2B SEO: Increase Traffic & Leads in 2020
B2B SEO: Increase Traffic & Leads in 2020
TechSEO Boost 2019: Research Competition
TechSEO Boost 2019: Research Competition
NLP Powered Outreach Link Building
NLP Powered Outreach Link Building
Generating Qualitative Content with GPT-2 in All Languages
Generating Qualitative Content with GPT-2 in All Languages
Automate, Create Tools, & Test Ideas Quickly with Google Apps Script
Automate, Create Tools, & Test Ideas Quickly with Google Apps Script
NLP for SEO
NLP for SEO
Kürzlich hochgeladen
social media optimization complete indroduction
social media optimization complete indroduction
infoshraddha747
A Comprehensive Guide to Technical SEO | Banyanbrain
A Comprehensive Guide to Technical SEO | Banyanbrain
Banyanbrain
Digital Marketing in 5G Era - Digital Transformation in 5G Age
Digital Marketing in 5G Era - Digital Transformation in 5G Age
DigiKarishma
The power of SEO-driven market intelligence
The power of SEO-driven market intelligence
Hinde Lamrani
5 Digital Marketing Tips | Devherds Software Solutions
5 Digital Marketing Tips | Devherds Software Solutions
Devherds Software Solutions
Understand the Key differences between SMO and SMM
Understand the Key differences between SMO and SMM
searchextensionin
SEO and Digital PR - How to Connect Your Teams to Maximise Success
SEO and Digital PR - How to Connect Your Teams to Maximise Success
Liv Day
Miss Immigrant USA Activity Pageant Program.pdf
Miss Immigrant USA Activity Pageant Program.pdf
Magdalena Kulisz
(Generative) AI & Marketing: - Out of the Hype - Empowering the Marketing M...
(Generative) AI & Marketing: - Out of the Hype - Empowering the Marketing M...
Hugues Rey
When to use Machine Learning Models in SEO and Which ones to use - Lazarina S...
When to use Machine Learning Models in SEO and Which ones to use - Lazarina S...
LazarinaStoyanova
Storyboards for my Final Major Project Video
Storyboards for my Final Major Project Video
SineadBidwell
Introduction to marketing Management Notes
Introduction to marketing Management Notes
KiranTiwari42
Unlocking Passive Income: The Power of Affiliate Marketing
Unlocking Passive Income: The Power of Affiliate Marketing
Daniel
Digital Marketing Courses In Pune- school Of Internet Marketing
Digital Marketing Courses In Pune- school Of Internet Marketing
ShauryaBadaya
From Chance to Choice - Tactical Link Building for International SEO
From Chance to Choice - Tactical Link Building for International SEO
Szymon Słowik
Influencer Marketing Power point presentation
Influencer Marketing Power point presentation
dgtivemarketingagenc
15 Tactics to Scale Your Trade Show Marketing Strategy
15 Tactics to Scale Your Trade Show Marketing Strategy
Blue Atlas Marketing
The 10 Most Influential CMO's Leading the Way of Success, 2024 (Final file) (...
The 10 Most Influential CMO's Leading the Way of Success, 2024 (Final file) (...
CIO Business World
Fueling A_B experiments with behavioral insights (1).pdf
Fueling A_B experiments with behavioral insights (1).pdf
VWO
Most Influential HR Leaders Leading the Corporate World, 2024 (Final file).pdf
Most Influential HR Leaders Leading the Corporate World, 2024 (Final file).pdf
CIO Business World
Kürzlich hochgeladen
(20)
social media optimization complete indroduction
social media optimization complete indroduction
A Comprehensive Guide to Technical SEO | Banyanbrain
A Comprehensive Guide to Technical SEO | Banyanbrain
Digital Marketing in 5G Era - Digital Transformation in 5G Age
Digital Marketing in 5G Era - Digital Transformation in 5G Age
The power of SEO-driven market intelligence
The power of SEO-driven market intelligence
5 Digital Marketing Tips | Devherds Software Solutions
5 Digital Marketing Tips | Devherds Software Solutions
Understand the Key differences between SMO and SMM
Understand the Key differences between SMO and SMM
SEO and Digital PR - How to Connect Your Teams to Maximise Success
SEO and Digital PR - How to Connect Your Teams to Maximise Success
Miss Immigrant USA Activity Pageant Program.pdf
Miss Immigrant USA Activity Pageant Program.pdf
(Generative) AI & Marketing: - Out of the Hype - Empowering the Marketing M...
(Generative) AI & Marketing: - Out of the Hype - Empowering the Marketing M...
When to use Machine Learning Models in SEO and Which ones to use - Lazarina S...
When to use Machine Learning Models in SEO and Which ones to use - Lazarina S...
Storyboards for my Final Major Project Video
Storyboards for my Final Major Project Video
Introduction to marketing Management Notes
Introduction to marketing Management Notes
Unlocking Passive Income: The Power of Affiliate Marketing
Unlocking Passive Income: The Power of Affiliate Marketing
Digital Marketing Courses In Pune- school Of Internet Marketing
Digital Marketing Courses In Pune- school Of Internet Marketing
From Chance to Choice - Tactical Link Building for International SEO
From Chance to Choice - Tactical Link Building for International SEO
Influencer Marketing Power point presentation
Influencer Marketing Power point presentation
15 Tactics to Scale Your Trade Show Marketing Strategy
15 Tactics to Scale Your Trade Show Marketing Strategy
The 10 Most Influential CMO's Leading the Way of Success, 2024 (Final file) (...
The 10 Most Influential CMO's Leading the Way of Success, 2024 (Final file) (...
Fueling A_B experiments with behavioral insights (1).pdf
Fueling A_B experiments with behavioral insights (1).pdf
Most Influential HR Leaders Leading the Corporate World, 2024 (Final file).pdf
Most Influential HR Leaders Leading the Corporate World, 2024 (Final file).pdf
Keynote: Bias in Search and Recommender Systems
1.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost #TechSEOBoost | @CatalystSEM THANK YOU TO THIS YEAR’S SPONSORS Keynote: Bias in Search and Recommender Systems Ricardo Baeza-Yates, NTENT
2.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Ricardo Baeza-Yates CTO, NTENT Biases in Search & Recommender Systems
3.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost NTENT ntent.com Marketing Engineering Operations International Applied Research ntent.com
4.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Prologue
5.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost A Bit of History Data Volume Complexity IR DB Two different points of view for data
6.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Data Understanding Data Query Unstructured Structured Explicit Information Retrieval (Relational) Databases Implicit Recommender Systems Unknown Data Mining
7.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost What is Bias? • Statistical: significant systematic deviation from a prior (unknown) distribution; • Cultural: interpretations and judgments phenomena acquired through our life; • Cognitive: systematic pattern of deviation from norm or rationality in judgment;
8.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost So (Observational) Human Data has Bias • Gender • Racial • Sexual • Age • Religious • Social • Linguistic • Geographic • Political • Educational • Economic • Technological ▪ Gathering process ▪ Sampling process ▪ Validity (e.g. temporal) ▪ Completeness ▪ Noise, spam Many people extrapolate results of a sample to the whole population (e.g., social media analysis) In addition there is bias when measuring bias as well as bias towards measuring it! Attempt of an unbiased (personal) view on bias in Search & RS Cultural Biases Statistical Biases Cognitive Biases Self-selection
9.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Impact in Search and Recommender Systems • Most web systems are optimized by using implicit user feedback • However, user data is partly biased to the choices that these systems make • Clicks can only be done on things that are shown to us • As those systems are usually based in ML, they learn to reinforce their own biases, yielding self-fulfilled prophecies and/or sub-optimal solutions • For example, personalization and filter bubbles for users • but also echo chambers for (recommender) systems • Moreover, sometimes these systems compete among themselves, learning also biases of other systems rather than real user behavior • Even more, an improvement in one system might be just a degradation in another system that uses a different (even inversely correlated) optimization function • For example, user experience vs. monetization
10.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost A Non-Technical Question Algorithm Biased Data Neutral? Fair? Same Bias Garbage In Garbage Out
11.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost What is being fair?
12.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost A Non-Technical Question Algorithm Biased Data Neutral? Fair? Same Bias Not Always! Debias the input Tune the algorithm Debias the output Bias awareness!
13.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost January 2017 ACM US Statement on Algorithm Transparency and Accountability 1. Awareness 2. Access and redress 3. Accountability 4. Explanation 5. Data Provenance 6. Auditability 7. Validation and Testing Systems do not need to be perfect, they just need to be better than us
14.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Biases Everywhere!
15.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Data bias Biases on Search & RS: Web Case Study Web Spam
16.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost [Baeza-Yates, Castillo & López, Cybermetrics, 2005] Number of linked domains Exports(thousandsofUS$) Economic Bias in Links
17.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost 17 [Baeza-Yates & Castillo, WWW2006] Economic Bias in Links
18.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost 18 Minimal effortShameCultural Bias in Websites [Baeza-Yates, Castillo, Efthimiadis, TOIT 2007]
19.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Language Bias
20.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost [Bolukbasi at al, NIPS 2016] • Word embedding’s in w2vNEWS Yes, about 60 to 70% at work although at college is the inverse Gender Bias in Content Most journalists are men?
21.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost [E. Graells-Garrido et al,. ACM Hypertext’15] Systemic bias? Equal opportunity? Gender Bias in Content Wikipedia Partial information
22.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Data bias Activity bias Bias on Usage Actions People We are all in the long tail! [Goel et al., WSDM 2010]
23.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Popularity Bias in Recommender Systems Items Users Popular items Rest of items (long tail) • Take care to recommended items that are not too popular • Metrics • Novelty enhancement • Problem solved! …really? 𝑛𝑜𝑣 𝑖 = 1 − # ratings of 𝑖 # users Items #interactions More novel Less novel 𝑎 𝑏 [Vargas & Castells, RecSys 2011]
24.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost A Self-fulfilling Prophecy? Popular items (short head) Rest of items (long tail) Observed user-item interaction Unobserved preference Items Users Ratings are missing not at random (MNAR)
25.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Test data (relevant items) Training data Unobserved preference Items Users Popular items (short head) Rest of items (long tail) avg P@𝑘 ∼ + 𝑘 Judgments are missing not at random (MNAR) Worse yet: user-system reinforcement loop (more later) A Self-fulfilling Prophecy? [Marlin et al., RecSys 2010] [Steck, RecSys 2010, 2011] [Fleder & Hossanagar, Management Sciences 2009]
26.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost 1.E-06 1.E-05 1.E-04 1.E-03 0 0.2 0.4 0.6 0.8 1 A Problem for IR Evaluation Methodology! 30 TREC collections Items / documents #ratings/judgments (infraction) [Bellogín, Castells & Cantador, IRJ 2017] To how many queries is a document relevant? 25% queries can be answered with less than 1% of the URLs! [Baeza-Yates, Boldi, Chierichetti, WWW 2015]
27.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Get Rid of the Popularity Bias! • In the rating split [Bellogín, Castells & Cantador, IRJ 2017] • In the metrics • Stratified recall [Steck, RecSys 2011] • Importance propensity scoring [Yang et al., RecSys 2018] • In the algorithms [Steck, RecSys 2011] [Lobato et al., ICML 2014] [Jannach et al., UMUAI 2015] [Cañamares & Castells, SIGIR 2018, best paper award] Test data (relevant items) Training data Unobserved preference Items Items #ratings Flat test Popularity strata #ratings Time Temporal split
28.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Activity Bias also Affects Content [Baeza-Yates & Saez-Trumper, ACM Hypertext 2015] Most users are passive (i.e., more than 90% are lurkers) Then, which percentage of active users produce 50% of the content?
29.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost October 2015
30.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost [Baeza-Yates & Saez-Trumper, ACM Hypertext 2015] Which percentage of active users produce 50% of the content? Wisdom of crowds is a partial illusion Activity Bias: The Wisdom of a Few
31.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Content Never Seen [Baeza-Yates & Saez-Trumper, ACM Hypertext 2015] The Digital Desert
32.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Data bias Activity bias Sampling (size) bias Algorithmic bias Search or Recommender System Bias on the Web
33.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost [E. Graells-Garrido & M. Lalmas, ACM Hypertext’14] Geographical Bias in Recommender Systems
34.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost • If we want to estimate the frequency of queries that appear with probability at least p with a certain relative error, ∊, we can use the standard binomial error formula which works well for p near ½ but not for p near 0 • Better is the Agresti-Coull technique (also called Take 2) which gives: where Z is the inverse of the standard normal distribution, 1 − 𝛼 is the confidence interval and • If p = 0.1, 1 − 𝛼 is 80% and ∊ is 10%, the standard formula gives n = 900, while with A-C we get n = 2342. [Brown, Cai & DasGupta, Statistical Science, 2001] [Baeza-Yates, SIGIR 2015, Industry track] Sample Size?
35.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost • Standard technique: • A good sample should cover well all the items distribution, but this does not work with very skewed distributions. 10 0 10 1 10 2 10 3 Rank 10 0 10 1 10 2 10 3 10 4 10 5 Frequency 50M 10M 100K 1K 10 0 10 1 10 2 10 3 10 4 10 5 10 6 10 7 Rank 10 0 10 1 10 2 10 3 10 4 10 5 Frequency 50M 10M 100K 1K [Zaragoza et al, CIKM 2010] Sampling Queries
36.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost 36 Stratified Sampling Example [Baeza-Yates, SIGIR 2015, Industry track]
37.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Data bias Activity bias Sampling bias Interaction bias (Self) selection bias Bias in the User Interaction Search or Recommender System
38.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Position bias Ranking bias Presentation or exposure bias Social bias Interaction bias Bias in the Interaction Amazon.com
39.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Position bias Presentation bias Social bias Interaction bias Ranking bias Click bias Scrolling bias Mouse movement bias Data and algorithmic bias Self-selection bias Dependencies: A Cascade of Biases!
40.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Ranking Bias in Web Search [Mediative Study, 2014]
41.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Ranking Bias: Click Bias in Web Search • Ranking & next page bias Navigational queries
42.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost CTR (log) 1 11 21 Rank Learning to Rank with bias [Joachims et al., WSDM 2017, best paper] + many other papers Fair rankings [Zehlike et al., CIKM 2017] Clicks as implicit positive user feedback Debiasing Search Clicks and Other Biases [Dupret & Piwowarski, SIGIR 2008] [Chapelle & Zhang, WWW 2009] [Dupret & Liao, WSDM 2010, best paper] Debias the input Tune the algorithm Debias the output
43.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Data bias Activity bias Sampling bias Interaction bias (Self) selection bias Second-order bias Vicious Cycle of Bias Search or Recommender System
44.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost [Baeza-Yates, Pereira & Ziviani, WWW 2008] Person Web content is redundant (> 20%) Query Ranking bias in new content Redundancy grows (35%) Search results New page Second Order Bias in Web Content [Fortunato, Flammini, Menczer & Vespignani. PNAS 2006]
45.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Data bias Activity bias Sampling bias Interaction bias (Self) selection bias Vicious Cycle of Bias Search or Recommender System Feedback loop bias
46.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Bias due to Personalization • The effect of self-selection bias • Avoid the rich get richer and poor get poorer syndrome • Avoid the echo chamber by empowering the tail Cold start problem solution: Explore & Exploit Partial solutions: • Diversity • Novelty • Serendipity • My dark side Wikipedia [Eli Pariser, Penguin 2011]
47.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Users’ Eco Chambers in Recommender Systems ▪ Filter bubbles ▪ Degenerate feedback loops (e.g., YouTube autoplay) [Jiang et al., AAAI 2019]
48.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Eco Chamber of the Recommender System • Short-term greedy optimization, partial knowledge of the world • Long-term revenue optimization is not achieved • Views from new users should balance the exploration for new items • Disparate impact: unfair ecommerce/information markets [Baeza-Yates & Ribaudo, to appear]
49.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Epilogue
50.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Recap Bias Type Statistical Cultural Cognitive Algorithmic ? ? Presentation Position Data Sampling Activity Self-selection Interaction Social Second order
51.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost [Silberzahn et al., COS, Univ. of Virginia, 2015] Professional Bias? ➔ 61 analysts, 29 teams: 20 yes and 9 no
52.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost If Systems Reflects Its Designers: What we can/should do? ▪ Data ▪ Analyze for known and unknown biases, debias when possible/needed ▪ Recollect more data for difficult/sparse regions of the problem ▪ Delete attributes associated directly/indirectly with harmful bias ▪ Interaction ▪ Make sure that the user is aware of the biases all the time ▪ Give more control to the user ▪ Design and Implementation • Let experts/colleagues/users contest every step of the process ▪ Evaluation • Do not fool yourself!
53.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Final Take-Home Message ▪ Systems are a mirror of us, the good, the bad and the ugly ▪ The Web amplifies everything, but always leaves traces ▪ We need to be aware of our own biases! ▪ We must be aware of the biases and contrarrest them to stop the vicious bias cycle ▪ Plenty of open (research) problems! Big Data of People is huge….. ….. but it is tiny compared to the future Big Data of the Internet of Things (IoT) No activity bias!
54.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Thank You! Any Questions? – rbaeza@acm.org | http://www.baeza.cl/ | http://fairness-measures.org Biased Questions? ASIST 2012 Book of the Year Award (Biased Ad)
55.
Ricardo Baeza-Yates ©
| @polarbearby | #TechSEOBoost Thanks for Viewing the Slideshare! – Watch the Recording: https://youtube.com/session-example Or Contact us today to discover how Catalyst can deliver unparalleled SEO results for your business. https://www.catalystdigital.com/
Jetzt herunterladen