SlideShare ist ein Scribd-Unternehmen logo
1 von 50
Downloaden Sie, um offline zu lesen
Designing with Big
Data
Ha Phan
@hpdailyrant
Designing with Big Data © Ha Phan
Long Story Short
Learned about Data at Porch
About 2 years ago, I joined a startup called Porch.
And then I had a conscious uncoupling
Designing with Big Data © Ha Phan
Porch
Aggregated data to create a home improvement network
Porch was started by
Scott Austin in late 2011. 

Building trust between
homeowners & home
pros by making home
improvement & home
pros data transparent.
Designing with Big Data © Ha Phan
Selling a vision to investors is often about
creating a utopia of perfect data & where all
segment of users give a damn.
Designing with Big Data © Ha Phan
Designing with Big Data © Ha Phan
What is Big Data?
Designing with Big Data © Ha Phan
Designing with Big Data © Ha Phan
Designing with Big Data © Ha Phan
Volume
!
Velocity
!
Variety
Designing with Big Data © Ha Phan
Designing with Big Data © Ha Phan
We’re moving towards predictive
technology where data is the UI
Designing with Big Data © Ha Phan
Designing with Big Data © Ha Phan
“Big data is bullshit. It’s like atoms. You could either make
a nuclear bomb or a bouquet of flowers with them.”
Richard Wurman, TED Founder
Designing with Big Data © Ha Phan
Web of

Services,

Mashups
Web of

People

Social
Networks
!
Web 3.0

Web of Sensors

Internet of Things.Web of

Databases
Web of

Pages
Web 3.0
We are all building sensors
Designing with Big Data © Ha Phan
TOP DOWN
BOTTOM UP
Platform
Data Ingestion Models
Top Down or Bottom Up
User Generated Content
Structured & Unstructured Data
Designing with Big Data © Ha Phan
Data Information
Presentation Knowledge
Designing with Big Data © Ha Phan
Data
From Data to Knowledge
10,400
36,876
47,948
25,046
18,984 57,948
28,948
8,964 32,948
18,948
27,983
65,948
17,465
14,576
Designing with Big Data © Ha Phan
Designing with Big Data © Ha Phan
Data
Information
Cost of kitchen remodels in your neighborhood
From Data to Knowledge
Designing with Big Data © Ha Phan
Designing with Big Data © Ha Phan
Data
Don’t spend more than $32,874 based on ROI
Information
Knowledge / Value
From Data to Knowledge
Designing with Big Data © Ha Phan
Designing with Big Data © Ha Phan
The Reality
of working
with
Big Data
Designing with Big Data © Ha Phan
Designing with Big Data © Ha Phan
Pose
Question
Acquire Clean Contextualize
/ Model
Give Access
Data Pipeline in a Nutshell
Acquisition to Integration
Ingest
Designing with Big Data © Ha Phan
“Not everything that can be counted counts. And not
everything that counts can be counted.”
Albert Einstein
Designing with Big Data © Ha Phan 25
Finding &
framing the
stuff that
counts to the
user
The Role of UX
Humanizing Data
Designing with Big Data © Ha Phan
Designing with Big Data © Ha Phan 25
The Role of UX
Humanizing Data
First.
Pose questions
to frame
discovery in
data analysis
Designing with Big Data © Ha Phan
Designing with Big Data © Ha Phan
Pose
Question
Data Management Cycle
UX & Product’s Role
What if homeowners could know
which pros worked on their
neighbors homes?
Designing with Big Data © Ha Phan
Every problem is about scaling relevance
Address
Home Pro
See actual
projects in homes
Actual projects
the pro worked on
Pro who worked on the home
Designing with Big Data © Ha Phan
Ingesting Permit Data as a scaleable
bandaid
Designing with Big Data © Ha Phan 25
Second.
Evaluate &
visualize your
ingredients
The Role of UX
Humanizing Data
Designing with Big Data © Ha Phan
Designing with Big Data © Ha Phan
Data Management Cycle
UX & Product’s Role
Acquire Ingest Clean
How can I optimize the data to
enrich the experience?

What does the data really look
like?
Designing with Big Data © Ha Phan
Permit Data is Barely Human
Designing with Big Data © Ha Phan 25
Sampling Data:
Walking Stick for
Blindness
Run queries to evaluate critical mass
of dimensions and properties such as:

• Natural language

• Scale

• Measures

• Frequency, Temporal Dimension
Designing with Big Data © Ha Phan
Visualizing Data
Picturing Dimensions
Time dimension
Designing with Big Data © Ha Phan 25
Third.
Information
Architecting
The Role of UX
Humanizing Data
Designing with Big Data © Ha Phan
Designing with Big Data © Ha Phan
Information Architecting
How can the data best be classified & used in various contexts?
Designing with Big Data © Ha Phan
Reconcile IA properties
Address
Photo
Description
Date Filed
Value
Photo
Description
Date Completed
Cost
Home Pro
Photo
Description
Date Filed
Value
Gap
Designing with Big Data © Ha Phan
Reconcile IA properties
Gap
Gaps in
ontology
leads to gaps
in experience
Designing with Big Data © Ha Phan
Designing with Big Data © Ha Phan 25
Fourth.
Plan for Gaps
!
- meaning
- coverage
- relevance
The Role of UX
Humanizing Data
Designing with Big Data © Ha Phan
Designing with Big Data © Ha Phan 25
Quantity Doesn’t Equal Compelling
Finding compelling content literally is like finding needle in haystack
San Francisco, CA Little Rock, AR Phoenix, AZ
Designing with Big Data © Ha PhanSan Diego, CA August, 2013
Designing with Big Data © Ha Phan
Porch
Home Report
A home CarFax, another
way of using the same
data.

Pick a point of
engagement that
maximizes relevance &
optimize your data
Designing with Big Data © Ha Phan
Define “Fit for Use”
Rules
Designing with Big Data © Ha Phan
Designing with Big Data © Ha Phan 29
The Empty Room Problem
Spotty coverage
Designing with Big Data is to
design for tiers of imperfect data.
Designing with Big Data © Ha Phan
Designing with Big Data © Ha Phan 25
Designing with Big Data © Ha Phan
Tiered Coverage Report
By Location and Type
Designing with Big Data © Ha Phan 25
Designing for tiered experiences
Evolving based on data coverage
Designing with Big Data © Ha Phan
How does the data inform relevance?
More is not always better
Designing with Big Data © Ha Phan
Designing with Big Data © Ha Phan
“There is no true information. Only spin.”
Abby Covert, Information Architect
Designing with Big Data © Ha Phan 25
It’s a journey
!
of connecting the dots
!
from
!
digital footprints
Designing with Big Data © Ha Phan
How quickly can you differentiate
with a credible compelling solution
or are you just spinning data?
Designing with Big Data © Ha Phan
Relevance
The user interacts with the “best” or
most relevant data. The rest s/he
doesn’t care about.
What is your tip of the iceberg?
Have best data inform relevance algorithm for each use case
Bad Quality or Low
Relevance Data
Designing with Big Data © Ha Phan
Road mapping is about enhancing relevance & value
Providing deeper engagement — aligning data initiatives with Product Strategy
Data Initiatives
Designing with Big Data © Ha Phan
Impact product strategy from the ground up
Almost Done
• Provide questions that lead to discovery
• Evaluate how data informs context
• Visualize data early
• Plan for tiered experiences to address gaps
• Prioritize tips of the icebergs
• Balance Top Down and Bottoms Up
Designing with Big Data © Ha Phan
“The hidden message of Big Data is that tiny
choices, such as those made by software
designers, when amplified through the network end
up shaping humanity in subtle ways.
It is up to us to put forth visions of how things
could be.”
Jonathan Harris, Co-Creator of WeFeelFine
Designing with Big Data © Ha Phan
Thank you

Weitere ähnliche Inhalte

Was ist angesagt?

How to use your data science team: Becoming a data-driven organization
How to use your data science team: Becoming a data-driven organizationHow to use your data science team: Becoming a data-driven organization
How to use your data science team: Becoming a data-driven organizationYael Garten
 
More Than a Feeling: Data-Informed Design
More Than a Feeling: Data-Informed DesignMore Than a Feeling: Data-Informed Design
More Than a Feeling: Data-Informed DesignCourtney Clark
 
Building a Data Driven Organization
Building a Data Driven OrganizationBuilding a Data Driven Organization
Building a Data Driven OrganizationIT Weekend
 
Data Informed Design - Good Tech Test - May 2018
Data Informed Design - Good Tech Test - May 2018Data Informed Design - Good Tech Test - May 2018
Data Informed Design - Good Tech Test - May 2018Courtney Clark
 
Be more certain - a practical approach to scaling a research practice
Be more certain - a practical approach to scaling a research practiceBe more certain - a practical approach to scaling a research practice
Be more certain - a practical approach to scaling a research practiceUXinsight
 
Beyond Data Visualization: What's next in communicating with data?
Beyond Data Visualization: What's next in communicating with data?Beyond Data Visualization: What's next in communicating with data?
Beyond Data Visualization: What's next in communicating with data?Zach Gemignani
 
Making Big Data Projects Successful - Data Science Pop-up Seattle
Making Big Data Projects Successful - Data Science Pop-up SeattleMaking Big Data Projects Successful - Data Science Pop-up Seattle
Making Big Data Projects Successful - Data Science Pop-up SeattleDomino Data Lab
 
Relationships are complicated: how data analysis and UX research come togethe...
Relationships are complicated: how data analysis and UX research come togethe...Relationships are complicated: how data analysis and UX research come togethe...
Relationships are complicated: how data analysis and UX research come togethe...UXinsight
 
Dan Mallinger – Data Science Practice Manager, Think Big Analytics at MLconf ATL
Dan Mallinger – Data Science Practice Manager, Think Big Analytics at MLconf ATLDan Mallinger – Data Science Practice Manager, Think Big Analytics at MLconf ATL
Dan Mallinger – Data Science Practice Manager, Think Big Analytics at MLconf ATLMLconf
 
Big Data, Big Investment
Big Data, Big InvestmentBig Data, Big Investment
Big Data, Big InvestmentGGV Capital
 
Big Data: The Force That’s Good for Consumers and Society
Big Data: The Force That’s Good for Consumers and SocietyBig Data: The Force That’s Good for Consumers and Society
Big Data: The Force That’s Good for Consumers and SocietyExperian_US
 
Frank Bien Opening Keynote - Join 2016
Frank Bien Opening Keynote - Join 2016Frank Bien Opening Keynote - Join 2016
Frank Bien Opening Keynote - Join 2016Looker
 
Winning with Data
Winning with Data Winning with Data
Winning with Data Looker
 
Big data Whitepaper
Big data WhitepaperBig data Whitepaper
Big data WhitepaperRahul Rathi
 
Unicom Big Data Innovation Conference - The return of the narrative
Unicom Big Data Innovation Conference - The return of the narrativeUnicom Big Data Innovation Conference - The return of the narrative
Unicom Big Data Innovation Conference - The return of the narrativeVenkataraman Ramachandran
 
Wisdom of Crowds Webinar Deck
Wisdom of Crowds Webinar DeckWisdom of Crowds Webinar Deck
Wisdom of Crowds Webinar DeckLooker
 
Data Visualization For the Rest of Us from the NC Tech4Good Conference
Data Visualization For the Rest of Us from the NC Tech4Good ConferenceData Visualization For the Rest of Us from the NC Tech4Good Conference
Data Visualization For the Rest of Us from the NC Tech4Good ConferenceHeather Yandow
 
Creating a Data-Driven Organization -- thisismetis meetup
Creating a Data-Driven Organization -- thisismetis meetupCreating a Data-Driven Organization -- thisismetis meetup
Creating a Data-Driven Organization -- thisismetis meetupCarl Anderson
 
Winning the 3rd Wave of BI
Winning the 3rd Wave of BIWinning the 3rd Wave of BI
Winning the 3rd Wave of BILooker
 

Was ist angesagt? (20)

How to use your data science team: Becoming a data-driven organization
How to use your data science team: Becoming a data-driven organizationHow to use your data science team: Becoming a data-driven organization
How to use your data science team: Becoming a data-driven organization
 
More Than a Feeling: Data-Informed Design
More Than a Feeling: Data-Informed DesignMore Than a Feeling: Data-Informed Design
More Than a Feeling: Data-Informed Design
 
Building a Data Driven Organization
Building a Data Driven OrganizationBuilding a Data Driven Organization
Building a Data Driven Organization
 
Data Informed Design - Good Tech Test - May 2018
Data Informed Design - Good Tech Test - May 2018Data Informed Design - Good Tech Test - May 2018
Data Informed Design - Good Tech Test - May 2018
 
Be more certain - a practical approach to scaling a research practice
Be more certain - a practical approach to scaling a research practiceBe more certain - a practical approach to scaling a research practice
Be more certain - a practical approach to scaling a research practice
 
Beyond Data Visualization: What's next in communicating with data?
Beyond Data Visualization: What's next in communicating with data?Beyond Data Visualization: What's next in communicating with data?
Beyond Data Visualization: What's next in communicating with data?
 
Making Big Data Projects Successful - Data Science Pop-up Seattle
Making Big Data Projects Successful - Data Science Pop-up SeattleMaking Big Data Projects Successful - Data Science Pop-up Seattle
Making Big Data Projects Successful - Data Science Pop-up Seattle
 
Relationships are complicated: how data analysis and UX research come togethe...
Relationships are complicated: how data analysis and UX research come togethe...Relationships are complicated: how data analysis and UX research come togethe...
Relationships are complicated: how data analysis and UX research come togethe...
 
Dan Mallinger – Data Science Practice Manager, Think Big Analytics at MLconf ATL
Dan Mallinger – Data Science Practice Manager, Think Big Analytics at MLconf ATLDan Mallinger – Data Science Practice Manager, Think Big Analytics at MLconf ATL
Dan Mallinger – Data Science Practice Manager, Think Big Analytics at MLconf ATL
 
Big Data, Big Investment
Big Data, Big InvestmentBig Data, Big Investment
Big Data, Big Investment
 
Belvilla
BelvillaBelvilla
Belvilla
 
Big Data: The Force That’s Good for Consumers and Society
Big Data: The Force That’s Good for Consumers and SocietyBig Data: The Force That’s Good for Consumers and Society
Big Data: The Force That’s Good for Consumers and Society
 
Frank Bien Opening Keynote - Join 2016
Frank Bien Opening Keynote - Join 2016Frank Bien Opening Keynote - Join 2016
Frank Bien Opening Keynote - Join 2016
 
Winning with Data
Winning with Data Winning with Data
Winning with Data
 
Big data Whitepaper
Big data WhitepaperBig data Whitepaper
Big data Whitepaper
 
Unicom Big Data Innovation Conference - The return of the narrative
Unicom Big Data Innovation Conference - The return of the narrativeUnicom Big Data Innovation Conference - The return of the narrative
Unicom Big Data Innovation Conference - The return of the narrative
 
Wisdom of Crowds Webinar Deck
Wisdom of Crowds Webinar DeckWisdom of Crowds Webinar Deck
Wisdom of Crowds Webinar Deck
 
Data Visualization For the Rest of Us from the NC Tech4Good Conference
Data Visualization For the Rest of Us from the NC Tech4Good ConferenceData Visualization For the Rest of Us from the NC Tech4Good Conference
Data Visualization For the Rest of Us from the NC Tech4Good Conference
 
Creating a Data-Driven Organization -- thisismetis meetup
Creating a Data-Driven Organization -- thisismetis meetupCreating a Data-Driven Organization -- thisismetis meetup
Creating a Data-Driven Organization -- thisismetis meetup
 
Winning the 3rd Wave of BI
Winning the 3rd Wave of BIWinning the 3rd Wave of BI
Winning the 3rd Wave of BI
 

Ähnlich wie Designing with Big Data

Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...
Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...
Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...Connotate
 
Level Seven - Expedient Big Data presentation
Level Seven - Expedient Big Data presentationLevel Seven - Expedient Big Data presentation
Level Seven - Expedient Big Data presentationDoug Denton
 
How Analytics as a Service Changes the Game and Expands the Market for Big Da...
How Analytics as a Service Changes the Game and Expands the Market for Big Da...How Analytics as a Service Changes the Game and Expands the Market for Big Da...
How Analytics as a Service Changes the Game and Expands the Market for Big Da...Dana Gardner
 
Data Modeling Techniques
Data Modeling TechniquesData Modeling Techniques
Data Modeling TechniquesDATAVERSITY
 
Next generation analytics
Next generation analyticsNext generation analytics
Next generation analyticsEddie Carter
 
2014 Big Data Research by IDG Enterprise
2014 Big Data Research by IDG Enterprise2014 Big Data Research by IDG Enterprise
2014 Big Data Research by IDG EnterpriseIDG
 
How to Scale BI and Analytics with Hadoop-based Platforms
How to Scale BI and Analytics with Hadoop-based PlatformsHow to Scale BI and Analytics with Hadoop-based Platforms
How to Scale BI and Analytics with Hadoop-based PlatformsArcadia Data
 
WCIT 2014 Rohit Tandon - Big Data to Drive Business Results: HP HAVEn
WCIT 2014 Rohit Tandon - Big Data to Drive Business Results: HP HAVEnWCIT 2014 Rohit Tandon - Big Data to Drive Business Results: HP HAVEn
WCIT 2014 Rohit Tandon - Big Data to Drive Business Results: HP HAVEnWCIT 2014
 
Getting Started with Big Data for Business Managers
Getting Started with Big Data for Business ManagersGetting Started with Big Data for Business Managers
Getting Started with Big Data for Business ManagersDatameer
 
Take the Big Data Challenge - Take Advantage of ALL of Your Data 16 Sept 2014
Take the Big Data Challenge - Take Advantage of ALL of Your Data 16 Sept 2014Take the Big Data Challenge - Take Advantage of ALL of Your Data 16 Sept 2014
Take the Big Data Challenge - Take Advantage of ALL of Your Data 16 Sept 2014pietvz
 
It Takes A Village: Organizational Alignment to Deliver Big Data Analytics in...
It Takes A Village: Organizational Alignment to Deliver Big Data Analytics in...It Takes A Village: Organizational Alignment to Deliver Big Data Analytics in...
It Takes A Village: Organizational Alignment to Deliver Big Data Analytics in...Andy Ashta
 
Data Modeling for Big Data
Data Modeling for Big DataData Modeling for Big Data
Data Modeling for Big DataDATAVERSITY
 
Beyond data eindhoven
Beyond data eindhovenBeyond data eindhoven
Beyond data eindhovenRosseau Bart
 
Data-Ed Slides: Data-Centric Strategy & Roadmap - Supercharging Your Business
Data-Ed Slides: Data-Centric Strategy & Roadmap - Supercharging Your BusinessData-Ed Slides: Data-Centric Strategy & Roadmap - Supercharging Your Business
Data-Ed Slides: Data-Centric Strategy & Roadmap - Supercharging Your BusinessDATAVERSITY
 
Trends for Modernizing Analytics and Data Warehousing in 2019
Trends for Modernizing Analytics and Data Warehousing in 2019Trends for Modernizing Analytics and Data Warehousing in 2019
Trends for Modernizing Analytics and Data Warehousing in 2019Arcadia Data
 
Data Architecture Strategies: The Rise of the Graph Database
Data Architecture Strategies: The Rise of the Graph DatabaseData Architecture Strategies: The Rise of the Graph Database
Data Architecture Strategies: The Rise of the Graph DatabaseDATAVERSITY
 
Data science and its potential to change business as we know it. The Roadmap ...
Data science and its potential to change business as we know it. The Roadmap ...Data science and its potential to change business as we know it. The Roadmap ...
Data science and its potential to change business as we know it. The Roadmap ...InnoTech
 
Big data for situation awareness and decision making
Big data for situation awareness and decision makingBig data for situation awareness and decision making
Big data for situation awareness and decision makingPaloma Diaz
 
02 a holistic approach to big data
02 a holistic approach to big data02 a holistic approach to big data
02 a holistic approach to big dataRaul Chong
 
Big data and data mining
Big data and data miningBig data and data mining
Big data and data miningEmran Hossain
 

Ähnlich wie Designing with Big Data (20)

Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...
Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...
Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...
 
Level Seven - Expedient Big Data presentation
Level Seven - Expedient Big Data presentationLevel Seven - Expedient Big Data presentation
Level Seven - Expedient Big Data presentation
 
How Analytics as a Service Changes the Game and Expands the Market for Big Da...
How Analytics as a Service Changes the Game and Expands the Market for Big Da...How Analytics as a Service Changes the Game and Expands the Market for Big Da...
How Analytics as a Service Changes the Game and Expands the Market for Big Da...
 
Data Modeling Techniques
Data Modeling TechniquesData Modeling Techniques
Data Modeling Techniques
 
Next generation analytics
Next generation analyticsNext generation analytics
Next generation analytics
 
2014 Big Data Research by IDG Enterprise
2014 Big Data Research by IDG Enterprise2014 Big Data Research by IDG Enterprise
2014 Big Data Research by IDG Enterprise
 
How to Scale BI and Analytics with Hadoop-based Platforms
How to Scale BI and Analytics with Hadoop-based PlatformsHow to Scale BI and Analytics with Hadoop-based Platforms
How to Scale BI and Analytics with Hadoop-based Platforms
 
WCIT 2014 Rohit Tandon - Big Data to Drive Business Results: HP HAVEn
WCIT 2014 Rohit Tandon - Big Data to Drive Business Results: HP HAVEnWCIT 2014 Rohit Tandon - Big Data to Drive Business Results: HP HAVEn
WCIT 2014 Rohit Tandon - Big Data to Drive Business Results: HP HAVEn
 
Getting Started with Big Data for Business Managers
Getting Started with Big Data for Business ManagersGetting Started with Big Data for Business Managers
Getting Started with Big Data for Business Managers
 
Take the Big Data Challenge - Take Advantage of ALL of Your Data 16 Sept 2014
Take the Big Data Challenge - Take Advantage of ALL of Your Data 16 Sept 2014Take the Big Data Challenge - Take Advantage of ALL of Your Data 16 Sept 2014
Take the Big Data Challenge - Take Advantage of ALL of Your Data 16 Sept 2014
 
It Takes A Village: Organizational Alignment to Deliver Big Data Analytics in...
It Takes A Village: Organizational Alignment to Deliver Big Data Analytics in...It Takes A Village: Organizational Alignment to Deliver Big Data Analytics in...
It Takes A Village: Organizational Alignment to Deliver Big Data Analytics in...
 
Data Modeling for Big Data
Data Modeling for Big DataData Modeling for Big Data
Data Modeling for Big Data
 
Beyond data eindhoven
Beyond data eindhovenBeyond data eindhoven
Beyond data eindhoven
 
Data-Ed Slides: Data-Centric Strategy & Roadmap - Supercharging Your Business
Data-Ed Slides: Data-Centric Strategy & Roadmap - Supercharging Your BusinessData-Ed Slides: Data-Centric Strategy & Roadmap - Supercharging Your Business
Data-Ed Slides: Data-Centric Strategy & Roadmap - Supercharging Your Business
 
Trends for Modernizing Analytics and Data Warehousing in 2019
Trends for Modernizing Analytics and Data Warehousing in 2019Trends for Modernizing Analytics and Data Warehousing in 2019
Trends for Modernizing Analytics and Data Warehousing in 2019
 
Data Architecture Strategies: The Rise of the Graph Database
Data Architecture Strategies: The Rise of the Graph DatabaseData Architecture Strategies: The Rise of the Graph Database
Data Architecture Strategies: The Rise of the Graph Database
 
Data science and its potential to change business as we know it. The Roadmap ...
Data science and its potential to change business as we know it. The Roadmap ...Data science and its potential to change business as we know it. The Roadmap ...
Data science and its potential to change business as we know it. The Roadmap ...
 
Big data for situation awareness and decision making
Big data for situation awareness and decision makingBig data for situation awareness and decision making
Big data for situation awareness and decision making
 
02 a holistic approach to big data
02 a holistic approach to big data02 a holistic approach to big data
02 a holistic approach to big data
 
Big data and data mining
Big data and data miningBig data and data mining
Big data and data mining
 

Kürzlich hochgeladen

Streamlining Your Application Builds with Cloud Native Buildpacks
Streamlining Your Application Builds  with Cloud Native BuildpacksStreamlining Your Application Builds  with Cloud Native Buildpacks
Streamlining Your Application Builds with Cloud Native BuildpacksVish Abrams
 
Fields in Java and Kotlin and what to expect.pptx
Fields in Java and Kotlin and what to expect.pptxFields in Java and Kotlin and what to expect.pptx
Fields in Java and Kotlin and what to expect.pptxJoão Esperancinha
 
eAuditor Audits & Inspections - conduct field inspections
eAuditor Audits & Inspections - conduct field inspectionseAuditor Audits & Inspections - conduct field inspections
eAuditor Audits & Inspections - conduct field inspectionsNirav Modi
 
JS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AIJS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AIIvo Andreev
 
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine HarmonyLeveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmonyelliciumsolutionspun
 
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...Jaydeep Chhasatia
 
Watermarking in Source Code: Applications and Security Challenges
Watermarking in Source Code: Applications and Security ChallengesWatermarking in Source Code: Applications and Security Challenges
Watermarking in Source Code: Applications and Security ChallengesShyamsundar Das
 
Growing Oxen: channel operators and retries
Growing Oxen: channel operators and retriesGrowing Oxen: channel operators and retries
Growing Oxen: channel operators and retriesSoftwareMill
 
Why Choose Brain Inventory For Ecommerce Development.pdf
Why Choose Brain Inventory For Ecommerce Development.pdfWhy Choose Brain Inventory For Ecommerce Development.pdf
Why Choose Brain Inventory For Ecommerce Development.pdfBrain Inventory
 
AI Embracing Every Shade of Human Beauty
AI Embracing Every Shade of Human BeautyAI Embracing Every Shade of Human Beauty
AI Embracing Every Shade of Human BeautyRaymond Okyere-Forson
 
Introduction-to-Software-Development-Outsourcing.pptx
Introduction-to-Software-Development-Outsourcing.pptxIntroduction-to-Software-Development-Outsourcing.pptx
Introduction-to-Software-Development-Outsourcing.pptxIntelliSource Technologies
 
IA Generativa y Grafos de Neo4j: RAG time
IA Generativa y Grafos de Neo4j: RAG timeIA Generativa y Grafos de Neo4j: RAG time
IA Generativa y Grafos de Neo4j: RAG timeNeo4j
 
Your Vision, Our Expertise: TECUNIQUE's Tailored Software Teams
Your Vision, Our Expertise: TECUNIQUE's Tailored Software TeamsYour Vision, Our Expertise: TECUNIQUE's Tailored Software Teams
Your Vision, Our Expertise: TECUNIQUE's Tailored Software TeamsJaydeep Chhasatia
 
Deep Learning for Images with PyTorch - Datacamp
Deep Learning for Images with PyTorch - DatacampDeep Learning for Images with PyTorch - Datacamp
Deep Learning for Images with PyTorch - DatacampVICTOR MAESTRE RAMIREZ
 
Top Software Development Trends in 2024
Top Software Development Trends in  2024Top Software Development Trends in  2024
Top Software Development Trends in 2024Mind IT Systems
 
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/MLBig Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/MLAlluxio, Inc.
 
online pdf editor software solutions.pdf
online pdf editor software solutions.pdfonline pdf editor software solutions.pdf
online pdf editor software solutions.pdfMeon Technology
 
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdfARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdfTobias Schneck
 
Enterprise Document Management System - Qualityze Inc
Enterprise Document Management System - Qualityze IncEnterprise Document Management System - Qualityze Inc
Enterprise Document Management System - Qualityze Incrobinwilliams8624
 
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...OnePlan Solutions
 

Kürzlich hochgeladen (20)

Streamlining Your Application Builds with Cloud Native Buildpacks
Streamlining Your Application Builds  with Cloud Native BuildpacksStreamlining Your Application Builds  with Cloud Native Buildpacks
Streamlining Your Application Builds with Cloud Native Buildpacks
 
Fields in Java and Kotlin and what to expect.pptx
Fields in Java and Kotlin and what to expect.pptxFields in Java and Kotlin and what to expect.pptx
Fields in Java and Kotlin and what to expect.pptx
 
eAuditor Audits & Inspections - conduct field inspections
eAuditor Audits & Inspections - conduct field inspectionseAuditor Audits & Inspections - conduct field inspections
eAuditor Audits & Inspections - conduct field inspections
 
JS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AIJS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AI
 
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine HarmonyLeveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
 
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
 
Watermarking in Source Code: Applications and Security Challenges
Watermarking in Source Code: Applications and Security ChallengesWatermarking in Source Code: Applications and Security Challenges
Watermarking in Source Code: Applications and Security Challenges
 
Growing Oxen: channel operators and retries
Growing Oxen: channel operators and retriesGrowing Oxen: channel operators and retries
Growing Oxen: channel operators and retries
 
Why Choose Brain Inventory For Ecommerce Development.pdf
Why Choose Brain Inventory For Ecommerce Development.pdfWhy Choose Brain Inventory For Ecommerce Development.pdf
Why Choose Brain Inventory For Ecommerce Development.pdf
 
AI Embracing Every Shade of Human Beauty
AI Embracing Every Shade of Human BeautyAI Embracing Every Shade of Human Beauty
AI Embracing Every Shade of Human Beauty
 
Introduction-to-Software-Development-Outsourcing.pptx
Introduction-to-Software-Development-Outsourcing.pptxIntroduction-to-Software-Development-Outsourcing.pptx
Introduction-to-Software-Development-Outsourcing.pptx
 
IA Generativa y Grafos de Neo4j: RAG time
IA Generativa y Grafos de Neo4j: RAG timeIA Generativa y Grafos de Neo4j: RAG time
IA Generativa y Grafos de Neo4j: RAG time
 
Your Vision, Our Expertise: TECUNIQUE's Tailored Software Teams
Your Vision, Our Expertise: TECUNIQUE's Tailored Software TeamsYour Vision, Our Expertise: TECUNIQUE's Tailored Software Teams
Your Vision, Our Expertise: TECUNIQUE's Tailored Software Teams
 
Deep Learning for Images with PyTorch - Datacamp
Deep Learning for Images with PyTorch - DatacampDeep Learning for Images with PyTorch - Datacamp
Deep Learning for Images with PyTorch - Datacamp
 
Top Software Development Trends in 2024
Top Software Development Trends in  2024Top Software Development Trends in  2024
Top Software Development Trends in 2024
 
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/MLBig Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
 
online pdf editor software solutions.pdf
online pdf editor software solutions.pdfonline pdf editor software solutions.pdf
online pdf editor software solutions.pdf
 
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdfARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
 
Enterprise Document Management System - Qualityze Inc
Enterprise Document Management System - Qualityze IncEnterprise Document Management System - Qualityze Inc
Enterprise Document Management System - Qualityze Inc
 
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
 

Designing with Big Data

  • 1. Designing with Big Data Ha Phan @hpdailyrant
  • 2. Designing with Big Data © Ha Phan Long Story Short Learned about Data at Porch About 2 years ago, I joined a startup called Porch. And then I had a conscious uncoupling
  • 3. Designing with Big Data © Ha Phan Porch Aggregated data to create a home improvement network Porch was started by Scott Austin in late 2011. Building trust between homeowners & home pros by making home improvement & home pros data transparent.
  • 4. Designing with Big Data © Ha Phan Selling a vision to investors is often about creating a utopia of perfect data & where all segment of users give a damn. Designing with Big Data © Ha Phan
  • 5. Designing with Big Data © Ha Phan What is Big Data? Designing with Big Data © Ha Phan
  • 6. Designing with Big Data © Ha Phan
  • 7. Designing with Big Data © Ha Phan Volume ! Velocity ! Variety Designing with Big Data © Ha Phan
  • 8. Designing with Big Data © Ha Phan We’re moving towards predictive technology where data is the UI Designing with Big Data © Ha Phan
  • 9. Designing with Big Data © Ha Phan “Big data is bullshit. It’s like atoms. You could either make a nuclear bomb or a bouquet of flowers with them.” Richard Wurman, TED Founder
  • 10. Designing with Big Data © Ha Phan Web of Services, Mashups Web of People Social Networks ! Web 3.0 Web of Sensors Internet of Things.Web of Databases Web of Pages Web 3.0 We are all building sensors
  • 11. Designing with Big Data © Ha Phan TOP DOWN BOTTOM UP Platform Data Ingestion Models Top Down or Bottom Up User Generated Content Structured & Unstructured Data
  • 12. Designing with Big Data © Ha Phan Data Information Presentation Knowledge
  • 13. Designing with Big Data © Ha Phan Data From Data to Knowledge 10,400 36,876 47,948 25,046 18,984 57,948 28,948 8,964 32,948 18,948 27,983 65,948 17,465 14,576 Designing with Big Data © Ha Phan
  • 14. Designing with Big Data © Ha Phan Data Information Cost of kitchen remodels in your neighborhood From Data to Knowledge Designing with Big Data © Ha Phan
  • 15. Designing with Big Data © Ha Phan Data Don’t spend more than $32,874 based on ROI Information Knowledge / Value From Data to Knowledge Designing with Big Data © Ha Phan
  • 16. Designing with Big Data © Ha Phan The Reality of working with Big Data Designing with Big Data © Ha Phan
  • 17. Designing with Big Data © Ha Phan Pose Question Acquire Clean Contextualize / Model Give Access Data Pipeline in a Nutshell Acquisition to Integration Ingest
  • 18. Designing with Big Data © Ha Phan “Not everything that can be counted counts. And not everything that counts can be counted.” Albert Einstein
  • 19. Designing with Big Data © Ha Phan 25 Finding & framing the stuff that counts to the user The Role of UX Humanizing Data Designing with Big Data © Ha Phan
  • 20. Designing with Big Data © Ha Phan 25 The Role of UX Humanizing Data First. Pose questions to frame discovery in data analysis Designing with Big Data © Ha Phan
  • 21. Designing with Big Data © Ha Phan Pose Question Data Management Cycle UX & Product’s Role What if homeowners could know which pros worked on their neighbors homes?
  • 22. Designing with Big Data © Ha Phan Every problem is about scaling relevance Address Home Pro See actual projects in homes Actual projects the pro worked on Pro who worked on the home
  • 23. Designing with Big Data © Ha Phan Ingesting Permit Data as a scaleable bandaid
  • 24. Designing with Big Data © Ha Phan 25 Second. Evaluate & visualize your ingredients The Role of UX Humanizing Data Designing with Big Data © Ha Phan
  • 25. Designing with Big Data © Ha Phan Data Management Cycle UX & Product’s Role Acquire Ingest Clean How can I optimize the data to enrich the experience? What does the data really look like?
  • 26. Designing with Big Data © Ha Phan Permit Data is Barely Human
  • 27. Designing with Big Data © Ha Phan 25 Sampling Data: Walking Stick for Blindness Run queries to evaluate critical mass of dimensions and properties such as: • Natural language • Scale • Measures • Frequency, Temporal Dimension
  • 28. Designing with Big Data © Ha Phan Visualizing Data Picturing Dimensions Time dimension
  • 29. Designing with Big Data © Ha Phan 25 Third. Information Architecting The Role of UX Humanizing Data Designing with Big Data © Ha Phan
  • 30. Designing with Big Data © Ha Phan Information Architecting How can the data best be classified & used in various contexts?
  • 31. Designing with Big Data © Ha Phan Reconcile IA properties Address Photo Description Date Filed Value Photo Description Date Completed Cost Home Pro Photo Description Date Filed Value Gap
  • 32. Designing with Big Data © Ha Phan Reconcile IA properties Gap Gaps in ontology leads to gaps in experience Designing with Big Data © Ha Phan
  • 33. Designing with Big Data © Ha Phan 25 Fourth. Plan for Gaps ! - meaning - coverage - relevance The Role of UX Humanizing Data Designing with Big Data © Ha Phan
  • 34. Designing with Big Data © Ha Phan 25 Quantity Doesn’t Equal Compelling Finding compelling content literally is like finding needle in haystack San Francisco, CA Little Rock, AR Phoenix, AZ
  • 35. Designing with Big Data © Ha PhanSan Diego, CA August, 2013
  • 36. Designing with Big Data © Ha Phan Porch Home Report A home CarFax, another way of using the same data. Pick a point of engagement that maximizes relevance & optimize your data
  • 37. Designing with Big Data © Ha Phan Define “Fit for Use” Rules Designing with Big Data © Ha Phan
  • 38. Designing with Big Data © Ha Phan 29 The Empty Room Problem Spotty coverage Designing with Big Data is to design for tiers of imperfect data. Designing with Big Data © Ha Phan
  • 39. Designing with Big Data © Ha Phan 25
  • 40. Designing with Big Data © Ha Phan Tiered Coverage Report By Location and Type
  • 41. Designing with Big Data © Ha Phan 25 Designing for tiered experiences Evolving based on data coverage
  • 42. Designing with Big Data © Ha Phan How does the data inform relevance? More is not always better Designing with Big Data © Ha Phan
  • 43. Designing with Big Data © Ha Phan “There is no true information. Only spin.” Abby Covert, Information Architect
  • 44. Designing with Big Data © Ha Phan 25 It’s a journey ! of connecting the dots ! from ! digital footprints
  • 45. Designing with Big Data © Ha Phan How quickly can you differentiate with a credible compelling solution or are you just spinning data?
  • 46. Designing with Big Data © Ha Phan Relevance The user interacts with the “best” or most relevant data. The rest s/he doesn’t care about. What is your tip of the iceberg? Have best data inform relevance algorithm for each use case Bad Quality or Low Relevance Data
  • 47. Designing with Big Data © Ha Phan Road mapping is about enhancing relevance & value Providing deeper engagement — aligning data initiatives with Product Strategy Data Initiatives
  • 48. Designing with Big Data © Ha Phan Impact product strategy from the ground up Almost Done • Provide questions that lead to discovery • Evaluate how data informs context • Visualize data early • Plan for tiered experiences to address gaps • Prioritize tips of the icebergs • Balance Top Down and Bottoms Up
  • 49. Designing with Big Data © Ha Phan “The hidden message of Big Data is that tiny choices, such as those made by software designers, when amplified through the network end up shaping humanity in subtle ways. It is up to us to put forth visions of how things could be.” Jonathan Harris, Co-Creator of WeFeelFine
  • 50. Designing with Big Data © Ha Phan Thank you