SlideShare ist ein Scribd-Unternehmen logo
1 von 20
Downloaden Sie, um offline zu lesen
Tagging with AI to Enable
Data-Driven Applications at Scale
Jason Koh, PhD
Chief Data Scientist at Mapped
1
2
3
Potential of Building Data
Air Quality Estimation
Occupancy-driven
Energy Optimization
Customizable
Thermal Comfort
On-demand space booking
Automated Fault Detection
HVAC
Electricity
Security
Lightning
Elevator
Water
4
Mapped, the Unified API
Air Quality Estimation
Occupancy-driven
Energy Optimization
Customizable
Thermal Comfort
On-demand space booking
Automated Fault Detection
HVAC
Electricity
Security
Lightning
Elevator
Water
5
State of Building Data
- Open up your building management/automation system, look at the point names
- 3 different buildings/BMS/subsystems → 3 (or more) different labeling/naming schemes
Slide source: Gabe Fierro
6
Mapped Ontology Extending Brick
Point
Equipment Location
feeds,
hasPart isPartOf
feeds
hasPoint
hasPoint
controls
- Introduce People on top of Brick
- Extend more Classes
(e.g., security, conference)
- Identities management
- Community-driven open-source
- Rigorously validated
- Extensible and expressive
7
An Example Building Graph
AHU-1
VAV-101 VAV-102 Zone-102
Room-102-1 Room-102-2
ZNT101 SAF101
feeds
hasPoint
feeds
hasPart
Variable Air
Volume Box
Variable Air
Volume Box
Air Handling
Unit
type
HVAC Zone
Zone Air Temp
Sensor
Supply Air Flow
Sensor Room Room
HVAC & Structural Data
Jane Doe
Access Card
Reader 1
Security & People Data
Person
Jane’s
Corp Badge
Badge
hasLocation
Access
History 1
owns
hasObserved
hasPoint
Access History
Status
Access Card
Reader
8
Unified Access
via GraphQL
{
building(id:"175A7C19") {
floors(level: "3") {
spaces {
id
name
geoshape
points {
type
timestamp
aggregate
}
}
}
}
}
Visualize &
Control Data
Data Flow
Fine-grained
Control
Mapped Data Pipeline
Mapping
with AI
Data Experts
9
Cloud hosted via
site-to-site VPN
Discover &
Extract
Or
Or
The Metadata Mapping Problem
RM-101.VMA-101.ZN_T
type
HVAC_Zone VAV
type
feeds
AHU-1
RM-101.VMA-101.OCC
Zone Air
Temperature
Sensor
type
hasPoint
feeds
hasPoint
Occupancy
Command
type
AHU
type
1. Finding Entities / Types
2. Finding Relationships
Various AI Methods
- Point name analysis
- Timeseries clustering
- Causality / correlation learning
Goals
10
Technical Challenges in Auto-Mapping
Heterogeneous
Buildings
Complex
Relationships
Expensive
Labeling Effort
Lack of
Labeled Data
11
Active
Learning
Transfer
Learning
Ensemble
Learning
Mapped Approach
A New Building
Known Buildings
Machine Learning
Ensemble DAG
Domain Experts
Mapped Graph
12
Active Learning
1. Train a model with given labeled data
Machine Learning
Models
Domain
Experts
What is the most efficient way of
acquiring labels?
1.
2.
3.
At Mapped:
1. Various statistical metrics
2. Highly optimized labeling tool
13
2. Infer unlabeled data with the model
3. Ask labels for less confident inference
4. Repeat
Transfer Learning
1. Shift data distribution
2. Cherry-pick common features
3. Ask uncommon patterns to
domain experts
A New
Building
Known
Buildings
How to utilize
different buildings’ data?
At Mapped:
1. Domain adaptation models
2. Similarity analysis for co-training
14
Machine Learning
Models
Ensemble Learning
1. Voting, decision tree, boosting, etc.
2. Directed Acyclic Graph (DAG) for
complementing different ML models
Machine Learning
Ensemble DAG
How to ensemble various ML models?
At Mapped:
1. Flexible DAG based on customer requirements
2. Learned priorities over different ML models
15
Mapped Approach
A New Building
Known Buildings
Machine Learning
Ensemble DAG
Domain Experts
Mapped Graph
16
Active
Learning
Transfer
Learning
Ensemble
Learning
Mapped in a Slide
17
Mapped solves the complicated ML problem with
active, transfer, and ensemble learning
Applications need a single API with
a common view of the world
The automated data pipeline from discovery to
mapping, control, and usage.
Air Quality Estimation
Occupancy-driven
Energy Optimization
On-demand space
booking
HVAC
Electricity
Security
Lightning
Jason Koh jason@mapped.com
18
Some Numbers from Mapped
1. Scrabble++
a. 97% accuracy with 1-2 % labeled data for a new building
b. 20% increased accuracy with transfer learning (when there are not many examples)
c. 30 seconds to manually label an entity (or a BACnet object)
2. Equipment correlation learning
a. 93% accuracy without labels but with ground-truth point labels
19
© 2021 MAPPED. ALL RIGHTS RESERVED 20
Scrabble: Transferable Active Learning [Koh et al. 2018]
R M 3 - Z N T
Sentence
BIO Tags
Conditional
Random
Fields (CRF)
Robust to
variations
Room
id ⦰
Zone
Temp
Tags
(IR)
Entity Class Room ZoneTempSensor
Multi-Label
MLP
common layer
across buildings
RM-3 RM3-ZNT
Mapped
Graph
hasLocation
Inference
from Schema
static rules
20

Weitere ähnliche Inhalte

Was ist angesagt?

Product and Technology Roadmaps and Roadmapping Processes - Dave Litwiller - ...
Product and Technology Roadmaps and Roadmapping Processes - Dave Litwiller - ...Product and Technology Roadmaps and Roadmapping Processes - Dave Litwiller - ...
Product and Technology Roadmaps and Roadmapping Processes - Dave Litwiller - ...Dave Litwiller
 
SiriusCon2016 - ASML's MDE Going Sirius
SiriusCon2016 - ASML's MDE Going SiriusSiriusCon2016 - ASML's MDE Going Sirius
SiriusCon2016 - ASML's MDE Going SiriusObeo
 
VR/AR introduction & state-of-the-art VR/AR prototyping
VR/AR introduction & state-of-the-art VR/AR prototypingVR/AR introduction & state-of-the-art VR/AR prototyping
VR/AR introduction & state-of-the-art VR/AR prototypingValentijn Destoop
 
How BIM is able to optimise the design phase of a construction project
How BIM is able to optimise the design phase of a construction projectHow BIM is able to optimise the design phase of a construction project
How BIM is able to optimise the design phase of a construction projectJacob Ostwald
 
Building Information Modeling (BIM) & Industry Foundation Classes (IFC)
Building Information Modeling (BIM)  & Industry Foundation Classes (IFC)Building Information Modeling (BIM)  & Industry Foundation Classes (IFC)
Building Information Modeling (BIM) & Industry Foundation Classes (IFC)metalalp
 
Building information modeling & value to the AEC industry Part 2
Building information modeling &  value to the AEC industry   Part 2Building information modeling &  value to the AEC industry   Part 2
Building information modeling & value to the AEC industry Part 2Stephen Au
 
Odoo 14 Data Cleaning Module
Odoo 14 Data Cleaning ModuleOdoo 14 Data Cleaning Module
Odoo 14 Data Cleaning ModuleCeline George
 
Business Models_Internet of Things (Part 02)
Business Models_Internet of Things (Part 02)Business Models_Internet of Things (Part 02)
Business Models_Internet of Things (Part 02)alengadan
 
Principles of Experiential Design (Part 1): Presence, Dialectics & Process, C...
Principles of Experiential Design (Part 1): Presence, Dialectics & Process, C...Principles of Experiential Design (Part 1): Presence, Dialectics & Process, C...
Principles of Experiential Design (Part 1): Presence, Dialectics & Process, C...Kent Bye
 
IoT and the industrial Internet of Things - june 20 2019
IoT and the industrial Internet of Things - june 20 2019IoT and the industrial Internet of Things - june 20 2019
IoT and the industrial Internet of Things - june 20 2019John D. Johnson
 
Application in Augmented and Virtual Reality
Application in Augmented and Virtual RealityApplication in Augmented and Virtual Reality
Application in Augmented and Virtual RealityMark Billinghurst
 
How a project is born. Intro to Discovery Phase
How a project is born. Intro to Discovery Phase How a project is born. Intro to Discovery Phase
How a project is born. Intro to Discovery Phase Kate Semizhon
 
Internet of-thing
Internet of-thingInternet of-thing
Internet of-thingRishab garg
 
Lecture 8 Introduction to Augmented Reality
Lecture 8 Introduction to Augmented RealityLecture 8 Introduction to Augmented Reality
Lecture 8 Introduction to Augmented RealityMark Billinghurst
 
What’s up with the Metaverse!? A film school’s approach to immersive engageme...
What’s up with the Metaverse!? A film school’s approach to immersive engageme...What’s up with the Metaverse!? A film school’s approach to immersive engageme...
What’s up with the Metaverse!? A film school’s approach to immersive engageme...Chaitanya Chinchlikar
 

Was ist angesagt? (20)

Project Sign Off Tempalte
Project Sign Off TempalteProject Sign Off Tempalte
Project Sign Off Tempalte
 
Smart Construction Site
Smart Construction SiteSmart Construction Site
Smart Construction Site
 
Product and Technology Roadmaps and Roadmapping Processes - Dave Litwiller - ...
Product and Technology Roadmaps and Roadmapping Processes - Dave Litwiller - ...Product and Technology Roadmaps and Roadmapping Processes - Dave Litwiller - ...
Product and Technology Roadmaps and Roadmapping Processes - Dave Litwiller - ...
 
SiriusCon2016 - ASML's MDE Going Sirius
SiriusCon2016 - ASML's MDE Going SiriusSiriusCon2016 - ASML's MDE Going Sirius
SiriusCon2016 - ASML's MDE Going Sirius
 
VR/AR introduction & state-of-the-art VR/AR prototyping
VR/AR introduction & state-of-the-art VR/AR prototypingVR/AR introduction & state-of-the-art VR/AR prototyping
VR/AR introduction & state-of-the-art VR/AR prototyping
 
How BIM is able to optimise the design phase of a construction project
How BIM is able to optimise the design phase of a construction projectHow BIM is able to optimise the design phase of a construction project
How BIM is able to optimise the design phase of a construction project
 
Building Information Modeling (BIM) & Industry Foundation Classes (IFC)
Building Information Modeling (BIM)  & Industry Foundation Classes (IFC)Building Information Modeling (BIM)  & Industry Foundation Classes (IFC)
Building Information Modeling (BIM) & Industry Foundation Classes (IFC)
 
Building information modeling & value to the AEC industry Part 2
Building information modeling &  value to the AEC industry   Part 2Building information modeling &  value to the AEC industry   Part 2
Building information modeling & value to the AEC industry Part 2
 
Odoo 14 Data Cleaning Module
Odoo 14 Data Cleaning ModuleOdoo 14 Data Cleaning Module
Odoo 14 Data Cleaning Module
 
Bim
BimBim
Bim
 
Business Models_Internet of Things (Part 02)
Business Models_Internet of Things (Part 02)Business Models_Internet of Things (Part 02)
Business Models_Internet of Things (Part 02)
 
Principles of Experiential Design (Part 1): Presence, Dialectics & Process, C...
Principles of Experiential Design (Part 1): Presence, Dialectics & Process, C...Principles of Experiential Design (Part 1): Presence, Dialectics & Process, C...
Principles of Experiential Design (Part 1): Presence, Dialectics & Process, C...
 
IoT and the industrial Internet of Things - june 20 2019
IoT and the industrial Internet of Things - june 20 2019IoT and the industrial Internet of Things - june 20 2019
IoT and the industrial Internet of Things - june 20 2019
 
Application in Augmented and Virtual Reality
Application in Augmented and Virtual RealityApplication in Augmented and Virtual Reality
Application in Augmented and Virtual Reality
 
How a project is born. Intro to Discovery Phase
How a project is born. Intro to Discovery Phase How a project is born. Intro to Discovery Phase
How a project is born. Intro to Discovery Phase
 
Internet of-thing
Internet of-thingInternet of-thing
Internet of-thing
 
Presentation 5-tekla
Presentation 5-teklaPresentation 5-tekla
Presentation 5-tekla
 
Lecture 8 Introduction to Augmented Reality
Lecture 8 Introduction to Augmented RealityLecture 8 Introduction to Augmented Reality
Lecture 8 Introduction to Augmented Reality
 
BIM
BIM BIM
BIM
 
What’s up with the Metaverse!? A film school’s approach to immersive engageme...
What’s up with the Metaverse!? A film school’s approach to immersive engageme...What’s up with the Metaverse!? A film school’s approach to immersive engageme...
What’s up with the Metaverse!? A film school’s approach to immersive engageme...
 

Ähnlich wie Tagging with AI to Enable Data-Driven Smart Building Applications at Scale!

L'architettura di classe enterprise di nuova generazione - Massimo Brignoli
L'architettura di classe enterprise di nuova generazione - Massimo BrignoliL'architettura di classe enterprise di nuova generazione - Massimo Brignoli
L'architettura di classe enterprise di nuova generazione - Massimo BrignoliData Driven Innovation
 
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...Alex Liu
 
Modernize Your Data Platform for Analytics and AI
Modernize Your Data Platform for Analytics and AIModernize Your Data Platform for Analytics and AI
Modernize Your Data Platform for Analytics and AIAlluxio, Inc.
 
Achieve big data analytic platform with lambda architecture on cloud
Achieve big data analytic platform with lambda architecture on cloudAchieve big data analytic platform with lambda architecture on cloud
Achieve big data analytic platform with lambda architecture on cloudScott Miao
 
Deep Learning for Autonomous Driving
Deep Learning for Autonomous DrivingDeep Learning for Autonomous Driving
Deep Learning for Autonomous DrivingJan Wiegelmann
 
Mastering MapReduce: MapReduce for Big Data Management and Analysis
Mastering MapReduce: MapReduce for Big Data Management and AnalysisMastering MapReduce: MapReduce for Big Data Management and Analysis
Mastering MapReduce: MapReduce for Big Data Management and AnalysisTeradata Aster
 
Using Grid Technologies in the Cloud for High Scalability
Using Grid Technologies in the Cloud for High ScalabilityUsing Grid Technologies in the Cloud for High Scalability
Using Grid Technologies in the Cloud for High Scalabilitymabuhr
 
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame Work
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame WorkA Big-Data Process Consigned Geographically by Employing Mapreduce Frame Work
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame WorkIRJET Journal
 
Hw09 Hadoop Based Data Mining Platform For The Telecom Industry
Hw09   Hadoop Based Data Mining Platform For The Telecom IndustryHw09   Hadoop Based Data Mining Platform For The Telecom Industry
Hw09 Hadoop Based Data Mining Platform For The Telecom IndustryCloudera, Inc.
 
Serhii Kholodniuk: What you need to know, before migrating data platform to G...
Serhii Kholodniuk: What you need to know, before migrating data platform to G...Serhii Kholodniuk: What you need to know, before migrating data platform to G...
Serhii Kholodniuk: What you need to know, before migrating data platform to G...Lviv Startup Club
 
Enterprise guide to building a Data Mesh
Enterprise guide to building a Data MeshEnterprise guide to building a Data Mesh
Enterprise guide to building a Data MeshSion Smith
 
Porting Spring PetClinic to GigaSpaces
Porting Spring PetClinic to GigaSpacesPorting Spring PetClinic to GigaSpaces
Porting Spring PetClinic to GigaSpacesUri Cohen
 
The Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
The Enterprise Guide to Building a Data Mesh - Introducing SpecMeshThe Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
The Enterprise Guide to Building a Data Mesh - Introducing SpecMeshIanFurlong4
 
Computer aided design, computer aided manufacturing, computer aided engineering
Computer aided design, computer aided manufacturing, computer aided engineeringComputer aided design, computer aided manufacturing, computer aided engineering
Computer aided design, computer aided manufacturing, computer aided engineeringuniversity of sust.
 
Key-Key-Value Stores for Efficiently Processing Graph Data in the Cloud
Key-Key-Value Stores for Efficiently Processing Graph Data in the CloudKey-Key-Value Stores for Efficiently Processing Graph Data in the Cloud
Key-Key-Value Stores for Efficiently Processing Graph Data in the CloudUniversity of New South Wales
 
Applying Cloud Techniques to Address Complexity in HPC System Integrations
Applying Cloud Techniques to Address Complexity in HPC System IntegrationsApplying Cloud Techniques to Address Complexity in HPC System Integrations
Applying Cloud Techniques to Address Complexity in HPC System Integrationsinside-BigData.com
 
Data Intensive Grid Service Model
Data Intensive Grid Service ModelData Intensive Grid Service Model
Data Intensive Grid Service Modelgomathynayagam
 
ArangoML Pipeline Cloud - Managed Machine Learning Metadata
ArangoML Pipeline Cloud - Managed Machine Learning MetadataArangoML Pipeline Cloud - Managed Machine Learning Metadata
ArangoML Pipeline Cloud - Managed Machine Learning MetadataArangoDB Database
 
Building ML Pipelines with DCOS
Building ML Pipelines with DCOSBuilding ML Pipelines with DCOS
Building ML Pipelines with DCOSQAware GmbH
 
Planet lab : cloud vs grid computing
Planet lab : cloud vs grid computingPlanet lab : cloud vs grid computing
Planet lab : cloud vs grid computingGaurav Singh
 

Ähnlich wie Tagging with AI to Enable Data-Driven Smart Building Applications at Scale! (20)

L'architettura di classe enterprise di nuova generazione - Massimo Brignoli
L'architettura di classe enterprise di nuova generazione - Massimo BrignoliL'architettura di classe enterprise di nuova generazione - Massimo Brignoli
L'architettura di classe enterprise di nuova generazione - Massimo Brignoli
 
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
 
Modernize Your Data Platform for Analytics and AI
Modernize Your Data Platform for Analytics and AIModernize Your Data Platform for Analytics and AI
Modernize Your Data Platform for Analytics and AI
 
Achieve big data analytic platform with lambda architecture on cloud
Achieve big data analytic platform with lambda architecture on cloudAchieve big data analytic platform with lambda architecture on cloud
Achieve big data analytic platform with lambda architecture on cloud
 
Deep Learning for Autonomous Driving
Deep Learning for Autonomous DrivingDeep Learning for Autonomous Driving
Deep Learning for Autonomous Driving
 
Mastering MapReduce: MapReduce for Big Data Management and Analysis
Mastering MapReduce: MapReduce for Big Data Management and AnalysisMastering MapReduce: MapReduce for Big Data Management and Analysis
Mastering MapReduce: MapReduce for Big Data Management and Analysis
 
Using Grid Technologies in the Cloud for High Scalability
Using Grid Technologies in the Cloud for High ScalabilityUsing Grid Technologies in the Cloud for High Scalability
Using Grid Technologies in the Cloud for High Scalability
 
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame Work
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame WorkA Big-Data Process Consigned Geographically by Employing Mapreduce Frame Work
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame Work
 
Hw09 Hadoop Based Data Mining Platform For The Telecom Industry
Hw09   Hadoop Based Data Mining Platform For The Telecom IndustryHw09   Hadoop Based Data Mining Platform For The Telecom Industry
Hw09 Hadoop Based Data Mining Platform For The Telecom Industry
 
Serhii Kholodniuk: What you need to know, before migrating data platform to G...
Serhii Kholodniuk: What you need to know, before migrating data platform to G...Serhii Kholodniuk: What you need to know, before migrating data platform to G...
Serhii Kholodniuk: What you need to know, before migrating data platform to G...
 
Enterprise guide to building a Data Mesh
Enterprise guide to building a Data MeshEnterprise guide to building a Data Mesh
Enterprise guide to building a Data Mesh
 
Porting Spring PetClinic to GigaSpaces
Porting Spring PetClinic to GigaSpacesPorting Spring PetClinic to GigaSpaces
Porting Spring PetClinic to GigaSpaces
 
The Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
The Enterprise Guide to Building a Data Mesh - Introducing SpecMeshThe Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
The Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
 
Computer aided design, computer aided manufacturing, computer aided engineering
Computer aided design, computer aided manufacturing, computer aided engineeringComputer aided design, computer aided manufacturing, computer aided engineering
Computer aided design, computer aided manufacturing, computer aided engineering
 
Key-Key-Value Stores for Efficiently Processing Graph Data in the Cloud
Key-Key-Value Stores for Efficiently Processing Graph Data in the CloudKey-Key-Value Stores for Efficiently Processing Graph Data in the Cloud
Key-Key-Value Stores for Efficiently Processing Graph Data in the Cloud
 
Applying Cloud Techniques to Address Complexity in HPC System Integrations
Applying Cloud Techniques to Address Complexity in HPC System IntegrationsApplying Cloud Techniques to Address Complexity in HPC System Integrations
Applying Cloud Techniques to Address Complexity in HPC System Integrations
 
Data Intensive Grid Service Model
Data Intensive Grid Service ModelData Intensive Grid Service Model
Data Intensive Grid Service Model
 
ArangoML Pipeline Cloud - Managed Machine Learning Metadata
ArangoML Pipeline Cloud - Managed Machine Learning MetadataArangoML Pipeline Cloud - Managed Machine Learning Metadata
ArangoML Pipeline Cloud - Managed Machine Learning Metadata
 
Building ML Pipelines with DCOS
Building ML Pipelines with DCOSBuilding ML Pipelines with DCOS
Building ML Pipelines with DCOS
 
Planet lab : cloud vs grid computing
Planet lab : cloud vs grid computingPlanet lab : cloud vs grid computing
Planet lab : cloud vs grid computing
 

Mehr von Memoori

The Market for AI in Commercial Buildings 2024.pdf
The Market for AI in Commercial Buildings 2024.pdfThe Market for AI in Commercial Buildings 2024.pdf
The Market for AI in Commercial Buildings 2024.pdfMemoori
 
A BluePrint for the Future of Smart Building Retrofits
A BluePrint for the Future of Smart Building RetrofitsA BluePrint for the Future of Smart Building Retrofits
A BluePrint for the Future of Smart Building RetrofitsMemoori
 
AI + Memoori = AIM
AI + Memoori = AIMAI + Memoori = AIM
AI + Memoori = AIMMemoori
 
How Tenants & Landlords Can Work Together to Reduce Energy Consumption!
How Tenants & Landlords Can Work Together to Reduce Energy Consumption!How Tenants & Landlords Can Work Together to Reduce Energy Consumption!
How Tenants & Landlords Can Work Together to Reduce Energy Consumption!Memoori
 
How Can Smart Building Technology Become Mainstream?
How Can Smart Building Technology Become Mainstream?How Can Smart Building Technology Become Mainstream?
How Can Smart Building Technology Become Mainstream?Memoori
 
The Carbon Lifestyle - Not a Fad
The Carbon Lifestyle - Not a FadThe Carbon Lifestyle - Not a Fad
The Carbon Lifestyle - Not a FadMemoori
 
Hybrid Work: Driving the Workplace Tech Market!
Hybrid Work: Driving the Workplace Tech Market!Hybrid Work: Driving the Workplace Tech Market!
Hybrid Work: Driving the Workplace Tech Market!Memoori
 
AI IoT Edge Applications Insights and Trends
AI IoT Edge Applications Insights and TrendsAI IoT Edge Applications Insights and Trends
AI IoT Edge Applications Insights and TrendsMemoori
 
What Building Owners Need to Know About Cyber Security Insurance!
What Building Owners Need to Know About Cyber Security Insurance!What Building Owners Need to Know About Cyber Security Insurance!
What Building Owners Need to Know About Cyber Security Insurance!Memoori
 
3 Step Guide to Your Holistic Building Experience Journey
3 Step Guide to Your Holistic Building Experience Journey3 Step Guide to Your Holistic Building Experience Journey
3 Step Guide to Your Holistic Building Experience JourneyMemoori
 
Smart, Connected Restrooms. A Cornerstone of Today's Smart Healthy Buildings
Smart, Connected Restrooms. A Cornerstone of Today's Smart Healthy BuildingsSmart, Connected Restrooms. A Cornerstone of Today's Smart Healthy Buildings
Smart, Connected Restrooms. A Cornerstone of Today's Smart Healthy BuildingsMemoori
 
Using Software Robots to Unlock Energy Efficiency in Aging Buildings
Using Software Robots to Unlock Energy Efficiency in Aging BuildingsUsing Software Robots to Unlock Energy Efficiency in Aging Buildings
Using Software Robots to Unlock Energy Efficiency in Aging BuildingsMemoori
 
The Case for an Open IoT ‘Data Fabric’ for Smart Buildings Integration
The Case for an Open IoT ‘Data Fabric’ for Smart Buildings IntegrationThe Case for an Open IoT ‘Data Fabric’ for Smart Buildings Integration
The Case for an Open IoT ‘Data Fabric’ for Smart Buildings IntegrationMemoori
 
Why Should I Adopt a Digital Twin?
Why Should I Adopt a Digital Twin?Why Should I Adopt a Digital Twin?
Why Should I Adopt a Digital Twin?Memoori
 
Project Haystack - 10 Years of Bringing Data Semantics to the Built Environment!
Project Haystack - 10 Years of Bringing Data Semantics to the Built Environment!Project Haystack - 10 Years of Bringing Data Semantics to the Built Environment!
Project Haystack - 10 Years of Bringing Data Semantics to the Built Environment!Memoori
 
Overcoming Tech Obsolescence in Smart Buildings
Overcoming Tech Obsolescence in Smart BuildingsOvercoming Tech Obsolescence in Smart Buildings
Overcoming Tech Obsolescence in Smart BuildingsMemoori
 
Catching Up with the Brick Schema for Smart Buildings
Catching Up with the Brick Schema for Smart BuildingsCatching Up with the Brick Schema for Smart Buildings
Catching Up with the Brick Schema for Smart BuildingsMemoori
 
The Workplace Leader’s Handbook of the Digital Tools of Tomorrow
The Workplace Leader’s Handbook of the Digital Tools of TomorrowThe Workplace Leader’s Handbook of the Digital Tools of Tomorrow
The Workplace Leader’s Handbook of the Digital Tools of TomorrowMemoori
 
Disruptive Trends Fueled by AI & Camera Edge Analytics
Disruptive Trends Fueled by AI & Camera Edge AnalyticsDisruptive Trends Fueled by AI & Camera Edge Analytics
Disruptive Trends Fueled by AI & Camera Edge AnalyticsMemoori
 
Where Things go Wrong with Smart Buildings!
Where Things go Wrong with Smart Buildings!Where Things go Wrong with Smart Buildings!
Where Things go Wrong with Smart Buildings!Memoori
 

Mehr von Memoori (20)

The Market for AI in Commercial Buildings 2024.pdf
The Market for AI in Commercial Buildings 2024.pdfThe Market for AI in Commercial Buildings 2024.pdf
The Market for AI in Commercial Buildings 2024.pdf
 
A BluePrint for the Future of Smart Building Retrofits
A BluePrint for the Future of Smart Building RetrofitsA BluePrint for the Future of Smart Building Retrofits
A BluePrint for the Future of Smart Building Retrofits
 
AI + Memoori = AIM
AI + Memoori = AIMAI + Memoori = AIM
AI + Memoori = AIM
 
How Tenants & Landlords Can Work Together to Reduce Energy Consumption!
How Tenants & Landlords Can Work Together to Reduce Energy Consumption!How Tenants & Landlords Can Work Together to Reduce Energy Consumption!
How Tenants & Landlords Can Work Together to Reduce Energy Consumption!
 
How Can Smart Building Technology Become Mainstream?
How Can Smart Building Technology Become Mainstream?How Can Smart Building Technology Become Mainstream?
How Can Smart Building Technology Become Mainstream?
 
The Carbon Lifestyle - Not a Fad
The Carbon Lifestyle - Not a FadThe Carbon Lifestyle - Not a Fad
The Carbon Lifestyle - Not a Fad
 
Hybrid Work: Driving the Workplace Tech Market!
Hybrid Work: Driving the Workplace Tech Market!Hybrid Work: Driving the Workplace Tech Market!
Hybrid Work: Driving the Workplace Tech Market!
 
AI IoT Edge Applications Insights and Trends
AI IoT Edge Applications Insights and TrendsAI IoT Edge Applications Insights and Trends
AI IoT Edge Applications Insights and Trends
 
What Building Owners Need to Know About Cyber Security Insurance!
What Building Owners Need to Know About Cyber Security Insurance!What Building Owners Need to Know About Cyber Security Insurance!
What Building Owners Need to Know About Cyber Security Insurance!
 
3 Step Guide to Your Holistic Building Experience Journey
3 Step Guide to Your Holistic Building Experience Journey3 Step Guide to Your Holistic Building Experience Journey
3 Step Guide to Your Holistic Building Experience Journey
 
Smart, Connected Restrooms. A Cornerstone of Today's Smart Healthy Buildings
Smart, Connected Restrooms. A Cornerstone of Today's Smart Healthy BuildingsSmart, Connected Restrooms. A Cornerstone of Today's Smart Healthy Buildings
Smart, Connected Restrooms. A Cornerstone of Today's Smart Healthy Buildings
 
Using Software Robots to Unlock Energy Efficiency in Aging Buildings
Using Software Robots to Unlock Energy Efficiency in Aging BuildingsUsing Software Robots to Unlock Energy Efficiency in Aging Buildings
Using Software Robots to Unlock Energy Efficiency in Aging Buildings
 
The Case for an Open IoT ‘Data Fabric’ for Smart Buildings Integration
The Case for an Open IoT ‘Data Fabric’ for Smart Buildings IntegrationThe Case for an Open IoT ‘Data Fabric’ for Smart Buildings Integration
The Case for an Open IoT ‘Data Fabric’ for Smart Buildings Integration
 
Why Should I Adopt a Digital Twin?
Why Should I Adopt a Digital Twin?Why Should I Adopt a Digital Twin?
Why Should I Adopt a Digital Twin?
 
Project Haystack - 10 Years of Bringing Data Semantics to the Built Environment!
Project Haystack - 10 Years of Bringing Data Semantics to the Built Environment!Project Haystack - 10 Years of Bringing Data Semantics to the Built Environment!
Project Haystack - 10 Years of Bringing Data Semantics to the Built Environment!
 
Overcoming Tech Obsolescence in Smart Buildings
Overcoming Tech Obsolescence in Smart BuildingsOvercoming Tech Obsolescence in Smart Buildings
Overcoming Tech Obsolescence in Smart Buildings
 
Catching Up with the Brick Schema for Smart Buildings
Catching Up with the Brick Schema for Smart BuildingsCatching Up with the Brick Schema for Smart Buildings
Catching Up with the Brick Schema for Smart Buildings
 
The Workplace Leader’s Handbook of the Digital Tools of Tomorrow
The Workplace Leader’s Handbook of the Digital Tools of TomorrowThe Workplace Leader’s Handbook of the Digital Tools of Tomorrow
The Workplace Leader’s Handbook of the Digital Tools of Tomorrow
 
Disruptive Trends Fueled by AI & Camera Edge Analytics
Disruptive Trends Fueled by AI & Camera Edge AnalyticsDisruptive Trends Fueled by AI & Camera Edge Analytics
Disruptive Trends Fueled by AI & Camera Edge Analytics
 
Where Things go Wrong with Smart Buildings!
Where Things go Wrong with Smart Buildings!Where Things go Wrong with Smart Buildings!
Where Things go Wrong with Smart Buildings!
 

Kürzlich hochgeladen

Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-pyJamie (Taka) Wang
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfDianaGray10
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...DianaGray10
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfJamie (Taka) Wang
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarPrecisely
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationIES VE
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Brian Pichman
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDELiveplex
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 

Kürzlich hochgeladen (20)

Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-py
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 

Tagging with AI to Enable Data-Driven Smart Building Applications at Scale!

  • 1. Tagging with AI to Enable Data-Driven Applications at Scale Jason Koh, PhD Chief Data Scientist at Mapped 1
  • 2. 2
  • 3. 3
  • 4. Potential of Building Data Air Quality Estimation Occupancy-driven Energy Optimization Customizable Thermal Comfort On-demand space booking Automated Fault Detection HVAC Electricity Security Lightning Elevator Water 4
  • 5. Mapped, the Unified API Air Quality Estimation Occupancy-driven Energy Optimization Customizable Thermal Comfort On-demand space booking Automated Fault Detection HVAC Electricity Security Lightning Elevator Water 5
  • 6. State of Building Data - Open up your building management/automation system, look at the point names - 3 different buildings/BMS/subsystems → 3 (or more) different labeling/naming schemes Slide source: Gabe Fierro 6
  • 7. Mapped Ontology Extending Brick Point Equipment Location feeds, hasPart isPartOf feeds hasPoint hasPoint controls - Introduce People on top of Brick - Extend more Classes (e.g., security, conference) - Identities management - Community-driven open-source - Rigorously validated - Extensible and expressive 7
  • 8. An Example Building Graph AHU-1 VAV-101 VAV-102 Zone-102 Room-102-1 Room-102-2 ZNT101 SAF101 feeds hasPoint feeds hasPart Variable Air Volume Box Variable Air Volume Box Air Handling Unit type HVAC Zone Zone Air Temp Sensor Supply Air Flow Sensor Room Room HVAC & Structural Data Jane Doe Access Card Reader 1 Security & People Data Person Jane’s Corp Badge Badge hasLocation Access History 1 owns hasObserved hasPoint Access History Status Access Card Reader 8
  • 9. Unified Access via GraphQL { building(id:"175A7C19") { floors(level: "3") { spaces { id name geoshape points { type timestamp aggregate } } } } } Visualize & Control Data Data Flow Fine-grained Control Mapped Data Pipeline Mapping with AI Data Experts 9 Cloud hosted via site-to-site VPN Discover & Extract Or Or
  • 10. The Metadata Mapping Problem RM-101.VMA-101.ZN_T type HVAC_Zone VAV type feeds AHU-1 RM-101.VMA-101.OCC Zone Air Temperature Sensor type hasPoint feeds hasPoint Occupancy Command type AHU type 1. Finding Entities / Types 2. Finding Relationships Various AI Methods - Point name analysis - Timeseries clustering - Causality / correlation learning Goals 10
  • 11. Technical Challenges in Auto-Mapping Heterogeneous Buildings Complex Relationships Expensive Labeling Effort Lack of Labeled Data 11 Active Learning Transfer Learning Ensemble Learning
  • 12. Mapped Approach A New Building Known Buildings Machine Learning Ensemble DAG Domain Experts Mapped Graph 12
  • 13. Active Learning 1. Train a model with given labeled data Machine Learning Models Domain Experts What is the most efficient way of acquiring labels? 1. 2. 3. At Mapped: 1. Various statistical metrics 2. Highly optimized labeling tool 13 2. Infer unlabeled data with the model 3. Ask labels for less confident inference 4. Repeat
  • 14. Transfer Learning 1. Shift data distribution 2. Cherry-pick common features 3. Ask uncommon patterns to domain experts A New Building Known Buildings How to utilize different buildings’ data? At Mapped: 1. Domain adaptation models 2. Similarity analysis for co-training 14 Machine Learning Models
  • 15. Ensemble Learning 1. Voting, decision tree, boosting, etc. 2. Directed Acyclic Graph (DAG) for complementing different ML models Machine Learning Ensemble DAG How to ensemble various ML models? At Mapped: 1. Flexible DAG based on customer requirements 2. Learned priorities over different ML models 15
  • 16. Mapped Approach A New Building Known Buildings Machine Learning Ensemble DAG Domain Experts Mapped Graph 16 Active Learning Transfer Learning Ensemble Learning
  • 17. Mapped in a Slide 17 Mapped solves the complicated ML problem with active, transfer, and ensemble learning Applications need a single API with a common view of the world The automated data pipeline from discovery to mapping, control, and usage. Air Quality Estimation Occupancy-driven Energy Optimization On-demand space booking HVAC Electricity Security Lightning
  • 19. Some Numbers from Mapped 1. Scrabble++ a. 97% accuracy with 1-2 % labeled data for a new building b. 20% increased accuracy with transfer learning (when there are not many examples) c. 30 seconds to manually label an entity (or a BACnet object) 2. Equipment correlation learning a. 93% accuracy without labels but with ground-truth point labels 19
  • 20. © 2021 MAPPED. ALL RIGHTS RESERVED 20 Scrabble: Transferable Active Learning [Koh et al. 2018] R M 3 - Z N T Sentence BIO Tags Conditional Random Fields (CRF) Robust to variations Room id ⦰ Zone Temp Tags (IR) Entity Class Room ZoneTempSensor Multi-Label MLP common layer across buildings RM-3 RM3-ZNT Mapped Graph hasLocation Inference from Schema static rules 20