SlideShare ist ein Scribd-Unternehmen logo
1 von 25
Big Data Analytics for Internet of
Things and Machine Intelligence
Shamshad Ansari
President & CEO
Accure Inc.
Agenda
• Introduction
• Iot & Big Data
• IoT Reference Architecture
• IoT on Momentum
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Year 2020
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Big Numbers of Small Things
Year 2020
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
$7.1
Trillion
$1.9
Trillion
50 Billion Connected Devices | Cisco
IoT Economic Vaule Added| Gartner
IoT Solutions Revenue| IDC
IoT
Processor
Cost Less
Than
$1
Gartner
What is IoT?
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
• Objects connected to
Internet and
communicating with each
other.
• Any object that can be
turned on and off could be
a part of the IoT.
Business Opportunities
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Monitor
OptimizeControl
Improved
performance
Reduced cost
New innovative
products
1% savings across
all industries
$150 Billion
Savings
Source: GE
Is IoT New?
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
We’ve doing this
for many years
Yes
This is really very
facinating and looks
like IoT will change
the world
If IoT is not new, why is this buzz now?
- Widespread cell phone usage
- Reduced price of sensors
- Cheaper Internet connection
- Improvded technology to handle and make use of data
How Big Data Relates to IoT?
How much data?
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Gas turbine comressor blade: 500GB/ day | GE
4.4
44
0.132
4.4
2015 2020
Overall
IoT
Zettabyte
An IoT Sensor generates
about 0.5MB per
variable per day
1000 sensors & 1000 variables = 500GB per day
IoT generates big data
IoT and Big Data
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Data Ingestion Data Storage
Data
Processing
Data
Reporting
Action
A new mindset and technology is needed to handle IoT data
IoT Challanges
• Scale
– Size and fast growing data
– Large number of users
• Pace
– Fast pace analysis, command and control and cost
– Skill required to do data science and learn new
platform
• Environment
– Complex IoT infrastructure
– Security and privacy
– Lack of standards in data interoperability
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
IoT Solutions Until Now
• Complex and expensive
• Cost of failing was huge
• Mostly high-volume, homogenous devices,
where software needs are simple
– For simple things like thermostat, refrigerator etc.
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Practical Solution Approach
• Think big. Start small
• Start small
– Experiment, learn, and refine
• Think big
– scale
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Big Data IoT Architecture
Requirements
• Be able to handle hardware and software
hetrogenity
• Be able to scale big
• Provide low latency
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Momentum as an IoT Platform
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Momentum provides a configurable platform to manage IoT
• Per device level security
• Massive scalability – millions of concurrent sensors
• Real-time and batch analytics
• Predictive analytics
• Smart alerts
IoT Reference Architecture
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Streaming
Gateway
Adapter
Local
Gateway
Scalable
storage
Batch analytics
Realtime
analytics Visualiza
tion
Working Example:
Smart Street Light Analytics
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Environment Internal parts Weather
Temperature Temperature Temperature
Pressure Input voltage Pressure
Humidity Output voltage Humidity
Noise Light intensity Sand storm
Rain
Snow
Fog
External DataSensor Data
Momentum in Smart Street Lights
• Data Ingestion
• Predictive Model Building
• Predictive analytics – batch
• Realtime analytics
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Momentum Demo – How to create
Streaming Hub
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Predictive Modeling
Feature Engineering
• Set A = weather + holiday + weekday + weekend features for the
predicted day
• Set B = number of vehicles that passed each pole in each of the
previous 12 hours
• Set C = number of vehicles that passed in each of the previous 12
days at the same hour
• Set D = number of vehicles that passed in each of the previous 12
weeks at the same hour and the same day
Traing Sets
• Training set 1: feature set A only
• Training set 2: feature sets A+B
• Training set 3: feature sets A+B+C
• Training set 4: feature sets A+B+C+D
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Load Data to Momentum
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
-Specify your source data
- RDBMS
- NoSQL
- Delimited files
- Full or continuos/incremental mode
Pre-processing & Transformation
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Provide transformation logic in the form of familiar SQL statement
Predictive Modeling
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Predictive Modeling without any programming
Scoring
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Model A+B+C is preferred as it has the lowest RMS
Conclusion
• Momentum provide highly scalable IoT
platform
• Big data analytics without any programming
• Reduce implementation time and cost
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Next Step
Visit us at www.accureanalytics.com
For an online demo
email us at info@accureanalytics.com
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Weitere ähnliche Inhalte

Was ist angesagt?

Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17Mark Goldstein
 
Intro to Big Data and Apache Hadoop by Dr. Amr Awadallah at CLOUD WEEKEND '13...
Intro to Big Data and Apache Hadoop by Dr. Amr Awadallah at CLOUD WEEKEND '13...Intro to Big Data and Apache Hadoop by Dr. Amr Awadallah at CLOUD WEEKEND '13...
Intro to Big Data and Apache Hadoop by Dr. Amr Awadallah at CLOUD WEEKEND '13...TheInevitableCloud
 
Using The Internet of Things for Population Health Management - StampedeCon 2016
Using The Internet of Things for Population Health Management - StampedeCon 2016Using The Internet of Things for Population Health Management - StampedeCon 2016
Using The Internet of Things for Population Health Management - StampedeCon 2016StampedeCon
 
Accelerating analytics on the Sensor and IoT Data.
Accelerating analytics on the Sensor and IoT Data. Accelerating analytics on the Sensor and IoT Data.
Accelerating analytics on the Sensor and IoT Data. Keshav Murthy
 
ParStream - Big Data for Business Users
ParStream - Big Data for Business UsersParStream - Big Data for Business Users
ParStream - Big Data for Business UsersParStream Inc.
 
02 a holistic approach to big data
02 a holistic approach to big data02 a holistic approach to big data
02 a holistic approach to big dataRaul Chong
 
Making Smarter Systems with IoT and Analytics
Making Smarter Systems with IoT and AnalyticsMaking Smarter Systems with IoT and Analytics
Making Smarter Systems with IoT and AnalyticsWSO2
 
IoT Analytics from Edge to Cloud - using IBM Informix
IoT Analytics from Edge to Cloud - using IBM InformixIoT Analytics from Edge to Cloud - using IBM Informix
IoT Analytics from Edge to Cloud - using IBM InformixPradeep Muthalpuredathe
 
Xanadu Based Big Data Deep Learning for Medical Data Analysis
Xanadu Based Big Data Deep Learning for Medical Data AnalysisXanadu Based Big Data Deep Learning for Medical Data Analysis
Xanadu Based Big Data Deep Learning for Medical Data AnalysisAlex G. Lee, Ph.D. Esq. CLP
 
Real-Time Analytics with Apache Cassandra and Apache Spark
Real-Time Analytics with Apache Cassandra and Apache SparkReal-Time Analytics with Apache Cassandra and Apache Spark
Real-Time Analytics with Apache Cassandra and Apache SparkGuido Schmutz
 
Green Compute and Storage - Why does it Matter and What is in Scope
Green Compute and Storage - Why does it Matter and What is in ScopeGreen Compute and Storage - Why does it Matter and What is in Scope
Green Compute and Storage - Why does it Matter and What is in ScopeNarayanan Subramaniam
 
The Synapse IoT Stack: Technology Trends in IOT and Big Data
The Synapse IoT Stack: Technology Trends in IOT and Big DataThe Synapse IoT Stack: Technology Trends in IOT and Big Data
The Synapse IoT Stack: Technology Trends in IOT and Big DataInMobi Technology
 
“The Data-Driven Engineering Revolution,” a Presentation from Edge Impulse
“The Data-Driven Engineering Revolution,” a Presentation from Edge Impulse“The Data-Driven Engineering Revolution,” a Presentation from Edge Impulse
“The Data-Driven Engineering Revolution,” a Presentation from Edge ImpulseEdge AI and Vision Alliance
 
Building a Modern FinTech Big Data Infrastructure
Building a Modern FinTech Big Data InfrastructureBuilding a Modern FinTech Big Data Infrastructure
Building a Modern FinTech Big Data InfrastructureDatabricks
 
Xanadu Big Data Platform Technology BMT@ Rackspace Cloud
Xanadu Big Data Platform Technology BMT@ Rackspace Cloud Xanadu Big Data Platform Technology BMT@ Rackspace Cloud
Xanadu Big Data Platform Technology BMT@ Rackspace Cloud Alex G. Lee, Ph.D. Esq. CLP
 
Transforming GE Healthcare with Data Platform Strategy
Transforming GE Healthcare with Data Platform StrategyTransforming GE Healthcare with Data Platform Strategy
Transforming GE Healthcare with Data Platform StrategyDatabricks
 

Was ist angesagt? (20)

Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
 
Intro to Big Data and Apache Hadoop by Dr. Amr Awadallah at CLOUD WEEKEND '13...
Intro to Big Data and Apache Hadoop by Dr. Amr Awadallah at CLOUD WEEKEND '13...Intro to Big Data and Apache Hadoop by Dr. Amr Awadallah at CLOUD WEEKEND '13...
Intro to Big Data and Apache Hadoop by Dr. Amr Awadallah at CLOUD WEEKEND '13...
 
Using The Internet of Things for Population Health Management - StampedeCon 2016
Using The Internet of Things for Population Health Management - StampedeCon 2016Using The Internet of Things for Population Health Management - StampedeCon 2016
Using The Internet of Things for Population Health Management - StampedeCon 2016
 
Accelerating analytics on the Sensor and IoT Data.
Accelerating analytics on the Sensor and IoT Data. Accelerating analytics on the Sensor and IoT Data.
Accelerating analytics on the Sensor and IoT Data.
 
ParStream - Big Data for Business Users
ParStream - Big Data for Business UsersParStream - Big Data for Business Users
ParStream - Big Data for Business Users
 
02 a holistic approach to big data
02 a holistic approach to big data02 a holistic approach to big data
02 a holistic approach to big data
 
ttec - ParStream
ttec - ParStreamttec - ParStream
ttec - ParStream
 
Making Smarter Systems with IoT and Analytics
Making Smarter Systems with IoT and AnalyticsMaking Smarter Systems with IoT and Analytics
Making Smarter Systems with IoT and Analytics
 
IoT Analytics from Edge to Cloud - using IBM Informix
IoT Analytics from Edge to Cloud - using IBM InformixIoT Analytics from Edge to Cloud - using IBM Informix
IoT Analytics from Edge to Cloud - using IBM Informix
 
Xanadu Based Big Data Deep Learning for Medical Data Analysis
Xanadu Based Big Data Deep Learning for Medical Data AnalysisXanadu Based Big Data Deep Learning for Medical Data Analysis
Xanadu Based Big Data Deep Learning for Medical Data Analysis
 
Real-Time Analytics with Apache Cassandra and Apache Spark
Real-Time Analytics with Apache Cassandra and Apache SparkReal-Time Analytics with Apache Cassandra and Apache Spark
Real-Time Analytics with Apache Cassandra and Apache Spark
 
AI in the Enterprise at Scale
AI in the Enterprise at ScaleAI in the Enterprise at Scale
AI in the Enterprise at Scale
 
Green Compute and Storage - Why does it Matter and What is in Scope
Green Compute and Storage - Why does it Matter and What is in ScopeGreen Compute and Storage - Why does it Matter and What is in Scope
Green Compute and Storage - Why does it Matter and What is in Scope
 
Big Data Telecom
Big Data TelecomBig Data Telecom
Big Data Telecom
 
The Synapse IoT Stack: Technology Trends in IOT and Big Data
The Synapse IoT Stack: Technology Trends in IOT and Big DataThe Synapse IoT Stack: Technology Trends in IOT and Big Data
The Synapse IoT Stack: Technology Trends in IOT and Big Data
 
Michael Hummel - Stop Storing Data! - Parstream
Michael Hummel - Stop Storing Data! - ParstreamMichael Hummel - Stop Storing Data! - Parstream
Michael Hummel - Stop Storing Data! - Parstream
 
“The Data-Driven Engineering Revolution,” a Presentation from Edge Impulse
“The Data-Driven Engineering Revolution,” a Presentation from Edge Impulse“The Data-Driven Engineering Revolution,” a Presentation from Edge Impulse
“The Data-Driven Engineering Revolution,” a Presentation from Edge Impulse
 
Building a Modern FinTech Big Data Infrastructure
Building a Modern FinTech Big Data InfrastructureBuilding a Modern FinTech Big Data Infrastructure
Building a Modern FinTech Big Data Infrastructure
 
Xanadu Big Data Platform Technology BMT@ Rackspace Cloud
Xanadu Big Data Platform Technology BMT@ Rackspace Cloud Xanadu Big Data Platform Technology BMT@ Rackspace Cloud
Xanadu Big Data Platform Technology BMT@ Rackspace Cloud
 
Transforming GE Healthcare with Data Platform Strategy
Transforming GE Healthcare with Data Platform StrategyTransforming GE Healthcare with Data Platform Strategy
Transforming GE Healthcare with Data Platform Strategy
 

Ähnlich wie Big Data Analytics for IoT and Machine Intelligence

Cloudera - IoT & Smart Cities
Cloudera - IoT & Smart CitiesCloudera - IoT & Smart Cities
Cloudera - IoT & Smart CitiesCloudera, Inc.
 
Distributed Solar Systems at EDF Renewables and AWS IoT: A Natural Fit (PUT30...
Distributed Solar Systems at EDF Renewables and AWS IoT: A Natural Fit (PUT30...Distributed Solar Systems at EDF Renewables and AWS IoT: A Natural Fit (PUT30...
Distributed Solar Systems at EDF Renewables and AWS IoT: A Natural Fit (PUT30...Amazon Web Services
 
Hey IT, Meet OT with Hima Mukkamala
Hey IT, Meet OT with Hima MukkamalaHey IT, Meet OT with Hima Mukkamala
Hey IT, Meet OT with Hima Mukkamalagogo6
 
IoT Connected Brewery
IoT Connected BreweryIoT Connected Brewery
IoT Connected BreweryJason Hubbard
 
Serverless patterns
Serverless patternsServerless patterns
Serverless patternsJesse Butler
 
Simplifying Real-Time Architectures for IoT with Apache Kudu
Simplifying Real-Time Architectures for IoT with Apache KuduSimplifying Real-Time Architectures for IoT with Apache Kudu
Simplifying Real-Time Architectures for IoT with Apache KuduCloudera, Inc.
 
Cloudera Altus: Big Data in the Cloud Made Easy
Cloudera Altus: Big Data in the Cloud Made EasyCloudera Altus: Big Data in the Cloud Made Easy
Cloudera Altus: Big Data in the Cloud Made EasyCloudera, Inc.
 
Preventative Maintenance of Robots in Automotive Industry
Preventative Maintenance of Robots in Automotive IndustryPreventative Maintenance of Robots in Automotive Industry
Preventative Maintenance of Robots in Automotive IndustryDataWorks Summit/Hadoop Summit
 
Big data journey to the cloud 5.30.18 asher bartch
Big data journey to the cloud 5.30.18   asher bartchBig data journey to the cloud 5.30.18   asher bartch
Big data journey to the cloud 5.30.18 asher bartchCloudera, Inc.
 
Hopper energyservices
Hopper energyservicesHopper energyservices
Hopper energyserviceshopperdev
 
Leveraging Operational Data in the Cloud
 Leveraging Operational Data in the Cloud Leveraging Operational Data in the Cloud
Leveraging Operational Data in the CloudInductive Automation
 
Implementing Multi-Region AWS IoT, ft. Analog Devices (IOT401) - AWS re:Inven...
Implementing Multi-Region AWS IoT, ft. Analog Devices (IOT401) - AWS re:Inven...Implementing Multi-Region AWS IoT, ft. Analog Devices (IOT401) - AWS re:Inven...
Implementing Multi-Region AWS IoT, ft. Analog Devices (IOT401) - AWS re:Inven...Amazon Web Services
 
5 Steps To Deliver The Fastest Mobile Shopping Experience This Holiday Season
5 Steps To Deliver The Fastest Mobile Shopping Experience This Holiday Season5 Steps To Deliver The Fastest Mobile Shopping Experience This Holiday Season
5 Steps To Deliver The Fastest Mobile Shopping Experience This Holiday SeasonG3 Communications
 
Leveraging Operational Data in the Cloud
Leveraging Operational Data in the CloudLeveraging Operational Data in the Cloud
Leveraging Operational Data in the CloudInductive Automation
 
Shiratech solutions open hours
Shiratech solutions open hoursShiratech solutions open hours
Shiratech solutions open hoursRobert Wolff
 
HPC DAY 2017 | Altair's PBS Pro: Your Gateway to HPC Computing
HPC DAY 2017 | Altair's PBS Pro: Your Gateway to HPC ComputingHPC DAY 2017 | Altair's PBS Pro: Your Gateway to HPC Computing
HPC DAY 2017 | Altair's PBS Pro: Your Gateway to HPC ComputingHPC DAY
 
SOUG Day - autonomous what is next
SOUG Day - autonomous what is nextSOUG Day - autonomous what is next
SOUG Day - autonomous what is nextThomas Teske
 

Ähnlich wie Big Data Analytics for IoT and Machine Intelligence (20)

Cloudera - IoT & Smart Cities
Cloudera - IoT & Smart CitiesCloudera - IoT & Smart Cities
Cloudera - IoT & Smart Cities
 
Distributed Solar Systems at EDF Renewables and AWS IoT: A Natural Fit (PUT30...
Distributed Solar Systems at EDF Renewables and AWS IoT: A Natural Fit (PUT30...Distributed Solar Systems at EDF Renewables and AWS IoT: A Natural Fit (PUT30...
Distributed Solar Systems at EDF Renewables and AWS IoT: A Natural Fit (PUT30...
 
Hey IT, Meet OT with Hima Mukkamala
Hey IT, Meet OT with Hima MukkamalaHey IT, Meet OT with Hima Mukkamala
Hey IT, Meet OT with Hima Mukkamala
 
Top 5 IoT Use Cases
Top 5 IoT Use CasesTop 5 IoT Use Cases
Top 5 IoT Use Cases
 
IoT Connected Brewery
IoT Connected BreweryIoT Connected Brewery
IoT Connected Brewery
 
Serverless patterns
Serverless patternsServerless patterns
Serverless patterns
 
Simplifying Real-Time Architectures for IoT with Apache Kudu
Simplifying Real-Time Architectures for IoT with Apache KuduSimplifying Real-Time Architectures for IoT with Apache Kudu
Simplifying Real-Time Architectures for IoT with Apache Kudu
 
Cloudera Altus: Big Data in the Cloud Made Easy
Cloudera Altus: Big Data in the Cloud Made EasyCloudera Altus: Big Data in the Cloud Made Easy
Cloudera Altus: Big Data in the Cloud Made Easy
 
Preventative Maintenance of Robots in Automotive Industry
Preventative Maintenance of Robots in Automotive IndustryPreventative Maintenance of Robots in Automotive Industry
Preventative Maintenance of Robots in Automotive Industry
 
Big data journey to the cloud 5.30.18 asher bartch
Big data journey to the cloud 5.30.18   asher bartchBig data journey to the cloud 5.30.18   asher bartch
Big data journey to the cloud 5.30.18 asher bartch
 
Hopper energyservices
Hopper energyservicesHopper energyservices
Hopper energyservices
 
Leveraging Operational Data in the Cloud
 Leveraging Operational Data in the Cloud Leveraging Operational Data in the Cloud
Leveraging Operational Data in the Cloud
 
Implementing Multi-Region AWS IoT, ft. Analog Devices (IOT401) - AWS re:Inven...
Implementing Multi-Region AWS IoT, ft. Analog Devices (IOT401) - AWS re:Inven...Implementing Multi-Region AWS IoT, ft. Analog Devices (IOT401) - AWS re:Inven...
Implementing Multi-Region AWS IoT, ft. Analog Devices (IOT401) - AWS re:Inven...
 
What is the Cloud: and how does it reduce cost by 50%
What is the Cloud: and how does it reduce cost by 50%What is the Cloud: and how does it reduce cost by 50%
What is the Cloud: and how does it reduce cost by 50%
 
5 Steps To Deliver The Fastest Mobile Shopping Experience This Holiday Season
5 Steps To Deliver The Fastest Mobile Shopping Experience This Holiday Season5 Steps To Deliver The Fastest Mobile Shopping Experience This Holiday Season
5 Steps To Deliver The Fastest Mobile Shopping Experience This Holiday Season
 
Big Data: Myths and Realities
Big Data: Myths and RealitiesBig Data: Myths and Realities
Big Data: Myths and Realities
 
Leveraging Operational Data in the Cloud
Leveraging Operational Data in the CloudLeveraging Operational Data in the Cloud
Leveraging Operational Data in the Cloud
 
Shiratech solutions open hours
Shiratech solutions open hoursShiratech solutions open hours
Shiratech solutions open hours
 
HPC DAY 2017 | Altair's PBS Pro: Your Gateway to HPC Computing
HPC DAY 2017 | Altair's PBS Pro: Your Gateway to HPC ComputingHPC DAY 2017 | Altair's PBS Pro: Your Gateway to HPC Computing
HPC DAY 2017 | Altair's PBS Pro: Your Gateway to HPC Computing
 
SOUG Day - autonomous what is next
SOUG Day - autonomous what is nextSOUG Day - autonomous what is next
SOUG Day - autonomous what is next
 

Kürzlich hochgeladen

1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样vhwb25kk
 
While-For-loop in python used in college
While-For-loop in python used in collegeWhile-For-loop in python used in college
While-For-loop in python used in collegessuser7a7cd61
 
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一F sss
 
Semantic Shed - Squashing and Squeezing.pptx
Semantic Shed - Squashing and Squeezing.pptxSemantic Shed - Squashing and Squeezing.pptx
Semantic Shed - Squashing and Squeezing.pptxMike Bennett
 
Heart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis ProjectHeart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis ProjectBoston Institute of Analytics
 
Multiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdfMultiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdfchwongval
 
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理e4aez8ss
 
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...Boston Institute of Analytics
 
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝DelhiRS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhijennyeacort
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDRafezzaman
 
Top 5 Best Data Analytics Courses In Queens
Top 5 Best Data Analytics Courses In QueensTop 5 Best Data Analytics Courses In Queens
Top 5 Best Data Analytics Courses In Queensdataanalyticsqueen03
 
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSINGmarianagonzalez07
 
Advanced Machine Learning for Business Professionals
Advanced Machine Learning for Business ProfessionalsAdvanced Machine Learning for Business Professionals
Advanced Machine Learning for Business ProfessionalsVICTOR MAESTRE RAMIREZ
 
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort servicejennyeacort
 
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...Florian Roscheck
 
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...GQ Research
 
Easter Eggs From Star Wars and in cars 1 and 2
Easter Eggs From Star Wars and in cars 1 and 2Easter Eggs From Star Wars and in cars 1 and 2
Easter Eggs From Star Wars and in cars 1 and 217djon017
 
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改yuu sss
 

Kürzlich hochgeladen (20)

1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
 
While-For-loop in python used in college
While-For-loop in python used in collegeWhile-For-loop in python used in college
While-For-loop in python used in college
 
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
 
Semantic Shed - Squashing and Squeezing.pptx
Semantic Shed - Squashing and Squeezing.pptxSemantic Shed - Squashing and Squeezing.pptx
Semantic Shed - Squashing and Squeezing.pptx
 
Heart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis ProjectHeart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis Project
 
Multiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdfMultiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdf
 
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
 
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
 
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝DelhiRS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
 
Top 5 Best Data Analytics Courses In Queens
Top 5 Best Data Analytics Courses In QueensTop 5 Best Data Analytics Courses In Queens
Top 5 Best Data Analytics Courses In Queens
 
Call Girls in Saket 99530🔝 56974 Escort Service
Call Girls in Saket 99530🔝 56974 Escort ServiceCall Girls in Saket 99530🔝 56974 Escort Service
Call Girls in Saket 99530🔝 56974 Escort Service
 
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
 
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
 
Advanced Machine Learning for Business Professionals
Advanced Machine Learning for Business ProfessionalsAdvanced Machine Learning for Business Professionals
Advanced Machine Learning for Business Professionals
 
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
 
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
 
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
 
Easter Eggs From Star Wars and in cars 1 and 2
Easter Eggs From Star Wars and in cars 1 and 2Easter Eggs From Star Wars and in cars 1 and 2
Easter Eggs From Star Wars and in cars 1 and 2
 
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
 

Big Data Analytics for IoT and Machine Intelligence

  • 1. Big Data Analytics for Internet of Things and Machine Intelligence Shamshad Ansari President & CEO Accure Inc.
  • 2. Agenda • Introduction • Iot & Big Data • IoT Reference Architecture • IoT on Momentum © Copyright Accure Inc. All rights reserved. www.accureanalytics.com
  • 3. Year 2020 © Copyright Accure Inc. All rights reserved. www.accureanalytics.com
  • 4. Big Numbers of Small Things Year 2020 © Copyright Accure Inc. All rights reserved. www.accureanalytics.com $7.1 Trillion $1.9 Trillion 50 Billion Connected Devices | Cisco IoT Economic Vaule Added| Gartner IoT Solutions Revenue| IDC IoT Processor Cost Less Than $1 Gartner
  • 5. What is IoT? © Copyright Accure Inc. All rights reserved. www.accureanalytics.com • Objects connected to Internet and communicating with each other. • Any object that can be turned on and off could be a part of the IoT.
  • 6. Business Opportunities © Copyright Accure Inc. All rights reserved. www.accureanalytics.com Monitor OptimizeControl Improved performance Reduced cost New innovative products 1% savings across all industries $150 Billion Savings Source: GE
  • 7. Is IoT New? © Copyright Accure Inc. All rights reserved. www.accureanalytics.com We’ve doing this for many years Yes This is really very facinating and looks like IoT will change the world If IoT is not new, why is this buzz now? - Widespread cell phone usage - Reduced price of sensors - Cheaper Internet connection - Improvded technology to handle and make use of data
  • 8. How Big Data Relates to IoT? How much data? © Copyright Accure Inc. All rights reserved. www.accureanalytics.com Gas turbine comressor blade: 500GB/ day | GE 4.4 44 0.132 4.4 2015 2020 Overall IoT Zettabyte An IoT Sensor generates about 0.5MB per variable per day 1000 sensors & 1000 variables = 500GB per day IoT generates big data
  • 9. IoT and Big Data © Copyright Accure Inc. All rights reserved. www.accureanalytics.com Data Ingestion Data Storage Data Processing Data Reporting Action A new mindset and technology is needed to handle IoT data
  • 10. IoT Challanges • Scale – Size and fast growing data – Large number of users • Pace – Fast pace analysis, command and control and cost – Skill required to do data science and learn new platform • Environment – Complex IoT infrastructure – Security and privacy – Lack of standards in data interoperability © Copyright Accure Inc. All rights reserved. www.accureanalytics.com
  • 11. IoT Solutions Until Now • Complex and expensive • Cost of failing was huge • Mostly high-volume, homogenous devices, where software needs are simple – For simple things like thermostat, refrigerator etc. © Copyright Accure Inc. All rights reserved. www.accureanalytics.com
  • 12. Practical Solution Approach • Think big. Start small • Start small – Experiment, learn, and refine • Think big – scale © Copyright Accure Inc. All rights reserved. www.accureanalytics.com
  • 13. Big Data IoT Architecture Requirements • Be able to handle hardware and software hetrogenity • Be able to scale big • Provide low latency © Copyright Accure Inc. All rights reserved. www.accureanalytics.com
  • 14. Momentum as an IoT Platform © Copyright Accure Inc. All rights reserved. www.accureanalytics.com Momentum provides a configurable platform to manage IoT • Per device level security • Massive scalability – millions of concurrent sensors • Real-time and batch analytics • Predictive analytics • Smart alerts
  • 15. IoT Reference Architecture © Copyright Accure Inc. All rights reserved. www.accureanalytics.com Streaming Gateway Adapter Local Gateway Scalable storage Batch analytics Realtime analytics Visualiza tion
  • 16. Working Example: Smart Street Light Analytics © Copyright Accure Inc. All rights reserved. www.accureanalytics.com Environment Internal parts Weather Temperature Temperature Temperature Pressure Input voltage Pressure Humidity Output voltage Humidity Noise Light intensity Sand storm Rain Snow Fog External DataSensor Data
  • 17. Momentum in Smart Street Lights • Data Ingestion • Predictive Model Building • Predictive analytics – batch • Realtime analytics © Copyright Accure Inc. All rights reserved. www.accureanalytics.com
  • 18. Momentum Demo – How to create Streaming Hub © Copyright Accure Inc. All rights reserved. www.accureanalytics.com
  • 19. Predictive Modeling Feature Engineering • Set A = weather + holiday + weekday + weekend features for the predicted day • Set B = number of vehicles that passed each pole in each of the previous 12 hours • Set C = number of vehicles that passed in each of the previous 12 days at the same hour • Set D = number of vehicles that passed in each of the previous 12 weeks at the same hour and the same day Traing Sets • Training set 1: feature set A only • Training set 2: feature sets A+B • Training set 3: feature sets A+B+C • Training set 4: feature sets A+B+C+D © Copyright Accure Inc. All rights reserved. www.accureanalytics.com
  • 20. Load Data to Momentum © Copyright Accure Inc. All rights reserved. www.accureanalytics.com -Specify your source data - RDBMS - NoSQL - Delimited files - Full or continuos/incremental mode
  • 21. Pre-processing & Transformation © Copyright Accure Inc. All rights reserved. www.accureanalytics.com Provide transformation logic in the form of familiar SQL statement
  • 22. Predictive Modeling © Copyright Accure Inc. All rights reserved. www.accureanalytics.com Predictive Modeling without any programming
  • 23. Scoring © Copyright Accure Inc. All rights reserved. www.accureanalytics.com Model A+B+C is preferred as it has the lowest RMS
  • 24. Conclusion • Momentum provide highly scalable IoT platform • Big data analytics without any programming • Reduce implementation time and cost © Copyright Accure Inc. All rights reserved. www.accureanalytics.com
  • 25. Next Step Visit us at www.accureanalytics.com For an online demo email us at info@accureanalytics.com © Copyright Accure Inc. All rights reserved. www.accureanalytics.com