SlideShare ist ein Scribd-Unternehmen logo
1 von 15
Making Managing and Using Deep Learning and
AI Infrastructure Easy, Elastic, and Efficient
@timgasper @pspitler3
Amazon AI Enabled Services DIY Deep Learning
*
Deep Learning Neural Nets
Source: https://www.slideshare.net/roelofp/deep-learning-as-a-catdog-detector
1 Develop 2 Train 3 Deploy
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
GPU
Deep Learning Application Lifecycle
Locally or in the cloud On CPUs or GPUs
(Single, Multi-GPU, or
Distributed)
To “inference” endpoint
API or edge device
(mobile app, drone, car,
robot, etc.)
Deep Learning Training vs Inference
Source: NVIDIA
ROBOTICS
SOFTWARE
ADS & PUBLISHING
ENTERTAINMENT
AUTOMOTIVE
FINANCE
PHARMA
HEALTHCARE
ENERGY
EDUCATION
SALES
CUSTOMER SERVICE
MAINTENANCE
SECURITY
COMPUTER VISION & SPEECH, DRONES, DROIDS
PERSONAL ASSISTANTS, CODE GENERATION
AUTO-CONTENT CREATION, ADAPTIVE AD TARGETING
INTERACTIVE VIRTUAL & MIXED REALITY
SELF-DRIVING CARS, CO-PILOT ADVISOR
PREDICTIVE PRICE ANALYSIS, DYNAMIC DECISION SUPPORT
DRUG DISCOVERY, PROTEIN SIMULATION
PREDICTIVE DIAGNOSIS, WEARABLE INTELLIGENCE
GEO-SEISMIC RESOURCE DISCOVERY
ADAPTIVE LEARNING COURSES
ADAPTIVE PRODUCT RECOMMENDATIONS
BOTS AND FULLY-AUTOMATED SERVICE
DYNAMIC RISK MITIGATION AND YIELD OPTIMIZATION
ADAPTIVE THREAT IDENTIFICATION & EARLY DISCOVERY
INDUSTRY / FUNCTION AI REVOLUTION
Source: Bored Panda
Deep Learning Frameworks - Popularity
Deep Learning Frameworks – Pros/Cons
Ease to Start
Speed
Audio/Video
Images
Scale Out
Keras*
Intel/Nervana
If forced
to segment…
Deep Learning Frameworks – Pros/Cons
Deep Learning Benchmarks: https://arxiv.org/abs/1608.07249
Bitfusion AMIs
AWS Marketplace
Bitfusion Boost
Any Datacenter or Cloud
GPU Applications
No Code Changes
Bitfusion GPU
Virtualization
• Elastic GPUs
• Partial GPUs
• GPU Scale Out
• GPU HA/Failover
Heterogeneous
Infrastructure
Bitfusion Docker Containers
Ping me:
tim@bitfusion.io
Coming Soon!
CPU
Instances
Get started quickly with
our pre-built deep learning
AMIs or containers.
Develop locally or on
shared CPU nodes with
Elastic GPUs.
1
Train and optimize models
on shared resources at
scale, either with many
Elastic GPUs or directly
on the GPU cluster.
3
GPU
Instances
Boost Enabled Environment
Local
Environment
GPU Scale Out
AMIs or Docker Containers
Leverage Partial GPUs
early in the development
process for maximum
utilization and efficiency.
2
Elastic GPU attachment
Partial GPU attachment
Expose finalized
models for production
inference.
4
Inference Server
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank You!

Weitere ähnliche Inhalte

Andere mochten auch

Шевченківський тиждень
Шевченківський тижденьШевченківський тиждень
Шевченківський тижденьЛюдмила Губа
 
французкий 6 доп образ и.г. леонова
французкий 6 доп образ и.г. леоновафранцузкий 6 доп образ и.г. леонова
французкий 6 доп образ и.г. леоноваAlexandr Romanovich Salomasov
 
PQT - Total Productive Maintenance
PQT - Total Productive MaintenancePQT - Total Productive Maintenance
PQT - Total Productive MaintenanceDr. John V. Padua
 
Redefining Customer Expectations: 5 Trends for 2017
Redefining Customer Expectations: 5 Trends for 2017Redefining Customer Expectations: 5 Trends for 2017
Redefining Customer Expectations: 5 Trends for 2017BrandSquare
 
Detección de necesidades de mejora en centros educativos que aspiran a ser in...
Detección de necesidades de mejora en centros educativos que aspiran a ser in...Detección de necesidades de mejora en centros educativos que aspiran a ser in...
Detección de necesidades de mejora en centros educativos que aspiran a ser in...Gabinete Psicopedagógico Kaposkly
 
дубровицькі фольклористи
дубровицькі фольклористидубровицькі фольклористи
дубровицькі фольклористиsemyurihor
 
Predicting Azure Churn with Deep Learning and Explaining Predictions with LIME
Predicting Azure Churn with Deep Learning and Explaining Predictions with LIMEPredicting Azure Churn with Deep Learning and Explaining Predictions with LIME
Predicting Azure Churn with Deep Learning and Explaining Predictions with LIMEFeng Zhu
 
IAAF WorldCrossCountry champs Kampala(uga) 2017 final entry lists
IAAF WorldCrossCountry champs Kampala(uga) 2017 final entry listsIAAF WorldCrossCountry champs Kampala(uga) 2017 final entry lists
IAAF WorldCrossCountry champs Kampala(uga) 2017 final entry listsAlberto Stretti
 
Desplazamiento de nodos método energético y maxwell mohr
Desplazamiento de nodos método energético y maxwell mohrDesplazamiento de nodos método energético y maxwell mohr
Desplazamiento de nodos método energético y maxwell mohrJlm Udal
 
Presetacion de power point 97 2003
Presetacion de power point 97 2003Presetacion de power point 97 2003
Presetacion de power point 97 2003Lismari Martinez
 
Ejercicio de hipertexto
Ejercicio de hipertextoEjercicio de hipertexto
Ejercicio de hipertextoluisaruiz2202
 

Andere mochten auch (18)

Evaluation 7
Evaluation 7Evaluation 7
Evaluation 7
 
FAMILIAS Y NUEVAS TECNOLOGÍAS
FAMILIAS Y NUEVAS TECNOLOGÍASFAMILIAS Y NUEVAS TECNOLOGÍAS
FAMILIAS Y NUEVAS TECNOLOGÍAS
 
Шевченківський тиждень
Шевченківський тижденьШевченківський тиждень
Шевченківський тиждень
 
французкий Delf
французкий Delf французкий Delf
французкий Delf
 
французкий 6 доп образ и.г. леонова
французкий 6 доп образ и.г. леоновафранцузкий 6 доп образ и.г. леонова
французкий 6 доп образ и.г. леонова
 
PQT - Total Productive Maintenance
PQT - Total Productive MaintenancePQT - Total Productive Maintenance
PQT - Total Productive Maintenance
 
Redefining Customer Expectations: 5 Trends for 2017
Redefining Customer Expectations: 5 Trends for 2017Redefining Customer Expectations: 5 Trends for 2017
Redefining Customer Expectations: 5 Trends for 2017
 
El Gimnasio
El GimnasioEl Gimnasio
El Gimnasio
 
Detección de necesidades de mejora en centros educativos que aspiran a ser in...
Detección de necesidades de mejora en centros educativos que aspiran a ser in...Detección de necesidades de mejora en centros educativos que aspiran a ser in...
Detección de necesidades de mejora en centros educativos que aspiran a ser in...
 
дубровицькі фольклористи
дубровицькі фольклористидубровицькі фольклористи
дубровицькі фольклористи
 
Predicting Azure Churn with Deep Learning and Explaining Predictions with LIME
Predicting Azure Churn with Deep Learning and Explaining Predictions with LIMEPredicting Azure Churn with Deep Learning and Explaining Predictions with LIME
Predicting Azure Churn with Deep Learning and Explaining Predictions with LIME
 
IAAF WorldCrossCountry champs Kampala(uga) 2017 final entry lists
IAAF WorldCrossCountry champs Kampala(uga) 2017 final entry listsIAAF WorldCrossCountry champs Kampala(uga) 2017 final entry lists
IAAF WorldCrossCountry champs Kampala(uga) 2017 final entry lists
 
Actividad 2
Actividad 2Actividad 2
Actividad 2
 
Renderizado 3D
Renderizado 3DRenderizado 3D
Renderizado 3D
 
Desplazamiento de nodos método energético y maxwell mohr
Desplazamiento de nodos método energético y maxwell mohrDesplazamiento de nodos método energético y maxwell mohr
Desplazamiento de nodos método energético y maxwell mohr
 
Presetacion de power point 97 2003
Presetacion de power point 97 2003Presetacion de power point 97 2003
Presetacion de power point 97 2003
 
Ejercicio de hipertexto
Ejercicio de hipertextoEjercicio de hipertexto
Ejercicio de hipertexto
 
1°trabajo flores antezana rogger david
1°trabajo flores antezana rogger david1°trabajo flores antezana rogger david
1°trabajo flores antezana rogger david
 

Ähnlich wie Deep Learning on AWS with Bitfusion

AI in the Financial Services Industry
AI in the Financial Services IndustryAI in the Financial Services Industry
AI in the Financial Services IndustryAlison B. Lowndes
 
Introduction to Deep Learning (NVIDIA)
Introduction to Deep Learning (NVIDIA)Introduction to Deep Learning (NVIDIA)
Introduction to Deep Learning (NVIDIA)Rakuten Group, Inc.
 
Building Intelligent Applications, Experimental ML with Uber’s Data Science W...
Building Intelligent Applications, Experimental ML with Uber’s Data Science W...Building Intelligent Applications, Experimental ML with Uber’s Data Science W...
Building Intelligent Applications, Experimental ML with Uber’s Data Science W...Databricks
 
Uber - Building Intelligent Applications, Experimental ML with Uber’s Data Sc...
Uber - Building Intelligent Applications, Experimental ML with Uber’s Data Sc...Uber - Building Intelligent Applications, Experimental ML with Uber’s Data Sc...
Uber - Building Intelligent Applications, Experimental ML with Uber’s Data Sc...Karthik Murugesan
 
abelbrownnvidiarakuten2016-170208065814 (1).pptx
abelbrownnvidiarakuten2016-170208065814 (1).pptxabelbrownnvidiarakuten2016-170208065814 (1).pptx
abelbrownnvidiarakuten2016-170208065814 (1).pptxgopikahari7
 
Dell NVIDIA AI Roadshow - South Western Ontario
Dell NVIDIA AI Roadshow - South Western OntarioDell NVIDIA AI Roadshow - South Western Ontario
Dell NVIDIA AI Roadshow - South Western OntarioBill Wong
 
Global Azure Bootcamp 2019 - AIoT powered by Azure
Global Azure Bootcamp 2019 - AIoT powered by AzureGlobal Azure Bootcamp 2019 - AIoT powered by Azure
Global Azure Bootcamp 2019 - AIoT powered by AzureAndri Yadi
 
Pentesting Android Applications
Pentesting Android ApplicationsPentesting Android Applications
Pentesting Android ApplicationsCláudio André
 
Biometrics Authentication Using Raspberry Pi
Biometrics Authentication Using Raspberry PiBiometrics Authentication Using Raspberry Pi
Biometrics Authentication Using Raspberry PiIJTET Journal
 
AI and Innovations on AWS
AI and Innovations on AWSAI and Innovations on AWS
AI and Innovations on AWSAdrian Hornsby
 
"The Vision AI Start-ups That Matter Most," a Presentation from Cognite Ventures
"The Vision AI Start-ups That Matter Most," a Presentation from Cognite Ventures"The Vision AI Start-ups That Matter Most," a Presentation from Cognite Ventures
"The Vision AI Start-ups That Matter Most," a Presentation from Cognite VenturesEdge AI and Vision Alliance
 
Synthetic Data: From 3D model to AI on the Edge
Synthetic Data: From 3D model to AI on the EdgeSynthetic Data: From 3D model to AI on the Edge
Synthetic Data: From 3D model to AI on the EdgeSherry List
 
AI in Finance: Moving forward!
AI in Finance: Moving forward!AI in Finance: Moving forward!
AI in Finance: Moving forward!Adrian Hornsby
 
Inception Awards: The Top Six AI Startups Changing The World
Inception Awards: The Top Six AI Startups Changing The WorldInception Awards: The Top Six AI Startups Changing The World
Inception Awards: The Top Six AI Startups Changing The WorldNVIDIA
 
Whole Chain Traceability, pulling a Kobayashi Maru.
Whole Chain Traceability, pulling a Kobayashi Maru. Whole Chain Traceability, pulling a Kobayashi Maru.
Whole Chain Traceability, pulling a Kobayashi Maru. clive boulton
 
Smart Attendance System using Raspberry Pi
Smart Attendance System using Raspberry PiSmart Attendance System using Raspberry Pi
Smart Attendance System using Raspberry Piijtsrd
 
Lake Crest について調べてみた
Lake Crest について調べてみたLake Crest について調べてみた
Lake Crest について調べてみたYutaka Yasuda
 
"Imaging + AI: Opportunities Inside the Car and Beyond," a Presentation from ...
"Imaging + AI: Opportunities Inside the Car and Beyond," a Presentation from ..."Imaging + AI: Opportunities Inside the Car and Beyond," a Presentation from ...
"Imaging + AI: Opportunities Inside the Car and Beyond," a Presentation from ...Edge AI and Vision Alliance
 

Ähnlich wie Deep Learning on AWS with Bitfusion (20)

AI in the Financial Services Industry
AI in the Financial Services IndustryAI in the Financial Services Industry
AI in the Financial Services Industry
 
Webinar AI&ML
Webinar AI&MLWebinar AI&ML
Webinar AI&ML
 
Introduction to Deep Learning (NVIDIA)
Introduction to Deep Learning (NVIDIA)Introduction to Deep Learning (NVIDIA)
Introduction to Deep Learning (NVIDIA)
 
Building Intelligent Applications, Experimental ML with Uber’s Data Science W...
Building Intelligent Applications, Experimental ML with Uber’s Data Science W...Building Intelligent Applications, Experimental ML with Uber’s Data Science W...
Building Intelligent Applications, Experimental ML with Uber’s Data Science W...
 
Uber - Building Intelligent Applications, Experimental ML with Uber’s Data Sc...
Uber - Building Intelligent Applications, Experimental ML with Uber’s Data Sc...Uber - Building Intelligent Applications, Experimental ML with Uber’s Data Sc...
Uber - Building Intelligent Applications, Experimental ML with Uber’s Data Sc...
 
abelbrownnvidiarakuten2016-170208065814 (1).pptx
abelbrownnvidiarakuten2016-170208065814 (1).pptxabelbrownnvidiarakuten2016-170208065814 (1).pptx
abelbrownnvidiarakuten2016-170208065814 (1).pptx
 
Dell NVIDIA AI Roadshow - South Western Ontario
Dell NVIDIA AI Roadshow - South Western OntarioDell NVIDIA AI Roadshow - South Western Ontario
Dell NVIDIA AI Roadshow - South Western Ontario
 
Global Azure Bootcamp 2019 - AIoT powered by Azure
Global Azure Bootcamp 2019 - AIoT powered by AzureGlobal Azure Bootcamp 2019 - AIoT powered by Azure
Global Azure Bootcamp 2019 - AIoT powered by Azure
 
Pentesting Android Applications
Pentesting Android ApplicationsPentesting Android Applications
Pentesting Android Applications
 
Biometrics Authentication Using Raspberry Pi
Biometrics Authentication Using Raspberry PiBiometrics Authentication Using Raspberry Pi
Biometrics Authentication Using Raspberry Pi
 
AI and Innovations on AWS
AI and Innovations on AWSAI and Innovations on AWS
AI and Innovations on AWS
 
"The Vision AI Start-ups That Matter Most," a Presentation from Cognite Ventures
"The Vision AI Start-ups That Matter Most," a Presentation from Cognite Ventures"The Vision AI Start-ups That Matter Most," a Presentation from Cognite Ventures
"The Vision AI Start-ups That Matter Most," a Presentation from Cognite Ventures
 
Synthetic Data: From 3D model to AI on the Edge
Synthetic Data: From 3D model to AI on the EdgeSynthetic Data: From 3D model to AI on the Edge
Synthetic Data: From 3D model to AI on the Edge
 
AI in Finance: Moving forward!
AI in Finance: Moving forward!AI in Finance: Moving forward!
AI in Finance: Moving forward!
 
Inception Awards: The Top Six AI Startups Changing The World
Inception Awards: The Top Six AI Startups Changing The WorldInception Awards: The Top Six AI Startups Changing The World
Inception Awards: The Top Six AI Startups Changing The World
 
Whole Chain Traceability, pulling a Kobayashi Maru.
Whole Chain Traceability, pulling a Kobayashi Maru. Whole Chain Traceability, pulling a Kobayashi Maru.
Whole Chain Traceability, pulling a Kobayashi Maru.
 
Smart Attendance System using Raspberry Pi
Smart Attendance System using Raspberry PiSmart Attendance System using Raspberry Pi
Smart Attendance System using Raspberry Pi
 
NVIDIA DataArt IT
NVIDIA DataArt ITNVIDIA DataArt IT
NVIDIA DataArt IT
 
Lake Crest について調べてみた
Lake Crest について調べてみたLake Crest について調べてみた
Lake Crest について調べてみた
 
"Imaging + AI: Opportunities Inside the Car and Beyond," a Presentation from ...
"Imaging + AI: Opportunities Inside the Car and Beyond," a Presentation from ..."Imaging + AI: Opportunities Inside the Car and Beyond," a Presentation from ...
"Imaging + AI: Opportunities Inside the Car and Beyond," a Presentation from ...
 

Kürzlich hochgeladen

Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfPrecisely
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 

Kürzlich hochgeladen (20)

Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 

Deep Learning on AWS with Bitfusion

  • 1. Making Managing and Using Deep Learning and AI Infrastructure Easy, Elastic, and Efficient @timgasper @pspitler3
  • 2. Amazon AI Enabled Services DIY Deep Learning
  • 3. *
  • 4. Deep Learning Neural Nets Source: https://www.slideshare.net/roelofp/deep-learning-as-a-catdog-detector
  • 5. 1 Develop 2 Train 3 Deploy GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU Deep Learning Application Lifecycle Locally or in the cloud On CPUs or GPUs (Single, Multi-GPU, or Distributed) To “inference” endpoint API or edge device (mobile app, drone, car, robot, etc.)
  • 6. Deep Learning Training vs Inference Source: NVIDIA
  • 7. ROBOTICS SOFTWARE ADS & PUBLISHING ENTERTAINMENT AUTOMOTIVE FINANCE PHARMA HEALTHCARE ENERGY EDUCATION SALES CUSTOMER SERVICE MAINTENANCE SECURITY COMPUTER VISION & SPEECH, DRONES, DROIDS PERSONAL ASSISTANTS, CODE GENERATION AUTO-CONTENT CREATION, ADAPTIVE AD TARGETING INTERACTIVE VIRTUAL & MIXED REALITY SELF-DRIVING CARS, CO-PILOT ADVISOR PREDICTIVE PRICE ANALYSIS, DYNAMIC DECISION SUPPORT DRUG DISCOVERY, PROTEIN SIMULATION PREDICTIVE DIAGNOSIS, WEARABLE INTELLIGENCE GEO-SEISMIC RESOURCE DISCOVERY ADAPTIVE LEARNING COURSES ADAPTIVE PRODUCT RECOMMENDATIONS BOTS AND FULLY-AUTOMATED SERVICE DYNAMIC RISK MITIGATION AND YIELD OPTIMIZATION ADAPTIVE THREAT IDENTIFICATION & EARLY DISCOVERY INDUSTRY / FUNCTION AI REVOLUTION
  • 10. Deep Learning Frameworks – Pros/Cons Ease to Start Speed Audio/Video Images Scale Out Keras* Intel/Nervana If forced to segment…
  • 11. Deep Learning Frameworks – Pros/Cons Deep Learning Benchmarks: https://arxiv.org/abs/1608.07249
  • 12. Bitfusion AMIs AWS Marketplace Bitfusion Boost Any Datacenter or Cloud GPU Applications No Code Changes Bitfusion GPU Virtualization • Elastic GPUs • Partial GPUs • GPU Scale Out • GPU HA/Failover Heterogeneous Infrastructure
  • 13. Bitfusion Docker Containers Ping me: tim@bitfusion.io Coming Soon!
  • 14. CPU Instances Get started quickly with our pre-built deep learning AMIs or containers. Develop locally or on shared CPU nodes with Elastic GPUs. 1 Train and optimize models on shared resources at scale, either with many Elastic GPUs or directly on the GPU cluster. 3 GPU Instances Boost Enabled Environment Local Environment GPU Scale Out AMIs or Docker Containers Leverage Partial GPUs early in the development process for maximum utilization and efficiency. 2 Elastic GPU attachment Partial GPU attachment Expose finalized models for production inference. 4 Inference Server
  • 15. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Thank You!