NVIDIA CEO Jensen Huang's keynote address at the GPU Technology Conference 2019 (#GTC19) in Silicon Valley, where he introduced breakthroughs in pro graphics with NVIDIA Omniverse; in data science with NVIDIA-powered Data Science Workstations; in inference and enterprise computing with NVIDIA T4 GPU-powered servers; in autonomous machines with NVIDIA Jetson Nano and the NVIDIA Isaac SDK; in autonomous vehicles with NVIDIA Safety Force Field and DRIVE Constellation; and much more.
4. 4
NVIDIA CUDA-X
GPU-ACCELERATED COMPUTING LIBRARIES
RTX HPC AI DR IS CL ME
NGC
RTX DGX HGX AGX
CUDA-X
CUDA
Programmable SD, TTS, GID
Acceleration TTA, SOP, COI
Domains COD, COI
Architecture GIA, GID, COI
5. 5
NVIDIA CUDA-X
GPU-ACCELERATED COMPUTING LIBRARIES
RTX HPC AI DR IS CL ME
NGC
RTX DGX HGX AGX
CUDA-X
CUDA
PRogrammable SD, TTS, GID
Acceleration TTA, SOP, COI
Domains COD, COI
Architecture GIA, GID, COI
6. 6
RTX HPC AI DR IS CL ME
NGC
RTX DGX HGX AGX
CUDA-X
CUDA
CHAPTER 1: GRAPHICS
14. 14
BROAD SUPPORT FOR NVIDIA RTX
RTX comes to 9M 3D creators in 2019
3 MILLION
Designers
3 MILLION
3D Artists
1 MILLION
Architects
2 MILLION
M&E Pros
24. 24
ANNOUNCING RTX SERVER
Datacenter Graphics Server Design
40 Turing GPUs in 8U | Virtualize graphics apps up to 320 CCU
Optimized end-to-end stack for rendering, remote workstation, and cloud gaming
25. 25
ANNOUNCING RTX SERVER POD
Modular Designs for Enterprise & Cloud Edge Datacenters
Pods scale to 32 RTX servers | 1,280 GPUs in 10 racks
High-speed storage connected with MLNX IB | Up to 10,000 concurrent users per RTX Pod
28. 28
RTX HPC AI DR IS CL ME
NGC
RTX DGX HGX AGX
CUDA-X
CUDA
CHAPTER 2: AI & HPC
29. 29
DATA SCIENCE –
A NEW PILLAR OF DISCOVERY
PREDICTIVE
MODELFEATURES
PREDICTIONDATA
ML
DL
CVNLU
AI
DATA
ANALYTICS INFERENCE
30. 30
DATA SCIENCE –
A NEW PILLAR OF DISCOVERY
PREDICTIVE
MODELFEATURES
PREDICTIONDATA
ETL, Pandas,
Spark, Graph
TensorFlow, PyTorch
MXNet, Scikit-Learn, XGBoost
TensorFlow Serving
ONNX, SageMaker NEO
CSV, PARQ, HDFS
ML
DL
CVNLU
AI
DATA
ANALYTICS INFERENCE
31. 31
DATA SCIENCE –
A NEW PILLAR OF DISCOVERY
PREDICTIVE
MODELFEATURES
PREDICTIONDATA
cuIO
cuDF
cuGraph
cuDNN
cuML
TensorRT
TRTIS
ML
DL
CVNLU
AI
DATA
ANALYTICS INFERENCE
32. 32
NVIDIA CUDA-X AI ECOSYSTEM
FRAMEWORKS CLOUD ML SERVICES DEPLOYMENT
Workstation CloudServer
DA GRAPH DL TRAINML DL INFERENCE
Serving
Amazon
SageMaker Neo
CUDA-X AI
CUDA
Amazon
SageMaker
Google
Cloud ML
Azure Machine Learning
33. 33
NVIDIA CUDA-X AI ECOSYSTEM
FRAMEWORKS CLOUD ML SERVICES DEPLOYMENT
Workstation CloudServer
DA GRAPH DL TRAINML DL INFERENCE
Serving
Amazon
SageMaker Neo
CUDA-X AI
CUDA
Amazon
SageMaker
Google
Cloud ML
Azure Machine Learning
Announcing Tensor Core Mixed-Precision
Automatically Supported in TensorFlow, PyTorch, MXNet
34. 34
NVIDIA CUDA-X AI ECOSYSTEM
FRAMEWORKS CLOUD ML SERVICES DEPLOYMENT
Workstation CloudServer
DA GRAPH DL TRAINML DL INFERENCE
Serving
Amazon
SageMaker Neo
CUDA-X AI
CUDA
Amazon
SageMaker
Google
Cloud ML
Azure Machine Learning
Announcing RAPIDS Now Integrated
with Databricks Unified Analytics Platform
35. 35
NVIDIA CUDA-X AI ECOSYSTEM
FRAMEWORKS CLOUD ML SERVICES DEPLOYMENT
Workstation CloudServer
DA GRAPH DL TRAINML DL INFERENCE
Serving
Amazon
SageMaker Neo
CUDA-X AI
CUDA
Amazon
SageMaker
Azure Machine Learning
Announcing RAPIDS with
GCP VM Images and Kubeflow
Google
Cloud ML
36. 36
NVIDIA CUDA-X AI ECOSYSTEM
FRAMEWORKS CLOUD ML SERVICES DEPLOYMENT
Workstation CloudServer
DA GRAPH DL TRAINML DL INFERENCE
Serving
Amazon
SageMaker Neo
CUDA-X AI
CUDA
Amazon
SageMaker
Google
Cloud ML
Announcing RAPIDS Integrated
into Azure Machine Learning Service
37. 37
NVIDIA CUDA-X AI ECOSYSTEM
FRAMEWORKS CLOUD ML SERVICES DEPLOYMENT
Workstation CloudServer
DA GRAPH DL TRAINML DL INFERENCE
Serving
Amazon
SageMaker Neo
CUDA-X AI
CUDA
Amazon
SageMaker
Google
Cloud ML
Azure Machine Learning
“ We are excited to announce that we are partnering with NVIDIA to bring RAPIDS to
Accenture’s new Applied Intelligence Platform enabling our joint venture with Kansai
Electric Power, K4Digital, to transform business process and create new opportunities.”
– MIKE SUTCLIFF, Group Chief Executive, Accenture Digital
38. 38
NVIDIA CUDA-X AI ECOSYSTEM
FRAMEWORKS CLOUD ML SERVICES DEPLOYMENT
Workstation CloudServer
DA GRAPH DL TRAINML DL INFERENCE
Serving
Amazon
SageMaker Neo
CUDA-X AI
CUDA
Amazon
SageMaker
Google
Cloud ML
Azure Machine Learning
Announcing NVIDIA TensorRT
Integrated into Microsoft ONNX Runtime
39. 39
CLOUD ML SERVICES
NVIDIA CUDA-X AI ECOSYSTEM
FRAMEWORKS DEPLOYMENT
Workstation CloudServer
DA GRAPH DL TRAINML DL INFERENCE
Serving
Amazon
SageMaker Neo
CUDA-X AI
CUDA
Amazon
SageMaker
Azure Machine Learning
Google
Cloud ML
40. 40
AI CONVERSATIONAL SEARCH
20-30 containers end-to-end | RNN, CNN, MLP in INT8, FP16, FP32 | Latency <300ms
Text to Speech
Speech Recognition
Object DetectionJPEG Decode Resize
Denoising
Voice Encoder
Language Model
AUDIO
AUDIO
VISUAL
VISUAL
Social
News
Visual Search
Web
Question and Answer
Page Layout
Entity Recognition
Query Annotation
Query Search
Auto Correct
Recommendation
Ambient, task and accent
What are different types of
lighting for a living room?
42. 42
ANNOUNCING WORLD’S
LEADING TECH COMPANIES
Voice Search | Image Search
Recommendations | Home Assistant
News Feed | Translation | eCommerce
Adopt CUDA-X AI to Accelerate Model Deployment
6X TensorRT Downloads
2017 2018
300K
50K
43. 43
TRANSFER
LEARNING
ANNOUNCING CLARA AI TOOLKIT
Build, Manage And Deploy AI Applications For Radiology
AI-Assisted Annotation – Hours to Minutes | 10x Less Training Data Needed | 13 Pre-Trained Models
Reference Training and Deployment Pipelines | Available at developer.nvidia.com/clara
AI
DEPLOYMENT
PRE-TRAINED
MODELS
AI-ASSISTED
ANNOTATION
44. 44
CLARA AI – BUILT FOR RADIOLOGY
MGH
3D Annotation from
Hours to Minutes
OSU
Clinical Model Deployment
in Less Than 24 hours
DKFZ
Clara AI Annotation Integrated
in MITK Open Source Viewer
NIH
Trained State-of-the-Art Model
in Weeks
45. 45
DATA SCIENCE IS THE NEW HPC CHALLENGE
ML
DL
CVNLU
AI
DATA
ANALYTICS
PREDICTIVE
MODELFEATURES
INFERENCE PREDICTIONDATA
48. 48
A WORKSTATION FOR DATA SCIENTISTS
Powered by NVIDIA GPU and CUDA-X AI
Dual Quadro RTX 8000 with 96 GB Memory | Pre-installed for CUDA-X Accelerated Data Science —
RAPIDS, TensorFlow, PyTorch, Caffe, Anaconda Distribution | 10X Faster
49. 49
ANNOUNCING WORLD’S TOP COMPUTER MAKERS
OFFER WORKSTATIONS OPTIMIZED FOR DATA SCIENCE
Powered by NVIDIA GPU and CUDA-X AI
Dual Quadro RTX 8000 with 96 GB Memory | Pre-installed for CUDA-X Accelerated Data Science —
RAPIDS, TensorFlow, PyTorch, Caffe, Anaconda Distribution | 10X Faster
Acceleration of FSI Data Science Workflow
2x RTX8000 1x RTX8000 CPU
50. 50
ANNOUNCING WORLD’S TOP COMPUTER MAKERS
OFFER WORKSTATIONS OPTIMIZED FOR DATA SCIENCE
Powered by NVIDIA GPU and CUDA-X AI
Dual Quadro RTX 8000 with 96 GB Memory | Pre-installed for CUDA-X Accelerated Data Science —
RAPIDS, TensorFlow, PyTorch, Caffe, Anaconda Distribution | 10X Faster
70. 70
ANNOUNCING JETSON NANO
$99 NVIDIA CUDA-X AI Computer
CUDA-X acceleration stack | High-resolution sensor support | Runs all CUDA-X AI models
71. 71
ANNOUNCING ISAAC OPEN SDK
Isaac Robot Engine – Modular robot framework | Isaac Sim - Virtual robotics laboratory
Isaac Gym – Reinforcement learning simulator | Isaac Robot Apps – Kaya, Carter and Link
Available at developer.nvidia.com/isaac-sdk
CARTER (Xavier)KAYA (Nano) LINK (Multi Xavier)
ISAAC OPEN TOOLBOX
Sensor and
Actuator Drivers Core Libraries GEMS Reference DNN Tools
CUDA-X
74. 74
DRIVE OPEN PLATFORM ECOSYSTEM
CARS TRUCKS
MOBILITY
SERVICES AI ISVs SIMULATIONMAPPING SENSORSTIER 1s
75. 75
ANNOUNCING DRIVE AP2X RELEASE 9.0
High Function L2+ Autopilot system
On-ramp to off-ramp | Surround perception for auto lane-change | Localization to all major HD maps
Real-time mapping with camera and radar | Integrated AR and VR confidence visualization
Integrated DM and voice command
77. 77
DRIVE AV — PERCEPTION
Objects
Lanes & Road Markings
Free Space
Distance
78. 78
Baidu — Beijing, China
TomTom — Barcelona, Spain
HERE — Oakland, USA
Navinfo — Shanghai, China
DRIVE AV — PERCEPTION
Objects
Lanes & Road Markings
Free Space
Distance
DRIVE AV — LOCALIZATION & MAPPING
79. 79
ANNOUNCING DRIVE AV —
PATH PLANNING WITH SAFETY FORCE FIELD
Path Planning + Prediction + Safety Force Field | Designed for AV safety and drive comfort
Mathematically verifiable, validated in simulation | Open platform
80. 80
ANNOUNCING DRIVE AV —
PATH PLANNING WITH SAFETY FORCE FIELD
Path Planning + Prediction + Safety Force Field | Designed for AV safety and drive comfort
Mathematically verifiable, validated in simulation | Open platform
81. 81
ANNOUNCING DRIVE AV —
PATH PLANNING WITH SAFETY FORCE FIELD
Path Planning + Prediction + Safety Force Field | Designed for AV safety and drive comfort
Mathematically verifiable, validated in simulation | Open platform
82. 82
ANNOUNCING DRIVE AV —
PATH PLANNING WITH SAFETY FORCE FIELD
Path Planning + Prediction + Safety Force Field | Designed for AV safety and drive comfort
Mathematically verifiable, validated in simulation | Open platform
83. 83
ANNOUNCING DRIVE AV —
PATH PLANNING WITH SAFETY FORCE FIELD
Path Planning + Prediction + Safety Force Field | Designed for AV safety and drive comfort
Mathematically verifiable, validated in simulation | Open platform
84. 84
ANNOUNCING DRIVE AV —
PATH PLANNING WITH SAFETY FORCE FIELD
Path Planning + Prediction + Safety Force Field | Designed for AV safety and drive comfort
Mathematically verifiable, validated in simulation | Open platform
85. 85
ANNOUNCING DRIVE CONSTELLATION
AVAILABLE NOW
Virtual AV Test Fleet
Bit-accurate, hardware-in-the-loop simulator | Test corner and rare conditions
Simulate previous failure scenarios | Cloud-based workflow | Open platform
86. 86
ANNOUNCING DRIVE CONSTELLATION
AVAILABLE NOW
Virtual AV Test Fleet
Bit-accurate, hardware-in-the-loop simulator | Test corner and rare conditions
Simulate previous failure scenarios | Cloud-based workflow | Open platform
89. 89
ANNOUNCING DRIVE CONSTELLATION
AVAILABLE NOW
Virtual AV Test Fleet
Bit-accurate, hardware-in-the-loop simulator | Test corner and rare conditions
Simulate previous failure scenarios | Cloud-based workflow | Open platform