Emerging AI Trends: How AI and Its

Applications Impact Healthcare

Industry
Rupali Deshpande
Global Partner Business Manager, Medical Instruments
rdeshpande@nvidia.com
 AI: PAST THE HYPE CYCLE
R&D and STARTUPS

93% $8B 121

R&D UTILIZING AI STARTUP FUNDING FDA/CE Clearances

Source: MICCAI (2019), https://arxiv.org/abs/1912.12378?_lrsc=0b30bc06-52ba-441d-8efc-1af4edd6a1fb&ncid=so-lin-lt-798 , CB INSIGHTS (2019), Medical Futurist (2019) 2

 EMERGING SMART MEDICAL DEVICES
Intersection of Graphics, Compute and AI

Point of Care &

Diagnostic Imaging In Vitro Diagnostics Therapeutics & Robotics
Patient Monitoring

• CT, MR, Mammography • Digital Pathology • Endoscopy • Smart Camera

• Dental CT • Genomics • Radiation • Medical Display

Market Size = $40B Market Size = $20B Market Size = $40B Market Size = 5K hospitals,
GPU TAM = $200M GPU TAM = $150M GPU TAM = $200M 200 Beds
GPU TAM = $200M

3
 EMERGING SMART MEDICAL DEVICES
Intersection of Graphics, Compute and AI

Point of Care &

Diagnostic Imaging In Vitro Diagnostics Therapeutics & Robotics
Patient Monitoring

• CT, MR, Mammography • Digital Pathology • Endoscopy • Smart Camera

• Dental CT • Genomics • Radiation • Medical Display

Market Size = $40B Market Size = $20B Market Size = $40B Market Size = 5K hospitals,
GPU TAM = $200M GPU TAM = $150M GPU TAM = $200M 200 Beds
GPU TAM = $200M

4
 EMERGING SMART MEDICAL DEVICES
Intersection of Graphics, Compute and AI

Point of Care &

Diagnostic Imaging In Vitro Diagnostics Therapeutics & Robotics
Patient Monitoring

• CT, MR, Mammography • Digital Pathology • Endoscopy • Smart Camera

• Dental CT • Genomics • Radiation • Medical Display

Market Size = $40B Market Size = $20B Market Size = $40B Market Size = 5K hospitals,
GPU TAM = $200M GPU TAM = $150M GPU TAM = $200M 200 Beds
GPU TAM = $200M

5
 EMERGING SMART MEDICAL DEVICES
Intersection of Graphics, Compute and AI

Point of Care &

Diagnostic Imaging In Vitro Diagnostics Therapeutics & Robotics
Patient Monitoring

• CT, MR, Mammography • Digital Pathology • Endoscopy • Smart Camera

• Dental CT • Genomics • Radiation • Medical Display

Market Size = $40B Market Size = $20B Market Size = $40B Market Size = 5K hospitals,
GPU TAM = $200M GPU TAM = $150M GPU TAM = $200M 200 Beds
GPU TAM = $200M

6
 AI WORKFLOW

Training DNN Model Inference

7
 NVIDIA CLARA
Application Framework for Healthcare

SMART MEDICAL DEVICES

SENSORS APPLICATIONS

ISVs
NVIDIA CLARA GUARDIAN NVIDIA CLARA AGX NVIDIA CLARA IMAGING NVIDIA CLARA DISCOVERY NVIDIA CLARA PARABRICKS

Multi-Modal
Video Conversational Realtime Data Realtime AI & SW AS Medical NLP / Genomics Long
Analytics AI Acquisition Robotics Device
Multi-Device Biomegatron
Parabricks
Read Mapping
Deep Learning
AI

CUDA

NVIDIA EGX

AGX EGX DGX CLOUD

8
 NVIDIA CLARA APPLICATION FRAMEWORK
Application Framework for AI Development in Healthcare

AI ASSISTED DEEPSTREAM OPTIMIZED DEPLOYMENT FRAMEWORK

PRE-TRAINED MODELS
ANNOTATION WORKFLOW

9
 NVIDIA CLARA APPLICATION FRAMEWORK
Application Framework for AI Development in Healthcare

AI ASSISTED DEEPSTREAM OPTIMIZED DEPLOYMENT FRAMEWORK

PRE-TRAINED MODELS
ANNOTATION WORKFLOW

10
 NVIDIA CLARA APPLICATION FRAMEWORK
Application Framework for AI Development in Healthcare

AI ASSISTED DEEPSTREAM OPTIMIZED DEPLOYMENT FRAMEWORK

PRE-TRAINED MODELS
ANNOTATION WORKFLOW

11
 NVIDIA CLARA APPLICATION FRAMEWORK
Application Framework for AI Development in Healthcare

AI ASSISTED DEEPSTREAM OPTIMIZED DEPLOYMENT FRAMEWORK

PRE-TRAINED MODELS
ANNOTATION WORKFLOW

12
 TensorRT FOR INFERENCING
Bringing Accuracy and Speed

6x Performance on A100 vs V100

6x

Throughput (seq/sec) Speedup

1x
0.6x
T4 V100 A100

https://github.com/
Tuned for A100 GPUs INT8 optimizations Framework Integrations

13
 TRITON Inference Server
Scaling Inference to Multi-GPU Multi-Node

Quickly deploy and manage

NVIDIA multiple models per GPU per node

TensorRT
Inference
Server
T4

NVIDIA
T4
Easily scale to heterogeneous
GPUs and multi GPU nodes
Tesla

TensorRT
Inference
Concurrent model execution

Server
A100

Tesla
A100
Multiple Backends supported

TensorRT
Server HTTP REST API/gRPC
Inference
Tesla P4

Server
Tesla P4
Python/C++ client libraries

14
Real World Use Cases
Solutions leveraging NVIDIA CLARA

15
 ACCELERATING WORLD OF INSTRUMENTS
NVIDIA Platform for Healthcare

Hardware Software Partner Ecosystem

APPLICATIONS
Datacenter Edge AI Training Real Time Scale out
Endoscopy Inferencing

Interactive AI Image AI Clinical

Labeling Reconstruction Integration

NVIDIA CLARA
Tesla T4/A100 AI Assisted Pre-Trained Federated
Quadro RTX Jetson/AGX Annotation Models Learning

Scalable AI Real Time

Inferencing Imaging
I/O Adaptors • Inception Partners
• Hospitals
NVIDIA EGX • Research Institutes
• Software Partners
• Solution Partners
Tesla V100 Quadro RTX NVIDIA GPUs
16
PARTNERING WITH ADVANTECH
X

USM-500 POC Series

Medical Grade Box PC Medical Grade Panel PC

NVIDIA RTX NVIDIA MXM

17