Custom AI

Anderson Santos
Data & AI Cloud Solution Architect

anderson.santos@vnex.com.br
 AI, Machine Learning and Deep Learning

Artificial
Intelligence
Machine
Learning
Deep
Learning

1950 1960 1970 1980 1990 2000 2010

 7x7 conv, 64, /2.pool/2

1x1 conv, 64

Deep learning advancements

3x3 conv, 64

1x1 conv, 256

1x1 conv, 64

3x3 conv, 64

1x1 conv, 256

1x1 conv, 64

3x3 conv, 64

1x1 conv, 256

96% 5.1% 88.493% 69.9%

1x2 conv, 128./2

3x3 conv, 128

1x1 conv, 512

RESNET vision test

1x1 conv, 128 Switchboard speech SQuAD reading MT
152 layers 3x3 conv, 128

1x1 conv, 512

recognition test comprehension test research system
1x1 conv, 128

3x3 conv, 128

1x1 conv, 512

1x1 conv, 128

3x3 conv, 128

1x1 conv, 512

1x1 conv, 128

3x3 conv, 128 Switchboard

Meeting
1x1 conv, 512 speech
1x1 conv, 128

Object recognition
3x3 conv, 128 Speech recognition
Broadcast
speech
Switchboard
cellular Machine reading Machine translation
1x1 conv, 512

Human parity 1x1 conv, 128 Human parity IBM

Switchboard
comprehension Human parity
Human parity March 2018
3x3 conv, 128

2016 1x1 conv, 512

2017
1x1 conv, 128

3x3 conv, 512

Jan 2018
1x1 conv, 512

3x3 conv, 256./2

1993 2000 2006 2010 2017
3x3 conv, 256

1x1 conv, 1024

1x1 conv, 256

3x3 conv, 256

 Microsoft AI Platform

Azure AI Services
PRE-BUILT AI CONVERSATIONAL AI CUSTOM AI CODING & MANAGEMENT TOOLS

Cognitive Services Bot Service Azure Machine Learning VS Tools

for AI Tools
Azure ML
Studio
Azure ML
Workbench

Others (PyCharm, Jupyter Notebooks…)

Azure InfrastructureAI COMPUTE

AI ON DATA
DEEP LEARNING FRAMEWORKS
3rd Party
Cosmos SQL SQL Data Batch IoT Cognitive
Spark DSVM ACS TensorFlow Caffe
DB DB DW Lake AI Edge Toolkit

Others (Scikit-learn, MXNet, Keras,

CPU, FPGA, GPU Chainer, Gluon…)
Microsoft Cognitive Services

Vision Speech Language Knowledge Search Labs

From faces to Hear and speak Process text and Tap into rich Access billions of An early look at
feelings, allow to your users learn how to knowledge amassed web pages, images, emerging Cognitive
your apps to by filtering noise, recognize what from the web, videos, and news Services
understand identifying users want academia, or your with the power of technologies:
images and video speakers, and own data Bing APIs discover, try and
understanding intent give feedback on
new technologies
before general
availability
 Azure Machine Learning Studio

Platform for emerging data scientists to

graphically build and deploy experiments
• Rapid experiment composition
• > 100 easily configured modules for data
prep, training, evaluation
• Extensibility through R & Python
• Serverless training and deployment

Some numbers:
• 100’s of thousands of deployed models
serving billions of requests
DEMO
Azure ML Studio
Machine Learning & AI Portfolio
When to use what?
Microsoft
ML & AI
products

Build your own or consume pre- Build your

Consume
trained models? own

Azure Machine Learning Cognitive services, bots

Which experience do you

Code first Visual tooling
want?

Deployment target (On-prem) (cloud) (cloud)

ML Server AML services (Preview) AML Studio

What engine(s) do you want

to use?
On- SQL SQL Spark Hadoop Azure DSVM Azure
prem Server Server Batch Container
Hadoop Service
Azure Machine Learning - Experimentation

Local machine

Scale up to DSVM

Command line tools

Scale out with Spark on HDInsight
IDEs
Notebooks in Workbench
AZURE ML Azure Batch AI (Coming Soon)
VS Code Tools for AI
E X P E R I M E N TAT I O N

ML Server
Azure Machine Learning – Model Management

Single node deployment

(cloud/on-prem)

Azure Container Service

Azure IoT Edge

AZURE ML DOCKER Microsoft ML Server

MODEL
MANAGEMENT
Spark clusters

SQL Server
Tools
Visual Studio Tools for AI
Boost productivity with code-centric AI
development and Azure integration.

Azure Machine Learning Workbench

Full lifecycle support for AI and data wrangling
productivity.

Open deep learning framework support

Full support for Cognitive Toolkit, TensorFlow,
Caffee and others.
Open standard for deep learning (ONNX).
DEMO
Azure ML Model
Management
Machine Learning & AI Portfolio
When to use what?
Microsoft
ML & AI
products

Build your own or consume pre- Build your

Consume
trained models? own

Azure Machine Learning Cognitive services, bots

Which experience do you

Code first Visual tooling
want?

Deployment target (On-prem) (cloud) (cloud)

ML Server AML services (Preview) AML Studio

What engine(s) do you want

to use?
On- SQL SQL Spark Hadoop Azure DSVM Azure
prem Server Server Batch Container
Hadoop Service