Scribd Logo
Upload

Welcome to Scribd!

  • 1 1 5 How-Do-We-Enable-Tinyml 3

    Uploaded by

    Mumtaz
    23 views53 pages
    TinyML enables machine learning on embedded systems with low-power microcontrollers. It uses small neural networks and sensor data from devices to perform tasks like speech recognition with just microwatts of power. As more internet-connected devices are produced, TinyML will allow machine learning everywhere by taking advantage of microcontrollers' low cost, size, and power consumption compared to traditional computers and mobile phones.

    Original Description:

    Embedded system with machine learning

    Original Title

    1.1.5.how-do-we-enable-tinyml.3

    Copyright

    © © All Rights Reserved

    Available Formats

    PPTX, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    TinyML enables machine learning on embedded systems with low-power microcontrollers. It uses small neural networks and sensor data from devices to perform tasks like speech recognition with just microwatts of power. As more internet-connected devices are produced, TinyML will allow machine learning everywhere by taking advantage of microcontrollers' low cost, size, and power consumption compared to traditional computers and mobile phones.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pptx, pdf, or txt
    23 views53 pages

    1 1 5 How-Do-We-Enable-Tinyml 3

    Uploaded by

    Mumtaz
    TinyML enables machine learning on embedded systems with low-power microcontrollers. It uses small neural networks and sensor data from devices to perform tasks like speech recognition with just microwatts of power. As more internet-connected devices are produced, TinyML will allow machine learning everywhere by taking advantage of microcontrollers' low cost, size, and power consumption compared to traditional computers and mobile phones.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pptx, pdf, or txt
    of 53

    How Do We Enable

    TinyML?
    What Makes TinyML?

    Embedded
    Systems

    TinyML
    Machine
    Learning
    What Makes TinyML?

    Embedded
    Systems

    TinyML
    Machine
    Learning
    What Makes TinyML?

    Embedded
    Systems

    TinyML
    Machine
    Learning
    Let’s Take an Example
    Let’s Take an Example

    Google Assistant
    Let’s Take an Example

    Okay, Google!

    Hi, how can I help?


    The Three Basic Steps
    The Three Basic Steps

    Step 1
    Audio input
    from microphone (sensor)

    input
    complete
    The Three Basic Steps

    Step 1 Step 2
    Audio input Process input translation,
    from microphone (sensor) then
    execute command

    input
    complete
    The Three Basic Steps

    Step 1 Step 2 Step 3


    Audio input from Process input translation, Generate Output
    microphone (sensor) then play response through
    execute command embedded speaker

    input
    complete
    Input

    Step 1 Step 2 Step 3


    Audio input Process input translation, Generate Output
    from microphone (sensor) then play response through
    execute command embedded speaker

    input
    complete
    Endpoints Have Sensors, Tons of Sensors

    Motion Sensors Acoustic Sensors Environmental Sensors


    Gyroscope, radar, Ultrasonic, Microphones, Temperature, Humidity,
    magnetometer, accelerator Geophones, Vibrometers Pressure, IR, etc.

    Touchscreen Sensors Image Sensors Biometric Sensors


    Capacitive, IR Thermal, Image Fingerprint, Heart rate, etc.

    Force Sensors Rotation Sensors


    Pressure, Strain Encoders
    Endpoints Have Sensors, Tons of Sensors

    Motion Sensors Acoustic Sensors Environmental Sensors


    Gyroscope, radar, Ultrasonic, Microphones, Temperature, Humidity,
    magnetometer, accelerator Geophones, Vibrometers Pressure, IR, etc.

    Touchscreen Sensors Image Sensors Biometric Sensors


    Capacitive, IR Thermal, Image Fingerprint, Heart rate, etc.

    Force Sensors Rotation Sensors


    Pressure, Strain Encoders
    Biometric Sensors

    Non-invasive Glucose Monitoring Fingerprint + Photoplethysmography (PPG)

    Source: Jacobs School of Engineering/UC San Diego


    Endpoints Have Sensors, Tons of Sensors

    Motion Sensors Acoustic Sensors Environmental Sensors


    Gyroscope, radar, Ultrasonic, Microphones, Temperature, Humidity,
    magnetometer, accelerator Geophones, Vibrometers Pressure, IR, etc.

    Touchscreen Sensors Image Sensors Biometric Sensors


    Capacitive, IR Thermal, Image Fingerprint, Heart rate, etc.

    Force Sensors Rotation Sensors


    Pressure, Strain Encoders
    Endpoints Have Sensors, Tons of Sensors
    Processing

    Step 1 Step 2 Step 3


    Audio input from Process input Generate Output
    microphone (sensor) translation, then play response through
    execute command embedded speaker

    input
    complete
    Thinking Big
    Thinking Big
    Thinking Big

    BIG
    GPU / CPU
    561mm2
    Thinking Small

    BIG
    GPU / CPU
    561mm2
    Thinking Small

    BIG
    GPU / CPU
    561mm2
    Thinking Small

    BIG
    GPU / CPU SMALL
    561mm2

    Mobile SoC
    83mm2
    Thinking Tiny

    BIG
    GPU / CPU SMALL
    561mm2

    Mobile SoC
    83mm2
    Thinking Tiny

    BIG
    GPU / CPU SMALL
    561mm2

    Mobile SoC
    83mm2
    Thinking Tiny

    BIG
    GPU / CPU SMALL
    561mm2

    Mobile SoC
    83mm2
    Thinking Tiny

    BIG
    GPU / CPU SMALL TINY

    561mm2
    Apple 0778
    Mobile SoC 30mm2
    83mm2
    We’re just getting started.
    Thinking Record-breaking

    BIG
    GPU / CPU SMALL TINY

    561mm2
    Apple 0778 Kinetis KL03
    Mobile SoC 30mm2 3.2mm2
    83mm2
    Thinking Record-breaking

    world’s smallest ARM-


    Powered MCU
    48MHz, 32KB flash, 20-pin

    BIG
    GPU / CPU SMALL TINY

    561mm2
    Apple 0778 Kinetis KL03
    Mobile SoC 30mm2 3.2mm2
    83mm2
    2.0 mm

    1.6 mm
    250 Billion
    MCUs today
    MCU Demand Forecast
    Millions of Units

    forecasted

    Source: IC Insights
    MCU Demand Forecast
    Millions of Units

    forecasted

    Source: IC Insights
    MCU Pricing Forecast
    Average Selling Price

    forecasted

    Source: IC Insights
    Comparing Power

    BIG SMALL
    GPU / CPU
    140 μW
    Syntiant NDP100
    3.64W
    Apple A12

    300W
    NVIDIA Tesla K80
    Comparing Power

    BIG SMALL
    GPU / CPU
    140 μW
    Syntiant NDP100
    3.64W
    Apple A12

    300W
    NVIDIA Tesla K80
    Comparing Power
    Neural Decision Processor
    Always-on deep learning
    speech/audio recognition
    Ultra low power, 128KB SRAM,
    12-pin, 2.52mm2

    BIG SMALL
    GPU / CPU
    140 μW
    Syntiant NDP100
    3.64W
    Apple A12

    300W
    NVIDIA Tesla K80
    Comparing Power
    Neural Decision Processor
    Always-on deep learning
    speech/audio recognition
    Ultra low power, 128KB SRAM,
    12-pin, 2.52mm2

    140 μW
    Syntiant NDP100

    Use case: button cell battery


    Output

    Step 1 Step 2 Step 3


    Audio input from Process input translation, Generate Output
    microphone (sensor) then play response through
    execute command embedded speaker

    input
    complete
    Output
    Output
    Output
    MCUs enable TinyML

    LOW LOW
    SIZE
    POWER COST
    MCUs enable TinyML

    LOW LOW
    SIZE
    POWER COST
    MCUs enable TinyML

    LOW LOW
    SIZE
    POWER COST

    < 140 μW
    Syntiant NDP100
    MCUs enable TinyML

    LOW LOW
    SIZE
    POWER COST

    Average Selling Price


    MCUs enable TinyML

    LOW LOW
    SIZE
    POWER COST

    HIGH DEMAND
    What Makes TinyML?

    Embedded
    Systems

    TinyML
    Machine
    Learning
    What Makes TinyML?

    Embedded
    Systems

    TinyML
    Machine
    Learning
    What Makes TinyML?

    Embedded
    Systems

    TinyML
    Machine
    Learning
    Fullscreen. Show presenter.

    You might also like