Scribd Logo
Upload

Welcome to Scribd!

  • Interpretable Ai Not Just For Regulators

    Uploaded by

    Ko Duan
    9 views18 pages
    This document discusses machine learning interpretability and provides ideas on how to make machine learning models more interpretable and transparent. It discusses the challenges of interpreting complex machine learning models compared to simpler linear models. It then presents some approaches for interpreting machine learning models, including partial dependence plots, surrogate models, and local interpretable model-agnostic explanations. The document emphasizes that interpretability can help increase fairness, accountability, and trust in machine learning systems by providing explanations for predictions and quantifying prediction uncertainty. Overall, it argues that interpretability is important for enhancing understanding and trust in machine learning.

    Original Description:

    Original Title

    Interpretable Ai Not Just for Regulators

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    This document discusses machine learning interpretability and provides ideas on how to make machine learning models more interpretable and transparent. It discusses the challenges of interpreting complex machine learning models compared to simpler linear models. It then presents some approaches for interpreting machine learning models, including partial dependence plots, surrogate models, and local interpretable model-agnostic explanations. The document emphasizes that interpretability can help increase fairness, accountability, and trust in machine learning systems by providing explanations for predictions and quantifying prediction uncertainty. Overall, it argues that interpretability is important for enhancing understanding and trust in machine learning.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    9 views18 pages

    Interpretable Ai Not Just For Regulators

    Uploaded by

    Ko Duan
    This document discusses machine learning interpretability and provides ideas on how to make machine learning models more interpretable and transparent. It discusses the challenges of interpreting complex machine learning models compared to simpler linear models. It then presents some approaches for interpreting machine learning models, including partial dependence plots, surrogate models, and local interpretable model-agnostic explanations. The document emphasizes that interpretability can help increase fairness, accountability, and trust in machine learning systems by providing explanations for predictions and quantifying prediction uncertainty. Overall, it argues that interpretability is important for enhancing understanding and trust in machine learning.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    of 18

    Ideas

    on Machine Learning Interpretability


    Patrick Hall, Wen Phan, SriSatish Ambati and the H2O.ai team
    Big Ideas
    Learning from data …

    Adapted from:
    Learning from Data. https://work.caltech.edu/textbook.html
    Learning from data …
    transparently.

    (explain predictions with reason codes)

    EXPLAIN
    HYPOTHESIS
    h ≈ g, βj g(x(i)j), g(x(i)(-j))

    Adapted from:
    Learning from Data. https://work.caltech.edu/textbook.html
    Increasing fairness, accountability, and trust by
    decreasing unwanted sociological biases

    Source: http://money.cnn.com/, Apple Computers


    Increasing trust by quantifying prediction variance

    Source: http://www.vias.org/tmdatanaleng/
    A framework for interpretability
    Complexity of learned functions: Scope of interpretability:
    • Linear, monotonic Global vs. local
    • Nonlinear, monotonic
    • Nonlinear, non-monotonic

    (~ Number of parameters/VC dimension)

    Enhancing trust and understanding: Application domain:


    the mechanisms and results of an Model-agnostic vs. model-specific
    interpretable model should be both
    transparent AND dependable.

    Understanding ~ transparency
    Trust ~ fairness and accountability
    7
    Big Challenges
    Linear Models
    Strong model locality
    Usually stable models and explanations

    Machine Learning
    Weak model locality
    Sometimes unstable models and explanations
    (a.k.a. The Multiplicity of Good Models )
    𝑔 𝑥 = 0.8 𝑥

    Number of Purchases
    Linear Models
    Wasted marketing.

    Exact explanations for


    Lost profits.
    approximate models.
    “For a one unit increase in age, the number
    of purchases increases by 0.8 on average.”
    Age

    𝑔 𝑥 ≈ 𝑓(𝑥)

    Number of Purchase
    “Slope begins to
    decrease here. Act to
    optimize savings.”
    Machine Learning “Slope begins to
    increase here sharply.
    Approximate explanations Act to optimize profits.”

    for exact models.

    Age
    A Few of Our Favorite Things
    Partial dependence plots

    HomeValue ~ MedInc + AveOccup + HouseAge + AveRooms

    Source: http://statweb.stanford.edu/~tibs/ElemStatLearn/printings/ESLII_print10.pdf
    Surrogate models
    Local interpretable model-agnostic explanations

    Source: https://www.oreilly.com/learning/introduction-to-local-interpretable-model-agnostic-explanations-lime
    Variable importance measures
    Global variable
    importance indicates the
    impact of a variable on
    the model for the entire
    training data set.

    Local variable
    importance can indicate
    the impact of a variable
    for each decision a model
    makes – similar to reason
    codes.
    Resources
    Machine Learning Interpretability with
    H2O Driverless AI
    https://www.h2o.ai/wp-content/uploads/2017/09/MLI.pdf
    (OR come by the booth!!)

    Ideas on Interpreting Machine Learning


    https://www.oreilly.com/ideas/ideas-on-interpreting-machine-learning

    FAT/ML
    http://www.fatml.org/
    Questions?

    You might also like