Scribd Logo
Upload

Welcome to Scribd!

  • Verihab 5

    Uploaded by

    Emir Faruk Erman
    10 views1 page
    Information is defined as the resolution of uncertainty. It is quantified as the log of the probability of an outcome, and the unit of information is bits. Information is higher for low probability outcomes than high probability outcomes since information measures the amount of surprise. Entropy measures the expected uncertainty or average amount of information in a system, and is calculated as the sum over all possible outcomes of the probability of each outcome times its information content.

    Original Description:

    Original Title

    Verihab5

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    Information is defined as the resolution of uncertainty. It is quantified as the log of the probability of an outcome, and the unit of information is bits. Information is higher for low probability outcomes than high probability outcomes since information measures the amount of surprise. Entropy measures the expected uncertainty or average amount of information in a system, and is calculated as the sum over all possible outcomes of the probability of each outcome times its information content.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    10 views1 page

    Verihab 5

    Uploaded by

    Emir Faruk Erman
    Information is defined as the resolution of uncertainty. It is quantified as the log of the probability of an outcome, and the unit of information is bits. Information is higher for low probability outcomes than high probability outcomes since information measures the amount of surprise. Entropy measures the expected uncertainty or average amount of information in a system, and is calculated as the sum over all possible outcomes of the probability of each outcome times its information content.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    of 1

    Information

    * is the resolution of uncertainty (C. Shannon (1948)

    info of an outcome/observation log P

    #Torreiom,
    -> en

    I(x)
    log(ix)
    =

    I
    =-

    logP(x)
    if base of log is then

    the unit is bits


    ↳ neder log
    -> sibistimg
    conpualor -> toplana

    Information of low probability


    * outcomes are
    higher compared to high prob.outcomes.

    (Info is a
    degree of surprise (

    *
    Entropy is
    average value of uncertainty
    expected //

    3
    burnbullan
    entropy sorarca

    H(x) 2Px(x)
    =

    logs (if(x)
    &
    xesx

    P(X x) =

    probability

    foronary outcomes
    seatstal .lossnp.cologic
    *

    Px(X,) p
    =

    Px(Xz) 1 p
    =
    -

    You might also like