Professional Documents
Culture Documents
Integrated Information Theory (IIT) Attempts To Explain What Consciousness Is
Integrated Information Theory (IIT) Attempts To Explain What Consciousness Is
IIT was proposed by neuroscientist Giulio Tononi in 2004, and has been
continuously developed over the past decade. The latest version of the theory,
labeled IIT 3.0, was published in 2014.[2][3]
Overview
Relationship to the "hard problem of consciousness"
Axioms: essential properties of experience
Postulates: properties required of the physical substrate
Mathematics: formalization of the postulates
Cause-effect space
Central identity
Extensions
Related experimental work
Reception
Support
Criticism
See also
References
External links
Related papers
Websites
Software
Books
News articles
Talks
Overview
Specifically, IIT moves from phenomenology to mechanism by attempting to identify the essential properties of conscious experience
(dubbed "axioms") and, from there, the essential properties of conscious physical systems (dubbed "postulates").
The wording of the axioms has changed slightly as the theory has developed, and the
most recent and complete statement of the axioms is as follows:
The properties required of a conscious physical substrate are called the "postulates," since the existence of the physical substrate is
itself only postulated (remember, IIT maintains that the only thing one can be sure of is the existence of one's own consciousness). In
what follows, a "physical system" is taken to be a set of elements, each with two or more internal states, inputs that influence that
state, and outputs that are influenced by that state (neurons or logic gates are the natural examples). Given this definition of "physical
system", the postulates are:
A system refers to a set of elements, each with two or more internal states, inputs that influence that state, and outputs that are
influenced by that state. A mechanism refers to a subset of system elements. The mechanism-level quantities below are used to
assess the integration of any given mechanism, and the system-level quantities are used to assess the integration of sets of
mechanisms ("sets of sets").
In order to apply the IIT formalism to a system, its full transition probability matrix (TPM) must be known. The TPM specifies the
probability with which any state of a system transitions to any other system state. Each of the following quantities is calculated in a
bottom-up manner from the system's TPM.
Mechanism-level quantities
A cause-effect repertoire is a set of two probability
distributions, describing how the mechanism in its current state constrains the past and future states of the
sets of system elements and , respectively.
Note that may be different from , since the elements that a mechanism affects may be different from the
elements that affect it.
A partition is a grouping of system elements, where the connections between the parts
and are injected with independent noise. For a simple binary element which outputs to a
simple binary element , injecting the connection with independent noise means that the input value which
receives, or , is entirely independent of the actual state of , thus rendering causally ineffective.
denotes a pair of partitions, one of which is considered when looking at a mechanism's causes, and the other of
which is considered when looking at its effects.
The earth mover's distance is used to measure distances between probability distributions and .
The EMD depends on the user's choice of ground distance between points in the metric space over which the
probability distributions are measured, which in IIT is the system's state space. When computing the EMD with a
system of simple binary elements, the ground distance between system states is chosen to be their Hamming
distance.
Integrated information measures the irreducibility of a cause-effect repertoire with respect to partition ,
obtained by combining the irreducibility of its constituent cause and ef
fect repertoires with respect to the same
partitioning.
The irreducibility of the cause repertoire with respect to is given by
, and similarly for the effect
repertoire.
A cause-effect structure is the set of concepts specified by all mechanisms with within the
system in its current state . If a system turns out to be conscious, its cause-ef
fect structure is often referred to as
a conceptual structure.
A unidirectional partition is a grouping of system elements where the connections from the set of
elements to are injected with independent noise.
The extended earth mover's distance is used to measure the minimal cost of transforming cause-
effect structure into structure . Informally, one can say that–whereas the EMD transports the probability of a
system state over the distance between two system states–the XEMD transports the strength of a concept over the
distance between two concepts.
In the XEMD, the "earth" to be transported is intrinsic cause-effect power ( ), and the ground distance between
concepts and with cause repertoires and and effect repertoires and is given by
.
The intrinsic cause-effect powerof a set of elements in a state is given by , such that
for any other with , . According to IIT, a system's is the degree to which it can
be said to exist.
A complex is a set of elements with , and thus specifies a maximally irreducible cause-
effect structure, also called a conceptual structure. According to IIT, complexes are conscious entities.
Cause-effect space
For a system of simple binary elements, cause-effect space is formed by axes, one for each possible past and future state
of the system. Any cause-effect repertoire , which specifies the probability of each possible past and future state of the system, can
be easily plotted as a point in this high-dimensional space: The position of this point along each axis is given by the probability of
that state as specified by . If a point is also taken to have a scalar magnitude (which can be informally thought of as the point's
"size", for example), then it can easily represent a concept: The concept's cause-effect repertoire specifies the location of the point in
cause-effect space, and the concept's value specifies that point's magnitude.
In this way, a conceptual structure can be plotted as a constellation of points in cause-effect space. Each point is called a star, and
each star's magnitude ( ) is its size.
Central identity
IIT addresses the mind-body problem by proposing an identity between phenomenological properties of experience and causal
properties of physical systems:The conceptual structure specified by a complex of elements in a state is identical to its experience.
Specifically, the form of the conceptual structure in cause-effect space completely specifies the quality of the experience, while the
irreducibility of the conceptual structure specifies the level to which it exists (i.e., the complex's level of consciousness). The
maximally irreducible cause-effect repertoire of each concept within a conceptual structure specifies what the concept contributes to
the quality of the experience, while its irreducibility specifies how much the concept is present in the experience.
Extensions
The calculation of even a modestly-sized system's is often computationally intractable, so efforts have been made to develop
heuristic or proxy measures of integrated information. For example, Masafumi Oizumi has developed , a practical approximation
for integrated information that solves the theoretical shortcomings of previously proposed proxy measures,[6] such as the one
proposed by Adam Barrett.[7]
A significant computational challenge in calculating integrated information is finding the Minimum Information Partitionof a neural
system, which requires iterating through all possible network partitions. To solve this problem, Daniel Toker has suggested using the
[8]
most modular decomposition of a network as an extremely quick proxy for the Minimum Information Partition.
Despite these challenges, researchers have attempted to use measures of information integration and differentiation to assess levels of
consciousness in a variety of subjects.[9][10] For instance, a recent study using a less computationally-intensive proxy for was
able to reliably discriminate between varying levels of consciousness in wakeful, sleeping (dreaming vs. non-dreaming),
[11]
anesthetized, and comatose (vegetative vs. minimally-conscious vs. locked-in) individuals.
IIT also makes several predictions which fit well with existing experimental evidence, and can be used to explain some
counterintuitive findings in consciousness research.[12] For example, IIT can be used to explain why some brain regions, such as the
cerebellum do not appear to contribute to consciousness, despite their size and/or functional importance.
Reception
Integrated Information Theory has received both broad criticism and support.
Support
Neuroscientist Christof Koch, who has helped to develop the theory, has called IIT "the only really promising fundamental theory of
consciousness".[13] Technologist Virgil Griffith says "IIT is currently the leading theory of consciousness."
[14]
Criticism
Challenges to IIT:
ficient.[15]
IIT proposes conditions which are necessary for consciousness, but are not entirely suf
[16]
IIT claims that all of its axioms are self-evident.
Since IIT is not a functionalist theory of consciousness, criticisms of non-functionalism have been levied against
it.[16]
[15][16]
The limits of IIT's definition of consciousness have led to criticism.
See also
Causality Phenomenology (philosophy)
Consciousness Phenomenology (psychology)
Hard problem of consciousness Philosophy of mind
Mind–body problem Qualia
Neural correlates of consciousness Sentience
References
1. Tononi, Giulio; Boly, Melanie; Massimini, Marcello; Koch, Christof."Integrated information theory: from
consciousness to its physical substrate"(http://www.nature.com/doifinder/10.1038/nrn.2016.44). Nature Reviews
Neuroscience. 17 (7): 450–461. doi:10.1038/nrn.2016.44 (https://doi.org/10.1038%2Fnrn.2016.44). PMID 27225071
(https://www.ncbi.nlm.nih.gov/pubmed/27225071).
2. Oizumi, Masafumi; Albantakis, Larissa; T
ononi, Giulio (2014-05-08). "From the Phenomenology to the Mechanisms
of Consciousness: Integrated Information Theory 3.0"(https://dx.doi.org/10.1371/journal.pcbi.1003588)
. PLoS
Comput Biol. 10 (5): e1003588. doi:10.1371/journal.pcbi.1003588(https://doi.org/10.1371%2Fjournal.pcbi.1003588)
.
PMC 4014402 (https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4014402) . PMID 24811198 (https://www.ncbi.nlm.ni
h.gov/pubmed/24811198).
3. "Integrated information theory - Scholarpedia"(http://www.scholarpedia.org/article/Integrated_information_theory).
www.scholarpedia.org. Retrieved 2015-11-23.
4. Albantakis, Larissa; Tononi, Giulio (2015-07-31). "The Intrinsic Cause-Effect Power of Discrete Dynamical Systems
—From Elementary Cellular Automata to Adapting Animats"(http://www.mdpi.com/1099-4300/17/8/5472). Entropy.
17 (8): 5472–5502. doi:10.3390/e17085472 (https://doi.org/10.3390%2Fe17085472).
5. "CSC-UW/iit-pseudocode"(https://github.com/CSC-UW/iit-pseudocode). GitHub. Retrieved 2016-01-29.
6. Oizumi, Masafumi; Amari, Shun-ichi; Yanagawa, Toru; Fujii, Naotaka; Tsuchiya, Naotsugu (2015-05-17). "Measuring
integrated information from the decoding perspective".PLOS Computational Biology. 12 (1): e1004654.
arXiv:1505.04368 (https://arxiv.org/abs/1505.04368) . doi:10.1371/journal.pcbi.1004654(https://doi.org/10.1371%2
Fjournal.pcbi.1004654).
7. Barrett, A.B.; Seth, A.K. (2011). "Practical measures of integrated information for time-series data".
PLoS Comput.
Biol. 7 (1): e1001052. doi:10.1371/journal.pcbi.1001052(https://doi.org/10.1371%2Fjournal.pcbi.1001052) .
8. Toker, Daniel; Sommer, Friedrich (2016-05-03). "Moving Past the Minimum Information Partition: How to Quickly and
Accurately Calculate Integrated Information".arXiv:1605.01096 (https://arxiv.org/abs/1605.01096) .
9. Massimini, M.; Ferrarelli, F.; Murphy, Mj; Huber, R.; Riedner, Ba; Casarotto, S.; Tononi, G. (2010-09-01)."Cortical
reactivity and effective connectivity during REM sleep in humans" (https://www.ncbi.nlm.nih.gov/pmc/articles/PMC29
30263). Cognitive Neuroscience. 1 (3): 176–183. doi:10.1080/17588921003731578(https://doi.org/10.1080%2F175
88921003731578). ISSN 1758-8936 (https://www.worldcat.org/issn/1758-8936). PMC 2930263 (https://www.ncbi.nl
m.nih.gov/pmc/articles/PMC2930263) . PMID 20823938 (https://www.ncbi.nlm.nih.gov/pubmed/20823938).
10. Ferrarelli, Fabio; Massimini, Marcello; Sarasso, Simone; Casali, Adenauer; Riedner , Brady A.; Angelini, Giuditta;
Tononi, Giulio; Pearce, Robert A. (2010-02-09). "Breakdown in cortical effective connectivity during midazolam-
induced loss of consciousness"(https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2823915). Proceedings of the
National Academy of Sciences of the United States of America . 107 (6): 2681–2686. doi:10.1073/pnas.0913008107
(https://doi.org/10.1073%2Fpnas.0913008107) . ISSN 1091-6490 (https://www.worldcat.org/issn/1091-6490).
PMC 2823915 (https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2823915) . PMID 20133802 (https://www.ncbi.nlm.ni
h.gov/pubmed/20133802).
11. Casali, Adenauer G.; Gosseries, Olivia; Rosanova, Mario; Boly, Mélanie; Sarasso, Simone; Casali, Karina R.;
Casarotto, Silvia; Bruno, Marie-Aurélie; Laureys, Steven; Massimini, Marcello (2013-08-14)."A Theoretically Based
Index of Consciousness Independent of Sensory Processing and Behavior" (http://stm.sciencemag.org/content/5/19
8/198ra105). Science Translational Medicine. 5 (198): 198ra105–198ra105.doi:10.1126/scitranslmed.3006294(http
s://doi.org/10.1126%2Fscitranslmed.3006294) . ISSN 1946-6234 (https://www.worldcat.org/issn/1946-6234).
PMID 23946194 (https://www.ncbi.nlm.nih.gov/pubmed/23946194).
12. "Integrated information theory - Scholarpedia"(http://www.scholarpedia.org/article/Integrated_information_theory#Pr
edictions_and_explanations). www.scholarpedia.org. Retrieved 2016-01-28.
13. Zimmer, Carl (2010-09-20). "Sizing Up Consciousness by Its Bits"(https://www.nytimes.com/2010/09/21/science/21c
onsciousness.html). The New York Times. ISSN 0362-4331 (https://www.worldcat.org/issn/0362-4331). Retrieved
2015-11-23.
14. "How valid is Giulio Tononi's mathematical formula for consciousness?"(https://www.quora.com/How-valid-is-Giulio-T
ononis-mathematical-formula-for-consciousness/answer/V irgil-Griffith-1).
15. "Shtetl-Optimized » Blog Archive » Why I Am Not An Integrated Information Theorist (or
, The Unconscious
Expander)" (http://www.scottaaronson.com/blog/?p=1799). www.ScottAaronson.com. Retrieved 23 November 2015.
16. Cerullo, Michael A.; Kording, Konrad P. (17 September 2015). "The Problem with Phi: A Critique of Integrated
Information Theory". PLOS Computational Biology. 11 (9): e1004286. doi:10.1371/journal.pcbi.1004286(https://doi.o
rg/10.1371%2Fjournal.pcbi.1004286).
External links
Related papers
Integrated information theory: from consciousness to its physical substrate
Integrated information theory (Scholarpedia)
From the Phenomenology to the Mechanisms of Consciousness: Integrated Information Theory 3.0
Integrated Information Theory: An Updated Account (2012) (First presentation of IIT 3.0)
Integrated Information Theory: A Provisional Manifesto (2008) (IIT 2.0)
An Information Integration Theory of Consciousness (2004) (IIT 1.0)
Websites
IntegratedInformationTheory.org: resource for learning about IIT; features a graphical user interface toPyPhi.
"Integrated Information Theory of Consciousness" . Internet Encyclopedia of Philosophy.
Software
PyPhi: an open-source Python library for calculating integrated information and related quantities.
Books
Phi: A Voyage from the Brain to the Soul
News articles
Nautilus (2017): Is Matter Conscious?
Aeon (2016): Consciousness creep
MIT Technology Review (2014):What It Will Take for Computers to Be Conscious
Wired (2013): A Neuroscientist's Radical Theory of How Networks Become Conscious
The New Yorker (2013): How Much Consciousness Does an iPhone Have?
New York Times (2010): Sizing Up Consciousness by Its Bits
Scientific American (2009):A "Complex" Theory of Consciousness
IEEE Spectrum (2008):A Bit of Theory: Consciousness as Integrated Information Theory
Talks
David Chalmers (2014):How do you explain consciousness?
Christof Koch (2014): The Integrated Information Theory of Consciousness
Text is available under theCreative Commons Attribution-ShareAlike License ; additional terms may apply. By using this
site, you agree to the Terms of Use and Privacy Policy. Wikipedia® is a registered trademark of theWikimedia
Foundation, Inc., a non-profit organization.