Professional Documents
Culture Documents
Homeostasis and Soft Robotics in The Design of Feeling Machines (Damasio)
Homeostasis and Soft Robotics in The Design of Feeling Machines (Damasio)
https://doi.org/10.1038/s42256-019-0103-7
Attempts to create machines that behave intelligently often conceptualize intelligence as the ability to achieve goals, leaving
unanswered a crucial question: whose goals? In a dynamic and unpredictable world, an intelligent agent should hold its own
meta-goal of self-preservation, like living organisms whose survival relies on homeostasis: the regulation of body states aimed
at maintaining conditions compatible with life. In organisms capable of mental states, feelings are a mental expression of the
state of life in the body and play a critical role in regulating behaviour. Our goal here is to inquire about conditions that would
potentially allow machines to care about what they do or think. Under certain conditions, machines capable of implementing a
process resembling homeostasis might also acquire a source of motivation and a new means to evaluate behaviour, akin to that
of feelings in living organisms. Drawing on recent developments in soft robotics and multisensory abstraction, we propose a
new class of machines inspired by the principles of homeostasis. The resulting machines would (1) exhibit equivalents to feel-
ing; (2) improve their functionality across a range of environments; and (3) constitute a platform for investigating conscious-
ness, intelligence and the feeling process itself.
W
e propose the design and construction of a new class of intelligent solutions to the tasks set before it—that is, augment the
machines organized according to the principles of life reach of its cognitive skills.
regulation, or homeostasis. These machines have physical We bring a biological perspective to the effort to produce
constructions—bodies—that must be maintained within a narrow machines with an artificial equivalent of feeling. For this effort, we
range of viability states and thus share some essential traits with all will rely on recent developments from two fields: materials science
living systems. The fundamental innovation of these machines is and computer science. Turning first to new materials, we note that the
the introduction of risk-to-self. Rather than up-armouring or add- past decade has witnessed the birth of a sub-discipline, soft robotics.
ing raw processing power to achieve resilience, we begin the design This was enabled by new discoveries in the design and construction
of these robots by, paradoxically, introducing vulnerability. of soft ‘tissues’ embedded with electronics, sensors and actuators.
Living organisms capable of mentation are fragile vessels of pain, These artificial tissues are flexible, stretchable, compressible and
pleasure and points in between. It is by virtue of that fragility that bounce back resiliently—in short, they are naturally compliant with
they gain access to the realm of feeling. The main motivation for their environments. Combined with conventional parameters such
this project is a set of theoretical contributions to the understand- as temperature and energy level, soft materials potentially provide a
ing of biological systems endowed with feeling. Damasio1 has pro- rich source of information on body and environment.
vided a rationale for the emergence of feelings from the physiology The second development concerns statistical machine learn-
of life regulation. Feelings are intrinsically about something: mak- ing algorithms for the creation of abstract representations. New
ing it possible for an organism to gravitate towards states of at least computational techniques may allow us to bring maps of the inner
good and preferably optimal life regulation, thus maintaining life and outer worlds into register. There has been enormous attention
and extending it into the future. We must add that, in our conceptu- paid to the capabilities of deep learning, but here we focus on one
alization, feelings are of necessity conscious, and play a critical role particular application of the technology: its ability to bridge across
in the machinery of consciousness. sensory modalities, including not only exteroception but also the
For the homeostatic machines we envision, behaviours can carry modalities concerned with internal organism states—interoception
real consequences. The world affords risks and opportunities, not and proprioception. This advance provides a crucial piece of the
in relation to an arbitrary reward or loss function, but in relation to puzzle of how to intertwine a system’s internal homeostatic states
the continued existence of the machine itself and, more to the point, with its external perceptions and behaviour.
to the quality of feeling that is the harbinger of the good or bad
outcome relative to survival. Rewards are not rewarding and losses Self-interest as fount of creativity
do not hurt unless they are rooted in life and death. True agency Today’s robots lack feelings. They are not designed to represent the
arises when the machine can take a side in this dichotomy, when internal state of their operations in a way that would permit them
it acts with a preference for (or, seen from a different angle, makes to experience that state in a mental space. They also lack selfhood
a reliable prediction of2) existence over dissolution. A robot engi- and ‘aboutness’. All these shortcomings are related. It is true that
neered to participate in its own homeostasis would become its own present-day intelligent machines perform extremely well in narrow
locus of concern. This elementary concern would infuse mean- domains, but they fare poorly in unconstrained interactions with
ing into its particular information processing3. A robot operating the real world. Our approach diverges from traditional concep-
on intrinsically meaningful representations might seek especially tions of intelligence that emphasize outward-directed perception
Brain and Creativity Institute, Dornsife College of Letters, Arts and Sciences, University of Southern California, Los Angeles, CA, USA.
e-mail: kman@usc.edu; damasio@usc.edu
A B
C D
Uniselector
Output
cap to other
acit A
anc Homeostat
e modules
element
resistance (pivoting Position
magnet) of the plate
B determines
ry
tte voltage to
Ba uniselector
Summed
effect of coil and to A coils
C
magnetic fields of other modules
on pivoting
D magnet
Coils
Fig. 1 | Ashby’s homeostat of 1954 exhibited some self-restoring stability. Composed of four identical electrical-magnetic modules, each exerting effects
on the others, the system executed a search for a globally stable state when the voltage (V) of one module exceeded some critical value of error (e) from
the null state. Reproduced from ref. 9, Taylor & Francis.
comparison to its niche—our human environment—that its integ- This is not to say that soft materials are necessarily weaker or
rity and viability is not a consideration. This is why metals and hard less resistant to mechanical damage than hard materials30. Soft mat-
plastics are ubiquitous in robotics: precisely so that, in most cases, ter admits of greater complexity and of more ways to regulate and
material integrity can be safely assumed. be regulated. Soft materials accommodate themselves to objects
Yet durability comes at a cost. An invulnerable material has rather than shoving objects aside. Under stress, they deform with-
nothing to say about its well-being. It rarely encounters existential out breaking, then enter dysfunction or gradual decline instead of
threats. If we imagine strain gauges embedded throughout a hard suffering sudden catastrophic failures. In many cases, soft materials
surface, they would spend most of their time reporting ‘no change’. can self-heal, regaining much, if not all, of their pre-injury struc-
The hard knocks of life accumulate until finally a catastrophic fail- tural and electrical properties (reviewed in refs. 31,32). In a coup of
ure occurs, and the sensors cry out in unison. The rigid robot pres- engineering, Cao et al.33 demonstrated an electronic gel skin that
ents a monolithic and implacable face to the world, unfeeling by can self-heal after a cut (via ionic interactions); can sense touch,
design, its function decoupled from its constitution. pressure, and strain; and function in wet or dry conditions!
Soft robots, on the other hand, more readily enter into a Soft materials have continuously varying morphology, with more
graceful and sensitive coupling with the environment (Fig. 2a; points of contact, control and force dispersion. They densely sam-
see reviews23–28). Beginning with vulnerability as a design principle ple the environment across multiple modalities, including pressure,
for robots, we propose to extend it down to the very stuff out of stretch, temperature and energy level, and return rich information
which the robot is made. Continuing the example we advanced about the evolving interaction. While not sufficient to generate feel-
earlier, the same strain gauges embedded in the volume of a soft ing on its own, soft matter is more likely to naturally create the kind
material can localize forces and signal graded disruptions in body of relationship that, we expect, admits of an approximation to feeling.
surface continuity, such as those caused by punctures and tears. As an example, consider the robotic octopus arm constructed of
As a realized example, Markvicka et al.29 fabricated a soft elec- silicone and actuated by tendons34 (Fig. 2b). It executes an envelop-
tronic ‘skin’ that localizes and can trigger responses to damage. ing, coiled grip on an irregular surface not by calculating an analyti-
They impregnated an elastomer base with droplets of liquid metal cal solution of applied torques to each of its microscopic ‘joints’, but
that, on rupture, cause changes in electrical conductivity across the rather by conforming itself to the object. To some extent, it holds
damaged surface. by allowing itself to be held. Its grip on the world is achieved not by
300 µm
Hair shaft
0.5 mm
5 mm
Sweat pore
Dermal papilla
Meissner’s corpuscle
(tactile corpuscle)
Stratum corneum
Pigment layer Epidermis
Stratum germinativum
Stratum spinosum
Stratum basale
2 cm 500 µm Dermis
Arrector pili muscle
Sebaceous gland
Hair follicle
Papilla of hair
Subcutis
Nerve fiber
(hypodermis)
1 cm
LM Elastomer Vein
droplet matrix Artery
Blood and
lymph vessels
Sweat gland
Conductive
LM network Pacinian corpuscle
Conductive LM network
Indication
of damage
Fig. 2 | Artificial and natural soft materials. a, Soft electronics can be embedded on flexible and stretchable substrates. LM, liquid metal. b, Soft robotic
effectors grip by conforming to the object. c, Human skin contains dense embeddings of sensors and effectors for the maintenance of its own integrity.
Reproduced from ref. 23, AAAS (a, top three rows); ref. 29, Wiley (a, bottom row); and ref. 24, Elsevier (b). Credit: National Cancer Institute (c).
high-level object cognition but by its own material properties. To a vibration and pressure, thus constituting the interface between self
considerable extent, so is feeling in biological creatures. and world. And yet the skin is exquisitely vulnerable. A tiny insect’s
The sensors of a living organism are themselves alive and vulner- jaws can breach the skin and create a large disturbance to the organ-
able to the conditions they are sensing. The retina is not an indiffer- ism. In fact, this literal hair-trigger sensitivity is one of the ‘pur-
ent piece of silicon, but a curved sheet of photoreceptor cells resting poses’ of skin. The skin’s registration and amplification of signals
on a bed of capillaries, all bathed in a saline jelly, surrounded by of attack, a loved one’s caresses or the sun’s rays, provides critical
pain sensors and defended by an ultra-rapidly deploying physical information regarding the ongoing governance of life. Things can
barrier: the eyelid. go well or very badly for soft materials, in more and more interest-
To take another example from biology, consider the near-mirac- ing ways than for hard matter.
ulous material called skin (Fig. 2c). In its totality, the skin is the Softness can be computationally modelled as a mesh or lattice
largest of the viscera in the human organism, and contains dense of small enough components interacting in large enough numbers.
embeddings of sensory, motor, nutrient exchange and self-repair The main challenge is to simulate the material at a high enough
systems. Furthermore, the individual cells comprising the skin not resolution for softness to be able to emerge while remaining com-
only contain their own life-maintenance systems, as all other vis- putationally tractable. Efficient algorithms have been developed
cera do, but skin cells also register itch, pain, temperature, stretch, to model the dynamics of soft robots35,36, even when composed of
heterogeneous materials37. Evolutionary algorithms have also been tissues and in charge of its own self-regulation will have a wealth of
applied to the problem of generating soft robot morphologies and internal data on which to draw to inform its plans and perceptions.
the corresponding motor patterns38. The vast expansion of degrees A proposal has been made that the feeling of existence itself, or of
of movement freedom in soft robots parallels a vast expansion of conscious presence, may be due to predictive coding of internal sen-
sensitivity and control. The ensuing complexity of simulation is well sations57. The homeostatic robot will process information with the
worth it because soft materials present a larger opportunity space aid of something akin to feeling. How does the colour, taste and
for maintenance and upkeep—a larger stage for a model of homeo- texture, say, of an apple, systematically associate with changes to the
stasis and feelings to play out on. ongoing management of life? All of which is to say that the question
We would also call attention to the interesting case of biohybrid ‘how does this make you feel?’ might be asked of machines.
systems, which integrate conventional or soft robotic materials with
engineered cells (reviewed in ref. 39). Muscle tissues may be inte- Questions and objections
grated into miniature robots for small-scale actuation, or bacterial We already have our hands full teaching robots to drive our cars and
cells into hydrogels for long-term sensing and computing40. The sweep our floors. Why add new failure modes? Why worry about
caveat, however, is that adding living cells or tissues to more conven- the Roomba catching a cold? The prospect of adding vulnerability
tional materials may muddy the waters in the goal of understanding and self-interest to robots provokes a set of common concerns. We
the principles behind feeling machines. Putting chunks of biological attempt to address them here.
matter in machines may very well get us some softness and feeling
‘for free’, without explicitly modelling them. Reward, reinforcement and overhead costs of homeostasis. The
addition of physical vulnerability opens the robot’s behaviour to new
Computing cross-modal associations. The dream of building a richness. We use the body to implicitly compute a high-dimensional
robot with a homeostatic self-representation would present a com- reward function, for which an explicit analytical solution is out of
plex exercise in machine learning but it could draw on neuroscience reach. Reward functions are employed in reinforcement learning
facts and theory—for example, on a neuro-architectural frame- (RL), a computational framework that originated from the behav-
work originally proposed in 198941,42. According to this framework, iourist tradition of psychology. In computational studies, RL can be
sensory inputs coalesce into abstract concepts by being progres- used to train a system to perform a complex, multi-step behaviour
sively remapped in a neural hierarchical fashion, with each higher by designing an appropriate reward function for it to maximize. A
level registering more complex features. Nodes in each level also chief difficulty is to define the reward function with enough speci-
re-instantiate their lower-level constituent features by top-down ficity to bring about the intended goal state. Another difficulty is
projections. This convergence–divergence architecture can form the requirement of enormous amounts of experiential data—on the
representations that bridge across the sensory modalities43,44. order of millions of trials and errors—to learn complex behaviour.
There is an intriguing correspondence between the biologically Machines can acquire vast experience in accelerated computer sim-
implemented convergence–divergence architecture and some vari- ulations, but this is not possible for organisms constrained by the
ants of deep neural networks. Deep Boltzmann machines45 (DBMs; material and temporal limits of physical reality.
introduced in refs. 46,47), for example, learn hierarchical representa- We regard RL as a powerful tool for certain classes of prob-
tions of sensory inputs in a stepwise manner, with increasingly com- lems, but RL in general should not be confused or identified with
plex internal features acquired as the hierarchy is climbed. DBMs a homeostatic system architecture. We specify a particular target
are also generative in that they attempt to reconstruct, at each level for optimization (homeostatic well-being) and build in a necessary
back down the hierarchy, the learned features and ultimately the linkage to the physical integrity of the body. In so doing, we hope to
original pattern of sensory energy corresponding to the stimulus. reframe terms used by RL practitioners such as reward, punishment
Visual recognition of written digits was one of the earliest practi- and motivation, which, for the most part, lack grounding in biologi-
cal uses of neural networks48, with auditory speech recognition of cal and phenomenological reality.
digits following somewhat later49. Today’s networks can learn rep- On this point, we are encouraged by a strain of computational
resentations that bridge across the auditory and visual modalities work58–60 that builds bridges between organism homeostasis, emo-
to perform cross-modal recognition. Ngiam et al.50 used DBMs and tions and RL (see ref. 61). Keramati and Gutkin60 mathematically
autoencoders to perform audiovisual speech recognition, training model RL as the traversal of a multidimensional homeostatic space,
on auditory data to recognize the corresponding videos of lip move- in which each dimension corresponds to a physiological parameter
ments. Recognition of objects across the auditory and visual modal- and has an optimal value. Reward, in this perspective, is not identi-
ities followed soon after51. Curiously, audiovisual-invariant object fied with bonbons or dollars or videogame points, but rather with
representations were discovered in the human brain around the anything that moves the agent towards the location in homeostatic
same period52. Other modalities have since joined the algorithmic space that minimizes distance to the various optima. As a reviewer
fray, including the significant combination of vision with motor and of Keramati and Gutkin’s work put it, this makes “reinforcement
touch modalities53. Keeping pace with the algorithms, the human learning accountable to homeostatic imperatives.” Recent work has
brain has been mapped for cross-modal correspondences among extended this homeostatic RL framework to address high-level cog-
vision and touch54, and among vision, hearing and touch55. nitive, social and economic behaviours62, and considered its relation
Crucially, cross-modal processing is not limited to combinations to active inference63.
of external (exteroceptive) sensory modalities, but can also accom-
modate the internal (proprioceptive and interoceptive) modalities. The well-behaved robot. We aim to build robots with a sense of
Damasio56 has proposed that a key to generating a self-perspective self-preservation. What could possibly go wrong with such an
is the integration of exteroceptive information (from visual cortices, endeavour? Stories about robots often end poorly for their human
for example) with information from sensory portals (such as the creators. We seem to be unsettled by the moral status of artefacts
frontal eye fields) and the musculoskeletal frame, which provides a imbued with lifelike qualities. If a genuinely feeling machine’s exis-
stable anchor for the evolving sensory processing. tence would be threatened by humans, would it necessarily respond
We suggest that deep neural networks are poised to tackle the in violent self-defence? We suggest not, provided, for example, that
next great challenge of building correspondences between inner in addition to having access to its own feelings, it would be able to
space and outer space, between internal homeostatic data and know about the feelings of others—that is, if it would be endowed
external sense data. A machine constructed of soft and sensitive with empathy. For some of the problems arising from giving some
But is it the real thing?. Would a homeostatic robot be, at best, a Received: 29 April 2019; Accepted: 4 September 2019;
simulacrum, replicating some of the behaviours and mechanisms Published online: 9 October 2019
of living organisms but missing a key ingredient of the real thing?
Is the ‘wet’ biochemistry of cellular tissue required for authentic References
homeostasis and for the mental experience we call feeling? These 1. Damasio, A. The Strange Order of Things: Life, Feeling, and the Making of
are important and open questions (Box 1). Can all mental phenom- Cultures (Pantheon, 2018).
ena be reduced to information processing, implementable on any 2. Friston, K. The free-energy principle: a unified brain theory? Nat. Rev.
arbitrary computing medium? A computer simulation of a hurri- Neurosci. 11, 127–38 (2010).
3. Kolchinsky, A. & Wolpert, D. H. Semantic information, autonomous agency
cane won’t get us wet68, but might simulation of thought, itself being and non-equilibrium statistical physics. Interface Focus 8, 20180041 (2018).
information processing, result in real thinking? 4. Kiverstein, J. D. & Rietveld, E. Reconceiving representation-hungry cognition:
Here we must entertain the possibility that true feeling—the sort an ecological-enactive proposal. Adapt. Behav. 26, 147–163 (2018).
of mental state that humans experience when we feel—may indeed 5. Shannon, C. E. The mathematical theory of communication. Bell Syst. Tech. J.
27, 379–423 (1948).
be restricted to wet biological tissue and may not be realizable on
6. Anderson, M. L. Embodied cognition: a field guide. Artif. Intell. 149,
non-living artefacts. The wetness hypothesis predicts that the poten- 91–130 (2003).
tially crucial mechanisms behind feeling are impossible to realize 7. Froese, T. & Ziemke, T. Enactive artificial intelligence: investigating the
in alternative materials, due to their lack of the physicochemical systemic organization of life and mind. Artif. Intell. 173, 466–500 (2009).