SCIENCE, TECHNOLOGY AND SOCIETY
C / JOANA BEATRICE SIBAL & ALIZAH JOY CUETO
CHAPTER 6: WHEN TECHNOLOGY AND HUMANITY CROSS
TOPIC OUTLINE
1 The Ethical Dilemmas of Robotics
2 Human, Morals and Machines
3 Why the Future Does Not Need Us?
A. The Ethical Dilemmas of Robotics
Technological progress has brought many amazing
achievements in the past century, like fast travel and
instant communication.
Androids
• robots that are just like humans and aware of
themselves
• Challenging to create
• Even though we've made progress, fully human-like
robots are still a long way off.
• Technology → advancing rapidly → some think it's
just a matter of time
But if these robots become a reality, there will be a lot Midea – can make Talos immortal in exchange with
of ethical issues to deal with.
Definition
ROBOT
a humanoid robot created by Honda in 2000
• no clear agreement on its exact definition
• Generally agreed that it possess attributes such as
mobility, intelligent behavior, sense and manipulation
of environment
• goes beyond just “androids”
Karel Capek (Rossum’s Universal Robots,
R.U.R, 1920)
• first to use the word “robot”
• “robota” – “work” from Slavic language
• “artificial people” were created to serve and were
given the ability to think
Although the term "robot" originated in 1920, the
concept of mechanical humans dates back to Greek
mythology.
Ancient Times
ROBOTS
• “mechanical human” - as depicted in Greek Mythology
BALICLIC. GUALTER. PAYOS. TOMOCO | 2207
GED SEM
109 O2
• Servants of Greek God Hephaestus (God of Fire
and the Forge)
o built robots out of gold which where his
“helpers” and life-size golden handmaidens
who helped around the house
• Myth of Pygmalion - carefully crafted a statue of
Galatea that would come to life thru the Goddess
Venus
700 BCE
Hephaestus (God of Technology) – he was creating a
new defense system for King Minos for his island
kingdom of Crete but mortal guards and ordinary
weapons.
Talos - shape of a giant man and made of gleaming
bronze with superhuman strength and powered with
Ichor (the life fluid of the Gods)
- the first robot
Patragol Crew of Jason, Midea, and Argonauts
removing the bolt and Talos agreed and it drained the
life of Talos and after that the crew got to go home safely
and sound
4th Century BCE
-- Greek engineers begun making actual automatons
including robotic servants and flying birds
Talos – is the most famous invention who appeared on
Greek coins, vase paintings, public fresco, and in
theatron performances.
Even 2500 years ago, Greeks already begun to
investigate the uncertain line between human and
machine
Developments
• 1495
o Leonardo da Vinci sketched plans for a
humanoid robot.
o Designed in a form of an armored knight
o unclear if Da Vinci built it, but the concept
marked a significant moment in robotic history.
o Possess the ability to sit up, wave its arms,
move its head and open its mouth
Since then, progress has been made in developing
humanoid robots, aiming for ones that closely
resemble humans. Despite recent technological
advances and increased computing power, achieving
this dream is still a long way off.
Robin Marantz Henig (Article in The New York
Times)
1
 WHEN TECHNOLOGY AND HUMANITY CROSS
• Shared her experiences with “Social robots”
• These robots fall short of the idealized servant
robots from Greek mythology and are more like
early versions of the desired androids.
-- Contrary to popular expectations, these machines
aren't obedient companions or villains ready to
rebel.
▪ Instead, they are metal entities connected to
computers, relying on their human designers
to start them up and troubleshoot any issues. –
they don’t have autonomy
Rodney Brooks (Expert in Robotics And Artificial
Intelligence, 2008)
• explains that it is no longer a question of whether
human-level artificial intelligence will be developed,
but rather how and when
• Android development introduces a set of unique
ethical issues which industrial robots do not evoke.
• The overarching question that results is what
exactly these robots truly are.
• Are they simply piles of electronics running
advanced algorithms, or are they a new form of life?
• What is Life? The question of what constitutes life
is one on which the world may never come to a
consensus.
Throughout history, people have had various opinions
on what defines a living organism, from ancient
philosophers to everyday individuals.
dro
Materialism vs Aristotle’s View
• The basic tenets of Aristotle’s view are that an
organism has both “matter” and “form.”
o “Form”: referring to the unique characteristics
that make an organism what it is
• This differs from the philosophical position known as
MATERIALISM, which has become popular in
modern times and finds its roots among the ancient
Indians.
• Materialism - “organisms are made simply of various
types of “matter.”
-- a more modern viewpoint that excludes the concept
of "form" or "soul," focusing solely on different types
of "matter."
These philosophical positions significantly impact how
humans approach and interact with robots.
BALICLIC. GUALTER. PAYOS. TOMOCO | 2207
• One type of “matter” which Aristotle speaks of could
be biological material such as what plants,
animals, and humans consist of; or
• Another type of “matter” could also be the
mechanical and electronic components which
make up modern-day robots.
Clearly it is not the “matter” alone which
distinguishes whether an object is a living
organism, for if it were, Aristotle’s view would differ little
from materialism.
• The distinguishing characteristic of Aristotle is his
inclusion of “form.”
FORM
• simply means whatever it is that makes a human a
human, a plant a plant, and an animal an animal.
o Each of these have a specific “form” which is
not the same as its “matter”
▪ but is a functioning unity (matter and
form) which is essential to each living
organism in order for it to be just that,
living.
• In Aristotle’s terms, the “form” of a living organism
is often referred to as “psyche” or “soul.”
Materialism and Catholicism
• Materialism: often conflicts with religious views
worldwide unlike Aristotle's philosophy which was
adopted by many religions, notably the Roman
Catholic Church and specifically by St. Thomas
Aquinas.
Materialism – “a philosophical system which regards
matter as the only reality in the world, which undertakes
to explain every event in the universe as resulting from
the conditions and activity of matter, and which thus
denies the existence of God and the soul.”
- Catholic Encyclopedia –
Materialism – matter and reality only
Aristotle’s View – has form, you are acknowledging the
existence of a higher being and has a soul
Why does it matter that materialism conflicts with
Catholicism and most other religions? Specifically,
what does this have to do with robots and androids?
o It is relevant because If materialism is
correct: humans should have the power to
develop new forms of life.
o If everything in the universe is just material
and the outcome of material interactions:
there should be no obstacle to developing
androids and considering them as equally valid
life forms as humans.
2
 WHEN TECHNOLOGY AND HUMANITY CROSS
THREE LAWS OF ROBOTICS
Isaac Asimov
• introduced to the world of science fiction what are
known as the Three Laws of Robotics, which were
published in his short story “Runaround” in 1942.
• The laws Asimov formulated are:
1. A robot may not injure a human being or,
through inaction, allow a human being to come
to harm.
2. A robot must obey any orders given to it by
human beings, except where such orders
would conflict with the First Law.
3. A robot must protect its own existence as long
as such protection does not conflict with the
First or Second Law.
These three laws indicate that the robots uphold
humans as superior since they have form.
While these laws are rooted in science fiction, the
current status of robotic technology requires a fresh
perspective on them.
• As ideas from science fiction become reality,
Asimov's laws can now be applied practically.
• Initially, these laws appear to ensure the safe
advancement of this potential new life form.
o However, they assume that human life holds
greater value than that of the androids being
created.
If we believe that androids should be regarded as equal
to or even above humans, Asimov's laws may not
apply.
o place androids in a subordinate position to
humans.
If androids are considered equal to humans in terms of
their right to life, implementing Asimov's laws
becomes problematic.
• In a scenario involving both human and android
soldiers, should an android always sacrifice
itself to save a human? Would humans be
willing to die for androids?
• Despite some embracing materialism and
envisioning robots as potential equals to humans,
it's doubtful that many would be willing to
sacrifice their lives for a robot.
Although current robotics technology doesn't demand
ethical codes for robots, some countries are taking
proactive steps towards developing a code of ethics for
them.
Robot Ethics Charter
BALICLIC. GUALTER. PAYOS. TOMOCO | 2207
South Korea
o considered one of the most high-tech
countries in the world
o leading the way in the development of the Robot
Ethics Charter
Robot Ethics Charter
o drawn up “to prevent human abuse of robots—
and vice versa”.
o focuses on addressing social issues arising
from the widespread integration of robots into
society, including
▪ defining proper human-robot
interactions
▪ managing data collection and
distribution by robots
▪ Some see this charter as reminiscent
of Asimov's Three Laws of Robotics,
but others, like robot designer Mark
Tilden, believe it's premature to
imbue robots with morals.
Despite differing views, the advancement of technology
will likely prompt other countries to develop their own
codes of ethics for robots and human interactions.
B. Human, Morals and Machines
Technology is transforming our interactions with
nature.
• We now have what's called "technological
nature," where various technologies either
replicate, enhance, or simulate natural experiences.
• Television channels like the Discovery Channel
and Animal Planet offer digital portrayals of nature,
showcasing animal behaviors and natural
phenomena.
• Video games like Zoo Tycoon allow children to
engage with virtual animal life. Even zoos are
integrating technology, using webcams to let
people observe animals remotely.
• Robot pets, like Sony's AIBO, are popular items
in stores.
• Many people spend significant time in virtual
worlds like Second Life.
Does it matter that we're substituting real nature
with technological alternatives?
3
 WHEN TECHNOLOGY AND HUMANITY CROSS
To answer this, we look at evolutionary and cross-
cultural perspectives on humans' relationship with
nature, as well as recent psychological research on the
impact of technological nature.
Legal Moves for Safety
Scientists are starting to seriously consider the
ethical challenges arising from advancements in
robotics.
• In South Korea, experts are creating an ethical
code to prevent mistreatment of robots by humans
and vice versa.
• The European Robotics Network (Euron) is
urging governments to establish laws, particularly
focusing on safety as robots become more
commonplace in everyday life.
As robots become more intelligent, determining
who is responsible for any harm they cause
becomes tricky - whether it's the designer, the user,
or the robot itself.
• Ethical guidelines for robots can be based on
utilitarian principles but may need adjustments
based on specific circumstances.
• For instance, medical professionals follow
ethical codes tailored to patient needs, and similar
standards apply to other professions like law,
religion, and military service.
• Robots will adhere to the ethical rules we provide
them, making decisions based on moral codes and
values we set.
• In emergency situations, autonomous vehicles
may prioritize saving more lives, even if it means
sacrificing a few.
Ethical Issues
• There are special cases that will require
modifications of the core rules that are based on the
circumstances of their use. For example:
✓ Doctors do not euthanize patients to spread
the wealth of their organs, even if it means that
there is a net positive with regard to
survivors.
-- They have to conform to a separate code of
ethics designed around the needs of patients
and their rights that restricts their actions.
✓ Lawyers, religious leaders, and military
personnel who establish special relationships
with individuals who are protected by specific
ethical codes
It's crucial for these systems to be able to explain their
moral decisions, just like humans would explain their
actions.
Today, advanced technologies like Artificial
Intelligence (AI), augmented reality, virtual reality,
home robots, and cloud computing are fascinating
many people.
BALICLIC. GUALTER. PAYOS. TOMOCO | 2207
• According to academics, entrepreneurs, and
businesses, these technologies have the potential
to significantly change society.
• While it's uncertain if these technologies will
achieve their ambitious goals, they will definitely
mix with influential demographic, economic,
and cultural factors, potentially altering daily
life significantly.
“Is Google Making Us Stupid?”
• article by Nicholas Carrs (2008)
• discusses how the Internet affects our ability to
focus, changes our knowledge, and increases
our dependence on it
• argues that spending time online has negative
effects on our minds, making it difficult to
concentrate on long reading passages.
• Carr personally struggles with the negative effects,
feeling that his brain now expects information to
be delivered quickly, like the fast flow of the
Internet.
• Carr suggests that our brains are adapting to the
rapid pace of online information consumption.
• The article is divided into two main parts:
o Carr's desire for his brain to synchronize with
the Internet
o Google's perspective on replacing human
brains with artificial intelligence
C. Why the Future Does Not Need Us?
• As technology advances, intelligent machines
capable of outperforming humans in various tasks
are being developed.
o This could lead to all work being carried out by
highly organized systems of machines,
rendering human effort unnecessary.
• Either of two cases might occur:
o The machines might be permitted to make all
of their own decisions without human oversight.
o Human control over the machines might be
retained.
Machines > Humans
• If machines are granted full decision-making
autonomy, the outcome is unpredictable since it's
impossible to foresee their behavior.
o However, it's evident that humanity's fate would
then be dictated by these machines.
• While it might be argued that humans would never
willingly surrender all power to machines, the
reality could be different. Society might either
o willingly relinquish control to machines or
o find itself so reliant on them that it has no
practical choice but to accept their decisions.
Humans > Machines
• Human control over machines might persist
o average man: may have control over certain
private machines of his own, such as his car or
his personal computer
4
 WHEN TECHNOLOGY AND HUMANITY CROSS
o tiny elite: control over large systems of
machines will be in the hands of the
• Ruthless elite: might opt to eliminate the majority
of humanity; could employ methods such as
propaganda or biological means to decrease the
birth rate until humanity dwindles, leaving only the
elite
• Compassionate elite: may choose to shepherd the
rest of humanity, ensuring their basic needs are
met, providing wholesome activities, and offering
treatments for dissatisfied individuals.
o However, life in such a society would lack
purpose, potentially requiring biological or
psychological alterations to eliminate the
desire for power or redirect it into harmless
pursuits.
o While engineered individuals in this society
may be content, they would lack freedom and
be reduced to the status of domesticated
animals.
Theodore Kaczynski
• also known as the Unabomber
• an American domestic terrorist who killed three
people and injured many more in a bombing campaign
targeting individuals involved with modern technology.
• While his actions were criminal and insane, his vision
highlighted the unintended consequences often
associated with technology.
❖ unintended consequences are often associated
with technology – highlighted by Unabomber
• Echoes Murphy's law – "Anything that can go
wrong, will." For examples:
o overuse of antibiotics → biggest such problem
so far: the emergence of antibiotic-resistant
and much more dangerous bacteria.
o attempts to eliminate malarial mosquitoes
using DDT (dichlorodiphenyltrichloroethane
insecticide) caused them to acquire DDT
resistance; malarial parasites, likewise,
acquired multi-drug-resistant genes
• The root cause of such surprises lies in the complexity
of the systems involved, where changes can have
cascading (may kasunod pa) effects that are hard to
predict, especially when human actions are involved.
• Biological species often struggle to survive when
faced with superior competitors, as seen in the
displacement of South American marsupials by
North American placental mammals millions of
years ago.
Marsupials – mammals comprising kangaroos and
related animals na hindi nakakapagdevelop ng true
placenta
• In a completely free marketplace, advanced robots
would likely impact humans similarly to how North
American placental mammals affected South
American marsupials, or how humans have impacted
numerous species.
BALICLIC. GUALTER. PAYOS. TOMOCO | 2207
Robot industries would compete fiercely for resources,
driving prices beyond human affordability and
potentially leading to the displacement of biological
humans from existence.
A textbook on dystopia and Moravec
• discuss how our main job in the 21st century will be
o “ensuring continued cooperation from the
robot industries” by passing laws decreeing
that they be “nice,” and
o describing how seriously dangerous a human
can be once transformed into an unbounded
super intelligent robot.
• Moravec’s view is that the robots will eventually
succeed us that humans clearly face extinction.
• While we're accustomed to frequent scientific
advancements, we haven't fully grasped the
unique threats posed by 21st-century technologies
like
o robotics
o genetic engineering
o nanotechnology
Threats Brought by Scientific Breakthroughs
1. Robots, engineered organisms, and nanobots share
a dangerous amplifying factor; they can self-replicate.
• While a bomb explodes only once, a single robot or
nanobot can reproduce rapidly and become
uncontrollable.
• This self-replication can occur through computer
networks, presenting risks like system failures or
disruptions.
• Uncontrolled self-replication may lead to a
GREATER RISK: potentially causing significant
physical damage.
2. With Robotics, genetic engineering and
nanotechnology, a sequence of small, individually
sensible advances leads to an accumulation of great
power and, simultaneously, great danger.
• Each of these technologies also offers untold
promise: The vision of near immortality that
Kurzweil sees in his robot dreams drives us
forward;
o Genetic engineering may soon provide
treatments, if not outright cures, for most
diseases; and
o Nanotechnology and nanomedicine can
address more ills.
o Together, they could significantly extend our
average life span and improve the quality of
our lives.
• What was different in the 20th century? Certainly,
the technologies underlying the weapons of mass
destruction (WMD)–nuclear, biological, and
chemical (NBC)–were powerful, and the weapons
an enormous threat.
• But building nuclear weapons required, at least for
a time, access to both
o rare–indeed, effectively unavailable–raw
materials and
o highly protected information
5
 WHEN TECHNOLOGY AND HUMANITY CROSS
• biological and chemical weapons programs also
tended to require large- scale activities.
21st-century technologies–genetics, nanotechnology,
and robotics (GNR)
• so powerful that they can spawn whole new
classes of accidents and abuses.
• Most dangerously, for the first time, these accidents
and abuses are widely within the reach of
individuals or small groups.
o do not require large facilities or rare raw
materials. Knowledge alone will enable their
use; thus, we have the possibility not just of
weapons of mass destruction but of
knowledge-enabled mass destruction
(KMD), this destructiveness hugely amplified
by the power of self-replication.
3. Enormous computing power is combined with the
manipulative advances of the physical sciences and the
new, deep understandings in genetics, enormous
transformative power is being unleashed with the rapid
and radical progress in molecular electronics.
• Molecular electronics – where individual atoms and
molecules replace lithographically drawn transistors
• We would be able to meet or exceed the Moore’s
law rate of progress for another 30 years. By 2030,
we are likely to be able to build machines, in
quantity, a million times as powerful as the
personal computers of today.
4. We now know with certainty that the profound
changes in the biological sciences are imminent and will
challenge all our notions of what life is.
• Genetic engineering promises to
- revolutionize agriculture by increasing crop
yields while reducing the use of pesticides
- create tens of thousands of novel species of
bacteria, plants, viruses, and animals
- replace reproduction, or supplement it, with
cloning
- create cures for many diseases, increasing our
life span and our quality of life.
• [Genetic engineering] Human cloning: profound
ethical and moral issues
- If we were to reengineer ourselves into several
separate and unequal species, then we would
threaten the notion of equality that is the very
cornerstone of our democracy.
- The general public is aware of, and uneasy
about, genetically modified foods, and
seems to be rejecting the notion that such
foods should be permitted to be unlabeled.
• [Genetic engineering]
- As the Lovins’ note, the USDA has already
approved about 50 genetically engineered
crops for unlimited release; more than half of
the world’s soybeans and a third of its corn now
contain genes spliced in from some other forms
of life.
5. Nanotechnology, like nuclear technology, is more
prone to misuse for destructive purposes rather than
BALICLIC. GUALTER. PAYOS. TOMOCO | 2207
constructive ones. It can be exploited by military or
terrorist groups to create devastating devices that could
target specific areas or populations.
J. Robert Oppenheimer
• a renowned physicist
• led the development of the atomic bomb out of
concern for the threat posed by Nazi Germany
obtaining such weapons.
• Despite concerns about potential risks such as an
atomic explosion setting the atmosphere on fire
based on the calculation by Edward Teller,
scientists proceeded with the first atomic test,
known as Trinity.
• Following a successful test, atomic bombs were
dropped on Hiroshima and Nagasaki.
• While some scientists suggested demonstrating the
bomb instead of using it in combat, the urgency to
end the war prevailed.
• Despite the shock and horror following the
bombings, another bomb was dropped on
Nagasaki.
• In November 1945, Oppenheimer emphasized the
responsibility of scientists to
- use knowledge for the betterment of humanity
and
- consider the consequences of their actions.
OPPENHEIMER
Oppenheimer stood firmly behind the scientific attitude,
saying, “It is not possible to be a scientist unless
you believe that the knowledge of the world, and the
power which this gives, is a thing which is of
intrinsic value to humanity, and that you are using
it to help in the spread of knowledge and are willing
to take the consequences.”
In our time, how much danger do we face not just
from nuclear weapons but from all these
technologies? How high are the extinction risks?
Human Extinction vs Technologies
• Philosopher John Leslie concluded that the risk
of human extinction is at least 30 percent.
• Ray Kurzweil holds the view that there is a greater
than fifty percent likelihood of successfully
6
 WHEN TECHNOLOGY AND HUMANITY CROSS

navigating the future, although it should be noted “The exercise of vital powers along lines of excellence
that he has frequently been labeled as optimistic. in a life affording them scope”

Not only are these estimates not encouraging, but they - Greeks Definition -
do not include the probability of many horrid outcomes
that lie short of extinction. • To be truly happy in the future,
- have meaningful goals and challenges.
How To Be Saved from Human Extinction? - explore other ways to express our
creativity, rather than relying solely on
• Faced with such assessments, some serious
constant economic growth.
people are already suggesting that we simply
▪ While economic growth has benefited
move beyond the Earth as quickly as possible.
us for a long time, it hasn't made us
• We would colonize the galaxy using von
completely happy.
Neumann probes (self-replicating spacecrafts),
which hop from star system to star system,
Now, we have to decide if we want to keep pursuing
replicating as they go.
endless growth through technology, knowing the
• This step will almost certainly be necessary billion
risks involved.
years from now (or sooner if our solar system is
disastrously impacted by the impending collision of
our galaxy with the Andromeda galaxy within the
next three billion years),
o but if we take Kurzweil and Moravec at their
word, it might be necessary by the middle of
this century.
• Another idea involves constructing shields to
defend against dangerous technologies, akin to
the Strategic Defense Initiative proposed during
the Reagan administration.
o However, experts argue that such shields
would be ineffective and may have harmful
side effects.
o Therefore, limiting the pursuit of certain types
of knowledge emerges as a more realistic
alternative to mitigate the risks posed by
advanced technologies.
• We have been seeking knowledge since ancient
times. Aristotle opened his Metaphysics with the
simple statement: “All men by nature desire to
know.”
• Throughout history, the pursuit of knowledge has
been revered, but there are warnings, such as
Nietzsche's, about the potential dangers of
seeking truth at any cost.
-- Nietzsche: at the end of the 19th century, not
only that God is dead but that “faith in science,
which after all exists undeniably, cannot owe its
origin to a calculus of utility; it must have originated
in spite of the fact that the disutility and
dangerousness of the ‘will to truth,’ of ‘truth at any
price’ is proved to it constantly.”
▪ It is this further danger that we now fully face
the consequences of our truth-seeking. The
truth that science seeks can certainly be
considered a dangerous substitute for God
if it is likely to lead to our extinction. – just
like atomic bombs, nanotechnology, genetic
engineering (we study it for knowledge, but it
has devastating effects)

HAPPINESS

BALICLIC. GUALTER. PAYOS. TOMOCO | 2207 7