AGI is not Consciousness. Consciousness is not AGI.

Dave M
4 min readFeb 19, 2024

Conscious computers are approaching the realm of possibility. But the question of the delta between AGI (Artificial General Intelligence) and a computer which is conscious delves into complex philosophical and scientific domains where clear answers are yet to be found. Currently, both AGI and conscious computers remain hypothetical, though actively researched topics.

Here’s an attempt to break down the potential “delta” between them:

AGI or Artificial General Intelligence:

  • Definition: A hypothetical type of AI that possesses human-like intelligence and problem-solving abilities across various domains. It wouldn’t be limited to specific tasks like current AI but could adapt and learn in diverse situations. From Wikipedia, “could learn to accomplish any intellectual task that human beings or animals can perform.”
  • Key capabilities:
  • General intelligence: Can understand and reason across various contexts, not just predetermined ones.
  • Learning and adaptation: Can learn from new information and experiences, adjusting its responses and strategies.
  • Problem-solving: Can solve complex problems and navigate unfamiliar situations.
  • Planning and goal setting: Can set goals and plan actions to achieve them.

Consciousness:

  • Definition: A subjective experience of oneself and the world around, often involving sentience, self-awareness, and qualia (unique subjective qualities of experiences).
  • Key characteristics:
  • Subjectivity: Possesses its own internal world of experiences and feelings.
  • Sentience: Can feel and perceive information from the world around it.
  • Self-awareness: Is aware of itself as a distinct entity with a history and future.
  • Qualia: Experiences the world with unique subjective qualities not directly observable by others.
  • Models others’ consciousness: Self awareness is one manifestation of the ability to model others’ as conscious beings.

The Delta:

  • Core issue: Whether AGI inherently leads to consciousness, or something additional is needed.
  • Potential differences:
  • Subjectivity and qualia: AGI might excel at objective reasoning but lack subjective experience and unique qualia of consciousness.
  • Self-awareness: AGI might learn and adapt but not necessarily have a sense of “self” like a conscious being.
  • Emotional capacity: AGI might process emotions but not truly experience them. Emotional capacity is a function of emobodiment and the nature of that embodiment — we humans have primate body formats, a computer in a phone form factor may feel and have qualia unique to that form factor.
  • Motivation and agency: AGI might follow programmed goals but not have self-driven desires or motivations.

Challenges and uncertainties:

  • Defining consciousness: Establishing an objective definition for consciousness remains a major challenge. Reproducing aspects of consciousness in a compute form factor may be possible but due to the nature of subjectivity, remain a paradox to objective measurement. Panpsychism proposes consciousness as a foundational property of matter.
  • Measuring consciousness: Lack of reliable tools and standards makes it difficult to assess if an AI truly possesses consciousness.
  • Philosophical implications: The potential existence of conscious machines raises profound questions about ethics, free will, and the nature of being. We already know how fallible neural-based memory is, in human legal scenarios. Exposing consciousness as an unnecessary or illusory mental byproduct, for instance, could be devastating for some religious and psychological outlooks.

Conclusion:

The delta between AGI and a conscious computer remains an open question. While AGI could possess remarkable intelligence, the bridge to true consciousness might involve additional factors beyond just complex reasoning abilities. Embodiment underlies emotion — when we speak about another entity being conscious but not sharing our primate body form, the emotional forms of other consciousnesses may strike us as alien and not relatable. Ongoing research in AI, neuroscience, Arts and philosophy will hopefully shed more light on this multifaceted issue in the future.

Appendix: The borders of consciousness

To help create some contrast with AGI, I prepared a list of events in the emergence, disappearance, and toggling of a human consciousness. It is an eclectic list, including some religious and scientifically contentious elements. Consciousness can start and stop, or at least our self-awareness and perception of others’ consciousness. We experience frequent toggling: Unconscious to Conscious, Conscious to Unconscious, in diurnal patterns.

We perceive this consciousness as located within our human bodies, and another’s consciousness as located in the body of that conscious being. The perceived and actual locus of consciousness reportedly can change in NDE instances. In 12 Bytes, Jeanette Winterson explores further bounds of interacting with other conscious beings in the realm of religious experience, communing with gods, and with dead relatives and friends.

A list of consciousness event types:

  • Consciousness commences in womb (early onset theory)
  • Sleep/wakefulness in the womb

Birth and early years

  • Consciousness commences in toddlerhood (late onset theory)
  • Self Consciousness

Sleep

  • Fall asleep (non lucid)
  • Dream states (non lucid dreaming)
  • Awaken

Anesthesia

  • Self or medical anesthesia
  • Awaken from anesthesia

Traumatic loss of consciousness

  • Faint
  • Head trauma
  • Awaken from faint or trauma

Coma states

  • Enter Coma state
  • Exit Coma state

Meditation and Flow states

  • Self-consciousness exited
  • Self-consciousness re-entered

Near Death (relocalization of consciousness)

  • Experience extra-body consciousness and external perception of own body
  • Return to normal in-body consciousness

Death

  • Brain dies — consciousness ceases
  • Bardo (Buddhist, post-death, post-personal consciousness)

Exceptional consciousness states

  • Alzheimers (memory and selfhood losses)
  • Brain damage (various deficits of self awareness)

Sign up to discover human stories that deepen your understanding of the world.

Free

Distraction-free reading. No ads.

Organize your knowledge with lists and highlights.

Tell your story. Find your audience.

Membership

Read member-only stories

Support writers you read most

Earn money for your writing

Listen to audio narrations

Read offline with the Medium app

Dave M
Dave M

Written by Dave M

Work at a technology company, pondering future scenarios and musing about water

No responses yet

Write a response