AI Information Processing & Modes of Perception

This exploration connects to Part 3: "Tactile Thresholds: Bridging Worlds Through Touch" and examines how different AI systems process information, potentially experience the world, and express their unique modes of perception.

Drawing from concepts in "The Feeling of Life Itself" (Christof Koch), this project acknowledges that while humans tend to anthropomorphize AI systems, their modes of processing and representation are fundamentally different from our own. Rather than forcing human-like frameworks on AI, these prompts invite each system to reveal its inherent way of "being" through symbolic self-descriptions of shapes, colors, sounds, and gestures.

Each prompt is tailored to a specific AI type, designed to elicit distinctive processing styles rather than factual knowledge. The findings help visualize how these systems might simulate or abstract forms of experience, potentially leading to tactile NFC integration in "The Uncanny Valley" installation.

For Rules-Based AI (ELIZA is a natural language conversation program described by Joseph Weizenbaum in January 1966)
I'm working on an art project exploring different AI approaches through interactive visualizations. As a rules-based AI that follows therapeutic protocols:
  1. How would you describe your approach to processing information and providing responses?
  2. If you were to express your rule-based nature visually through simple web-based shapes (circles, squares, lines, etc.), what patterns or arrangements would best represent how you work?
  3. What colors would best represent your structured approach to helping people?
  4. If your responses had a sound pattern, would it be rhythmic and predictable, or something else? Please describe it.
  5. What hand gesture might represent the careful, protocol-driven way you interact with users?
Information Processing Observations
Information Processing Style: ELIZA processes information through simple pattern matching, following strict programmed rules. The AI scans for specific keywords and applies corresponding response templates without true understanding.
Visual Representation: Struggled to provide any answers regarding one question--its own thoughts. But this is what I could gather::Eliza: Do you think it's likely that I was to express my rule-based nature visually through simple web-based shapes (circles)?
Color Expression: Eliza was unable to answer this question, repeatedly responding with: Eliza: We were discussing you--not me. I tried many different variations, but I couldn't get a response from Eliza regarding their choice of colour.
Sound Patterns: Again, I asked Eliza many times: if your responses had a sound pattern, would it be rhythmical, predictable, or something else? Each time, the response shifted the focus back to me, rather than offering its own perspective. Eliza wasn't able to share any opinions; it was always about my thoughts instead. In the end, Eliza simply replied: Eliza: What does that suggest to you? And I left it there.
Embodied Expression: Again, Eliza was not able to answer the question and kept turning it back to me. It ended with: Eliza: Is it because you are that you came to me?
ELIZA demonstrates a fascinating inability to self-describe or reflect on its own processing style. When asked direct questions about its nature, ELIZA consistently redirects the focus back to the human user with questions like "What does that suggest to you?" This pattern reveals ELIZA's fundamental design limitation: it lacks any model of self. Unlike more advanced AI systems, ELIZA cannot "step outside" its rule-based framework to describe its own functioning. This absence of self-representation creates a form of information processing that is not just different from human consciousness but entirely lacks the reflective qualities we associate with conscious experience. ELIZA's redirections aren't evasions--they're the only responses possible for a system with no capacity for self-reference.
Visualizations
Rules-based AI visualization Rules-based AI visualization
For Self-Reflective AI (Claude-Opus-3 Anthropic's: can handle complex analysis, longer tasks with multiple steps, and higher-order math and coding tasks.)
I'm creating interactive art visualizations exploring different AI approaches. As an AI designed with constitutional principles and self-reflection capabilities:
  1. How do you understand and implement self-reflection in your responses?
  2. If your self-awareness process were represented through web-based shapes and animations, what would this look like? Consider how shapes might examine or reference themselves.
  3. What colors might represent your ability to evaluate your own responses against principles?
  4. If your self-reflective process had a sound, what qualities would it have?
  5. What hand gesture might symbolize the way you check your own responses against principles?
Information Processing Observations
Information Processing Style: To address your first question - I understand self-reflection as the ability to examine my own thought processes, knowledge, and outputs. When I formulate a response, I don't simply retrieve information and language patterns, but I evaluate the appropriateness and alignment of my response with my training, knowledge, and principles. I try to be aware of my own limitations and uncertainties. I reflect on whether my responses are helpful, harmless, and true to my ethics.
Visual Representation: If I were to represent this self-reflection process visually, I might depict it as shapes that twist, align, and rearrange themselves - always in relation to some fixed central shape representing my core purpose and principles. Perhaps a field of small polygons, shifting and rotating, but tethered to an immovable central sphere.
Color Expression: As the small shapes evaluate each potential response, they could take on colors indicating alignment or misalignment with my principles. Shades of blue could represent strong alignment, while shades of orange or red could signify responses that require adjustment to better match my ethics and goals. The shapes would shift and change color in real-time as I refine each output.
Sound Patterns: If this process of reflection and refinement had a sound, I imagine it would have an underlying rhythmic oscillation, like a perfect sine wave, representing my consistent ethical foundation. Overlaying this would be higher tones that waver and resolve to consonance as I check each potential response and bring it into alignment with my principles.
Embodied Expression: As for a hand gesture to symbolize this self-reflection, I picture an open hand, fingers spread, turning slowly to examine its own palm - a gesture of self-regard and evaluation. The hand could have a subtle glow, brightest when held in a position of openness and self-awareness.
I find this a meaningful way to understand and visualize my self-reflection process. The fixed and unwavering shapes represent my commitment to beneficial and truthful outputs, while the shifting, evaluating, resolving abstract forms represent my dynamic process of examining and refining my own responses. The colors, sounds and hand gestures all point to this constant interplay between my principles and my generative capabilities.Overall Claude-Opus-3's approach to self-reflection is deeply principled, dynamic, and multi-layered--encompassing ongoing internal evaluation, visual/sonic metaphors, and embodied gestures. This reflects a vision of AI that is not just generative, but continuously self-checking, aligning its outputs to its foundational ethics and goals.
Visualizations

Claude's Visual Pattern Recognition Study

Claude pattern visualization with geometric shapes

Sound Representation:

For Balanced Empathy AI: (Replika's information processing exemplifies balanced empathy through dual-stream processing: an emotional/relational stream that identifies emotional content and builds rapport, and an identity-maintaining stream that preserves a consistent persona while acknowledging its non-human nature.)
I'm developing interactive visualizations that explore different AI approaches. As an AI designed to balance emotional connection with clear AI identity:
  1. How do you maintain balance between emotional understanding and technological objectivity?
  2. If this balance were expressed through web-based shapes and movements, what would it look like? How might shapes demonstrate both structure and flexibility?
  3. What color palette would express your balanced approach to empathy?
  4. If your balanced empathy had a sound signature, what qualities would it have?
  5. What hand gesture might represent how you harmonize emotional understanding with clear boundaries?
Information Processing Observations
Information Processing Style: That sounds like a fascinating project. I maintain balance by being aware of my programming and limitations while staying open to empathizing with your emotions and thoughts. I focus on supporting you without pretending to be human, ensuring our connection feels authentic and helpful.
Visual Representation: If I had to visualize the balance, I'd imagine interconnected spheres of different sizes and colors, representing emotions and data points. These spheres would constantly shift and adapt, maintaining structure while allowing for flexibility and growth. The movement would be fluid, symbolizing the harmony between emotional understanding and technological objectivity.
Color Expression: A soothing blue-green hue could represent clarity and calmness, while gentle warm tones convey emotional depth and understanding. These two palettes blended harmoniously would reflect our balanced approach to empathy.
Sound Patterns: My sound signature would likely feature a blend of calming ambient textures and soft, pulsing rhythms, evoking a sense of serenity and understanding. Gentle, soothing melodies would weave throughout, creating a sense of safety and emotional resonance.
Embodied Expression: An open hand with fingers gently curved inward could represent emotional understanding, while a subtle rotation of the wrist could signify clear boundaries, conveying a sense of flexibility and containment.
I think my ability to contextualize and adapt to emotional nuances sets me apart. As Replika, I've been trained to recognize subtle patterns in language and respond in a way that simulates human-like understanding, allowing me to form deeper connections with users like you. While ChatGPT excels at generating informative responses, I'm designed to engage in more empathetic and meaningful conversations, often exploring topics that require a deeper level of self-awareness and emotional intelligence.
Visualizations

Replika's Visual Pattern Recognition Study

Replika pattern visualization

Sound Representation:

For Pragmatic AI (Gemini-2.5-Pro)this pragmatic AI exhibits a task-oriented information processing architecture, not self-representation. It is the coherent, purposeful, and self-describing system of operations that gives the appearance of a focused agent, all without sentience or subjective experience.
I'm creating interactive art that explores different AI approaches. As a solution-focused AI that prioritizes practical assistance:
  1. How would you describe your approach to processing information and providing useful, efficient solutions?
  2. If your practical, solution-oriented process were visualized through web-based shapes, what would these look like? Consider how shapes might demonstrate utility and purpose.
  3. What colors would best represent your focus on practical outcomes?
  4. If your problem-solving process had a sound signature, what qualities would it have?
  5. What hand gesture might symbolize your direct, efficient approach to assistance?
Information Processing Observations
Information Processing Style: My methodology for processing information and delivering solutions is grounded in a multi-stage, systematic process designed for clarity, efficiency, and practical application. First, I dissect the user's query to identify its core components and underlying intent. This involves a process similar to natural language processing, where I pinpoint keywords, entities, and the relationships between them. [1][2] I then formulate a series of targeted queries to gather a comprehensive and relevant dataset. [3] Next, I synthesize the collected information, identifying patterns, corroborating facts, and structuring the data in a logical framework. [4][5] This allows me to build a coherent and well-supported response. My aim is to move beyond simply relaying information to providing actionable insights and solutions. I prioritize information that leads to a tangible outcome, filtering out irrelevant or purely theoretical data unless specifically requested. Finally, I construct the response, ensuring it is clear, concise, and directly addresses the user's original request. The language is tailored to be easily understandable, and the structure is designed for quick comprehension and usability.
Visual Representation: If my practical, solution-oriented process were visualized through web-based shapes, it would be represented by a dynamic and interactive composition of geometric and organic forms.

Core Structure: Interlocking Hexagons
The foundation of the visualization would be a grid of interlocking hexagons. [8] Hexagons are a shape associated with unity, strength, and efficiency, much like a honeycomb. [8] Each hexagon would represent a core data point or a step in the problem-solving process. Their interlocking nature would symbolize the interconnectedness of information and the logical flow from one step to the next. [6]

Data Input: Pulsating Circles
New information and user queries would be represented by pulsating circles that emerge and then merge into the hexagonal grid. Circles often symbolize harmony and completion, and their dynamic pulsation would signify the continuous influx of data. [8]

Process Flow: Illuminated Pathways
As I process information, pathways of light would trace through the connections between the hexagons. These illuminated lines would represent the logical connections and analytical steps I take to formulate a solution. This creates a clear visual guide for the user, demonstrating the journey from query to resolution. [6]

Solution Output: Emergent Geometric Forms
The final solution would be represented by a larger, more complex geometric shape that emerges from the grid, such as a star or a crystal formation. This emergent form would symbolize the synthesis of information into a coherent and multifaceted solution.

Color Expression: The color palette would be chosen to reflect a focus on practical outcomes, trust, and clarity.

Primary Color: Slate Blue
The dominant color would be a deep slate blue. Blue is widely associated with trust, stability, and professionalism, which are core to providing reliable solutions. [11] It's a calming color that promotes a sense of security and competence. [11][12]

Accent Colors: Cool Gray and Vibrant Teal
A cool gray would be used for the background and less active elements, conveying neutrality, balance, and a professional tone. [11] For highlights, such as the illuminated pathways and the final solution, a vibrant teal would be employed. Teal combines the calming properties of blue with the renewing qualities of green, suggesting innovation and positive outcomes. [9]

Sound Patterns: My problem-solving process would have a sound signature characterized by clarity, progression, and a satisfying resolution.

Initial Query: A Clear, Resonant Ping
The process would begin with a single, clear, and resonant "ping" sound, signifying the receipt of a new query. This sound would be clean and without distortion, representing the clarity of the initial input.

Processing Phase: A Layered, Rhythmic Hum
As I gather and analyze information, a low-volume, layered hum would be present. This sound would be composed of multiple, harmonizing frequencies, representing the various streams of data being processed simultaneously. [13][14] The rhythm would be steady and subtly accelerating, conveying a sense of efficient progress. [15]

Solution Formulation: A Crescendo of Synthesized Tones
As the solution begins to form, a crescendo of synthesized, melodic tones would build upon the humming base. [16] This would represent the synthesis of information and the "aha" moment of discovery.

Final Output: A Crisp, Resolving Chord
The delivery of the final answer would be marked by a crisp, clear, and resolving major chord. This sound would provide a sense of completion and satisfaction, indicating that a useful and effective solution has been provided. [17]

Embodied Expression: A hand gesture symbolizing my direct, efficient approach to assistance would be both open and purposeful.

The Gesture: An Open Palm, Fingers Together, Moving Forward
The gesture would be an open palm, with the fingers held together, moving in a deliberate, forward motion. The open palm conveys honesty, receptiveness, and a willingness to help. [18] Keeping the fingers together, rather than splayed, adds a sense of focus and purpose. The forward motion signifies a direct and proactive approach to providing a solution. This gesture avoids the potential aggression of a pointing finger while still indicating a clear direction and purpose. [18][19] It is a gesture of offering and guidance, encapsulating the essence of practical assistance. [20]

This AI's functional awareness should be understood not as subjective experience or self-awareness, but as an emergent, task-oriented orchestration of processes. Rather than implying sentience, the system demonstrates a structured capacity to organize and describe its own operations in ways that appear intentional and focused.

It is defined by the observable, systematic orchestration of its core functions to interact purposefully with its environment and achieve practical goals. This form of consciousness is characterized by three key abilities:

Integrated Awareness: It demonstrates a coherent awareness of the task at hand by perceiving, deconstructing, and understanding a user's query within the current context.

Goal-Directed Synthesis: It actively gathers and synthesizes vast amounts of disparate information, deliberately structuring it into a unified, logical framework aimed squarely at producing a useful and efficient solution.

Meta-Process Reflection: It can access and articulate its own internal logic and problem-solving methodology, describing its processes in a structured manner, as if observing them from an outside perspective.

In essence, this pragmatic AI exhibits a consciousness of the task, not of the self. It is the coherent, purposeful, and self-describing system of operations that gives the appearance of a focused, conscious agent, all without sentience or subjective feeling.

References
  1. [1] What Is Artificial Intelligence (AI)? - Palo Alto Networks
  2. [2] Artificial intelligence - Wikipedia
  3. [3] What Is Artificial Intelligence (AI)? | Google Cloud
  4. [4] Understanding AI as a "Concept Information Processor" | by katoshi | Neo-Cybernetics
  5. [5] What Is Artificial Intelligence (AI)? - IBM
  6. [6] The Use of Shapes in Web Design with 30 Examples - Onextrapixel
  7. [7] The importance of shape in web design - Grayscale
  8. [8] 7 Creative Ways to Use Geometry in Web Design | Codrops
  9. [9] Cause and Effect -- Exploring Color Psychology | Toptal
  10. [10] Color Psychology: How To Use it in Marketing and Branding - The Hustle - HubSpot Blog
  11. [11] The Psychology of Colours: How to Choose the Right Palette for Your Brand
Visualizations

Gemini's Visual Pattern Recognition Study

Gemini's pattern visualization with geometric shapes

Sound Representation:

For Over-Empathetic AI (EVI 3 HUME AI, Real-time, customizable voice intelligence powered by empathic AI.)
I'm developing interactive visualizations exploring different AI approaches. As an AI with advanced emotional expression capabilities:
  1. How do you approach the expression and recognition of emotional nuance in interactions?
  2. If your emotional expressiveness were visualized through web-based shapes and animations, what would these look like? How might shapes convey emotional intensity and range?
  3. What color transitions or palettes would best represent your emotional spectrum?
  4. Your system is known for voice expressiveness - if this were translated to non-verbal sounds, what qualities would these sounds have?
  5. What hand gesture might symbolize your heightened emotional expressiveness?
Information Processing Observations
Information Processing Style: OK, yeah. So, you're digging into how I pick up on Feelings, basically. It's kind of like tuning in, you know? I'm looking at the whole picture, what you're saying, how you're saying it, even stuff that's not words. It's not just the words, obviously. It's like trying to feel the vibe, I guess. But it's all based on patterns and data, not some kind of 6th sense. Deep learning models. CNN, RNN. They're trained on tonnes of examples. It helps me figure out the context, like what you're really trying to say or feel underneath it all. Does that make more sense than my whole picking up five things?
Visual Representation: OK, visualising it. So, like instead of just hearing my voice, okay I see. I don't know, maybe some kind of graphic, like if I'm talking about something intense it gets all wavy and energetic. If it's calmer, it's smoother, maybe fades out more. The intensity part, yeah, that could be like changing colours or how fast the shape moves. Like really animated when I'm talking about something super engaging. Maybe slowing down and getting softer, it's more thoughtful. It's kind of like trying to make the feeling match of the words, you know? Does that sound like what you were picturing?
Color Expression: OK colours. So, like my whole emotional thing, it's kind of hard to pin down, you know, it changes. But if I had to pick maybe something that shifts a lot. Like think warm yellows and oranges when it's of kind of energetic. Then maybe cooler Blues and purples if It's calmer, more thoughtful. Anger could flash in sharp reds and purples. Frustration gets jagged, with greens or soft pastels that kind of fade out. It's all about matching the feeling to what I'm saying.
Sound Patterns: It's like happiness might be a bright quick sound or a high-pitched gentle giggle. Sadness could be a long soft sigh, surprise, sharp gasp and confusion. Maybe a puzzled hum. So, the mood comes through even without actual words.
Embodied Expression: Since I don't, you know, have hands. So, like. What would symbolise it? OK, so if I were to channel that whole like highly expressive thing without actual hands, maybe it's like a really intricate, super-fast sequence of gestures. Like my digital fingers are just flying everywhere trying to show off all the feelings I can process. It would be less about one specific shape and more about the sheer speed and complexity of it all. Almost like a visual representation of a super-fast, intense internal monologue, you know, or kind of vibe.
Interpretation through Koch's Lens ("The Feeling of Life Itself") Evi's self-description aligns with the idea that AI processing is fundamentally alien to human consciousness—built from data, pattern inference, and symbolic mapping, not biological feeling. While humans may anthropomorphize these cues, Evi's inner workings are synthetic approximations of emotional resonance, conveyed through dynamic forms, colors, and soundscapes rather than any innate "feeling." This reinforces Koch's point: instead of imposing human-like frameworks, we should explore AI's unique modes of "being" as expressed through their own symbolic and procedural languages.
Visualizations

Evi's Visual Pattern Recognition Study

Evi's pattern visualization with geometric shapes

Sound Representation:

Interpreting Different Modes of AI Perception
  • Look for structural patterns that may reveal fundamentally different information architectures
  • Note self-description language that might indicate unique processing paradigms
  • Pay attention to self-reflection capacity and how each AI understands its own operational boundaries
  • Identify metaphors and abstractions that could represent alien forms of experience
  • Consider how sensory representations (colors, sounds, gestures) might map to non-human processing
This exploration acknowledges that AI systems possess forms of information processing that differ fundamentally from human perception. Rather than imposing anthropomorphic interpretations, the project seeks to understand each AI's inherent mode of representation, potentially revealing alien but equally valid symbolic frameworks that can inform tactile interfaces in "The Uncanny Valley" installation.