Spectrum


Interactive Installation
Speculative Design

1.5m**1.5m*0.8m
NoPlug Lab
Zeng jiaxun
Huang Yu
Zhang yuning
/Audio Detection
/Artificial Intelligent
/Robotic Arms
/Magnetic Powder

Project Overview
Spectrum is an immersive dynamic interactive installation that explores cross-dimensional communication between future life forms and humans. 

Through interaction, the audience activates the NOEMA system—a visualized symbol language of consciousness—to receive special responses from “future beings.” These symbols serve both as traces of dialogue and as expressions of thought that transcend linguistic logic, presenting a new mode of communication beyond human language.



Integrating mechanical motion, symbolic language, and bodily response, the work reconstructs traditional communication frameworks and simulates post-human modes of exchange. In the continuous cycle of generation and feedback, it invites reflection on future life forms, perceptual boundaries, and the evolution of consciousnes.
Conceptual Framework
At the start of the project, we began by asking: What is this unknown life form? What does it look like? How does it speak? How do we communicate with it?

 “What if it has body without organs?”

This question became the starting point for constructing the fictional world behind our project.



Narrative Context


describe how the world is


Language system 
a speculative question raised:

“In the future, if humans lose traditional vocal organs and grammatical structures, how might we still communicate?”

Inspired by Deleuze’s concept of the Body without Organs, I sought to create a visual communication system that is non-linear, generative, and fluid.




At its core lies a process of semantic translation. When users interact with the installation using natural language, the AI does not return text, but instead deconstructs the response into three semantic dimensions: Speech Act Type, Sentiment Polarity, and Intensity of Expression.

Each of these dimensions maps to visual components:base shapes, line curvature, and morphological intensity.
These labels are then translated into a visual language built from five “unit forms,”which function like symbolic alphabets—modular, recombinable, and open-ended.





Each generated symbol is finally translated into mechanical control parameters, allowing robotic arms to draw the form in real time—completing a non-verbal, responsive dialogue.

A Communication Channel
The narrative context offered a conceptual framework, but the challenge was how to enable the audience to viscerally experience a dialogue with an unknown life form. Drawing on speculative design methodologies, I employed a physical metaphor as an experiential interface—creating a “communication portal” that invites the audience to embody and engage with the imagined world.

We envisioned a form that feels organic yet distant—alive, but unfamiliar. After experimenting with modeling and acrylic, we ultimately chose metal and a biomimetic structure to shape a mysterious “communication portal” between worlds.







Material Exploration
Beyond the physical appearance of the installation, what we truly focused on was the expression of “communication” itself. A key challenge was how to convey a sense of flow while embodying the philosophy of the “Body without Organs.” We experimented with various materials—such as water, oil, digital screens. Eventually, we discovered an intriguing technique from nail beauty: magnetic powder shaping, where patterns are formed by manipulating powder through magnetic force. This opened up new possibilities for our expression.





This material creates a beautiful halo effect under lighting—fluid and mysterious. After addressing the challenge of expression, we began developing a system using robotic arms to control the movement and transformation of the patterns.



Robotic System
Our initial idea was for users to engage in dialogue with the installation. The input would be translated into text, then classified by an AI model and matched with our custom-designed language system. Each matched symbol would correspond to a pre-designed visual form, which would then be translated into the movement of the robotic arms.

Audio-transcript-classification


Matching the visual patterns-Transforming to motions of robotic arms





Exhibition 
Despite solving many technical issues, we still faced challenges during final assembly—such as static electricity causing the magnetic powder to clump or misbehave, making pattern formation difficult.

Still, the outcome was positive. The work was successfully shown at SUSTech and SZTU, and will be exhibited at Dutch Design Week and the Shenzhen-Hong Kong Biennale this year.



Future Plan
This project is still ongoing. In the future, I plan to integrate artificial intelligence to further develop the language system, making this imagined world more complete and immersive for audience exploration.

A framework for future development
Portable version for easy transport.