Consider Ryoji Ikeda's test pattern: high-frequency sine waves pulse in synchrony with strobing barcode imagery, and something curious happens. The viewer cannot meaningfully separate what is heard from what is seen. The aesthetic object exists in neither channel but in their inseparable binding. This is not multimedia—it is something ontologically new.
Traditional aesthetics inherited a stubborn separation. Music had its theorists, painting had its critics, and cinema reluctantly required both. Even film theory, that pioneering hybrid discipline, often treated sound as accompaniment to the privileged image. Digital media collapses this hierarchy. When pixels and samples are merely different organizations of the same computational substrate, the philosophical case for separating them weakens considerably.
What emerges is an aesthetic regime where synthesis precedes analysis. The digital audiovisual work is not the sum of soundtrack and visual track—it is a unified perceptual event that the brain processes through cross-modal binding mechanisms older than any art form. Understanding this regime requires abandoning the comfortable categories of musicology and visual studies in favor of something more difficult: an aesthetics of integrated temporal flux. The following analysis traces three dimensions of this integration, from the phenomenology of synesthetic unity to compositional principles for those creating in this expanded field.
Synesthetic Unity Beyond Addition
When Michel Chion coined the term synchresis, he identified something the laboratory had long confirmed: the perceptual system fuses simultaneous auditory and visual events into singular objects. A footstep heard while a foot lands is not two perceptions but one. Digital media exploits this binding with unprecedented precision, generating aesthetic objects that resist decomposition.
Consider Carsten Nicolai's installations, where oscilloscope traces are not visualizations of sound but co-instantiations of the same signal. The waveform you see and the tone you hear are mathematically identical—different sensory exposures of one computational event. The aesthetic experience is irreducibly unified because the underlying object is unified.
This challenges Lessing's classical division between spatial and temporal arts. Digital audiovisual works are neither spatial nor temporal but something more fundamental: structural. They are organizations of information that the perceptual apparatus distributes across modalities. The aesthetic object exists prior to its sensory unpacking.
Walter Benjamin observed that mechanical reproduction altered the aura of artworks. Computational synthesis goes further: it dissolves the very distinction between media that aura presupposed. There is no original painting whose reproduction loses something, because the audiovisual object was never primarily visual or sonic to begin with.
The implication for aesthetic theory is significant. Critical frameworks built around medium-specificity—Greenberg's modernism, much of musicology—become inadequate to works whose specificity lies precisely in their resistance to medium. We need vocabularies that begin with the integrated event and treat single-channel reception as an impoverished special case.
TakeawayWhen sound and image emerge from the same computational source, they are not collaborating—they are revealing different facets of one underlying object. The unity precedes the separation, not the other way around.
Temporal Binding and the Soundtrack's Hidden Sovereignty
Show the same shot of a face with two different soundtracks and you have shown two different faces. This is the foundational lesson of audiovisual editing, and it points to something deeper: sound does not accompany image, it temporally constitutes it. The soundtrack provides the metric against which visual events acquire pace, weight, and significance.
In digital contexts, this temporal sovereignty becomes explicit and manipulable. Software like Max/MSP or TouchDesigner exposes timing relationships as parameters. A frame rate change, a slight audio delay, a granular shift in sample playback—each transforms not just synchronization but the perceptual identity of what is being witnessed.
Temporality in digital audiovisual work is not a container for events but their material. The rhythmic structure of a piece by Alva Noto is simultaneously the rhythmic structure of its visual flicker. You cannot slow one without slowing the other, because they are aspects of a single temporal flow rather than two flows running in parallel.
This has consequences for meaning. Visual ambiguity resolves in the direction the soundtrack pushes. A static image accompanied by a rising tone becomes anticipatory; the same image with a decaying tone becomes elegiac. The semantic content of digital imagery is, to a significant extent, donated by its sonic partner.
Flusser argued that we have entered the age of technical images—images produced by apparatuses we barely understand. The audiovisual technical image extends this further: meaning emerges from the orchestrated interplay of code-generated streams, and the human reader experiences interpretive options pre-shaped by the temporal architecture the system imposes.
TakeawaySound does not describe what we see—it determines how time itself flows through the image. To control the soundtrack is to control the visual's mode of existence.
Compositional Integration as a Practice
If audiovisual unity is the goal, what does it demand of creators? First, abandoning the production pipeline that treats sound design as post-production. When sound arrives after picture lock, integration is impossible by definition—one channel has been fully determined before the other entered the conversation.
Artists like Robert Henke work differently. The visual and sonic dimensions of Lumière develop together from shared parametric controls. Laser positions and oscillator frequencies are not coordinated after the fact but specified simultaneously within unified gestures. The compositional unit is the audiovisual phrase, not the musical phrase synchronized to the visual phrase.
The principle: design from the parameter, not from the channel. What aspects of your computational object change over time? Those parameters can be routed to any sensory output. Frequency might become color, amplitude might become scale, spectral content might become texture. The mapping is a compositional decision, not a translation problem.
Second, integration requires resisting the redundancy that conventional production embraces. When the explosion sound coincides exactly with the explosion image, you have used two channels to deliver one piece of information. Genuine integration uses the channels to do different work that nevertheless coheres into a unified event—what Chion called added value.
Third, the creator must learn to listen with their eyes and look with their ears. This is not metaphor but disciplined practice: evaluating sonic decisions for their visual implications, judging visual choices for their acoustic consequences. The competent audiovisual artist holds the entire perceptual object in attention, never optimizing one dimension at the cost of the whole.
TakeawayGenuine audiovisual integration begins not with synchronization but with shared parameters. Design the underlying object once, then let it manifest across senses.
The audiovisual work in digital media is neither a hybrid nor a collaboration. It is a unified aesthetic object whose sensory distribution is a downstream consequence of computational structure. Recognizing this reorients both criticism and creation.
For theorists, it suggests that medium-specific aesthetics has reached the limits of its usefulness. The interesting questions now concern integration, parameter, and the choreography of perceptual binding. Benjamin's aura disappears not because reproduction surpasses it but because the unitary work it described was already a historical artifact.
For artists, the invitation is to compose at the level beneath sense modality—to work with the parameters, signals, and structures from which sensory experience is generated. The future of aesthetic experience lies less in perfecting any single medium than in cultivating sensibilities adequate to the integrated objects that digital systems naturally produce. Audiovisuality is not a genre; it is the default condition of computational art.