Performance Archive

Hayato Sumino Piano Recital "Klassik Arena"

Hayato Sumino Piano Recital
K Arena Yokohama / Visual Direction by Daito Manabe

November 29, 2025 / Doors 16:30 / Start 18:00

A page introducing Hayato Sumino's Klassik Arena at K Arena Yokohama, covering the performance overview, the real-time piano visualization system, the direction team, the visual program, production credits, and stage photographs.

Performance

Date

November 29, 2025 / Doors 16:30 / Start 18:00

Venue

K Arena Yokohama, Kanagawa

Photo

Overview

Core performance information and an overview of the supplied credits.

Internationally active pianist Hayato Sumino presented the classical performance "Klassik Arena" at K Arena Yokohama, one of Japan's largest music-dedicated arenas.

Stage direction was handled by Daito Manabe of Rhizomatiks, with visual programmers Satoshi Horii and Tatsuya Ishii joining the visual direction team.

Performance

Hayato Sumino Piano Recital "Klassik Arena"

Date

November 29, 2025 / Doors 16:30 / Start 18:00

Venue

K Arena Yokohama, Kanagawa

Direction

Show Director & Visual Direction: Daito Manabe

Live System

Real-Time Visualization System

The live stack connecting Steinway Spirio, Ableton Live, Max, and the Visualizer.

The system takes Steinway Spirio MIDI notes, velocity, and sustain pedal as primary input, routes them through Ableton Live, a VST MIDI plugin, and Cycling ’74 Max, then sends OSC control signals to the Visualizer for real-time graphics.

To keep a free-tempo classical concert dependable, preset switching is not left to automatic estimation alone: an operator reads the score and triggers /scene_main and /scene_sub to confirm each form-level transition.

Input

Steinway Spirio / MIDI note, velocity, sustain pedal

Audio

Microphone input -> Max (MuBu / FluCoMa)

Host / Processing

Ableton Live -> VST MIDI Plugin -> Cycling ’74 Max

Output

Visualizer / OSC-driven preset control and rendering

Analysis / OSC

Analysis / Signal Design

Key design points for MIDI loudness estimation, pitch spaces, microphone analysis, and OSC control.

Piano-Like Envelope

Per-note loudness vol_n(t) is estimated in three stages: Attack, Initial Decay, and Long Tail, while sustain pedal latches the note after Note Off until release.

Fixed 128-D signals such as note_vol_list, note_accum_list, note_vel_list, and note_chroma_list are generated for glow, trails, and chroma-based visual control.

Pitch Space

The design combines data-driven 3D embeddings based on note co-occurrence with theory-driven geometries such as a Pitch Helix, Torus, and Fourier Phase Torus.

This makes it possible to switch between song-specific spatial relationships and stable geometric mappings chosen for a particular visual concept.

Audio Features

MuBu / FluCoMa extracts a 10-D feature vector, novelty, centroid, spread, and a 2D embedding so that timbral changes outside MIDI can be used as auxiliary control signals.

For prepared piano and other cases where MIDI is unavailable, microphone analysis becomes the only control source.

OSC Interface

Core OSC messages include /note_vol, /note_accum, /sustain_on, /scene_main, /scene_sub, /mubu/features, and /mubu/embedding2d, with both event-based and 128-D list-based messages defined.

OSC events intentionally carry no timestamps, so the Visualizer interprets messages by arrival order and local receive time.

Operations

Operational Design

Control rules chosen to keep a free-tempo live performance reliable.

The live design favors low overhead and robustness over strict synchronization, so automatic estimation remains supportive while dependable scene changes take priority.

MIDI stays the primary control source, while audio descriptors that can fluctuate under hall reverberation and dense overtones are treated as auxiliary signals.

Scene Control

Operator-triggered /scene_main and /scene_sub

Score Following

Absolute position estimation is auxiliary, not authoritative

Chroma

12-D chroma uses A-based indexing and must be converted for C-based systems

Audio Role

Prepared piano input, texture analysis, and cluster transitions

Explainer

Explainer Images

A visual guide that follows the whitepaper section by section and turns each core idea into diagrams.

Motivation and design goals diagram — Motivation and goals: why the system focuses on decay, resonance, pedaling, and musical structure rather than a simple piano-roll view.

Real-time piano visualization system flow diagram — Signal flow from Steinway Spirio to the Visualizer, including operator-confirmed scene switching and microphone-based auxiliary analysis.

Manual scene control and score-following role diagram — Explains the no-timestamp policy, the auxiliary role of score following, and why manual scene control stays authoritative in performance.

MIDI range and 128-dimensional vector diagram — Shows how the 88-key physical range is represented inside fixed 0-127 vectors for interoperability.

Piano-like loudness envelope diagram — The loudness estimation model showing attack, initial decay, long tail, and sustain-pedal hold.

Envelope parameter effects and derived signal diagram — Summarizes how velocity, register, and pedal affect time constants, plus derived signals such as accumulation and chroma.

Song-specific note map based on piano-visualization embeddings — A song-specific note layout reconstructed from the piano-visualization embedding JSON.

Theory-driven pitch-space models diagram — Summarizes the Pitch Helix, Simple Torus, Fourier Phase Torus, and the exported JSON lookup-table format.

OSC interface families diagram — Organizes the OSC specification into four message families: Scene, MIDI Event, MIDI List, and Audio / MuBu.

Microphone analysis and clustering diagram — Shows the microphone-analysis path through MuBu / FluCoMa, including 10-D features, 2D embedding, and clustering.

Operational rules and constraints diagram — Summarizes the operational constraints: no timestamps, manual scenes first, A-based chroma, and audio treated as auxiliary.

Direction / Systems

Primary credits for direction, systems, and lighting.

Artistic Direction

Hayato Sumino

Show Director & Visual Direction

Daito Manabe (Studio Daito Manabe, sonicPlanet, Rhizomatiks)

Systems & Interaction Design

System & Interaction Design (Live System, Piano Analysis System, MIDI/Audio Reactive System, Interaction Design): Daito Manabe (Studio Daito Manabe, sonicPlanet, Rhizomatiks)

Live System Development & Operation: Kosaku Namikawa (7ild3)

Piano Analysis System Development: Sinan Bokesoy (sonicPlanet)

Lighting Design & Programming

Lighting Design: Takayuki Fujimoto (Kinsei R&D)

Lighting Programming: Ludo Takebe (LDMC Inc.)

Lighting System Engineering: Kunio Tamada (TamaTechLab.）

Lighting System Development: 2bit (ISHII 2bit Program Office)

Lighting installation : Sachiko Matsui（SWEET STUFF GROUP CO.,ltd）

Visual Program

Visual Program by Part

Visual design and programming credits organized by Part I, Part II, and Encore.

Part I

J.S. Bach: The Well-Tempered Clavier, Book I, No. 1 in C major, BWV 846 “Prelude and Fugue” – Visual Design & Programming: Daito Manabe (Studio Daito Manabe, sonicPlanet, Rhizomatiks)

J.S. Bach: Partita No. 2 in C minor, BWV 826

I. Sinfonia / II. Allemande / III. Courante / IV. Sarabande / V. Rondeaux / VI. Capriccio – Visual Design & Programming: Yuta Okuyama

John Cage: Sonata I from Sonatas and Interludes for prepared piano – Visual Design & Programming: Yuta Okuyama, Daito Manabe (Studio Daito Manabe, sonicPlanet, Rhizomatiks)

Hayato Sumino: Human Universe – Visual Design & Programming: 2bit (ISHII 2bit Program Office)

Ludwig van Beethoven: Piano Sonata No. 14 in C-sharp minor, Op. 27-2 “Moonlight”

I. Adagio sostenuto / II. Allegretto / III. Presto agitato – Visual Design & Programming: Satoshi Horii (Rhizomatiks)

Part II

Nikolai Kapustin: 8 Concert Etudes, Op. 40 – Nos. 1, 2, 3 – Visual Design & Programming: Satoshi Horii (Rhizomatiks)

Arvo Pärt: Für Alina – Visual Design & Programming: 2bit (ISHII 2bit Program Office)

Maurice Ravel: Jeux d’eau – Visual Design & Programming: Sogen Handa (Freelance)

Hayato Sumino: Postlude “Amadare” – Visual Design & Programming: Tatsuya Ishii (Rhizomatiks)

John Cage: Sonata XII from Sonatas and Interludes for prepared piano – Visual Design & Programming: Yuta Okuyama, Daito Manabe (Studio Daito Manabe, sonicPlanet, Rhizomatiks)

Encore

Hayato Sumino: Nocturne II ? After Dawn – Visual Design & Programming: Daito Manabe (Studio Daito Manabe, sonicPlanet, Rhizomatiks)

Hayato Sumino: “Twinkle, Twinkle, Little Star” Variations – Seven Levels – Visual Design & Programming: Satoshi Horii (Rhizomatiks)

Production

Production, technical, and support teams involved in the performance.

Live & Creation Staff

Technical Direction, Staging System Development & Operation: Kosaku Namikawa (7ild3)

Stage Engineering : So Ozaki

Data Editing: Kosaku Namikawa(7ild3), Daito Manabe (Studio Daito Manabe, sonicPlanet, Rhizomatiks), Kyoko Koyama, Hope Box

Technical Support : Kyo Imai

Assistant: Keke(Rhizomatiks)

Venue Modeling : Masahiro Kadokawa（Cuddys Pic）