New York Academy of Science - Neural Harmony

New York Academy of Science

Neural Harmony

Client
New York Academy of Science
Category
Cultural Institution
Output
Interactive Installation
Location
New York, NY, USA
Duration
3 months

Neural Harmony interactive installation explores the concept of Neural Syntax proposed by professor György Buzsáki. Neural Syntax suggests that the brain organizes information and processes sequences through rhythmic brain waves, akin to a language-like syntax that structures neural communication and cognitive functions.

We transformed the Neural Syntax theory into an interactive metaphorical game. By comparing nested brain activity to the structure of language - letters, words, sentences, and paragraphs - we created an intuitive way to visualize these relationships. The interactive installation invites audiences to explore the theory through playing, making its complex concepts easier to understand.

Behavior Description

Using the hierarchical relationship of letters, words, and sentences as a metaphor, Neural Harmony illustrates the nested hierarchical relationship between different brainwaves. When the user turns the knob: letters rearrange within specific words, like the faster neural oscillations nested within slower rhythms. Sentences are like the slowest neural oscillations, controlling and organizing all the faster ones.

Technical Information

  • TouchDesigner, p5.js and UE5 development for the interactive brain wave and text animation content.
  • Connecting Phidget input to control p5.js and UE5 animated experience.
  • Projection Mapping and pepper ghost effect.

Exhibitions & Press

Credits

← Back to work