Sonosthesia-Hub

The hub is the central building block which allows all the other software components to talk to each other. It implements networking, messaging, mapping and processing functionality as typescript modules running on node.js. This can be used independently or with a web-based UI based on angular 2, using electron. Client components can connect to the hub using websockets or raw tcp, exchanging JSON messages. Other connection options may be added later as the need arises.

Sonosthesia-Unity

A set of Unity C# utilities and behaviours providing a number of extensions for the Sonosthesia project. This includes core functionality such as websocket-based connectivity to the sonosthesia hub and utilities to handle sonosthesia messages. It also offers different scripts for scene setup, configuration and manipulation which are driven by control messages which facilitate the development of responsive, interactive scenes which can interact with other sonosthesia components.

Sonosthesia-Analyser

VST/AU plugin to analyse sound and broadcast them to the sonosthesia hub. Alternatively, you can map the results to channels and parameters, and broadcast them to OSC control targets (host/port combination). This project is derived from Adam Stark's Sound Analyser. Sound analysis can be performed using a variety of algorithms from the Gist library and others, additional analysis options are planned. You can use the sound going through any channel or bus in your DAW as a controller for anything that understands sonosthesia protocols, anywhere on your local network.

Sonosthesia-Relay

VST/AU plugin to intercept MIDI messages and automation data and broadcast to the sonosthesia hub. Alternatively, you can map the results to control channels and parameters and broadcast them to OSC control targets (host/port combination). There are different options to translate MIDI data to control data to allow for maximum flexibility. You can forward all your DAW's MIDI and automation data as controllers for anything that understands Sonosthesia protocols, anywhere on the network.