Hello everyone, on this occasion, I will share a little information as I have, hopefully useful
image source [1]steemians best friend The team from the Magenta project from Google has released a hardware interface for algorithm-based synthesizers that use deep networks to produce new sounds. Musicians can use their fingers on the surface of Nsynth's colorful touch screen (the name of the hardware released by the Magenta project from Google) to explore unique sounds with a list of existing learning algorithm systems.
Synthetic Super Interface offers musicians a new way to make their music by using the nervous system to study sound characteristics from various sources and produce sounds that are completely new from what they have learned. This project confirms that new creations are not an ordinary mixture of works, but a truly new work that will be difficult to produce using hand synthesizers.
The Nsynth algorithm identifies and extracts 16 features from each sound source input.
"These features are then linearly interpolated to produce new embedding (mathematical representation of each sound)," explained the project team. "This new embedding is then translated into new sound, which has the acoustic quality of both inputs." So, for example, the sounds that have just been produced will have qualities such as flute and harp instruments and will be unique works.
While the Magenta project is looking for ways to interact with the NSynth algorithm, Super NSynth is the first interface hardware and was developed in collaboration with Google Creative Lab. This interface can be played with various MIDI sources, such as DAW, sequencers or keyboards and the algorithm can generate more than 100,000 new sounds by taking sound from various sources.
In an experiment, 16 sound sources from 15 different tones were recorded and then entered into Nsynth's algorithm. Each button from the super interface is assigned to 4 different sound sources. Characteristics of selected sound sources can then be manipulated using the touch screen to create new sounds
This project has made several prototypes from Super NSynth and placed them in the hands of musicians, but the hardware will not be released as commercial products. However, all design codes, schemes, and templates are available for download from GitHub.
