Music-Search App Allows User to Draw Music in Air


SoundTracer app developed by researcher Olivier Lartillot from the University of Oslo allows user to search for a sing within digital library

The experimental new iOS app called as SoundTracer allows user to search for a specific song within a digital library, by ‘drawing’ musical wave in the air with phone. To use this app, user has to move iPhone or iPad vertically in the air to replicate the rise and fall of the pitch of the introduction to the piece of music in question. The app uses the device’s accelerometer and gyroscope to track specific gestures, which provide ascending and descending audio feedback tones.

The principle behind the app is an onscreen graph displaying the range of movement. That graph is compared to others for the intros to known pieces of music within the user’s library. If a match is found, that piece is displayed to user. Currently, SoundTracer is in initial phase having collection of around 50 Norwegian folk songs. The graphs of these songs are manually programmed into the app by developer. Lartillot has developed automation algorithms, which should let future versions of the app generate their own graphs for every piece of music in the user’s library.

Various market players are introducing this technology to enhance experience of the user. For instance, In March 2018, Chrome Music Lab launched a new music creation tool called Song Maker. A browser-based experience, Song Maker is a sequencer allows user to program loops for two different instruments of user’s choice, which can be saved and shared with someone else for collaboration.