Synthesis from musical instrument character maps

A new method is introduced for encapsulating the properties of a musical instrument for synthesis that is realistic both in terms of sound quality and responsiveness. Sound quality is achieved using analysis-synthesis techniques for capturing and reproducing the sounds of an instrument from actual recordings. The concept of the musical instrument character map (MICMap) is introduced as the basis for achieving responsiveness. The MICMap relates parameters about how an instrument is played to the sounds that the instrument creates. For example, the MICMap of a cello might relate the playing parameters of bowing force and bowing speed to the sound properties of harmonic magnitude. The MICMap has been implemented with neural networks, using a combination of supervised and unsupervised learning methods. Results are presented for an instrument model that accepts initial excitation only (e.g. plucked and struck instruments) and progress-to-date is described for making the transition to instruments which receive continuous excitation (e.g. bowed and blown instruments).