Deep Neural Networks for Sound Synthesis of Thai Duct F1ute, Khlui

Abstract

This paper introduces Thai musical instrument sound synthesis with an intelligent technique which is a combination of deep neural networks and conventional signal processing techniques. The instrument focused on in this paper is the Khlui, which is a unique Thai reedless wind instrument. Khlui sound can be synthesized by performing a combination of additive and subtractive syntheses. The synthesis system takes the pitch and loudness of any monophonic input signal. Then, multilayer perceptron and recurrent neural networks are used together in order to generate 3 parameters which are harmonic distribution, filter magnitude response, and the signal envelope. Finally, the harmonic characteristic of the Khlui along with the blowing noises are highly synthesized. The results are natural-sounding and realistic when compared with the recorded Khlui audio. This research will contribute to the more convenient natural synthesis of the Khlui sounds.