Timbre Replacement for Harmonic and Drum Components of Music Audio Signals

Tomohiko Nakamura, Hirokazu Kameoka (The University of Tokyo), Kazuyoshi Yoshii, and Masataka Goto (National Insitute of Advanced Industrial Science and Technology)

We show a system that can replace the frequency characteristics of the harmonic component and the drum timbres of a musical piece with those of another musical piece [1]. Audio examples generated by the proposed system are shown below.

All the audio files are from RWC music database [2].
Audio signals of the harmonic and percussive components are normalized such that the maximum of their amplitudes is one.

Input music audio signal	Reference music audio signal	Synthesized music audio signal by Equalizing method	Synthesized music audio signal by Copy and Paste method
RWC-MDB-P-2001 No. 12 "KAGE-ROU" Full Harmonic component Percussive component	RWC-MDB-P-2001 No. 64 "So Long" Full Harmonic component Percussive component	Full Harmonic component Percussive component	Full Harmonic component Percussive component
RWC-MDB-P-2001 No. 52 "Haru ga kurukara" Full Harmonic component Percussive component	RWC-MDB-P-2001 No. 64 "So Long" Full Harmonic component Percussive component	Full Harmonic component Percussive component	Full Harmonic component Percussive component
RWC-MDB-G-2001 No. 13 "Guess Again" Full Harmonic component Percussive component	RWC-MDB-G-2001 No. 14 "Tuesday Morning" Full Harmonic component Percussive component	Full Harmonic component Percussive component	Full Harmonic component Percussive component

References

[1] Tomohiko Nakamura, Hirokazu Kameoka, Kazuyoshi Yoshii, and Masataka Goto, “Timbre replacement of harmonic and drum components for music audio signals,” in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, May 2014, pp. 7520–7524.
demo
[2] Masataka Goto, "Development of the RWC Music Database," Proc. 18th International Congress on Acoustics (ICA 2004), pp. I-553-556, April 2004.