Application of Voice Conversion for Cross-Language Rap Singing Transformation

Oytun Türk; Osman Büyük; Ali Haznedaroglu; Levent M. Arslan

In: Proceedings of IEEE ICASSP 2009. International Conference on Acoustics, Speech and Signal Processing (ICASSP-2009), located at SST conference 2009, April 19-24, Taipei, Taiwan, Taiwan, Province of China, Institute of Electrical and Electronics Engineers (IEEE), 2009.


Voice conversion enables generation of a desired speaker's voice from audio recordings of another speaker. In this paper, we focus on a music application and describe the first steps towards generating voices of music celebrities using conventional voice conversion techniques. Specifically, rap singing transformations from English to Spanish are performed using parallel training material in English. Weighted codebook mapping based voice conversion with two different alignment methods and temporal smoothing of the transformation filter are employed. The first aligner uses a HMM trained for each source recording to force-align the corresponding target recording. The second aligner employs speaker-independent HMMs trained from a large number of speakers. Additionally, a smoothing step is devised to reduce discontinuities and to improve performance. The results of subjective evaluations indicate that both aligners perform equivalently well. The proposed smoothing technique improves both similarity to target singer and quality significantly regardless of the alignment method.


Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence