<div dir="ltr"><div><div><div><div>Hi Dave,<br><br></div>This task is the main goal of my PhD thesis. I'm doing lip-sync from the input text over the time duration estimation done while the speech is generated. You can develop your own strategy for lip/mouth synchronization, but often this is an avatar (or interface -I'm using a talking head too-) dependent task. So, if you are using an avatar, it depends if you can use blend shapes to mix by interpolation from the initial pose to the next one. Most of MPEG-4 systems are able to do that automatically.<br></div>On one hand, you have each phoneme and their start and finish time. On the other hand, you can adjust a set of visemes for each basic expression (no more than 15 are needed) and then choose the sequence corresponding to each word you are generating. It's the more efficient and simple way to have an effective lip synchronization.<br></div>Don't hesitate to contact me if you want more info or refs about.<br><br></div>Bes regards,<br><br></div><div class="gmail_extra"><br><div class="gmail_quote">2017-04-15 18:27 GMT+02:00 idoor Du <span dir="ltr"><<a href="mailto:idoorlab88@gmail.com" target="_blank">idoorlab88@gmail.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi all,<div><br></div><div>I am new to MaryTTS, tried to call its API via:</div><div><br></div><div>AudioInputStream audio = mary.generateAudio("testing");</div><div><br></div><div>Now I want to animate mouth/lip shapes at runtime based on the audio sound, how to achieve that? are there any <span style="color:rgb(36,39,41);font-family:arial,'helvetica neue',helvetica,sans-serif;font-size:15px;line-height:15.6px">viseme</span> data associated with the audio?</div><div><br></div><div>Thanks in advance.</div><div><br></div><div>Dave</div></div>
<br>______________________________<wbr>_________________<br>
Mary-users mailing list<br>
<a href="mailto:Mary-users@dfki.de">Mary-users@dfki.de</a><br>
<a href="http://www.dfki.de/mailman/cgi-bin/listinfo/mary-users" rel="noreferrer" target="_blank">http://www.dfki.de/mailman/<wbr>cgi-bin/listinfo/mary-users</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div><b>Joan Pere Sànchez Pellicer</b><br></div><a href="mailto:kaiserjp@gmail.com" target="_blank">kaiserjp@gmail.com</a><br></div><a href="http://www.chamaleon.net" target="_blank">www.chamaleon.net</a><br>+34 625 012 741<br></div></div>
</div>