[mary-users] Cannot use any non-Mbrola voices

Fri Nov 5 11:00:39 CET 2010

Dear Jay,

thank you very much for the log file, which allows us to pinpoint the issue. Apparently the AcousticModeller module is not being registered properly during server startup. This is probably http://mary.opendfki.de/ticket/346 rearing its ugly head.

As a workaround, and since I notice that you're using an older SVN checkout, could you please try merging in changeset 2682 and see if the problem goes away? The trigger might be the te.config, which up to that changeset caused a deprecated module to become registered, which under some conditions would in fact prevent registration of the AcousticModeller; if this helps in your case, we can confirm that this is the cause.

The root of the problem seems to be the somewhat unpredictable interaction between the ModuleRegistry and installed components, but it will take some effort to defray.

Best wishes,

/**
 * Ingmar Steiner
 * Researcher, Language Technology
 * German Research Center for Artificial Intelligence
 *
 * Campus D3 1 +1.18
 * D-66123 Saarbrücken
 * Germany
 * Phone: ++49-681-857-75-5263 (NEW!)
 * Email: ingmar.steiner at dfki.de
 *
 * Deutsches Forschungszentrum für Künstliche Intelligenz GmbH
 * Trippstadter Straße 122, D-67663 Kaiserslautern, Germany
 * Geschäftsführung:
 * Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster (Vorsitzender)
 * Dr. Walter Olthoff
 * Vorsitzender des Aufsichtsrats:
 * Prof. Dr. h.c. Hans A. Aukes
 * Amtsgericht Kaiserslautern, HRB 2313
 */

On 4 Nov 2010, at 22:27, Jay Yu wrote:

> The log file is attached (BTW, the command line specification of the log4j params does not seem to override the props in log4j.properties file).
> 
> Thanks!
> 
> On 11/04/2010 09:53 AM, Ingmar Steiner wrote:
>> Hi Jay,
>> 
>> thanks for the clarification. The reason I ask is that I suspect that the ModuleRegistry is not finding the correct path through the registered modules, one of which is MaryXMLToMbrola, which however should not be used for non-MBROLA voices.
>> 
>> Since I cannot reproduce your error (except when making the "illegal" request for MBROLA output I mentioned in my first response), could you please try the following?
>> 
>> 1) start the Mary server using the following command
>> 
>> bin/maryserver -Dlog4j.logger.marytts=DEBUG,logfile -Dlog4j.appender.logfile.File=MARYBASE/my.log
>> 
>> 2) make a synthesis request to reproduce the error you've been getting
>> 
>> 3) email me the full MARYBASE/my.log file, which should now contain all DEBUG data from this one server session
>> 
>> Best wishes,
>> 
>> /**
>>  * Ingmar Steiner
>>  * Researcher, Language Technology
>>  * German Research Center for Artificial Intelligence
>>  *
>>  * Campus D3 1 +1.18
>>  * D-66123 Saarbrücken
>>  * Germany
>>  * Phone: ++49-681-857-75-5263 (NEW!)
>>  * Email: ingmar.steiner at dfki.de
>>  *
>>  * Deutsches Forschungszentrum für Künstliche Intelligenz GmbH
>>  * Trippstadter Straße 122, D-67663 Kaiserslautern, Germany
>>  * Geschäftsführung:
>>  * Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster (Vorsitzender)
>>  * Dr. Walter Olthoff
>>  * Vorsitzender des Aufsichtsrats:
>>  * Prof. Dr. h.c. Hans A. Aukes
>>  * Amtsgericht Kaiserslautern, HRB 2313
>>  */
>> 
>> On 4 Nov 2010, at 16:23, Jay Yu wrote:
>> 
>>> I am using a 32 bit Redhat Enterprise 5th edition Linux box.
>>> My log level is set to debug and the log file is too big to attach.
>>> The part I included is the msg related to the request.
>>> 
>>> thanks for your help!
>>> 
>>> Jay
>>> 
>>> On 11/04/2010 01:31 AM, Ingmar Steiner wrote:
>>>> Interesting! I would have preferred the full file, and with DEBUG level output, not only INFO, but I'm beginning to suspect something. Are you by any chance running on a 64 bit architecture?
>>>> 
>>>> Best wishes,
>>>> 
>>>> /**
>>>>  * Ingmar Steiner
>>>>  * Researcher, Language Technology
>>>>  * German Research Center for Artificial Intelligence
>>>>  *
>>>>  * Campus D3 1 +1.18
>>>>  * D-66123 Saarbrücken
>>>>  * Germany
>>>>  * Phone: ++49-681-857-75-5263 (NEW!)
>>>>  * Email: ingmar.steiner at dfki.de
>>>>  *
>>>>  * Deutsches Forschungszentrum für Künstliche Intelligenz GmbH
>>>>  * Trippstadter Straße 122, D-67663 Kaiserslautern, Germany
>>>>  * Geschäftsführung:
>>>>  * Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster (Vorsitzender)
>>>>  * Dr. Walter Olthoff
>>>>  * Vorsitzender des Aufsichtsrats:
>>>>  * Prof. Dr. h.c. Hans A. Aukes
>>>>  * Amtsgericht Kaiserslautern, HRB 2313
>>>>  */
>>>> 
>>>> On 3 Nov 2010, at 17:25, Jay Yu wrote:
>>>> 
>>>>> I got the same exceptions running your request.
>>>>> 
>>>>> The following is from the server.log. BTW, this is tested on Redhat Linux with JDK 1.6.
>>>>> Thanks!
>>>>> 
>>>>> 2010-11-03 09:11:55,875 [I/O dispatcher 5] INFO  marytts.R 11 New request (input type "TEXT", output type "AUDIO", voice "cmu-slt-hsmm", effect "", audio "WAVE")
>>>>> 2010-11-03 09:11:55,875 [I/O dispatcher 5] INFO  marytts.server Read: Hello world
>>>>> 2010-11-03 09:11:55,875 [I/O dispatcher 5] INFO  marytts.R 11 Handling request using the following modules:
>>>>> 2010-11-03 09:11:55,875 [I/O dispatcher 5] INFO  marytts.R 11 - TextToMaryXML (marytts.modules.TextToMaryXML)
>>>>> 2010-11-03 09:11:55,875 [I/O dispatcher 5] INFO  marytts.R 11 Next module: TextToMaryXML
>>>>> 2010-11-03 09:11:55,876 [I/O dispatcher 5] INFO  marytts.R 11 Handling request using the following modules:
>>>>> 2010-11-03 09:11:55,876 [I/O dispatcher 5] INFO  marytts.R 11 - JTokeniser (marytts.language.en.JTokeniser)
>>>>> 2010-11-03 09:11:55,876 [I/O dispatcher 5] INFO  marytts.R 11 - XML2Utt TokensEn (marytts.language.en.XML2UttTokensEn)
>>>>> 2010-11-03 09:11:55,876 [I/O dispatcher 5] INFO  marytts.R 11 - TokenToWords (marytts.language.en.FreeTTSTokenToWords)
>>>>> 2010-11-03 09:11:55,876 [I/O dispatcher 5] INFO  marytts.R 11 - Utt2XML WordsEn (marytts.language.en.Utt2XMLWordsEn)
>>>>> 2010-11-03 09:11:55,876 [I/O dispatcher 5] INFO  marytts.R 11 - OpenNLPPosTagger (marytts.modules.OpenNLPPosTagger)
>>>>> 2010-11-03 09:11:55,876 [I/O dispatcher 5] INFO  marytts.R 11 - JPhonemiser (marytts.modules.JPhonemiser)
>>>>> 2010-11-03 09:11:55,876 [I/O dispatcher 5] INFO  marytts.R 11 - Prosody (marytts.language.en.Prosody)
>>>>> 2010-11-03 09:11:55,876 [I/O dispatcher 5] INFO  marytts.R 11 - PronunciationModel (marytts.language.en.PronunciationModel)
>>>>> 2010-11-03 09:11:55,876 [I/O dispatcher 5] INFO  marytts.R 11 - DummyAllophones2AcoustParams (marytts.modules.DummyAllophones2AcoustParams)
>>>>> 2010-11-03 09:11:55,876 [I/O dispatcher 5] INFO  marytts.R 11 - MaryXMLToMbrola (marytts.modules.MaryXMLToMbrola)
>>>>> 2010-11-03 09:11:55,876 [I/O dispatcher 5] INFO  marytts.R 11 - MbrolaCaller (marytts.modules.MbrolaCaller)
>>>>> 2010-11-03 09:11:55,876 [I/O dispatcher 5] INFO  marytts.R 11 Next module: JTokeniser
>>>>> 2010-11-03 09:11:55,876 [I/O dispatcher 5] INFO  marytts.R 11 Next module: XML2Utt TokensEn
>>>>> 2010-11-03 09:11:55,877 [I/O dispatcher 5] INFO  marytts.R 11 Next module: TokenToWords
>>>>> 2010-11-03 09:11:55,877 [I/O dispatcher 5] INFO  marytts.R 11 Next module: Utt2XML WordsEn
>>>>> 2010-11-03 09:11:55,877 [I/O dispatcher 5] INFO  marytts.R 11 Next module: OpenNLPPosTagger
>>>>> 2010-11-03 09:11:55,877 [I/O dispatcher 5] INFO  marytts.R 11 Next module: JPhonemiser
>>>>> 2010-11-03 09:11:55,921 [I/O dispatcher 5] INFO  marytts.R 11 Next module: Prosody
>>>>> 2010-11-03 09:11:55,922 [I/O dispatcher 5] INFO  marytts.R 11 Next module: PronunciationModel
>>>>> 2010-11-03 09:11:55,922 [I/O dispatcher 5] INFO  marytts.R 11 Next module: DummyAllophones2AcoustParams
>>>>> 2010-11-03 09:11:55,922 [I/O dispatcher 5] INFO  marytts.R 11 Next module: MaryXMLToMbrola
>>>>> 2010-11-03 09:11:55,922 [I/O dispatcher 5] ERROR marytts.server Processing failed.
>>>>> java.lang.Exception: Module MaryXMLToMbrola: Problem processing the data.
>>>>>        at marytts.server.Request.processOneChunk(Request.java:555)
>>>>>        at marytts.server.Request.processOrLookupOneChunk(Request.java:394)
>>>>>        at marytts.server.Request.process(Request.java:341)
>>>>>        at marytts.server.http.SynthesisRequestHandler.process(SynthesisRequestHandler.java:286)
>>>>>        at marytts.server.http.SynthesisRequestHandler.handleClientRequest(SynthesisRequestHandler.java:112)
>>>>>         at marytts.server.http.BaseHttpRequestHandler.handle(BaseHttpRequestHandler.java:150)
>>>>>        at org.apache.http.nio.protocol.BufferingHttpServiceHandler$RequestHandlerAdaptor.handle(BufferingHttpServiceHandler.java:193)
>>>>>        at org.apache.http.nio.protocol.SimpleNHttpRequestHandler.handle(SimpleNHttpRequestHandler.java:55)
>>>>>        at org.apache.http.nio.protocol.AsyncNHttpServiceHandler.processRequest(AsyncNHttpServiceHandler.java:454)
>>>>>        at org.apache.http.nio.protocol.AsyncNHttpServiceHandler.requestReceived(AsyncNHttpServiceHandler.java:229)
>>>>>        at org.apache.http.nio.protocol.BufferingHttpServiceHandler.requestReceived(BufferingHttpServiceHandler.java:131)
>>>>>        at org.apache.http.impl.nio.DefaultNHttpServerConnection.consumeInput(DefaultNHttpServerConnection.java:167)
>>>>>        at org.apache.http.impl.nio.DefaultServerIOEventDispatch.inputReady(DefaultServerIOEventDispatch.java:145)
>>>>>        at org.apache.http.impl.nio.reactor.BaseIOReactor.readable(BaseIOReactor.java:153)
>>>>>        at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvent(AbstractIOReactor.java:314)
>>>>>        at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvents(AbstractIOReactor.java:294)
>>>>>        at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:256)
>>>>>        at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:96)
>>>>>        at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:556)
>>>>>        at java.lang.Thread.run(Thread.java:619)
>>>>> Caused by: java.lang.IllegalArgumentException: Expected an MBROLA voice, but cmu-slt-hsmm is a class marytts.htsengine.HMMVoice
>>>>>        at marytts.modules.MaryXMLToMbrola.convertToMbrola(MaryXMLToMbrola.java:127)
>>>>>        at marytts.modules.MaryXMLToMbrola.process(MaryXMLToMbrola.java:112)
>>>>>        at marytts.server.Request.processOneChunk(Request.java:553)
>>>>>        ... 19 more
>>>>> 2010-11-03 09:11:55,923 [I/O dispatcher 5] INFO  marytts.server Request couldn't be handled successfully.
>>>>> 2010-11-03 09:11:56,085 [I/O dispatcher 5] INFO  marytts.server Connection closed: [closed]
>>>>> 
>>>>> 
>>>>> 
>>>>> 
>>>>> 
>>>>> On 11/03/2010 09:11 AM, Ingmar Steiner wrote:
>>>>>> Hi Jay,
>>>>>> 
>>>>>> the following request works for me as expected:
>>>>>> 
>>>>>> http://localhost:59125/process?INPUT_TEXT=Hello+world&INPUT_TYPE=TEXT&OUTPUT_TYPE=AUDIO&LOCALE=en_US&AUDIO=WAVE_FILE&VOICE=cmu-slt-hsmm
>>>>>> 
>>>>>> If you're still getting errors, could you please follow the guidelines at http://mary.opendfki.de/wiki/FrequentlyAskedQuestions#bugreport to produce a debug log and send it to me?
>>>>>> 
>>>>>> Best wishes,
>>>>>> 
>>>>>> /**
>>>>>>  * Ingmar Steiner
>>>>>>  * Researcher, Language Technology
>>>>>>  * German Research Center for Artificial Intelligence
>>>>>>  *
>>>>>>  * Campus D3 1 +1.18
>>>>>>  * D-66123 Saarbrücken
>>>>>>  * Germany
>>>>>>  * Phone: ++49-681-857-75-5263 (NEW!)
>>>>>>  * Email: ingmar.steiner at dfki.de
>>>>>>  *
>>>>>>  * Deutsches Forschungszentrum für Künstliche Intelligenz GmbH
>>>>>>  * Trippstadter Straße 122, D-67663 Kaiserslautern, Germany
>>>>>>  * Geschäftsführung:
>>>>>>  * Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster (Vorsitzender)
>>>>>>  * Dr. Walter Olthoff
>>>>>>  * Vorsitzender des Aufsichtsrats:
>>>>>>  * Prof. Dr. h.c. Hans A. Aukes
>>>>>>  * Amtsgericht Kaiserslautern, HRB 2313
>>>>>>  */
>>>>>> 
>>>>>> On 3 Nov 2010, at 16:52, Jay Yu wrote:
>>>>>> 
>>>>>>> Hi Ingmar,
>>>>>>> Thanks for your reply!
>>>>>>> No, I was not trying to get MBROLA output. My output type was AUDIO and voice param is
>>>>>>> cmu_slt-hsmm (or cmu_slt). I was just trying to test all the voices.
>>>>>>> What shold be correct params in teh client if I want to try non-Mbrola voices?
>>>>>>> 
>>>>>>> Jay
>>>>>>> 
>>>>>>> On 11/03/2010 03:26 AM, Ingmar Steiner wrote:
>>>>>>>> Dear Jay,
>>>>>>>> 
>>>>>>>> without seeing your debug log, I can only speculate, but judging from the error message you provide:
>>>>>>>> 
>>>>>>>> On 2 Nov 2010, at 23:54, Jay Yu wrote:
>>>>>>>>> Caused by: java.lang.IllegalArgumentException: Expected an MBROLA voice, but cmu-slt-hsmm is a class marytts.htsengine.HMMVoice
>>>>>>>> I suppose you are trying to get MBROLA output from a non-MBROLA voice. Simply put, you can't do that.
>>>>>>>> 
>>>>>>>> Best wishes,
>>>>>>>> 
>>>>>>>> /**
>>>>>>>>  * Ingmar Steiner
>>>>>>>>  * Researcher, Language Technology
>>>>>>>>  * German Research Center for Artificial Intelligence
>>>>>>>>  *
>>>>>>>>  * Campus D3 1 +1.18
>>>>>>>>  * D-66123 Saarbrücken
>>>>>>>>  * Germany
>>>>>>>>  * Phone: ++49-681-857-75-5263 (NEW!)
>>>>>>>>  * Email: ingmar.steiner at dfki.de
>>>>>>>>  *
>>>>>>>>  * Deutsches Forschungszentrum für Künstliche Intelligenz GmbH
>>>>>>>>  * Trippstadter Straße 122, D-67663 Kaiserslautern, Germany
>>>>>>>>  * Geschäftsführung:
>>>>>>>>  * Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster (Vorsitzender)
>>>>>>>>  * Dr. Walter Olthoff
>>>>>>>>  * Vorsitzender des Aufsichtsrats:
>>>>>>>>  * Prof. Dr. h.c. Hans A. Aukes
>>>>>>>>  * Amtsgericht Kaiserslautern, HRB 2313
>>>>>>>>  */
>>>>>>>> 
> <server.log>