Coding book:
Coding book not public available.

Number of annotators:
Between 4 and 10. (linguists, computational linguists, computer scientists)

Number of annotated dialogues:
Lots of test sets. Each test set consists of roughly 100 utterances.

Evaluations of scheme:
The correct word to state classification rate is 89%.

("Statistical Analysis of Dialogue Structure"; Ye-Yi Wang, Alex Waibel)

"scores from different judges may vary by as much as 10 percentage points" in Donna Gates et al. : End-to-End Evaluation in JANUS: A Speech-to-Speech translation system in: E. Maierr, M. Mast, S. LuperFoy (Eds.):Lecture Notes in Artificial Intelligence 1236 Dialogue Processing in Spoken Language Systems, Springer-Verlag Berlin Heidelberg, 1997
 

Underlying task:
Appointment scheduling
 

List of phenomena annotated:
Related to C-STAR phenomena.

Examples:
[nicety] (Hello Dr. Noah)
[nicety] (Hi Tor)
[suggest-meeting] (let's set up a meeting for a couple of hours)
[temporal] (in the next two weeks)
[your-availability] (when's good for you)
[interject] (let's see)
[suggest-time] (how about Friday the second in the morning)
[my-unavailability] (I'm busy that morning)

Markup language:
Own format.

Existence of annotation tools:
Annotation by hand.

Usability:
Janus system

Contact person:
Lori Levin (Lori_Levin@alexis.boltz.cs.cmu.edu)

Last Modificatiuon: 27.8.1998 by Marion Klein