SUMMARY : Session
Title | Evaluation of multimodal components within CHIL: The evaluation packages and results |
---|---|
Authors | D. Mostefa, M. Garcia, K. Choukri |
Abstract | This article describes the first CHIL evaluation campaign in which 12 technologies were evaluated. The major outcomes of the first evaluation campaign are the so-called Evaluation Packages. An evaluation package is the full documentation (definition and description of the evaluation methodologies, protocols and metrics) alongside the data sets and software scoring tools, which an organisation needs in order to perform the evaluation of one or more systems for a given technology. These evaluation packages will be made available to the community through ELDA General Catalogue. |
Keywords | corpus, multimodal interfaces, meeting data, evaluation |
Full paper | Evaluation of multimodal components within CHIL: The evaluation packages and results |