Nov 16, 2022 · Our study reveals that the offline metrics are well correlated with CR and can be reliably used for evaluating machine translation in simultaneous mode.
MT Metrics Correlate with Human Ratings of Simultaneous Speech ...
aclanthology.org › 2023.iwslt-1.12
Our study reveals that the offline metrics are well correlated with CR and can be reliably used for evaluating machine translation in simultaneous mode, with ...
Jul 13, 2023 · These metrics have been used to evaluate simultaneous speech translation (SST) but their correlations with human ratings of SST, which has been ...
An extensive correlation analysis of CR and offline machine translation evaluation metrics reveals that the offline metrics are well correlated with CR.
Nov 16, 2022 · Our studies reveal that the offline MT metrics correlate with CR and can be reliably used for evaluating machine translation in the simultaneous ...
This is an attachement of the paper "MT Metrics Correlate with Human Ratings of Simultaneous Speech Translation" that will be published at IWSLT 2023.
Jun 1, 2023 · We found correlation of offline MT metrics to hu- man judgements of simultaneous speech transla- tion. The most correlating and thus preferred ...
People also ask
What is MT vs human translation?
Is an automatic metric for MT evaluation with high levels of correlation with human judgments?
An extensive correlation analysis of CR and offline machine translation evaluation metrics reveals that the offline metrics are well correlated with CR and ...
Jun 19, 2024 · This study aims to assess the reliability of automatic metrics in evaluating simultaneous interpretations by analyzing their correlation with ...
MT metrics correlate with human ratings of simultaneous speech translation. In IWSLT, 2023. [Nguyen et al.,2021a] Ha Nguyen, Yannick Est`eve, and. Laurent ...