Jan 29, 2023 · We propose Schema-Guided Semantic Accuracy (SGSAcc) to evaluate utterances generated from both categorical and non-categorical slots by recognizing textual ...

We propose Schema-Guided Semantic Accuracy (SGSAcc) to evaluate utterances generated from both categorical and non-categorical slots by recognizing textual ...

This repository hosts the code for Schema-Guided Semantic Accuracy: Faithfulness in Task-Oriented Dialogue Response Generation, including the prefix-tuning ...

We show that SGSAcc can be applied to evaluate utterances generated from a wide range of dialogue actions in the Schema Guided Dialogue (SGD) dataset with good ...

Readers: Everyone. Schema-Guided Semantic Accuracy: Faithfulness in Task-Oriented Dialogue Response Generation · Jinghong Chen, Weizhe Lin, Bill Byrne.

Our evaluations reveal that while PLM fine-tuning leads to higher accuracy and coherence, LLM-based systems excel in producing diverse and likeable responses.

Schema-guided semantic accuracy: Faithfulness in task-oriented dialogue response generation. J Chen, W Lin, B Byrne. arXiv preprint arXiv:2301.12568, 2023. 3 ...

Schema-guided dialogue state trackers can generalise to new ... Schema-Guided Semantic Accuracy: Faithfulness in Task-Oriented Dialogue Response Generation.

In this paper, we propose a plug-and-play method for consistency identification, which can introduce external knowledge into the internal reasoning process.

Schema-Guided Semantic Accuracy: Faithfulness in Task-Oriented Dialogue Response Generation · Jinghong ChenWeizhe LinB. Byrne. Computer Science. ArXiv. 2023.