We show that both paraphrased test sets lead to significant decrease in performance on multiple state-of-the-art QA models. Using a neural paraphrasing model ...
People also ask
How do you evaluate the robustness of question answering models to paraphrased questions?
In what ways can paraphrasing help you again use your own words in answering the question?
What are the three stages of question answering system?
What is paraphrasing the question?
We explore the robustness of QA models to question paraphrasing by creating two test sets consisting of paraphrased SQuAD questions. Paraphrased questions from ...
Jul 1, 2019 · This work proposes a data augmentation approach that requires no human intervention to re-train the models for improved robustness to ...
Gan & Ng (2019) used paraphrases to create an adversarial test set that uses context words close to incorrect answers in order to confuse the system. Including ...
Datasets for the paper "Improving the Robustness of Question Answering Systems to Question Paraphrasing" (ACL 2019) - nusnlp/paraphrasing-squad.
This method provides us with a paraphrase of the original question prompt, holding the context and answer constant. Second, the contexts in the out-of-domain ...
Exposing the QA models to more diverse question phrases would be a logical step to improve the QA models' robustness to question paraphrasing. Generating ...
Improving the Robustness of Question Answering Systems to Question Paraphrasing · 1 code implementation • ACL 2019 • Wee Chung Gan, Hwee Tou Ng. Despite the ...
Project's Publications. Wee Chung Gan, Hwee Tou Ng. Improving the Robustness of Question Answering Systems to Question Paraphrasing. ACL 2019. 6065- ...
This study presents a variational QAG model that generates multiple diverse QA pairs from a paragraph that conjecture that diversity-promoting QAG can ...