Nov 16, 2022 · We probe this ability in an in-depth study of the pathways language model (PaLM), which has demonstrated the strongest machine translation (MT) performance.

Jul 9, 2023 · In all language pairs evaluated, fluency MQM scores for PaLM are generally similar to those for SOTA systems, while accuracy scores are lower.

In this paper, we carry out an in-depth investigation into the translation capabilities of LLMs, testing different prompting strategies and carefully assessing ...

Despite being trained mainly on English corpora and with only limited number of parallel text, LLMs have shown competitive performance in machine translation ...

Jul 10, 2023 · On-demand video platform giving you access to lectures from conferences worldwide.

Nov 18, 2022 · Prompting PaLM for Translation: Assessing Strategies and Performance. We evaluate the translation capability of LLMs with the procedure ...

2023. pdf bib abs. Prompting PaLM for Translation: Assessing Strategies and Performance · David Vilar | Markus Freitag | Colin Cherry | Jiaming Luo | Viresh ...

The capability of prompting heavily depends on its surface representation, where small modifications to the prompt could cause high variance in its performance.

Nov 18, 2022 · Prompting PaLM for Translation: Assessing Strategies and Performance. We evaluate the translation capability of LLMs with the procedure ...

Prompting palm for translation: Assessing strategies and performance. D Vilar, M Freitag, C Cherry, J Luo, V Ratnakar, G Foster. arXiv preprint arXiv ...