Computation and Language

Authors and titles for May 2024

[1] arXiv:2405.00134 [pdf, html, other]

Title: Transforming Dutch: Debiasing Dutch Coreference Resolution Systems for Non-binary Pronouns

Goya van Boven, Yupei Du, Dong Nguyen

Comments: 22 pages, 2 figures. Accepted at the 2024 ACM Conference on Fairness, Accountability, and Transparency (FAccT '24)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[2] arXiv:2405.00155 [pdf, html, other]

Title: HistNERo: Historical Named Entity Recognition for the Romanian Language

Andrei-Marius Avram, Andreea Iuga, George-Vlad Manolache, Vlad-Cristian Matei, Răzvan-Gabriel Micliuş, Vlad-Andrei Muntean, Manuel-Petru Sorlescu, Dragoş-Andrei Şerban, Adrian-Dinu Urse, Vasile Păiş, Dumitru-Clementin Cercel

Comments: Accepted at the International Conference on Document Analysis and Recognition (ICDAR 2024)

Subjects: Computation and Language (cs.CL)

[3] arXiv:2405.00175 [pdf, html, other]

Title: Towards a Search Engine for Machines: Unified Ranking for Multiple Retrieval-Augmented Large Language Models

Alireza Salemi, Hamed Zamani

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[4] arXiv:2405.00200 [pdf, html, other]

Title: In-Context Learning with Long-Context Models: An In-Depth Exploration

Amanda Bertsch, Maor Ivgi, Uri Alon, Jonathan Berant, Matthew R. Gormley, Graham Neubig

Comments: 27 pages; preprint

Subjects: Computation and Language (cs.CL)

[5] arXiv:2405.00201 [pdf, other]

Title: SPAFIT: Stratified Progressive Adaptation Fine-tuning for Pre-trained Large Language Models

Samir Arora, Liangliang Wang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[6] arXiv:2405.00204 [pdf, html, other]

Title: General Purpose Verification for Chain of Thought Prompting

Robert Vacareanu, Anurag Pratik, Evangelia Spiliopoulou, Zheng Qi, Giovanni Paolini, Neha Anna John, Jie Ma, Yassine Benajiba, Miguel Ballesteros

Comments: 22 pages, preprint

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[7] arXiv:2405.00208 [pdf, html, other]

Title: A Primer on the Inner Workings of Transformer-based Language Models

Javier Ferrando, Gabriele Sarti, Arianna Bisazza, Marta R. Costa-jussà

Subjects: Computation and Language (cs.CL)

[8] arXiv:2405.00216 [pdf, html, other]

Title: Graphical Reasoning: LLM-based Semi-Open Relation Extraction

Yicheng Tao, Yiqun Wang, Longju Bai

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[9] arXiv:2405.00253 [pdf, html, other]

Title: CodeHalu: Investigating Code Hallucinations in LLMs via Execution-based Verification

Yuchen Tian, Weixiang Yan, Qian Yang, Xuandong Zhao, Qian Chen, Wen Wang, Ziyang Luo, Lei Ma, Dawn Song

Subjects: Computation and Language (cs.CL); Software Engineering (cs.SE)

[10] arXiv:2405.00263 [pdf, other]

Title: Clover: Regressive Lightweight Speculative Decoding with Sequential Knowledge

Bin Xiao, Chunan Shi, Xiaonan Nie, Fan Yang, Xiangwei Deng, Lei Su, Weipeng Chen, Bin Cui

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[11] arXiv:2405.00273 [pdf, html, other]

Title: Social Life Simulation for Non-Cognitive Skills Learning

Zihan Yan, Yaohong Xiang, Yun Huang

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[12] arXiv:2405.00289 [pdf, html, other]

Title: Adversarial Attacks and Defense for Conversation Entailment Task

Zhenning Yang, Ryan Krawec, Liang-Yuan Wu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[13] arXiv:2405.00291 [pdf, html, other]

Title: How Can I Improve? Using GPT to Highlight the Desired and Undesired Parts of Open-ended Responses

Jionghao Lin, Eason Chen, Zeifei Han, Ashish Gurung, Danielle R. Thomas, Wei Tan, Ngoc Dang Nguyen, Kenneth R. Koedinger

Comments: 11 pages, full research paper, EDM 2024

Journal-ref: A&A 687, A227 (2024)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

[14] arXiv:2405.00301 [pdf, html, other]

Title: Enhanced Language Model Truthfulness with Learnable Intervention and Uncertainty Expression

Farima Fatahi Bayat, Xin Liu, H. V. Jagadish, Lu Wang

Comments: ACL 2024 Findings (Long paper)

Subjects: Computation and Language (cs.CL)

[15] arXiv:2405.00302 [pdf, html, other]

Title: Generating Feedback-Ladders for Logical Errors in Programming using Large Language Models

Hasnain Heickal, Andrew Lan

Comments: Published on the 17th EDM 2024 - Posters and Demos Track

Subjects: Computation and Language (cs.CL)

[16] arXiv:2405.00321 [pdf, other]

Title: DFKI-NLP at SemEval-2024 Task 2: Towards Robust LLMs Using Data Perturbations and MinMax Training

Bhuvanesh Verma, Lisa Raithel

Subjects: Computation and Language (cs.CL)

[17] arXiv:2405.00332 [pdf, html, other]

Title: A Careful Examination of Large Language Model Performance on Grade School Arithmetic

Hugh Zhang, Jeff Da, Dean Lee, Vaughn Robinson, Catherine Wu, Will Song, Tiffany Zhao, Pranav Raja, Dylan Slack, Qin Lyu, Sean Hendryx, Russell Kaplan, Michele Lunati, Summer Yue

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[18] arXiv:2405.00361 [pdf, html, other]

Title: AdaMoLE: Fine-Tuning Large Language Models with Adaptive Mixture of Low-Rank Adaptation Experts

Zefang Liu, Jiahua Luo

Subjects: Computation and Language (cs.CL)

[19] arXiv:2405.00390 [pdf, html, other]

Title: CofiPara: A Coarse-to-fine Paradigm for Multimodal Sarcasm Target Identification with Large Multimodal Models

Hongzhan Lin, Zixin Chen, Ziyang Luo, Mingfei Cheng, Jing Ma, Guang Chen

Comments: ACL 2024

Subjects: Computation and Language (cs.CL)

[20] arXiv:2405.00402 [pdf, html, other]

Title: Self-Refine Instruction-Tuning for Aligning Reasoning in Language Models

Leonardo Ranaldi, Andrè Freitas

Subjects: Computation and Language (cs.CL)

[21] arXiv:2405.00465 [pdf, html, other]

Title: BiomedRAG: A Retrieval Augmented Large Language Model for Biomedicine

Mingchen Li, Halil Kilicoglu, Hua Xu, Rui Zhang

Subjects: Computation and Language (cs.CL)

[22] arXiv:2405.00467 [pdf, html, other]

Title: Harnessing the Power of Multiple Minds: Lessons Learned from LLM Routing

KV Aditya Srivatsa, Kaushal Kumar Maurya, Ekaterina Kochmar

Comments: Accepted to Workshop on Insights from Negative Results in NLP 2024 (co-located with NAACL 2024)

Subjects: Computation and Language (cs.CL)

[23] arXiv:2405.00492 [pdf, html, other]

Title: Is Temperature the Creativity Parameter of Large Language Models?

Max Peeperkorn, Tom Kouwenhoven, Dan Brown, Anna Jordanous

Comments: To be published in the Proceedings of the 15th International Conference on Computational Creativity (ICCC'24), 8 pages, 2 figures, 2 tables

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[24] arXiv:2405.00536 [pdf, html, other]

Title: A Legal Framework for Natural Language Processing Model Training in Portugal

Rúben Almeida, Evelin Amorim

Comments: LEGAL2024 Legal and Ethical Issues in Human Language Technologies, LREC 2024

Subjects: Computation and Language (cs.CL); Emerging Technologies (cs.ET)

[25] arXiv:2405.00543 [pdf, html, other]

Title: New Benchmark Dataset and Fine-Grained Cross-Modal Fusion Framework for Vietnamese Multimodal Aspect-Category Sentiment Analysis

Quy Hoang Nguyen, Minh-Van Truong Nguyen, Kiet Van Nguyen

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[26] arXiv:2405.00557 [pdf, html, other]

Title: Mixture of insighTful Experts (MoTE): The Synergy of Thought Chains and Expert Mixtures in Self-Alignment

Zhili Liu, Yunhao Gou, Kai Chen, Lanqing Hong, Jiahui Gao, Fei Mi, Yu Zhang, Zhenguo Li, Xin Jiang, Qun Liu, James T. Kwok

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[27] arXiv:2405.00578 [pdf, other]

Title: The Real, the Better: Aligning Large Language Models with Online Human Behaviors

Guanying Jiang, Lingyong Yan, Haibo Shi, Dawei Yin

Comments: 11 pages, 6 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[28] arXiv:2405.00588 [pdf, html, other]

Title: Are Models Biased on Text without Gender-related Language?

Catarina G Belém, Preethi Seshadri, Yasaman Razeghi, Sameer Singh

Comments: In International Conference on Learning Representations 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY); Machine Learning (cs.LG)

[29] arXiv:2405.00602 [pdf, html, other]

Title: Investigating Automatic Scoring and Feedback using Large Language Models

Gloria Ashiya Katuka, Alexander Gain, Yen-Yun Yu

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[30] arXiv:2405.00611 [pdf, html, other]

Title: Addressing Topic Granularity and Hallucination in Large Language Models for Topic Modelling

Yida Mu, Peizhen Bai, Kalina Bontcheva, Xingyi Song

Subjects: Computation and Language (cs.CL)

[31] arXiv:2405.00622 [pdf, other]

Title: Causal Evaluation of Language Models

Sirui Chen, Bo Peng, Meiqi Chen, Ruiqi Wang, Mengying Xu, Xingyu Zeng, Rui Zhao, Shengjie Zhao, Yu Qiao, Chaochao Lu

Comments: 315 pages, 230 figures, 21 tables. Project website: this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[32] arXiv:2405.00632 [pdf, html, other]

Title: When Quantization Affects Confidence of Large Language Models?

Irina Proskurina, Luc Brun, Guillaume Metzler, Julien Velcin

Comments: Accepted to NAACL 2024 Findings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[33] arXiv:2405.00657 [pdf, html, other]

Title: RST-LoRA: A Discourse-Aware Low-Rank Adaptation for Long Document Abstractive Summarization

Dongqi Pu, Vera Demberg

Comments: NAACL 2024 Main & Long Conference Paper (Oral Presentation)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[34] arXiv:2405.00659 [pdf, html, other]

Title: NLU-STR at SemEval-2024 Task 1: Generative-based Augmentation and Encoder-based Scoring for Semantic Textual Relatedness

Sanad Malaysha, Mustafa Jarrar, Mohammed Khalilia

Subjects: Computation and Language (cs.CL)

[35] arXiv:2405.00664 [pdf, html, other]

Title: Is Bigger Edit Batch Size Always Better? -- An Empirical Study on Model Editing with Llama-3

Junsang Yoon, Akshat Gupta, Gopala Anumanchipalli

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[36] arXiv:2405.00704 [pdf, html, other]

Title: A Survey on the Real Power of ChatGPT

Ming Liu, Ran Liu, Ye Zhu, Hua Wang, Youyang Qu, Rongsheng Li, Yongpan Sheng, Wray Buntine

Comments: 18 pages, 2 tables

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[37] arXiv:2405.00705 [pdf, html, other]

Title: SHED: Shapley-Based Automated Dataset Refinement for Instruction Fine-Tuning

Yexiao He, Ziyao Wang, Zheyu Shen, Guoheng Sun, Yucong Dai, Yongkai Wu, Hongyi Wang, Ang Li

Comments: NeurIPS 2024

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[38] arXiv:2405.00706 [pdf, other]

Title: From Complexity to Clarity: How AI Enhances Perceptions of Scientists and the Public's Understanding of Science

David M. Markowitz

Comments: 17 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)

[39] arXiv:2405.00708 [pdf, html, other]

Title: Interactive Analysis of LLMs using Meaningful Counterfactuals

Furui Cheng, Vilém Zouhar, Robin Shing Moon Chan, Daniel Fürst, Hendrik Strobelt, Mennatallah El-Assady

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

[40] arXiv:2405.00709 [pdf, html, other]

Title: Evaluating Tool-Augmented Agents in Remote Sensing Platforms

Simranjit Singh, Michael Fore, Dimitrios Stamoulis

Comments: ICLR 2024 Machine Learning for Remote Sensing (ML4RS) Workshop

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[41] arXiv:2405.00710 [pdf, other]

Title: Homonym Sense Disambiguation in the Georgian Language

Davit Melikidze, Alexander Gamkrelidze

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[42] arXiv:2405.00711 [pdf, html, other]

Title: Fake Artificial Intelligence Generated Contents (FAIGC): A Survey of Theories, Detection Methods, and Opportunities

Xiaomin Yu, Yezhaohui Wang, Yanfang Chen, Zhen Tao, Dinghao Xi, Shichao Song, Simin Niu, Zhiyu Li

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)

[43] arXiv:2405.00715 [pdf, html, other]

Title: Adapting Open-Source Large Language Models for Cost-Effective, Expert-Level Clinical Note Generation with On-Policy Reinforcement Learning

Hanyin Wang, Chufan Gao, Bolun Liu, Qiping Xu, Guleid Hussein, Mohamad El Labban, Kingsley Iheasirim, Hariprasad Korsapati, Chuck Outcalt, Jimeng Sun

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[44] arXiv:2405.00716 [pdf, other]

Title: Large Language Models in the Clinic: A Comprehensive Benchmark

Fenglin Liu, Zheng Li, Hongjian Zhou, Qingyu Yin, Jingfeng Yang, Xianfeng Tang, Chen Luo, Ming Zeng, Haoming Jiang, Yifan Gao, Priyanka Nigam, Sreyashi Nag, Bing Yin, Yining Hua, Xuan Zhou, Omid Rohanian, Anshul Thakur, Lei Clifton, David A. Clifton

Comments: Accepted at EMNLP 2024 Main Conference

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[45] arXiv:2405.00717 [pdf, html, other]

Title: Exploring News Summarization and Enrichment in a Highly Resource-Scarce Indian Language: A Case Study of Mizo

Abhinaba Bala, Ashok Urlana, Rahul Mishra, Parameswari Krishnamurthy

Comments: Accepted at LREC-COLING2024 WILDRE Workshop

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[46] arXiv:2405.00718 [pdf, html, other]

Title: Can't say cant? Measuring and Reasoning of Dark Jargons in Large Language Models

Xu Ji, Jianyi Zhang, Ziyin Zhou, Zhangchi Zhao, Qianqian Qiao, Kaiying Han, Md Imran Hossen, Xiali Hei

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[47] arXiv:2405.00722 [pdf, html, other]

Title: LLMs for Generating and Evaluating Counterfactuals: A Comprehensive Study

Van Bach Nguyen, Paul Youssef, Jörg Schlötterer, Christin Seifert

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[48] arXiv:2405.00728 [pdf, other]

Title: Evaluating the Application of ChatGPT in Outpatient Triage Guidance: A Comparative Study

Dou Liu, Ying Han, Xiandi Wang, Xiaomei Tan, Di Liu, Guangwu Qian, Kang Li, Dan Pu, Rong Yin

Comments: 8 pages, 1 figure, conference(International Ergonomics Association)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

[49] arXiv:2405.00732 [pdf, html, other]

Title: LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report

Justin Zhao, Timothy Wang, Wael Abid, Geoffrey Angus, Arnav Garg, Jeffery Kinnison, Alex Sherstinsky, Piero Molino, Travis Addair, Devvret Rishi

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[50] arXiv:2405.00801 [pdf, html, other]

Title: "Ask Me Anything": How Comcast Uses LLMs to Assist Agents in Real Time

Scott Rome, Tianwen Chen, Raphael Tang, Luwei Zhou, Ferhan Ture

Subjects: Computation and Language (cs.CL)