Nov 16, 2023 · We demonstrate how Digital Socrates is useful for revealing insights about student models by examining their reasoning chains.
Aug 11, 2024 · In its critiques, Digital Socrates provides localized feedback on where and why reason- ing chains are flawed (focusing on the main flaw, if any) ...
Aug 12, 2024 · Digital Socrates is an evaluation tool that can characterize LLMs' explanation capabilities.
We demonstrate how Digital Socrates is useful for revealing insights about student models by examining their reasoning chains.
May 16, 2024 · Our paper “Digital Socrates: Evaluating LLMs through Explanation Critiques” has been accepted to the #ACL2024NLP main conference!
Through quantitative and qualitative analysis, we demonstrate how Digital Socrates is useful for revealing insights about student models by examining their ...
Digital Socrates is an open-source, automatic explanation-critiquing model. It is useful for revealing insights about student models by examining their ...
Aug 12, 2024 · The Digital Socrates model can analyze LLM-generated explanations, identify any flaws or issues, and suggest improvements. This allows for a ...
Digital Socrates is an open-source, automatic explanation-critiquing model. It is useful for revealing insights about student models by examining their ...
Aug 12, 2024 · Digital Socrates: Evaluating LLMs through Explanation Critiques. Blog written by Yuling Gu. Aug 12.
Learn how you can Validate, Evaluate and Fine Tune an LLM effectively.