Large language models (LLMs) have emerged as a powerful tool in education, offering novel approaches to analyzing educational data and enhancing learning experiences. However, they also present new challenges, such as finding ways to effectively implement LLMs into educational environments to aid, rather than detract, students from learning and ensuring that no toxic or irrelevant content is presented to students. They also present a new host of ethical questions regarding the degree to which LLMs can go in aiding and providing feedback to students. This workshop aims to bring together researchers, educators, and practitioners to discuss these opportunities and challenges in leveraging LLMs for education.