Abstract: Constraint-based modeling has been used in many application areas of Intelligent Tutoring Systems as a powerful means to analyse erroneous student solutions and generate helpful feedback. In contrast to domains where the structure of the problem under consideration allows a constraint to (almost) uniquely determine the possible cause of a particular student error, there are other applications where a multitude of competing error explanations has to be considered. In such cases constraint-based models alone hardly meet the requirements for a student model. Instead a constraint-based model clearly serves the purpose of error diagnosis and needs to be complemented by additional…components for diagnosis selection based on general or individually tailored heuristics. By investigating the apparent and strong parallelism between constraint-based modeling and model-based diagnosis, this paper identifies four major sources of ambiguity that need to be considered when using constraint-based modeling and describes options for dealing with situations in which alternative error descriptions are available. Examples are primarily drawn from the area of foreign language learning.
Show more
Abstract: In this paper, we introduce logic programming as a domain that exhibits some characteristics of being ill-defined. In order to diagnose student errors in such a domain, we need a means to hypothesise the student's intention, that is the strategy underlying her solution. This is achieved by weighting constraints, so that hypotheses about solution strategies, programming patterns and error diagnoses can be ranked and selected. Since diagnostic accuracy becomes an increasingly important issue, we present an evaluation methodology that measures diagnostic accuracy in terms of (1) the ability to identify the actual solution strategy, and (2) the reliability of error…diagnoses. The evaluation results confirm that the system is able to analyse a major share of real student solutions, providing highly informative and precise feedback.
Show more