… an approach to ranking with dense representations that applies knowledge distillation to
improve the recently proposed lateinteraction ColBERT model. Specifically, we distill the …

… with dense representations that applies knowledge distillation using the ColBERT late-interaction
ranking … from a bi-encoder teacher to a student by distilling knowledge from ColBERT’s …

… In the BERTCAT ranking model, the query 𝑞1:𝑚 and passage … With tightly coupled teachers
(TCT), Lin et al. [24] showed … We observe that the methods not using knowledge distillation …

… RQ3 How effective is our distillation for dense nearest … (using the ; operator) and the CLS
token representation computed … the teacher models have a very high pairwise ranking accuracy …

… high-dimensional dense learned representations for queries and … As the re-ranking teacher
model, we use the MiniLM cross… Tightly-Coupled Teachers. Proceedings of the 6th Workshop …

… ranking models applying contextualized representations are … use of teacher output and
RankNet-style order distillation … Measures We primarily assess densely annotated test collections …

… widely-used benchmarks, including MS MARCO Passage Ranking, … distillation with
tightly-coupled teachers for dense retrieval. In Proceedings of the 6th Workshop on Representation …

… (CE) is often used as the re-ranking model, rearranging the retriever … distillation with
tightly-coupled teachers for dense retrieval. In Proceedings of the 6th Workshop on Representation …

… representations compared to those of the original teacher … of the teacher with the student
model, combining the ranked … Distillation with Tightly-Coupled Teachers for Dense Retrieval…

… architecture to produce dense document representations [12, 29… Recent studies in dense
retrieval [45, 52, 52] have also adopted … to distill knowledge from a teacher model for re-ranking. …