Unsupervised conditional slot attention for object centric learning

A Kori, F Locatello, F Toni, B Glocker - arXiv preprint arXiv:2307.09437, 2023 - arxiv.org
arXiv preprint arXiv:2307.09437, 2023arxiv.org
Extracting object-level representations for downstream reasoning tasks is an emerging area
in AI. Learning object-centric representations in an unsupervised setting presents multiple
challenges, a key one being binding an arbitrary number of object instances to a specialized
object slot. Recent object-centric representation methods like Slot Attention utilize iterative
attention to learn composable representations with dynamic inference level binding but fail
to achieve specialized slot level binding. To address this, in this paper we propose …
Extracting object-level representations for downstream reasoning tasks is an emerging area in AI. Learning object-centric representations in an unsupervised setting presents multiple challenges, a key one being binding an arbitrary number of object instances to a specialized object slot. Recent object-centric representation methods like Slot Attention utilize iterative attention to learn composable representations with dynamic inference level binding but fail to achieve specialized slot level binding. To address this, in this paper we propose Unsupervised Conditional Slot Attention using a novel Probabilistic Slot Dictionary (PSD). We define PSD with (i) abstract object-level property vectors as key and (ii) parametric Gaussian distribution as its corresponding value. We demonstrate the benefits of the learnt specific object-level conditioning distributions in multiple downstream tasks, namely object discovery, compositional scene generation, and compositional visual reasoning. We show that our method provides scene composition capabilities and a significant boost in a few shot adaptability tasks of compositional visual reasoning, while performing similarly or better than slot attention in object discovery tasks
arxiv.org
Showing the best result for this search. See all results