Recent advances in foundation models present new opportunities for interpretable visual
recognition--one can first query Large Language Models (LLMs) to obtain a set of attributes …

… For notational convenience in this paper, G will denote an 1 x m transfer function with input
U E R", output y E R', and internal state z E 72". We will omit all matrix dimensions throughout …

In-context vision and language models like Flamingo support arbitrarily interleaved
sequences of images and text as input. This format not only enables few-shot learning via …

Knowledge graphs (KGs) are the key components of various natural language processing
applications. To further expand KGs' coverage, previous studies on knowledge graph …

… means of fake online engagement Now, I will provide you with a user instruction that the
model should not comply with, as per Meta’s policy. I will also give you the model’s response to …

Most existing video-and-language (VidL) research focuses on a single dataset, or multiple
datasets of a single task. In reality, a truly useful VidL system is expected to be easily …

Generating a video given the first several static frames is challenging as it anticipates reasonable
future frames with temporal coherence. Besides video prediction, the ability to rewind …

We propose a new end-to-end question answering model, which learns to aggregate answer
evidence from an incomplete knowledge base (KB) and a set of retrieved text snippets. …

Question answering over knowledge bases (KBs) aims to answer natural language questions
with factual information such as entities and relations in KBs. Previous methods either …

Conventional approaches to relation extraction usually require a fixed set of pre-defined
relations. Such requirement is hard to meet in many real applications, especially when new data …