← authors · overview

• Supervising Neural Attention Models for Video Captioning by Human Gaze Data
  2017 · 75 citations
• MERLOT: Multimodal Neural Script Knowledge Models
  2021 · 54 citations
• A Deep Ranking Model for Spatio-Temporal Highlight Detection from a 360 Video
  2018 · 46 citations
• Parameter Efficient Multimodal Transformers for Video Representation Learning
  2020 · 36 citations
• TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answering
  2017 · 35 citations
• Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Text
  2023 · 17 citations
• Encoding Video and Label Priors for Multi-label Video Classification on YouTube-8M dataset
  2017 · 6 citations
• A Memory Network Approach for Story-based Temporal Summarization of 360ẹg Videos
  2018 · 2 citations
• Spanning Tree Autoregressive Visual Generation
  2025
• MASS: Overcoming Language Bias in Image-Text Matching
  2025
• MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound
  2022
• Long Story Short: a Summarize-then-Search Method for Long Video Question Answering
  2023
• ActionSwitch: Class-agnostic Detection of Simultaneous Actions in Streaming Videos
  2024
• Can visual language models resolve textual ambiguity with visual cues? Let visual puns tell you!
  2024