Does Video Memory Use What It Retrieves? A Causal Audit of Memory Specificity
Not provided in the abstract
Abstract
This paper investigates the relationship between memory retrieval and performance in video models, revealing that memory gains can depend on various factors including representation support and specific content.
Reality Card
The study demonstrates that memory benefits in video models are significantly influenced by the specificity of the retrieved content, with read-time memory substitution providing a method to distinguish these effects.
In Ego-Exo4D, recovery of memory benefits fell from 102% to 1% as values moved away from observed training-memory representations.
The study's findings may be limited by the specific contexts and datasets used, which could affect generalizability.
Paper to code
Verified implementation resources so builders can test the paper’s claims instead of stopping at the abstract.