Interactive Video Retrieval in the Age of Effective Joint Embedding Deep Models: Lessons from the 11th Vbs

This paper presents findings of the eleventh Video Browser Showdown competition, where sixteen teams competed in knownitem and adhoc search tasks. Many of the teams utilized state-of-the-art video retrieval approaches that demonstrated high effectiveness in challenging search scenarios. In this paper, a broad survey of all utilized approaches is presented in connection with an analysis of the performance of participating teams. Specifically, both highlevel performance indicators are presented with overall statistics as well as indepth analysis of the performance of selected tools implementing result set logging. The analysis reveals evidence that the CLIP model represents a versatile tool for crossmodal video retrieval when combined with interactive search capabilities. Furthermore, the analysis investigates the effect of different users and text query properties on the performance in search tasks. Last but not least, lessons learned from search task preparation are presented, and a new direction for adhoc search based tasks at Video Browser Showdown is introduced.