We’ll present at ACM Multimedia 2015 in the Demos Track a system for content-based video recommendation that exploits visual saliency to better represent video features and content.
The system is demonstrated in a Social Network we implemented. Visual saliency is used to select relevant frames to be presented in a web-based interface to tag and annotate video frames in the social network; it is also employed to summarize video content to create amore eﬀective video representation used in the recommender system. The system also exploits automatic annotations from CNN-based classiﬁers on salient frames and user generated annotations.
In the demo article we evaluate several baseline approaches and show how the proposed method improves over them.
The system started as a project developed by the student Saverio Meucci as final work for the Bachelor of Art at the Faculty of Engineering of University of Florence under the supervision of prof. Alberto Del Bimbo, and his assistants Andrea Ferracani and Daniele Pezzatini.