- This event has passed.
Learning Club BIU talk by Sagie Benaim
June 27, 2021 @ 12:00 pm - 1:00 pm IDT
The recording of the talk:
—–
On Sunday 27.6.2021 at 12:00, we will host Sagie Benaim fromTel-Aviv university.
Please see the details below.
Zoom:
Meeting ID: 880 6390 0417
Passcode: 683072
Title:
Structure-Aware Manipulation of Images and Videos
Abstract:
Methods for image and video manipulation, such as texture and style transfer, are a subject of long term interest in computer vision. In this talk, I will go a step further, and discuss approaches for the manipulation of images and videos, based on structure.
In the first part of the talk, I will present methods for structure manipulation. I will begin by discussing the ‘unpaired setting’ in which a collection of unpaired images is given for two visual domains, and will present a method for recovering the shared structure between the domains as well as the structure that is unique to each domain. I will then discuss a method for generating a ‘structural analogy’ between two images A and B: that is, an image that keeps the appearance and style of B, but has a structural arrangement that corresponds to A. Moving to videos, I will discuss a method for generating diverse and novel videos from a single training video sample. The generated videos look realistic and capture the structure and motion of objects in the training video.
In the second part of the talk, I will present a method for video manipulation based on the understanding of structure. Specifically, our method learns to automatically predict the ‘speediness’ of moving objects in videos in a self-supervised manner. This can be used for adaptive video speedup as well as for self-supervised action recognition and video retrieval.