June 7-11
Shivangi
Aneja
PhD Student at Technical University of Munich, Germany
"Catching Out-of-Context Misinformation with Self-supervised Learning"
Unite 100 000 Women in Tech to Drive Change with Purpose and Impact.
Vote by Sharing
Do you want to see this session? Help increase the sharing count and its visibility. Sessions with the most votes will be made available to the general public.
Please note that it might take some time until your share & vote is reflected.
Session: Catching Out-of-Context Misinformation with Self-supervised Learning
Despite the recent attention to DeepFakes and other forms of image manipulations, one of the most prevalent ways to mislead audiences on social media is the use of unaltered images in a new but false context, commonly known as out-of-context image use. The danger of out-of-context images is that little technical expertise is required, as one can simply take an image from a different event and create a highly convincing but potentially misleading message. At the same time, it is extremely challenging to detect misinformation based on out-of-context images given that the visual content by itself is not manipulated; only the image-text combination creates misleading or false information. In order to detect these out-of-context images, several online fact-checking initiatives have been launched by newsrooms. However, they all heavily rely on manual human efforts to verify each post factually and to determine if a fact-checking claim should be labeled as an "out-of-context". In this talk, I will discuss in detail dangerous consequences caused by the spread of out-of-context images and talk about how can we build models that automatically detect these out-of-context image text pairs.This recording is not available yet.