Session: Seeing the unseen: inferring unobserved information from multi-modal data
As humans we can never fully observe the world around us and yet we are able to build remarkably useful models of it from our limited sensory data. Machine learning systems are often required to operate in a similar setup, that is the one of inferring unobserved information from the observed one. Partial observations entail data uncertainty, which may hinder the quality of the model predictions. In this talk, we will discuss two strategies to mitigate this problem: (1) leveraging the complementarity of different data modalities, and (2) actively acquiring additional information from the same data modality.
- Partial observations naturally induce uncertainty when attempting to recover full observations of the world.
- With the current technology, we are able to build reasonably good models of the world, which infer unobserved information from the observed one.
- Leveraging complementary data modalities helps reduce the uncertainty induced by the partial observations.
- Equipping the models with active acquisition also helps reduce this uncertainty.
- Building accurate models of the world unlocks the potential to many applications.
Adriana Romero Soriano is a research scientist at Facebook AI Research and an adjunct professor at McGill University. Her research focuses on developing models and algorithms that are able to learn from multi-modal and real world data, understand and reason about conceptual relations, and recognize their uncertainties, while addressing impactful problems. She completed her postdoctoral studies at Mila, where she was advised by Prof. Yoshua Bengio. Her postdoctoral research revolved around deep learning techniques to tackle biomedical challenges, such as the ones posed by multi-modal data, high dimensional data and graph structured data. She received her Ph.D. from University of Barcelona with a thesis on assisting the training of deep neural networks with applications to computer vision, advised by Dr. Carlo Gatta. Adriana co-organized WiCV at CVPR 2018, RLGM at ICLR 2019, SEDL at NeurIPS 2019, the Montreal AI Symposium 2019 and SEDL at ICLR 2021.