Publications

ReasonX: MLLM-Guided Intrinsic Image Decomposition

Alara Dirik, Tuanfeng Y. Wang, Duygu Ceylan, Stefanos Zafeiriou, Anna Frühstück

AI & Machine Learning Computer Vision, Imaging & Video Graphics (2D & 3D)

UniLight: A Unified Representation for Lighting

Zitian Zhang, Iliyan Georgiev, Michael Fischer, Yannick Hold-Geoffroy, Jean-François Lalonde, Valentin Deschaintre

Highlight

GENIE: A Visual-Only Diffusion Framework for TaskAgnostic Image Transformation

Uddeshya Singh, Aniket Thomas, Aishwarya Agarwal, Srikrishna Karanam, Biplab Banerjee

OWLViz: An Open-World Benchmark for Visual Question Answering

Thuy Nguyen, Dang Nguyen, Hoàng Nguyễn, Thuan Duc Luong, Franck Dernoncourt, Long Hoang Dang, Viet Lai

mSCoRe: A Multilingual and Scalable Benchmark for Skill-based Commonsense Reasoning

Nghia Trung Ngo, Franck Dernoncourt, Thien Huu Nguyen

Reasoning Graph-Structured Question Answering: Datasets and Insights from LLM Benchmarking

Khin Yone, Devasha Trivedi, Anish Pahilajani, Jincen Shuai, Samyak Rajesh Jain, Ryan A. Rossi, Nesreen K. Ahmed, Franck Dernoncourt, Yu Wang and Namyong Park

Multi-Domain Audio Question Answering Benchmark Toward Acoustic Content Reasoning

Chao-Han Huck Yang, Sreyan Ghosh, Jaeyeon Kim, Hengyi Hong, Sonal Kumar, Guirui Zhong, Zhifeng Kong, S Sakshi, Vaibhavi Lokegaonkar, Oriol Nieto, Ramani Duraiswami, Dinesh Manocha, Gunhee Kim, Jun Du, Rafael Valle, Bryan Catanzaro

AudioCards: Structured Metadata Improves Audio Language Models For Sound Design

Sripathi Sridhar, Prem Seetharaman, Oriol Nieto, Mark Cartwright, Justin Salamon

Dripping Thin Films for Real-time Digital Painting

Zoé Herson, Axel Paris, Élie Michel

Graphics (2D & 3D)

Mix2Morph: Learning Sound Morphing From Noisy Mixes

Annie Chu, Hugo Flores García, Oriol Nieto, Justin Salamon, Bryan Pardo, Prem Seetharaman