John Collomosse

Senior Principal Scientist

London

Prof. John Collomosse is a Senior Principal Scientist and manages the Trusted Media Intelligence (TMI) lab in Adobe Research.  John leads research for Adobe’s Content Authenticity Initiative (CAI) and is a core technical advisor to the initiative since his involvement co-founding it in 2019. Now with 5000+ members, CAI leads a cross-industry standards group (C2PA; Coalition for Content Provenance and Authenticity) where John chairs cross-industry task forces on watermarking and distributed ledgers (blockchain).  

John’s research intersects Artificial Intelligence (AI) and Distributed Ledger Technology (DLT), with focus on media provenance to fight misinformation and online harms, and on improving data integrity and attribution for responsible AI.  John’s content fingerprinting research is used to protect millions of images across Adobe’s platforms such as Photoshop, Lightroom and generative AI Firefly tools.  His watermarking technologies shipped in Adobe Content Authenticity (ACA).  John has also pioneered several visual search technologies, such as style, sketch and pose based search.  These have been demoed at Adobe MAX and shipped in products such as Behance ‘More Like This’ style similarity search.  John has published over 170 papers (h-Index 42) and over 30 patents, and is an Adobe Distinguished Inventor.

John has over 20 years experience at the intersection of Computer Vision, Graphics and AI, completing his PhD on Image and Video Stylization at the University of Bath in 2004.  John is concurrently a full professor at the University of Surrey, Centre for Vision Speech and Signal Processing (CVSSP) where he is the founder and director of DECaDE, the UKRI Natioanl Research Centre for the Decentralized Creative Economy.  Notably, he led the ARCHANGEL project which pioneered use of AI and Blockchain for provenance to tamper-proof National Archives around the world and was called out as a highlight of the UK Science Council (EPSRC) Digital Economy research programme.

John has also spent time elsewhere working on industry R&D in Computer Vision/AI, including at HP Labs, Vodafone Munich and IBM Research Hursley.  He is a Fellow of the IET (FIET), Life Fellow of the BCS (FBCS), Fellow of the Royal Society of Arts (FRSA), a Senior member of the IEEE, and a Chartered Engineer (CEng).  He was a member of the EPSRC advisory team for Information & Communication Technologies (ICT) portfolio (2018-2024).

Publications

On the Coexistence and Ensembling of Watermarks

Petrov, Aleksandar., Agarwal, Shruti., Torr, Phil., Bibi, Adel., Collomosse, John. (Dec. 3, 2025)

International Conference on Neural Information Processing Systems (NeurIPS)

ImProvShow: Multimodal Fusion for Image Provenance Summarization

Black, Alexander., Shi, Jing., Fan, Yifei., Collomosse, John. (Nov. 23, 2025)

British Machine Vision Conference (BMVC)

DiffTell: A High-Quality Dataset for Describing Image Manipulation Changes

Di, Zonglin., Shi, Jing., Fan, Yifei., Tan, Hao., Black, Alexander., Collomosse, John., Liu, Yang. (Oct. 19, 2025)

International Conference on Computer Vision (ICCV 2025)

MultiNeRF: Multiple Watermark Embedding for Neural Radiance Fields

Kulthe, Yash., Gilbert, Andrew., Collomosse, John. (Oct. 19, 2025)

ICCV 2025 Workshop on Authenticity and Provenance in the Age of Generative AI (APAI)

TrustMark: Robust Watermarking and Watermark Removal for Arbitrary Resolution Images

Agarwal, Shruti., Bui, Tu., Collomosse, John. (Oct. 19, 2025)

International Conference on Computer Vision (ICCV 2025)

CustomMark: Customization of Diffusion Models for Proactive Attribution

Asnani, Vishal., Collomosse, John., Liu, Xiaoming., Agarwal, Shruti. (Oct. 18, 2025)

ICCV APAI workshop 2025

MAD-Sherlock: Multi-Agent Debate for Visual Misinformation Detection

Lakara, Kumud., Channing, Georgia., Rupprecht, Christian., Sock, Juil., Torr, Phil., Collomosse, John., Witt, Christian. (Sep. 1, 2025)

Best paper award

ICML Workshop on Collaborative and Federated Agentic Workflows (CFAgentic)

Multitwine: Multi-Object Compositing with Text and Layout Control

Tarrés, Gemma., Lin, Zhe., Zhang, Zhifei., Zhang, He., Gilbert, Andrew., Collomosse, John., Kim, Soo. (Jun. 13, 2025)

Highlight

Conference on Computer Vision and Pattern Recognition (CVPR 2025)

Content Authenticities: A Discussion on the Values of Provenance Data for Creatives and Their Audiences

Moruzzi, Caterina., Tallyn, Ella., Liddell, Frances., Dixon, Billy., Collomosse, John., Elsden, Chris. (Jun. 2, 2025)

Best paper award

ACM Creativity and Cognition (C&C)

Content ARCs: Decentralized Content Rights in the Age of Generative AI

Balan, Kar., Gilbert, Andrew., Collomosse, John. (Jun. 2, 2025)

Intl. Conference on AI and the Digital Economy (CADE)

MAGNET: Augmenting Generative Decoders with Representation Learning and Infilling Capabilities

Khosla, Savya., Tiwari, Aditi., Kafle, Kushal., Jenni, Simon., Zhao, Handong., Collomosse, John., Shi, Jing. (Jun. 1, 2025)

Association for Computational Linguistics (ACL)

Self-Improving Diffusion Models With Synthetic Data

Alemohammad, Sina., Humayun, Ahmed., Agarwal, Shruti., Collomosse, John., Baraniuk, Richard. (Feb. 1, 2025)

ICLR Workshop on Scaling Self-Improving Foundation Models (SSI-FM)

CLASS: Conditional Latent Architecture for Search and Synthesis of Design Layouts

Manandhar, Dipu., Guerrero, Paul., Wang, Zhaowen., Collomosse, John. (Jan. 1, 2025)

IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)

SegGuard: Defending Scene Segmentation against Adversarial Patch Attack

Gittings, Tommy., Schneider, Steve., Collomosse, John. (Oct. 27, 2024)

International Conference on Image Processing (ICIP)

Self-supervised disentangled representation learning of artistic style through Neural Style Transfer

Ruta, Dan., Tarres, Gemma., Black, Alex., Gilbert, Andrew., Collomosse, John. (Oct. 1, 2024)

European Conference on Computer Vision (ECCVW) Workshop on Vision and Art (VISART)

FineMatch: Aspect-based Fine-grained Image and Text Mismatch Detection and Correction

Hua, Hang., Shi, Jing., Kafle, Kushal., Jenni, Simon., Zhang, Daoan., Collomosse, John., Cohen, Scott., Liu, Jiebo. (Oct. 1, 2024)

European Conference on Computer Vision (ECCV)

Thinking Outside the BBox: Unconstrained Generative Object Compositing

Tarres, Gemma., Lin, Zhe., Zhang, Zhifei., Zhang, Jianming., Song, Yizhe., Ruta, Dan., Gilbert, Andrew., Collomosse, John., Kim, Soo. (Oct. 1, 2024)

European Conference on Computer Vision (ECCV 2024)

NeAT: Neural Artistic Tracing for high resolution Style Transfer

Ruta, Dan., Gilbert, Andrew., Collomosse, John., Shechtman, Eli., Kolkin, Nick. (Sep. 29, 2024)

European Conference on Computer Vision (ECCVW'24) Workshop on Vision for Art (VISART VII)

DIFF-NST: Diffusion Interleaving For deFormable Neural Style Transfer

Ruta, Dan., Tarres, Gemma., Gilbert, Andrew., Shechtman, Eli., Kolkin, Nick., Collomosse, John. (Sep. 29, 2024)

European Conference on Computer Vision (ECCVW'24) Workshop on Vision for Art (VISART VII)

PDFed: Privacy-Preserving and Decentralized Asynchronous Federated Learning for Diffusion Models

Balan, Kar., Gilbert, Andrew., Collomosse, John. (Sep. 12, 2024)

Best paper award

European Conference on Computer Vision in Media Production (CVMP)

ORAgen: Exploring the Design of Attribution through Media Tokenisation

Liddell, Frances., Tallyn, Ella., Morgan, Evan., Balan, Kar., Disley, Martin., Koterwas, Ted., Dixon, Billy., Moruzzi, Catarina., Collomosse, John., Elsden, Chris. (Jul. 14, 2024)

ACM Designing Interactive Systems (DIS)

To Authenticity, and Beyond! Building Safe and Fair Generative AI upon the Three Pillars of Provenance

Parsons, Andy., Collomosse, John. (Jun. 30, 2024)

IEEE Computer Graphics and Applications (IEEE CG&A)

ProMark: Proactive Diffusion Watermarking for Causal Attribution

Asnani, Vishal., Collomosse, John., Bui, Tu., Liu, Xiaoming., Agarwal, Shruti. (Jun. 17, 2024)

CVPR 2024

PARASOL: Parametric Style Control for Diffusion Image Synthesis

Tarres, Gemma., Ruta, Dan., Bui, Tu., Collomosse, John. (Jun. 16, 2024)

Computer Vision and Pattern Recognition (CVPRW) Workshop on Women in Computer Vision (WiCV)

VIXEN: Visual Text Comparison Network for Image Difference Captioning

Black, Alex., Shi, Jing., Fan, Yifei., Bui, Tu., Collomosse, John. (Jan. 14, 2024)

AAAI Conference on Artificial Intelligence (AAAI)

DECORAIT: DECentralized Opt-in/out Registry for AI Training

Balan, Kar., Black, Alex., Jenni, Simon., Gilbert, Andrew., Parsons, Andy., Collomosse, John. (Dec. 17, 2023)

Best paper award

European Conference on Computer Vision in Media Production (CVMP)

Scene Designer: a Unified Model for Scene Search and Synthesis from Sketch

Ribeiro, Leo., Bui, Tu., Collomosse, John., Ponti, Moacir. (Dec. 1, 2023)

Journal on Multimedia Tools and Applications (MTAP)

EKILA: Synthetic Media Provenance and Attribution for Generative Art

Balan, Kar., Agarwal, Shruti., Jenni, Simon., Parsons, Andy., Gilbert, Andrew., Collomosse, John. (Jun. 21, 2023)

CVPR Workshop on Media Forensics (CVPRW)

SceneComposer: Any-Level Semantic Image Synthesis

Zeng, Yu., Lin, Zhe., Zhang, Jianming., Liu, Qing., Collomosse, John., Kuen, Jason., Patel, Vishal. (Jun. 20, 2023)

Computer Vision and Pattern Recognition (CVPR)

RoSteALS: Robust Steganography using Autoencoder Latent Space

Bui, Tu., Agarwal, Shruti., Yu, Ning., Collomosse, John. (Jun. 18, 2023)

CVPR Workshop on Media Forensics (CVPRW)

Video Manipulations Beyond Faces: A Dataset with Human-Machine Analysis

Mittal, Trisha., Sinha, Ritwik., Swaminathan, Vishy., Collomosse, John., Manocha, Dinesh. (Jan. 4, 2023)

IEEE/CVF Winter Conf. on Applications of Computer Vision (WACV-W)

Audio-Visual Contrastive Learning with Temporal Self-Supervision

Jenni, Simon., Black, Alexander., Collomosse, John., Collomosse, John. (Jan. 4, 2023)

AAAI Conference on Artificial Intelligence (AAAI)

Layout Representation Learning with Spatial and Structural Hierarchies

Bai, Yue., Manandhar, Dipu., Wang, Zhaowen., Collomosse, John., Fu, Yun. (Jan. 4, 2023)

AAAI Conference on Artificial Intelligence (AAAI)

StyleBabel: Artistic Style Tagging and Captioning

Ruta, Dan., Gilbert, Andrew., Aggarwal, Pranav., Marri, Naveen., Kale, Ajinkya., Briggs, Jo., Speed, Chris., Jin, Hailin., Faieta, Baldo., Filipkowski, Alex., Collomosse, John. (Oct. 23, 2022)

European Conference on Computer Vision (ECCV)

CoGS: Controllable Generation and Search from Sketch and Style

Ham, Cusuh., Tarres, Gemma., Bui, Tu., Hays, James., Lin, Zhe., Collomosse, John. (Oct. 23, 2022)

European Conference on Computer Vision (ECCV)

RepMix: Representation Mixing for Robust Attribution of Synthesized Images

Bui, Tu., Yu, Ning., Collomosse, John. (Oct. 23, 2022)

European Conference on Computer Vision (ECCV)

HyperNST: Hyper-Networks for Neural Style Transfer

Ruta, Dan., Gilbert, Andrew., Motiian, Saeid., Faeita, Baldo., Lin, Zhe., Collomosse, John. (Oct. 22, 2022)

European Conference on Computer Vision Workshop (ECCVW) on Vision and Art (VISART)

ARIA: Adversarially Robust Image Attribution for Content Provenance

Andriushchenko, Maksym., LI, Rebecca., Oxholm, Geoffrey., Gittings, Thomas., Bui, Tu., Flammarion, Nicolas., Collomosse, John. (Jun. 19, 2022)

CVPR 2022, Workshop on Media Forensics

VPN: Video Provenance Network for Robust Content Attribution

Black, Alexander., Bui, Tu., Jenni, Simon., Swaminathan, Vishy., Collomosse, John. (Dec. 6, 2021)

International Conference on Computer Vision in Media Production (CVMP)

Defending Object Detection Networks Against Adversarial Patch Attacks

Gittings, Tommy., Schneider, Steve., Collomosse, John. (Oct. 17, 2021)

ICCV Workshop on Adversarial Robustness in the Real World (ICCVW)

Scene Designer: a Unified Model for Scene Search and Synthesis from Sketch

Ribeiro, Leo., Bui, Tu., Collomosse, John., Ponti, Moacir. (Oct. 17, 2021)

ICCV Workshop on Sketching and Human Expressivity (ICCVW)

OSCAR-Net: Object-centric Scene Graph Attention for Image Attribution

Nguyen, Eric., Bui, Tu., Swaminathan, Vishy., Collomosse, John. (Oct. 17, 2021)

International Conference on Computer Vision (ICCV)

ALADIN: All Layer Adaptive Instance Normalization for Fine-grained Style Similarity

Ruta, Dan., Motiian, Saeid., Faeita, Baldo., Lin, Zhe., Jin, Hailin., Filipkowski, Alex., Gilbert, Andrew., Collomosse, John. (Oct. 17, 2021)

International Conference on Computer Vision (ICCV)

Deep Image Comparator: Learning to Visualize Editorial Change

Black, Alexander., Bui, Tu., Jin, Hailin., Swaminathan, Vishy., Collomosse, John. (Jun. 20, 2021)

CVPR Workshop on Media Forensics (CVPRW)

Magic Layouts: Structural Prior for Component Detection in User Interface Designs

Manandhar, Dipu., Jin, Hailin., Collomosse, John., Collomosse, John. (Jun. 6, 2021)

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Compositional Sketch Search

Black, Alexander., Bui, Tu., Mai, Long., Jin, Hailin., Collomosse, John. (Jan. 1, 2021)

International Conference on Image Processing (ICIP)

Neural Architecture Search for Deep Image Prior

Ho, Kary., Gilbert, Andrew., Jin, Hailin., Collomosse, John. (Jan. 1, 2021)

Elsevier Computers & Graphics (CAG)

Geo-PIFu: Geometry and Pixel Aligned Implicit Functions for Single-view Human Reconstruction

He, Tong., Collomosse, John., Jin, Hailin., Soatto, Stefano. (Dec. 1, 2020)

Advances in Neural Information Processing Systems (NeurIPS)

DeepVoxels++: Enhancing the Fidelity of Novel View Synthesis from 3D Voxel Embeddings

He, Tong., Collomosse, John., Jin, Hailin., Soatto, Stefano. (Dec. 1, 2020)

Asian Conference on Computer Vision (ACCV)

Vax-a-Net: Training-time Defence Against Adversarial Patch Attacks

Gittings, Tommy., Schneider, Steve., Collomosse, John. (Dec. 1, 2020)

Asian Conference on Computer Vision (ACCV)

Semantic Estimation of 3D Body Shape and Pose using Minimal Cameras

Gilbert, Andrew., Trumble, Matthew., Hilton, Adrian., Collomosse, John. (Sep. 9, 2020)

British Machine Vision Conference (BMVC)

Sketchformer: Transformer-based Representation for Sketched Structure

Ribeiro, Leo., Bui, Tu., Collomosse, John., Ponti, Moacir. (Jun. 20, 2020)

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

TAPESTRY: A De-centralized Service for Trusted Interaction Online

Yang, Yifan., Cooper, Daniel., Collomosse, John., Dragan, Constantin., Manulis, Mark., Steane, Jamie., Manohar, Arthi., Briggs, Jo., Moncur, Wendy., Jones, Helen. (May. 31, 2020)

IEEE Transactions on Services Computing (TSC)

Learning Structural Similarity of User Interface Layouts using Graph Networks

Manandhar, Dipu., Ruta, Dan., Collomosse, John. (Mar. 1, 2020)

European Conference on Computer Vision (ECCV)

Tamper-proofing Video with Hierarchical Attention Autoencoder Hashing on Blockchain

Bui, Tu., Cooper, Daniel., Collomosse, John., Bell, Mark., Green, Alex., Sheridan, John., Higgins, Jez., Das, Arindra., Keller, Jared., Thereaux, Olivier. (Jan. 31, 2020)

IEEE Transactions on Multimedia

Real-Time Multi-person Motion Capture from Multi-view Video

Malleson, Charles., Collomosse, John., Hilton, Adrian. (Dec. 17, 2019)

International Journal on Computer Vision (IJCV)

An Internal Learning Approach to Video Inpainting

Zhang, Haotian., Mai, Long., Xu, Ning., Wang, Zhaowen., Collomosse, John., Jin, Hailin. (Oct. 28, 2019)

International Conference on Computer Vision (ICCV) 2019

Robust Synthesis of Adversarial Visual Examples Using a Deep Image Prior

Gittings, Tommy., Schneider, Steve., Collomosse, John. (Sep. 11, 2019)

British Machine Vision Conference (BMVC) 2019

LiveSketch: Query Perturbation for Guided Sketch-based Visual Search

Collomosse, John., Bui, Tu., Jin, Hailin. (Jun. 18, 2019)

Conference on Computer Vision and Pattern Recognition (CVPR) 2019

ARCHANGEL: Tamper-proofing Video Archives using Temporal Content Hashes on the Blockchain

Bui, Tu., Cooper, Daniel., Collomosse, John., Bell, Mark., Green, Alex., Sheridan, John., Higgins, Jez., Das, Arindra., Keller, Jared., Thereaux, Olivier., Brown, Alan. (Jun. 17, 2019)

Computer Vision and Pattern Recognition (CVPR) Workshops 2019. Computer Vision, AI and Blockchain.

Fusing Visual and Inertial Sensors with Semantics for 3D Human Pose Estimation

Gilbert, Andrew., Trumble, Matthew., Malleson, Charles., Hilton, Adrian., Collomosse, John. (Apr. 1, 2019)

International Journal of Computer Vision (IJCV)

In-painting of Wide-baseline Multiple Viewpoint Video

Gilbert, Andrew., Trumble, Matthew., Hilton, Adrian., Collomosse, John., Collomosse, John. (Dec. 24, 2018)

IEEE Transactions on Visualization and Computer Graphics (TVCG)

Deep Manifold Alignment for Mid-grain Sketch based Image Retrieval

Bui, Tu., Ribeiro, Leo., Ponti, Moacir., Collomosse, John. (Dec. 2, 2018)

Asian Conference on Computer Vision (ACCV). 2018.

TAPESTRY: Visualizing Interwoven Identities for Trust Provenance

Yang, Yifan., Collomosse, John., Manohar, Arthi., Briggs, Jo., Steane, Jamie. (Oct. 22, 2018)

IEEE Symposium on Visualization for Cyber Security (VizSec)

Volumetric performance capture from minimal camera viewpoints

Trumble, Matthew., Gilbert, Andrew., Hilton, Adrian., Collomosse, John. (Sep. 9, 2018)

European Conference on Computer Vision (ECCV). 2018.

Deep Autoencoder for Combined Human Pose Estimation and Body Model Upscaling

Trumble, Matthew., Gilbert, Andrew., Hilton, Adrian., Collomosse, John. (Sep. 8, 2018)

European Conference on Computer Vision (ECCV). 2018.

ARCHANGEL: Trusted Archives of Digital Public Documents

Collomosse, John., Bui, Tu., Brown, Alan., Sheridan, John., Green, Alex., Bell, Mark., Fawcett, Jamie., Higgins, Jez., Thereaux, Olivier. (Aug. 29, 2018)

ACM Conference on Document Engineering (DocEng). 2018.

Disentangling Structure and Aesthetics for Content-aware Image Completion

Gilbert, Andrew., Collomosse, John., Jin, Hailin., Price, Brian. (Jun. 18, 2018)

Conference on Computer Vision and Pattern Recognition (CVPR) 2018

Sketching out the Details: Sketch-based Image Retrieval using Convolutional Neural Networks with Multi-stage Regression

Bui, Tu., Ribeiro, Leo., Ponti, Moacir., Collomosse, John. (Apr. 1, 2018)

Elsevier Journal on Computers & Graphics (C&G)

Compact descriptors for sketch-based image retrieval using a triplet loss convolutional neural network

Bui, Tu., Ribeiro, Leo., Ponti, Moacir., Collomosse, John. (Nov. 1, 2017)

Journal on Computer Vision and Image Understanding (CVIU)

Sketching with Style: Visual Search with Sketches and Aesthetic Context

Collomosse, John., Bui, Tu., Wilber, Michael., Fang, Chen., Jin, Hailin. (Oct. 22, 2017)

International Conference on Computer Vision (ICCV). 2017.

BAM! The Behance Artistic Media Dataset for Recognition Beyond Photography

Wilber, Michael., Fang, Chen., Jin, Hailin., Hertzmann, Aaron., Collomosse, John., Belongie, Serge. (Oct. 22, 2017)

International Conference on Computer Vision (ICCV). 2017.

Real-time Full-Body Motion Capture from Video and IMUs

Malleson, Charles., Gilbert, Andrew., Trumble, Matthew., Collomosse, John., Hilton, Adrian., Volino, Marco. (Oct. 10, 2017)

International Conference on 3D Vision (3DV). 2017.

Total Capture: 3D Human Pose Estimation Fusing Video and Inertial Sensors

Trumble, Matthew., Gilbert, Andrew., Malleson, Charles., Hilton, Adrian., Collomosse, John. (Sep. 4, 2017)

British Machine Vision Conference (BMVC). 2017.

Comprehensible Video Thumbnails

Kim, Jongdae., Gray, Charles., Asente, Paul., Collomosse, John. (May. 1, 2015)

Computer Graphics Forum (Proc. Eurographics 2015)

A Particle Filtering Approach to Salient Video Object Localization

Gray, Charles., James, Stuart., Collomosse, John., Asente, Paul. (Oct. 1, 2014)

IEEE International Conference on Image Processing (ICIP). 2014.

Special section on the 2011 joint symposium on computational aesthetics (CAe), non-photorealistic animation and rendering (NPAR), and sketch-based interfaces and modeling (SBIM)

Asente, Paul., Collomosse, John., Isenberg, Tobias., Sezgin, T.. (Oct. 1, 2012)

Computers & Graphics Volume 36, Issue 6 (October 2012)

NPAR 2011 – Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering

Collomosse, John., Asente, Paul., Spencer, Stephen. (Aug. 5, 2011)

NPAR 2011 – Proceedings of the ACM/Eurographics Symposium on Non-Photorealistic Animation and Rendering

News