Prof. John Collomosse is a principal scientist in Adobe’s Media Intelligence Lab (MIL), based in the London (UK) office.  John leads the Deep Learning Group within MIL.

John has over 15 years experience at the intersection of Computer Vision, Graphics and AI, completing his PhD on Image and Video Stylization at the University of Bath in 2004.  John is concurrently a full professor at the University of Surrey, Centre for Vision Speech and Signal Processing (CVSSP) where he directs the DECaDE research centre.

John’s research focuses on representation learning for visual search and content discovery, focusing on creative modalities such as search, style and design layout.  His work has been demoed at Adobe MAX and appears in products e.g. Behance ‘More Like This’ style similarity search.  He has worked on volumetric video and performance capture for immersive AR/VR content production and video-realistic character animation.  John is a technical advisor on the Adobe Content Authenticity Initiative (CAI), researching content fingerprinting and decentralized technologies for visual content provenance.  He leads the task force on this topic for the C2PA cross-industry standards body.

John serves on the advisory boards of the UK Engineering and Science Council EPSRC and for the UKRI Digital Economy theme.

Publications

ARIA: Adversarially Robust Image Attribution for Content Provenance

Andriushchenko, M., LI, R., Oxholm, G., Gittings, T., Bui, T., Flammarion, N., Collomosse, J. (Jun. 19, 2022)

CVPR 2022, Workshop on Media Forensics

VPN: Video Provenance Network for Robust Content Attribution

Black, A., Bui, T., Jenni, S., Swaminathan, V., Collomosse, J. (Dec. 6, 2021)

International Conference on Computer Vision in Media Production (CVMP)

ALADIN: All Layer Adaptive Instance Normalization for Fine-grained Style Similarity

Ruta, D., Motiian, S., Faeita, B., Lin, Z., Jin, H., Filipkowski, A., Gilbert, A., Collomosse, J. (Oct. 17, 2021)

International Conference on Computer Vision (ICCV)

OSCAR-Net: Object-centric Scene Graph Attention for Image Attribution

Nguyen, E., Bui, T., Swaminathan, V., Collomosse, J. (Oct. 17, 2021)

International Conference on Computer Vision (ICCV)

Scene Designer: a Unified Model for Scene Search and Synthesis from Sketch

Ribeiro, L., Bui, T., Collomosse, J., Ponti, M. (Oct. 17, 2021)

ICCV Workshop on Sketching and Human Expressivity (ICCVW)

Defending Object Detection Networks Against Adversarial Patch Attacks

Gittings, T., Schneider, S., Collomosse, J. (Oct. 17, 2021)

ICCV Workshop on Adversarial Robustness in the Real World (ICCVW)

Deep Image Comparator: Learning to Visualize Editorial Change

Black, A., Bui, T., Jin, H., Swaminathan, V., Collomosse, J. (Jun. 20, 2021)

CVPR Workshop on Media Forensics (CVPRW)

Magic Layouts: Structural Prior for Component Detection in User Interface Designs

Manandhar, D., Jin, H., Collomosse, J., Collomosse, J. (Jun. 6, 2021)

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Compositional Sketch Search

Black, A., Bui, T., Mai, L., Jin, H., Collomosse, J. (Jan. 1, 2021)

International Conference on Image Processing (ICIP)

Neural Architecture Search for Deep Image Prior

Ho, K., Gilbert, A., Jin, H., Collomosse, J. (Jan. 1, 2021)

Elsevier Computers & Graphics (CAG)

Geo-PIFu: Geometry and Pixel Aligned Implicit Functions for Single-view Human Reconstruction

He, T., Collomosse, J., Jin, H., Soatto, S. (Dec. 1, 2020)

Advances in Neural Information Processing Systems (NeurIPS)

DeepVoxels++: Enhancing the Fidelity of Novel View Synthesis from 3D Voxel Embeddings

He, T., Collomosse, J., Jin, H., Soatto, S. (Dec. 1, 2020)

Asian Conference on Computer Vision (ACCV)

Vax-a-Net: Training-time Defence Against Adversarial Patch Attacks

Gittings, T., Schneider, S., Collomosse, J. (Dec. 1, 2020)

Asian Conference on Computer Vision (ACCV)

Semantic Estimation of 3D Body Shape and Pose using Minimal Cameras

Gilbert, A., Trumble, M., Hilton, A., Collomosse, J. (Sep. 9, 2020)

British Machine Vision Conference (BMVC)

Sketchformer: Transformer-based Representation for Sketched Structure

Ribeiro, L., Bui, T., Collomosse, J., Ponti, M. (Jun. 20, 2020)

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

TAPESTRY: A De-centralized Service for Trusted Interaction Online

Yang, Y., Cooper, D., Collomosse, J., Dragan, C., Manulis, M., Steane, J., Manohar, A., Briggs, J., Moncur, W., Jones, H. (May. 31, 2020)

IEEE Transactions on Services Computing (TSC)

Learning Structural Similarity of User Interface Layouts using Graph Networks

Manandhar, D., Ruta, D., Collomosse, J. (Mar. 1, 2020)

European Conference on Computer Vision (ECCV)

Tamper-proofing Video with Hierarchical Attention Autoencoder Hashing on Blockchain

Bui, T., Cooper, D., Collomosse, J., Bell, M., Green, A., Sheridan, J., Higgins, J., Das, A., Keller, J., Thereaux, O. (Jan. 31, 2020)

IEEE Transactions on Multimedia

Real-Time Multi-person Motion Capture from Multi-view Video

Malleson, C., Collomosse, J., Hilton, A. (Dec. 17, 2019)

International Journal on Computer Vision (IJCV)

An Internal Learning Approach to Video Inpainting

Zhang, H., Mai, L., Xu, N., Wang, Z., Collomosse, J., Jin, H. (Oct. 28, 2019)

International Conference on Computer Vision (ICCV) 2019

Robust Synthesis of Adversarial Visual Examples Using a Deep Image Prior

Gittings, T., Schneider, S., Collomosse, J. (Sep. 11, 2019)

British Machine Vision Conference (BMVC) 2019

LiveSketch: Query Perturbation for Guided Sketch-based Visual Search

Collomosse, J., Bui, T., Jin, H. (Jun. 18, 2019)

Conference on Computer Vision and Pattern Recognition (CVPR) 2019

ARCHANGEL: Tamper-proofing Video Archives using Temporal Content Hashes on the Blockchain

Bui, T., Cooper, D., Collomosse, J., Bell, M., Green, A., Sheridan, J., Higgins, J., Das, A., Keller, J., Thereaux, O., Brown, A. (Jun. 17, 2019)

Computer Vision and Pattern Recognition (CVPR) Workshops 2019. Computer Vision, AI and Blockchain.

Fusing Visual and Inertial Sensors with Semantics for 3D Human Pose Estimation

Gilbert, A., Trumble, M., Malleson, C., Hilton, A., Collomosse, J. (Apr. 1, 2019)

International Journal of Computer Vision (IJCV)

In-painting of Wide-baseline Multiple Viewpoint Video

Gilbert, A., Trumble, M., Hilton, A., Collomosse, J., Collomosse, J. (Dec. 24, 2018)

IEEE Transactions on Visualization and Computer Graphics (TVCG)

Deep Manifold Alignment for Mid-grain Sketch based Image Retrieval

Bui, T., Ribeiro, L., Ponti, M., Collomosse, J. (Dec. 2, 2018)

Asian Conference on Computer Vision (ACCV). 2018.

TAPESTRY: Visualizing Interwoven Identities for Trust Provenance

Yang, Y., Collomosse, J., Manohar, A., Briggs, J., Steane, J. (Oct. 22, 2018)

IEEE Symposium on Visualization for Cyber Security (VizSec)

Volumetric performance capture from minimal camera viewpoints

Trumble, M., Gilbert, A., Hilton, A., Collomosse, J. (Sep. 9, 2018)

European Conference on Computer Vision (ECCV). 2018.

Deep Autoencoder for Combined Human Pose Estimation and Body Model Upscaling

Trumble, M., Gilbert, A., Hilton, A., Collomosse, J. (Sep. 8, 2018)

European Conference on Computer Vision (ECCV). 2018.

ARCHANGEL: Trusted Archives of Digital Public Documents

Collomosse, J., Bui, T., Brown, A., Sheridan, J., Green, A., Bell, M., Fawcett, J., Higgins, J., Thereaux, O. (Aug. 29, 2018)

ACM Conference on Document Engineering (DocEng). 2018.

Disentangling Structure and Aesthetics for Content-aware Image Completion

Gilbert, A., Collomosse, J., Jin, H., Price, B. (Jun. 18, 2018)

Conference on Computer Vision and Pattern Recognition (CVPR) 2018

Sketching out the Details: Sketch-based Image Retrieval using Convolutional Neural Networks with Multi-stage Regression

Bui, T., Ribeiro, L., Ponti, M., Collomosse, J. (Apr. 1, 2018)

Elsevier Journal on Computers & Graphics (C&G)

Compact descriptors for sketch-based image retrieval using a triplet loss convolutional neural network

Bui, T., Ribeiro, L., Ponti, M., Collomosse, J. (Nov. 1, 2017)

Journal on Computer Vision and Image Understanding (CVIU)

Sketching with Style: Visual Search with Sketches and Aesthetic Context

Collomosse, J., Bui, T., Wilber, M., Fang, C., Jin, H. (Oct. 22, 2017)

International Conference on Computer Vision (ICCV). 2017.

BAM! The Behance Artistic Media Dataset for Recognition Beyond Photography

Wilber, M., Fang, C., Jin, H., Hertzmann, A., Collomosse, J., Belongie, S. (Oct. 22, 2017)

International Conference on Computer Vision (ICCV). 2017.

Real-time Full-Body Motion Capture from Video and IMUs

Malleson, C., Gilbert, A., Trumble, M., Collomosse, J., Hilton, A., Volino, M. (Oct. 10, 2017)

International Conference on 3D Vision (3DV). 2017.

Total Capture: 3D Human Pose Estimation Fusing Video and Inertial Sensors

Trumble, M., Gilbert, A., Malleson, C., Hilton, A., Collomosse, J. (Sep. 4, 2017)

British Machine Vision Conference (BMVC). 2017.

Comprehensible Video Thumbnails

Kim, J., Gray, C., Asente, P., Collomosse, J. (May. 1, 2015)

Computer Graphics Forum (Proc. Eurographics 2015)

A Particle Filtering Approach to Salient Video Object Localization

Gray, C., James, S., Collomosse, J., Asente, P. (Oct. 1, 2014)

IEEE International Conference on Image Processing (ICIP). 2014.

Special section on the 2011 joint symposium on computational aesthetics (CAe), non-photorealistic animation and rendering (NPAR), and sketch-based interfaces and modeling (SBIM)

Asente, P., Collomosse, J., Isenberg, T., Sezgin, T. (Oct. 1, 2012)

Computers & Graphics Volume 36, Issue 6 (October 2012)

NPAR 2011 – Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering

Collomosse, J., Asente, P., Spencer, S. (Aug. 5, 2011)

NPAR 2011 – Proceedings of the ACM/Eurographics Symposium on Non-Photorealistic Animation and Rendering