Trung Bui

Senior Research Scientist & Research Manager

San Jose

Trung is a researcher and research manager at Creative Intelligence Lab, Adobe Research. He joined Adobe from North Side Inc. in Montreal where he led the language team to develop dialog management technologies for the Bot Colony game. He conducted his PhD research at Human Media Interaction Group, University of Twente, the Netherlands and spent one and a half years as a research associate at Stanford University in the Center for the Study of Language and Information. He also worked at the Artificial Intelligence Laboratory, Swiss Federal Institute of Technology in Lausanne, Switzerland.

He has been working in various research projects in the domain of dialogue management, natural language processing, joint vision and language, AI and machine learning.

Personal web page

Publications

Towards Enhancing Coherence in Extractive Summarization: Dataset and Experiments with LLMs

Parmar, M., Deilamsalehy, H., Dernoncourt, F., Yoon, D., Rossi, R., Bui, T. (Nov. 16, 2024)

EMNLP 2024

Identifying Speakers in Dialogue Transcripts: A Text-based Approach Using Pretrained Language Models

Van Nguyen, M., Dernoncourt, F., Yoon, D., Deilamsalehy, H., Tan, H., Rossi, R., Tran, Q., Bui, T., Nguyen, T. (Sep. 5, 2024)

Interspeech 2024

Multilingual Meta-Distillation Alignment for Semantic Retrieval

M'hamdi, M., May, J., Dernoncourt, F., Bui, T., Yoon, D. (Jul. 18, 2024)

SIGIR 2024

Scaling Up Video Summarization Pretraining with Large Language Models

Argaw, D., Yoon, D., Heilbron, F., Deilamsalehy, H., Bui, T., Wang, Z., Dernoncourt, F., Chung, J. (Jun. 21, 2024)

CVPR 2024

PEEB: Part-based Image Classifiers with an Explainable and Editable Language Bottleneck

Pham, T., Chen, P., Nguyen, T., Yoon, D., Bui, T., Nguyen, A. (Jun. 16, 2024)

NAACL 2024 Findings

Fine-tuning CLIP Text Encoders with Two-step Paraphrasing

Kim, H., Yoon, D., Bui, T., Zhao, H., Tran, Q., Dernoncourt, F., Kang, J. (Mar. 22, 2024)

EACL 2024 Findings

Retrieval Augmented Generation for Domain-specific Question Answering

Sharma, S., Yoon, D., Dernoncourt, F., Sultania, D., Bagga, K., Zhang, M., Bui, T., Kotte, V. (Feb. 26, 2024)

AAAI 2024 Workshop on Scientific Document Understanding

Multi-Modal Video Topic Segmentation with Dual-Contrastive Domain Adaptation

Xing, L., Tran, Q., Heilbron, F., Dernoncourt, F., Yoon, D., Wang, Z., Bui, T., Carenini, G. (Feb. 2, 2024)

Multimedia Modelling 2024

Aspect-based Meeting Transcript Summarization: A Two-Stage Approach with Weak Supervision on Sentence Classification

Deng, Z., Yoon, D., Bui, T., Dernoncourt, F., Tran, Q., Liu, S., Zhao, W., Zhang, T., Wang, Y., Yu, P. (Dec. 18, 2023)

2023 IEEE International Conference on Big Data

Perturbation Robust Metric for Multi-Lingual Image Captioning

Kim, Y., Hwang, Y., Yun, H., Yoon, D., Bui, T., Jung, K. (Dec. 10, 2023)

EMNLP 2023 Findings

ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learning

Lai, V., Ngo, N., Veyseh, A., Man, H., Dernoncourt, F., Bui, T., Nguyen, T. (Dec. 10, 2023)

Findings of EMNLP 2023

PaperToPlace: Transforming Instruction Documents into Spatialized and Context-Aware Mixed Reality Experiences

Chen, C., Nguyen, C., Hoffswell, J., Healey, J., Bui, T., Weibel, N. (Oct. 10, 2023)

ACM UIST 2023

Learning Navigational Visual Representations with Semantic Map Supervision

Hong, Y., Zhou, Y., Zhang, R., Dernoncourt, F., Bui, T., Gould, S., Tan, H. (Oct. 6, 2023)

ICCV 2023

Moment Detection in Long Tutorial Videos

Croitoru, I., Bogolin, S., Albanie, S., Liu, Y., Wang, Z., Yoon, D., Dernoncourt, F., Jin, H., Bui, T. (Oct. 6, 2023)

ICCV 2023

Boosting Punctuation Restoration with Data Generation and Reinforcement Learning

Lai, V., Salinas, A., Tan, H., Bui, T., Tran, Q., Yoon, D., Deilamsalehy, H., Dernoncourt, F., Nguyen, T. (Aug. 24, 2023)

Interspeech 2023

SCCS: Semantics-Consistent Cross-domain Summarization via Optimal Transport Alignment

Qiu, J., Zhu, J., Xu, M., Dernoncourt, F., Bui, T., Wang, Z., Li, B., Jin, D. (Jul. 14, 2023)

Findings of ACL 2023

MeetingQA: Extractive Question-Answering on Meeting Transcripts

Prasad, A., Bui, T., Yoon, D., Deilamsalehy, H., Dernoncourt, F., Bansal, M. (Jul. 10, 2023)

ACL 2023

PiC: A Phrase-in-Context Dataset for Phrase Understanding and Semantic Search

Pham, T., Yoon, D., Bui, T., Nguyen, A. (May. 3, 2023)

EACL 2023

LiveSeg: Unsupervised Multimodal Temporal Segmentation of Long Livestream Videos

Qiu, J., Dernoncourt, F., Bui, T., Wang, Z., Zhao, D., Jin, H. (Jan. 6, 2023)

WACV 2023

Factual Error Correction for Abstractive Summaries Using Entity Retrieval

Lee, H., Park, C., Yoon, D., Bui, T., Dernoncourt, F., Kim, J., Jung, K. (Dec. 11, 2022)

EMNLP 2022 GEM Workshop

Keyphrase Prediction from Video Transcripts: New Dataset and Directions

Veyseh, A., Tran, Q., Yoon, D., Manjunatha, V., Deilamsalehy, H., Jain, R., Bui, T., Chang, W., Dernoncourt, F., Nguyen, T. (Oct. 17, 2022)

COLING 2022

Virtual Knowledge Graph Construction for Zero-Shot Domain-Specific Document Retrieval

Seonwoo, Y., Yoon, D., Dernoncourt, F., Bui, T., Oh, A. (Oct. 17, 2022)

COLING 2022

Medical Question Understanding and Answering with Knowledge Grounding and Semantic Self-Supervision

Mrini, K., Singh, H., Dernoncourt, F., Yoon, D., Bui, T., Chang, W., Farcas, E., Nakashole, N. (Oct. 17, 2022)

COLING 2022

Offensive Content Detection Via Synthetic Code-Switched Text

Salaam, C., Dernoncourt, F., Bui, T., Rawat, D., Yoon, D. (Oct. 17, 2022)

COLING 2022

Multimodal Intent Discovery from Livestream Videos

Maharana, A., Tran, Q., Yoon, D., Dernoncourt, F., Bui, T., Chang, W., Bansal, M. (Jul. 11, 2022)

NAACL 2022 Findings

Fine-grained Image Captioning with CLIP Reward

Cho, J., Yoon, D., Kale, A., Dernoncourt, F., Bui, T., Bansal, M. (Jul. 11, 2022)

NAACL 2022 Findings

CAISE: Conversational Agent for Image Search and Editing

Kim, H., Kim, D., Yoon, D., Dernoncourt, F., Bui, T., Bansal, M. (Feb. 28, 2022)

AAAI 2022

Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning

Zhang, J., Bui, T., Yoon, D., Chen, X., Liu, Z., Xia, C., Tran, Q., Chang, W., Yu, P. (Nov. 9, 2021)

EMNLP 2021

StreamHover: Livestream Transcript Summarization and Annotation

Cho, S., Dernoncourt, F., Ganter, T., Bui, T., Lipka, N., Chang, W., Jin, H., Brandt, J., Foroosh, H., Liu, F. (Nov. 9, 2021)

Empirical Methods in Natural Language Processing (EMNLP)

A Gradually Soft Multi-Task and Data-Augmented Approach to Medical Question Understanding

Mrini, K., Dernoncourt, F., Yoon, D., Bui, T., Chang, W., Farcas, E., Nakashole, N. (Aug. 4, 2021)

ACL 2021

UMIC: An Unreferenced Metric for Image Captioning via Contrastive Learning

Lee, H., Yoon, D., Dernoncourt, F., Bui, T., Jung, K. (Aug. 4, 2021)

ACL 2021

Learning by Planning: Language-Guided Global Image Editing

Shi, J., Xu, N., Xu, Y., Bui, T., Dernoncourt, F., Xu, C. (Jun. 25, 2021)

CVPR 2021

UCSD-Adobe at MEDIQA 2021: Transfer Learning and Answer Sentence Selection for Medical Summarization

Mrini, K., Dernoncourt, F., Yoon, D., Bui, T., Chang, W., Farcas, E., Nakashole, N. (Jun. 11, 2021)

NAACL BioNLP 2021

Open-Domain Question Answering with Pre-Constructed Question Spaces

Xiao, J., Wang, L., Dernoncourt, F., Bui, T., Sun, T., Han, J. (Jun. 11, 2021)

NAACL SRW 2021

A Context-Dependent Gated Module for Incorporating Symbolic Semantics into Event Coreference Resolution

Lai, T., Ji, H., Bui, T., Tran, Q., Dernoncourt, F., Chang, W. (Jun. 11, 2021)

NAACL 2021

KPQA: A Metric for Generative Question Answering Using Keyphrase Weights

Lee, H., Yoon, D., Dernoncourt, F., Kim, D., Bui, T., Shin, J., Jung, K. (Jun. 11, 2021)

NAACL 2021

X-METRA-ADA: Cross-lingual Meta-Transfer learning Adaptation to Natural Language Understanding and Question Answering

M'hamdi, M., Kim, D., Dernoncourt, F., Bui, T., Ren, X., May, J. (Jun. 11, 2021)

NAACL 2021

A Benchmark and Baseline for Language-Driven Image Editing

Shi, J., Xu, N., Bui, T., Dernoncourt, F., Wen, Z., Xu, C. (Dec. 4, 2020)

ACCV 2020

ViLBERTScore: Evaluating Image Caption Using Vision-and-Language BERT

Lee, H., Yoon, D., Dernoncourt, F., Kim, D., Bui, T., Jung, K. (Nov. 20, 2020)

EMNLP 2020 Eval4NLP

Rethinking Self-Attention: Towards Interpretability in Neural Parsing

Mrini, K., Dernoncourt, F., Tran, Q., Bui, T., Chang, W., Nakashole, N. (Nov. 18, 2020)

EMNLP Findings 2020

Scene Graph Modification Based on Natural Language Commands

He, X., Tran, Q., Haffari, G., Chang, W., Lin, Z., Bui, T., Dernoncourt, F., Dam, N. (Nov. 18, 2020)

EMNLP Findings 2020

Variational Hierarchical Dialog Autoencoder for Dialog State Tracking Data Augmentation

Yoo, K., Lee, H., Dernoncourt, F., Bui, T., Chang, W., Lee, S. (Nov. 18, 2020)

EMNLP 2020

Efficient Deployment of Conversational Natural Language Interfaces over Databases

Colas, A., Bui, T., Dernoncourt, F., Sinha, M., Kim, D. (Jul. 10, 2020)

ACL 2020 First Workshop on Natural Language Interfaces

Visual Dialog: Do we really need it?

Agarwal, S., Bui, T., Lee, J., Konstas, I., Rieser, V. (Jul. 5, 2020)

ACL 2020

Propagate-Selector: Detecting Supporting Sentences for Question Answering via Graph Neural Networks

Yoon, D., Dernoncourt, F., Kim, D., Bui, T., Jung, K. (May. 12, 2020)

LREC 2020

DSTC8-AVSD: Multimodal Semantic Transformer Network with Retrieval Style Word Generator

Lee, H., Yoon, D., Dernoncourt, F., Kim, D., Bui, T., Jung, K. (Feb. 8, 2020)

AAAI 2020 Dialog System Technology Challenge (DSTC8)

A Markov Network Model for Natural Language Semantic Matching

Wang, L., Bui, T., Dernoncourt, F., Modani, N. (Nov. 8, 2019)

ICDM 2019 Autonomous Machine Learning Workshop

Bayesian Optimization for Selecting Efficient Machine Learning Models

Wang, L., Dernoncourt, F., Bui, T. (Nov. 7, 2019)

CIKM 2019 MoST-Rec Workshop

A Compare-Aggregate Model with Latent Clustering for Answer Selection

Yoon, D., Dernoncourt, F., Kim, D., Bui, T., Jung, K. (Nov. 7, 2019)

CIKM 2019

A Gated Self-attention Memory Network for Answer Selection

Lai, T., Tran, Q., Bui, T., Kihara, D. (Nov. 5, 2019)

EMNLP 2019

Exploiting semi-supervised training through a dropout regularization in end-to-end speech recognition

Dey, S., Motlicek, P., Bui, T., Dernoncourt, F. (Sep. 20, 2019)

Interspeech 2019

Highlights of Attention Mechanisms for Model Interpretability

Mrini, K., Dernoncourt, F., Bui, T., Chang, W., Nakashole, N. (Sep. 13, 2019)

SoCal NLP Symposium 2019

Modeling Visual Relationships in Language

Tan, H., Dernoncourt, F., Lin, Z., Bui, T., Bansal, M. (Jul. 28, 2019)

Proc. of ACL

Supervised Transfer Learning for Product Information Question Answering

Lai, T., Bui, T., Lipka, N., Li, S. (Dec. 17, 2018)

Proc. of ICMLA

A Multimodal Dialogue System for Conversational Image Editing

Lin, T., Bui, T., Kim, D., Oh, J. (Dec. 13, 2018)

Proc. of 2nd Conversational AI Workshop - NIPS

Visually Indicated Sound Generation by Perceptually Optimized Classification

Chen, K., Zhang, C., Fang, C., Wang, Z., Bui, T., Nevatia, R. (Sep. 9, 2018)

Best Paper Award

Proc. of the 1st Multimodal Learning and Applications Workshop (MULA 2018)

A Framework for Speech Recognition Benchmarking

Dernoncourt, F., Bui, T., Chang, W. (Sep. 2, 2018)

Proc. of Interspeech 2018

A Review on Deep Learning Techniques Applied to Answer Selection

Lai, T., Bui, T., Li, S. (Aug. 20, 2018)

Proceedings of the 27th International Conference on Computational Linguistics (COLING 2018)

Conversational Image Editing: Incremental Intent Identification in a New Dialogue Task

Manuvinakurike, R., Bui, T., Chang, W., Georgila, K. (Jul. 12, 2018)

Best Paper Award

Proc. of SIGDIAL 2018

Visual to Sound: Generating Natural Sound for Videos in the Wild

Zhou, Y., Wang, Z., Fang, C., Bui, T., Berg, T. (Jun. 18, 2018)

Proc. of CVPR 2018

The Context-dependent Additive Recurrent Neural Net

Tran, Q., Lai, T., Haffari, G., Zukerman, I., Bui, T., Bui, H. (Jun. 1, 2018)

Proceedings of NAACL-HLT 2018

A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents

Cohan, A., Dernoncourt, F., Kim, D., Bui, T., Kim, S., Chang, W., Goharian, N. (Jun. 1, 2018)

Proceedings of NAACL-HLT 2018

Edit me: A Corpus and a Framework for Understanding Natural Language Image Editing

Manuvinakurike, R., Brixey, J., Bui, T., Chang, W., Kim, D., Artstein, R., Georgila, K. (May. 7, 2018)

Proc. of LREC 2018

PhotoshopQuiA: A Corpus of Non-Factoid Questions and Answers for Why-Question Answering

Dulceanu, A., Le Dinh, T., Chang, W., Bui, T., Kim, D., Vu, M., Kim, S. (May. 7, 2018)

Proc. of LREC 2018

Attention guided Multi-modal Correlation Learning for Image Search

Chen, K., Bui, T., Fang, C., Wang, Z., Nevatia, R. (Jul. 21, 2017)

Proc. of CVPR 2017

Practical Linear Models for Large-Scale One-Class Collaborative Filtering

Sedhain, S., Bui, H., Kawale, J., Vlassis, N., Kveton, B., Menon, A., Bui, T., Sanner, S. (Jul. 9, 2016)

25th International Joint Conference on Artificial Intelligence

Spoken Language Understanding for DSTC 4

Dernoncourt, F., Lee, J., Bui, T., Bui, H. (Jan. 13, 2016)

The 7th International Workshop on Spoken Dialogue Systems (IWSDS 2016), Finland

Robust Dialog State Tracking for Large Ontologies

Dernoncourt, F., Lee, J., Bui, T., Bui, H. (Jan. 1, 2016)

International Workshop on Spoken Dialog Systems 2016, Finland

A Speech-drive E-book Technology Prototype Demo

Peters, S., Bui, T. (Dec. 1, 2014)

In Proceedings of the 2014 Spoken Language Technology Workshop (SLT 2014) , South Lake Tahoe, Nevada, USA.

A Multi-core Fitted Q Iteration Algorithm for Customer Lifetime Value Optimization

Bui, T. (Jun. 26, 2014)

Proceedings of the ICML-2014 Workshop on Customers Value Optimization in Digital Marketing, Beijing, China

Decision Detection using Hierarchical Graphical Models

Bui, T., Peters, S. (Jan. 31, 2010)

In Proceedings of the 48th Annual Meeting of Association for Computational Linguistics (ACL 2010) , Uppsala, Sweden.

Affective Dialogue Management Using Factored POMDPs

Bui, T., Zwiers, J., Poel, M., Nijholt, A. (Jan. 1, 2010)

In Interactive Collaborative Information Systems, SCI 281, pages 207-236, Springer-Verlag Berlin

Extracting Decisions from multi-party Dialog using Directed Graphical Models and Semantic Similarity

Bui, T., Frampton, M., Dowding, J., Peters, S. (Sep. 11, 2009)

In Proceedings of the 10th Annual SIGDIAL Meeting on Discourse and Dialogue (SIGdial 09), London, UK.

Real-time Decision Detection in Multi-party Dialogue

Frampton, M., Huang, J., Bui, T., Peters, S. (Aug. 6, 2009)

In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, pages 1133–1141, Singapore.

A Tractable Hybrid DDN-POMDP Approach to Affective Dialogue Modeling for Probabilistic Frame-based Dialogue Systems

Bui, T., Poel, M., Nijholt, A., Zwiers, J. (Feb. 3, 2009)

In Natural Language Engineering, 15(2), pages 273-307, Cambridge University Press

Practical Dialogue Manager Development using POMDPs

Bui, T., van Schooten, B., Hofs, D. (Sep. 1, 2007)

In Proceedings of the 8th SIGdial Workshop on Discourse and Dialogue, pages 215–218, Antwerp, Belgium