Trung Bui

When Attention Closes: How LLMs Lose the Thread in Multi-Turn Interaction

Vardhan_Dongre, Joseph Hsieh, Viet Lai, David Seunghyun Yoon, Trung Bui, Dilek Hakkani-Tür

StreamGaze: Gaze-Guided Temporal Reasoning and Proactive Understanding in Streaming Videos

Daeun Lee, Subhojyoti Mukherjee, Branislav Kveton, Ryan A. Rossi, Viet Lai, David Seunghyun Yoon, Trung Bui, Franck Dernoncourt, Mohit Bansal

ViT-AdaLA: Adapting Vision Transformers with Linear Attention

Yifan Li, David Seunghyun Yoon, Viet Lai, Franck Dernoncourt, Jason Kuen, Yu Kong, Trung Bui

SPECI: Fine-grained Evaluation of Specificity for Image Captioning

Son Luu, Hiep Nguyen, Trung Bui, Viet Lai, Le-Minh Nguyen

FIFA: Unified Faithfulness Evaluation Framework for Text-to-Video and Video-to-Text Generation

Liqiang Jing, Viet Lai, David Seunghyun Yoon, Trung Bui, Xinya Du

Can Large Language Models Keep Up? Benchmarking Online Adaptation to Continual Knowledge Streams

Jiyeon Kim, Hyunji Lee, Dylan Zhou, Sue Hyun Park, David Seunghyun Yoon, Trung Bui, Franck Dernoncourt, Sungmin Cha, Minjoon Seo

Lizard: An Efficient Linearization Framework for Large Language Models

Chien Van Nguyen, Huy Huu Nguyen, Ruiyi Zhang, Hanieh Deilamsalehy, Puneet Mathur, Viet Lai, Haoliang Wang, Jayakumar Subramanian, Ryan A. Rossi, Trung Bui, Nikos Vlassis, Franck Dernoncourt, Thien Huu Nguyen

Steering MoE LLMs via Expert (De)Activation

Mohsen Fayyaz, Ali Modarressi, Hanieh Deilamsalehy, Franck Dernoncourt, Ryan A. Rossi, Trung Bui, Hinrich Schuetze, Nanyun Peng

A Survey on LLM-based Conversational User Simulation

Bo Ni, Yu Wang, Leyao Wang, Branislav Kveton, Franck Dernoncourt, Yu Xia, Hongjie Chen, Reuben Luera, Samyadeep Basu, Subhojyoti Mukherjee, Puneet Mathur, Nesreen K. Ahmed, Junda Wu, Li Li, Huixin Zhang, Ruiyi Zhang, Tong Yu, Sungchul Kim, Jiuxiang Gu, Zhengzhong Tu, Alexa Siu, Zichao Wang, David Seunghyun Yoon, Nedim Lipka, Namyong Park, Zihao Lin, Trung Bui, Yue Zhao, Tyler Derr, Ryan A. Rossi

Instruction Tuning with and without Context: Behavioral Shifts and Downstream Impact

Hyunji Lee, David Seunghyun Yoon, Yunjae Won, Hanseok Oh, Geewook Kim, Trung Bui, Franck Dernoncourt, Elias Stengel-Eskin, Mohit Bansal, Minjoon Seo

Understanding Generative AI Capabilities in Everyday Image Editing Tasks

Brandon Collins, Mohammad Reza Taesiri, Logan Bolton, Viet Lai, Franck Dernoncourt, Trung Bui, Anh Totti Nguyen

Vision Language Models Learn to Assess Images with Specialists

Quyet V. Do, David Seunghyun Yoon, Ruiyi Zhang, Thiloshon Nagarajah, Trung Bui, Viet Lai

Offline RL by Reward-Weighted Fine-Tuning for Conversation Optimization

Subhojyoti Mukherjee, Viet Lai, Raghavendra Addanki, Ryan A. Rossi, David Seunghyun Yoon, Trung Bui, Anup Rao, Jayakumar Subramanian, Branislav Kveton

DynaSaur: Large Language Agents Beyond Predefined Actions

Dang Nguyen, Viet Dac Lai, David Seunghyun Yoon, Ryan A. Rossi, Handong Zhao, Ruiyi Zhang, Puneet Mathur, Nedim Lipka, Yu Wang, Trung Bui, Franck Dernoncourt, Tianyi Zhou

SlimLM: An Efficient Small Language Model for On-Device Document Assistance

Thang M. Pham, Phat T. Nguyen, David Seunghyun Yoon, Viet Lai, Franck Dernoncourt, Trung Bui

Click, Type, Repeat: A Comprehensive Survey on GUI Agents

Dang Nguyen, Jian Chen, Yu Wang, Gang Wu, Namyong Park, Zhengmian Hu, Hanjia Lyu, Junda Wu, Ryan Aponte, Yu Xia, Xintong Li, Jing Shi, Hongjie Chen, Viet Lai, Zhouhang Xie, Sungchul Kim, Ruiyi Zhang, Tong Yu, Mehrab Tanjim, Nesreen K. Ahmed, Puneet Mathur, David Seunghyun Yoon, Lina Yao, Branislav Kveton, Jihyung Kil, Thien Huu Nguyen, Trung Bui, Tianyi Zhou, Ryan A. Rossi, Franck Dernoncourt

Toward Robust Hyper-Detailed Image Captioning: A Multiagent Approach and Dual Evaluation Metrics for Factuality and Coverage

Saehyung Lee, David Seunghyun Yoon, Trung Bui, Jing Shi, Sungroh Yoon

NoLiMa: Long-Context Evaluation Beyond Literal Matching

Ali Modarressi, Hanieh Deilamsalehy, Franck Dernoncourt, Trung Bui, Ryan A. Rossi, David Seunghyun Yoon, Hinrich Schütze

Understanding Generative AI Capabilities in Everyday Image Editing Tasks

Mohammad Reza Taesiri, Logan Bolton, Brandon Collins, Viet Lai, Franck Dernoncourt, Trung Bui, Anh Totti Nguyen

CORG: Generating Answers from Complex, Interrelated Contexts

Hyunji Lee, Franck Dernoncourt, Trung Bui, David Seunghyun Yoon

Domain-specific Question Answering with Hybrid Search

Dewang Sultania, Zhaoyu Lu, Twisha Naik, Franck Dernoncourt, David Seunghyun Yoon, Sanat Sharma, Trung Bui, Ashok Gupta, Tushar Vatsa, Suhas Suresha, Ishita Verma, Vibha Belavadi, Cheng Chen, Michael Friedrich

Towards Enhancing Coherence in Extractive Summarization: Dataset and Experiments with LLMs

Mihir Parmar, Hanieh Deilamsalehy, Franck Dernoncourt, David Seunghyun Yoon, Ryan A. Rossi, Trung Bui

Identifying Speakers in Dialogue Transcripts: A Text-based Approach Using Pretrained Language Models

Minh Van Nguyen, Franck Dernoncourt, David Seunghyun Yoon, Hanieh Deilamsalehy, Hao Tan, Ryan A. Rossi, Quan Hung Tran, Trung Bui, Thien Nguyen

Multilingual Meta-Distillation Alignment for Semantic Retrieval

Meryem M'hamdi, Jonathan May, Franck Dernoncourt, Trung Bui, David Seunghyun Yoon

Scaling Up Video Summarization Pretraining with Large Language Models

Dawit Mureja Argaw, David Seunghyun Yoon, Fabian Caba Heilbron, Hanieh Deilamsalehy, Trung Bui, Zhaowen Wang, Franck Dernoncourt, Joon Son Chung

PEEB: Part-based Image Classifiers with an Explainable and Editable Language Bottleneck

Thang M. Pham, Peijie Chen, Tin Nguyen, David Seunghyun Yoon, Trung Bui, Anh Nguyen

LRM: Large Reconstruction Model for Single Image to 3D

Yicong Hong, Kai Zhang, Jiuxiang Gu, Sai Bi, Yang Zhou, Difan Liu, Feng Liu, Kalyan Sunkavalli, Trung Bui, Hao Tan

Fine-tuning CLIP Text Encoders with Two-step Paraphrasing

Hyunjae Kim, David Seunghyun Yoon, Trung Bui, Handong Zhao, Quan Hung Tran, Franck Dernoncourt, Jaewoo Kang

Retrieval Augmented Generation for Domain-specific Question Answering

Sanat Sharma, David Seunghyun Yoon, Franck Dernoncourt, Dewang Sultania, Karishma Bagga, Mengjiao Zhang, Trung Bui, Varun Kotte

Multi-Modal Video Topic Segmentation with Dual-Contrastive Domain Adaptation

Linzi Xing, Quan Hung Tran, Fabian Caba Heilbron, Franck Dernoncourt, David Seunghyun Yoon, Zhaowen Wang, Trung Bui, Giuseppe Carenini

Aspect-based Meeting Transcript Summarization: A Two-Stage Approach with Weak Supervision on Sentence Classification

Zhongfen Deng, David Seunghyun Yoon, Trung Bui, Franck Dernoncourt, Quan Hung Tran, Shuaiqi Liu, Wenting Zhao, Tao Zhang, Yibo Wang, Philip Yu

Perturbation Robust Metric for Multi-Lingual Image Captioning

Yongil Kim, Yerin Hwang, Hyeongu Yun, David Seunghyun Yoon, Trung Bui, Kyomin Jung

ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learning

Viet Dac Lai, Nghia Trung Ngo, Amir Pouran Ben Veyseh, Hieu Man, Franck Dernoncourt, Trung Bui, Thien Huu Nguyen

PaperToPlace: Transforming Instruction Documents into Spatialized and Context-Aware Mixed Reality Experiences

Chen Chen, Cuong Nguyen, Jane Hoffswell, Jennifer Healey, Trung Bui, Nadir Weibel

AR, VR & 360 Photography Human Computer Interaction

Moment Detection in Long Tutorial Videos

Ioana Croitoru, Simion-Vlad Bogolin, Samuel Albanie, Yang Liu, Zhaowen Wang, David Seunghyun Yoon, Franck Dernoncourt, Hailin Jin, Trung Bui

Learning Navigational Visual Representations with Semantic Map Supervision

Yicong Hong, Yang Zhou, Ruiyi Zhang, Franck Dernoncourt, Trung Bui, Stephen Gould, Hao Tan

Boosting Punctuation Restoration with Data Generation and Reinforcement Learning

Viet Lai, Abel Salinas, Hao Tan, Trung Bui, Quan Hung Tran, David Seunghyun Yoon, Hanieh Deilamsalehy, Franck Dernoncourt, Thien Nguyen

SCCS: Semantics-Consistent Cross-domain Summarization via Optimal Transport Alignment

Jielin Qiu, Jiacheng Zhu, Mengdi Xu, Franck Dernoncourt, Trung Bui, Zhaowen Wang, Bo Li, Ding Zhao and Hailin Jin

MeetingQA: Extractive Question-Answering on Meeting Transcripts

Archiki Prasad, Trung Bui, David Seunghyun Yoon, Hanieh Deilamsalehy, Franck Dernoncourt, Mohit Bansal

PiC: A Phrase-in-Context Dataset for Phrase Understanding and Semantic Search

Thang Minh Pham, David Seunghyun Yoon, Trung Bui, Anh Nguyen

LiveSeg: Unsupervised Multimodal Temporal Segmentation of Long Livestream Videos

Jielin Qiu, Franck Dernoncourt, Trung Bui, Zhaowen Wang, Ding Zhao, Hailin Jin

Factual Error Correction for Abstractive Summaries Using Entity Retrieval

Hwanhee Lee, Cheoneum Park, David Seunghyun Yoon, Trung Bui, Franck Dernoncourt, Juae Kim, Kyomin Jung

AI & Machine Learning Document Intelligence Natural Language Processing

Keyphrase Prediction from Video Transcripts: New Dataset and Directions

Amir Pouran Ben Veyseh, Quan Hung Tran, David Seunghyun Yoon, Varun Manjunatha, Hanieh Deilamsalehy, Rajiv Jain, Trung Bui, Walter W. Chang, Franck Dernoncourt, Thien Huu Nguyen

Virtual Knowledge Graph Construction for Zero-Shot Domain-Specific Document Retrieval

Yeon Seonwoo, David Seunghyun Yoon, Franck Dernoncourt, Trung Bui, Alice Oh

Medical Question Understanding and Answering with Knowledge Grounding and Semantic Self-Supervision

Khalil Mrini, Harpreet Singh, Franck Dernoncourt, David Seunghyun Yoon, Trung Bui, Walter W. Chang, Emilia Farcas, Ndapa Nakashole

Offensive Content Detection Via Synthetic Code-Switched Text

Cesa Salaam, Franck Dernoncourt, Trung Bui, Danda Rawat, David Seunghyun Yoon

Multimodal Intent Discovery from Livestream Videos

Adyasha Maharana, Quan Hung Tran, David Seunghyun Yoon, Franck Dernoncourt, Trung Bui, Walter Chang, Mohit Bansal

Fine-grained Image Captioning with CLIP Reward

Jaemin Cho, David Seunghyun Yoon, Ajinkya Kale, Franck Dernoncourt, Trung Bui, Mohit Bansal

CAISE: Conversational Agent for Image Search and Editing

Hyounghun Kim, Doo Soon Kim, David Seunghyun Yoon, Franck Dernoncourt, Trung Bui, Mohit Bansal

StreamHover: Livestream Transcript Summarization and Annotation

Sangwoo Cho, Franck Dernoncourt, Tim Ganter, Trung Bui, Nedim Lipka, Walter Chang, Hailin Jin, Jonathan Brandt, Hassan Foroosh, Fei Liu

Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning

Jianguo Zhang, Trung Bui, David Seunghyun Yoon, Xiang Chen, Zhiwei Liu, Congying Xia, Quan Hung Tran, Walter Chang, Philip Yu

A Gradually Soft Multi-Task and Data-Augmented Approach to Medical Question Understanding

Khalil Mrini, Franck Dernoncourt, David Seunghyun Yoon, Trung Bui, Walter Chang, Emilia Farcas, Ndapa Nakashole

UMIC: An Unreferenced Metric for Image Captioning via Contrastive Learning

Hwanhee Lee, David Seunghyun Yoon, Franck Dernoncourt, Trung Bui, Kyomin Jung

Learning by Planning: Language-Guided Global Image Editing

Jing Shi, Ning Xu, Yihang Xu, Trung Bui, Franck Dernoncourt, Chenliang Xu

UCSD-Adobe at MEDIQA 2021: Transfer Learning and Answer Sentence Selection for Medical Summarization

Khalil Mrini, Franck Dernoncourt, David Seunghyun Yoon, Trung Bui, Walter Chang, Emilias Farcas, Ndapa Nakashole

Open-Domain Question Answering with Pre-Constructed Question Spaces

Jinfeng Xiao, Lidan Wang, Franck Dernoncourt, Trung Bui, Tong Sun, Jiawei Han

A Context-Dependent Gated Module for Incorporating Symbolic Semantics into Event Coreference Resolution

Tuan Lai, Heng Ji, Trung Bui, Quan Hung Tran, Franck Dernoncourt, Walter Chang

KPQA: A Metric for Generative Question Answering Using Keyphrase Weights

Hwanhee Lee, David Seunghyun Yoon, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Joongbo Shin, Kyomin Jung

X-METRA-ADA: Cross-lingual Meta-Transfer learning Adaptation to Natural Language Understanding and Question Answering

Meryem M'hamdi, Doo Soon Kim, Franck Dernoncourt, Trung Bui, Xiang Ren, Jonathan May

A Benchmark and Baseline for Language-Driven Image Editing

Jing Shi, Ning Xu, Trung Bui, Franck Dernoncourt, Zheng Wen, Chenliang Xu

ViLBERTScore: Evaluating Image Caption Using Vision-and-Language BERT

Hwanhee Lee, David Seunghyun Yoon, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Kyomin Jung

Scene Graph Modification Based on Natural Language Commands

Xuanli He, Quan Hung Tran, Gholamreza Haffari, Walter Chang, Zhe Lin, Trung Bui, Franck Dernoncourt, Nhan Dam

Variational Hierarchical Dialog Autoencoder for Dialog State Tracking Data Augmentation

Kang Min Yoo, Hanbit Lee, Franck Dernoncourt, Trung Bui, Walter Chang, Sang-goo Lee

Rethinking Self-Attention: Towards Interpretability in Neural Parsing

Khalil Mrini, Franck Dernoncourt, Quan Hung Tran, Trung Bui, Walter Chang, Ndapa Nakashole

Efficient Deployment of Conversational Natural Language Interfaces over Databases

Anthony Colas, Trung Bui, Franck Dernoncourt, Moumita Sinha, Doo Soon Kim

Visual Dialog: Do we really need it?

Shubham Agarwal, Trung Bui, Joon-Young Lee, Ioannis Konstas, Verena Rieser

Propagate-Selector: Detecting Supporting Sentences for Question Answering via Graph Neural Networks

David Seunghyun Yoon, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Kyomin Jung

DSTC8-AVSD: Multimodal Semantic Transformer Network with Retrieval Style Word Generator

Hwanhee Lee, David Seunghyun Yoon, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Kyomin Jung

A Markov Network Model for Natural Language Semantic Matching

Lidan Wang, Trung Bui, Franck Dernoncourt, Natwar Modani

Bayesian Optimization for Selecting Efficient Machine Learning Models

Lidan Wang, Franck Dernoncourt, Trung Bui

A Compare-Aggregate Model with Latent Clustering for Answer Selection

David Seunghyun Yoon, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Kyomin Jung

A Gated Self-attention Memory Network for Answer Selection

Tuan Lai, Quan Tran, Trung Bui, Daisuke Kihara

Exploiting semi-supervised training through a dropout regularization in end-to-end speech recognition

Subhadeep Dey, Petr Motlicek, Trung Bui, Franck Dernoncourt

Highlights of Attention Mechanisms for Model Interpretability

Khalil Mrini, Franck Dernoncourt, Trung Bui, Walter Chang, Ndapa Nakashole

Modeling Visual Relationships in Language

Hao Tan, Franck Dernoncourt, Zhe Lin, Trung Bui, Mohit Bansal

Supervised Transfer Learning for Product Information Question Answering

Tuan Manh Lai, Trung Bui, Nedim Lipka, Sheng Li

A Multimodal Dialogue System for Conversational Image Editing

Tzu-Hsiang Lin, Trung Bui, Doo Soon Kim, Jean Oh

Visually Indicated Sound Generation by Perceptually Optimized Classification

Kan Chen, Chuanxi Zhang, Chen Fang, Zhaowen Wang, Trung Bui, Ram Nevatia

Best Paper Award

A Framework for Speech Recognition Benchmarking

Franck Dernoncourt, Trung Bui, Walter Chang

A Review on Deep Learning Techniques Applied to Answer Selection

Tuan Manh Lai, Trung Bui, Sheng Li

Conversational Image Editing: Incremental Intent Identification in a New Dialogue Task

Ramesh Manuvinakurike, Trung Bui, Walter Chang, Kallirroi Georgila

Best Paper Award

Visual to Sound: Generating Natural Sound for Videos in the Wild

Yipin Zhou, Zhaowen Wang, Chen Fang, Trung Bui, Tamara L. Berg

A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents

Arman Cohan, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Seokhwan Kim, Walter Chang, Nazli Goharian

The Context-dependent Additive Recurrent Neural Net

Quan Hung Tran, Tuan Manh Lai, Gholamreza Haffari, Ingrid Zukerman, Trung Bui, Hung Bui

Edit me: A Corpus and a Framework for Understanding Natural Language Image Editing

Ramesh Manuvinakurike, Jacqueline Brixey, Trung Bui, Walter Chang, Doo Soon Kim, Ron Artstein, Kallirroi Georgila

PhotoshopQuiA: A Corpus of Non-Factoid Questions and Answers for Why-Question Answering

Andrei Dulceanu, Thang Le Dinh, Walter Chang, Trung Bui, Doo Soon Kim, Manh Chien Vu, Seokhwan Kim

Attention guided Multi-modal Correlation Learning for Image Search

Kan Chen, Trung Bui, Chen Fang, Zhaowen Wang, Ram Nevatia

Practical Linear Models for Large-Scale One-Class Collaborative Filtering

Suvash Sedhain, Hung Bui, Jaya Kawale, Nikos Vlassis, Branislav Kveton, Aditya Menon, Trung Bui, Scott Sanner

Spoken Language Understanding for DSTC 4

Franck Dernoncourt, J. Lee, Trung Bui, H. Bui

Robust Dialog State Tracking for Large Ontologies

Franck Dernoncourt, J. Lee, Trung Bui, H. Bui

A Speech-drive E-book Technology Prototype Demo

S. Peters, Trung Bui

A Multi-core Fitted Q Iteration Algorithm for Customer Lifetime Value Optimization

Trung Bui

Decision Detection using Hierarchical Graphical Models

Trung Bui, S. Peters

Affective Dialogue Management Using Factored POMDPs

Trung Bui, J. Zwiers, M. Poel, A. Nijholt

Extracting Decisions from multi-party Dialog using Directed Graphical Models and Semantic Similarity

Trung Bui, M. Frampton, J. Dowding, S. Peters

Real-time Decision Detection in Multi-party Dialogue

M. Frampton, J. Huang, Trung Bui, S. Peters

A Tractable Hybrid DDN-POMDP Approach to Affective Dialogue Modeling for Probabilistic Frame-based Dialogue Systems

Trung Bui, M. Poel, A. Nijholt, J. Zwiers

Practical Dialogue Manager Development using POMDPs

Trung Bui, B. van Schooten, D. Hofs

Generic Dialogue Modeling for Multi-application Dialogue Systems

Trung Bui, J. Zwiers, A. Nijholt, M. Poel

Rapid Dialogue Prototyping Methodology

Trung Bui, M. Rajman, M. Melichar