David Seunghyun Yoon

Senior Research Scientist

San Jose

David Seunghyun Yoon is a Senior Research Scientist at Adobe Research. He received his Ph.D. in Electrical and Computer Engineering from Seoul National University. His research interests include machine learning and natural language processing (NLP). He is particularly interested in question answering, and multimodal representations (e.g., text, audio, and visual data).

Additional information can be found on the personal website. 

He is looking for interns and research collaborators with strong NLP and multimodal backgrounds, particularly those working on question answering, and factual consistency in large language models and vision-language models. Feel free to contact him at syoon@adobe.com.

Publications

ReflectCAP: Detailed Image Captioning with Reflective Memory

Min, Kyungmin., Kim, Minbeom., Lee, Kang-il., Yoon, David., Jung, Kyomin. (Sep. 10, 2026)

ECCV 2026

MARCH: Evaluating the Intersection of Ambiguity Interpretation and Multi-hop Inference

Park, Jeonghyun., Baek, Ingeol., Yoon, David., Jang, Haeun., Garimella, Aparna., Jain, Akriti., Lipka, Nedim., Lee, Hwanhee. (Jul. 7, 2026)

ACL 2026 Findings

FIFA: Unified Faithfulness Evaluation Framework for Text-to-Video and Video-to-Text Generation

Jing, Liqiang., Lai, Viet., Yoon, David., Bui, Trung., Du, Xinya. (Jul. 7, 2026)

ACL 2026 Findings

Can Large Language Models Keep Up? Benchmarking Online Adaptation to Continual Knowledge Streams

Kim, Jiyeon., Lee, Hyunji., Zhou, Dylan., Park, Sue., Yoon, David., Bui, Trung., Dernoncourt, Franck., Cha, Sungmin., Seo, Minjoon. (Jul. 7, 2026)

ACL 2026

VILLAIN at AVerImaTeC: Verifying Image–Text Claims via Multi-Agent Collaboration

Jung, Jaeyoon., Yoon, Yejun., Yoon, David., Park, Kunwoo. (Mar. 29, 2026)

1st place at the main challenge

EACL 2026 Workshop on Fact Extraction and VERification (FEVER)

Instruction Tuning with and without Context: Behavioral Shifts and Downstream Impact

Lee, Hyunji., Yoon, David., Won, Yunjae., Oh, Hanseok., Kim, Geewook., Bui, Trung., Dernoncourt, Franck., Stengel-Eskin, Elias., Bansal, Mohit., Seo, Minjoon. (Mar. 29, 2026)

EACL 2026

A Survey on LLM-based Conversational User Simulation

Ni, Bo., Wang, Yu., Wang, Leyao., Kveton, Branislav., Dernoncourt, Franck., Xia, Yu., Chen, Hongjie., Luera, Reuben., Basu, Samyadeep., Mukherjee, Subhojyoti., Mathur, Puneet., Ahmed, Nesreen., Wu, Junda., Li, Li., Zhang, Huixin., Zhang, Ruiyi., Yu, Tong., Kim, Sungchul., Gu, Jiuxiang., Tu, Zhengzhong., Siu, Alexa., Wang, Zichao., Yoon, David., Lipka, Nedim., Park, Namyong., Lin, Zihao., Bui, Trung., Zhao, Yue., Derr, Tyler., Rossi, Ryan. (Mar. 29, 2026)

EACL 2026

Vision Language Models Learn to Assess Images with Specialists

Do, Quyet., Yoon, David., Zhang, Ruiyi., Nagarajah, Thiloshon., Bui, Trung., Lai, Viet. (Mar. 6, 2026)

WACV 2026

Program Synthesis via Test-Time Transduction

Kang-il_Lee, Kang-il_Lee., Koo, Jahyun., Yoon, David., Kim, Minbeom., Koh, Hyukhun., Lee, Dongryeol., Jung, Kyomin. (Dec. 3, 2025)

NeurIPS 2025

Offline RL by Reward-Weighted Fine-Tuning for Conversation Optimization

Mukherjee, Subhojyoti., Lai, Viet., Addanki, Raghavendra., Rossi, Ryan., Yoon, David., Bui, Trung., Rao, Anup., Subramanian, Jayakumar., Kveton, Branislav. (Dec. 2, 2025)

NeurIPS 2025

FaithUn: Toward Faithful Forgetting in Language Models by Investigating the Interconnectedness of Knowledge

Yang, Nakyeong., Kim, Minsung., Yoon, David., Shin, Joongbo., Jung, Kyomin. (Nov. 6, 2025)

EMNLP 2025

A Survey on Long-Video Storytelling Generation: Architectures, Consistency, and Cinematic Quality

Elmoghany, Mohamed., Rossi, Ryan., Yoon, David., Mukherjee, Subhojyoti., Bakr, Eslam., Mathur, Puneet., Wu, Gang., Lai, Viet., Lipka, Nedim., Zhang, Ruiyi., Manjunatha, Varun., Nguyen, Chien., Dangi, Daksh., Salinas, Abel., Taesiri, Mohammad., Chen, Hongjie., Huang, Xiaolei., Barrow, Joe., Ahmed, Nesreen., Eldardiry, Hoda., Park, Namyong., Wang, Yu., Cho, Jaemin., Nguyen, Anh., Tu, Zhengzhong., Nguyen, Thien., Manocha, Dinesh., Elhoseiny, Mohamed., Dernoncourt, Franck. (Oct. 20, 2025)

ICCV 2025 LongVid Foundations Workshop

DynaSaur: Large Language Agents Beyond Predefined Actions

Nguyen, Dang., Lai, Viet., Yoon, David., Rossi, Ryan., Zhao, Handong., Zhang, Ruiyi., Mathur, Puneet., Lipka, Nedim., Wang, Yu., Bui, Trung., Dernoncourt, Franck., Zhou, Tianyi. (Oct. 9, 2025)

COLM 2025

Click, Type, Repeat: A Comprehensive Survey on GUI Agents

Nguyen, Dang., Chen, Jian., Wang, Yu., Wu, Gang., Park, Namyong., Hu, Zhengmian., Lyu, Hanjia., Wu, Junda., Aponte, Ryan., Xia, Yu., Li, Xintong., Shi, Jing., Chen, Hongjie., Lai, Viet., Xie, Zhouhang., Kim, Sungchul., Zhang, Ruiyi., Yu, Tong., Tanjim, Mehrab., Ahmed, Nesreen., Mathur, Puneet., Yoon, David., Yao, Lina., Kveton, Branislav., Kil, Jihyung., Nguyen, Thien., Bui, Trung., Zhou, Tianyi., Rossi, Ryan., Dernoncourt, Franck. (Aug. 1, 2025)

ACL 2025 Findings

From Selection to Generation: A Survey of LLM-based Active Learning

Xia, Yu., Mukherjee, Subhojyoti., Xie, Zhouhang., Wu, Junda., Li, Xintong., Aponte, Ryan., Lyu, Hanjia., Barrow, Joe., Chen, Hongjie., Dernoncourt, Franck., Kveton, Branislav., Yu, Tong., Zhang, Ruiyi., Gu, Jiuxiang., Ahmed, Nesreen., Wang, Yu., Chen, Xiang., Deilamsalehy, Hanieh., Kim, Sungchul., Hu, Zhengmian., Zhao, Yue., Lipka, Nedim., Yoon, David., Huang, Ting-Hao., Wang, Zichao., Mathur, Puneet., Pal, Soumyabrata., Mukherjee, Koyel., Zhang, Zhehao., Park, Namyong., Nguyen, Thien., Luo, Jiebo., Rossi, Ryan., McAuley, Julian. (Aug. 1, 2025)

ACL 2025

Hypothetical Documents or Knowledge Leakage? Rethinking LLM-based Query Expansion

Yoon, Yejun., Jung, Jaeyoon., Yoon, David., Park, Kunwoo. (Aug. 1, 2025)

ACL 2025 Findings

SlimLM: An Efficient Small Language Model for On-Device Document Assistance

Pham, Thang., Nguyen, Phat., Yoon, David., Lai, Viet., Dernoncourt, Franck., Bui, Trung. (Aug. 1, 2025)

ACL 2025 System Demonstrations

HerO 2 for Efficient Fact Verification

Yoon, Yejun., Jung, Jaeyoon., Yoon, David., Park, Kunwoo. (Jul. 27, 2025)

Won 2nd place at the main challenge

ACL 2025 Workshop on Fact Extraction and VERification (FEVER)

Toward Robust Hyper-Detailed Image Captioning: A Multiagent Approach and Dual Evaluation Metrics for Factuality and Coverage

Lee, Saehyung., Yoon, David., Bui, Trung., Shi, Jing., Yoon, Sungroh. (Jul. 19, 2025)

ICML 2025

NoLiMa: Long-Context Evaluation Beyond Literal Matching

Modarressi, Ali., Deilamsalehy, Hanieh., Dernoncourt, Franck., Bui, Trung., Rossi, Ryan., Yoon, David., Schütze, Hinrich. (Jul. 19, 2025)

ICML 2025

Generating Diverse Hypotheses for Inductive Reasoning

Lee, Kang-il., Koh, Hyukhun., Lee, Dongryeol., Yoon, David., Kim, Minsung., Jung, Kyomin. (Apr. 30, 2025)

NAACL 2025

CORG: Generating Answers from Complex, Interrelated Contexts

Lee, Hyunji., Dernoncourt, Franck., Bui, Trung., Yoon, David. (Apr. 30, 2025)

NAACL 2025

VLind-Bench: Measuring Language Priors in Large Vision-Language Models

Lee, Kang-il., Kim, Minbeom., Yoon, David., Kim, Minsung., Lee, Dongryeol., Koh, Hyukhun., Jung, Kyomin. (Apr. 30, 2025)

NAACL 2025 Findings

Domain-specific Question Answering with Hybrid Search

Sultania, Dewang., Lu, Zhaoyu., Naik, Twisha., Dernoncourt, Franck., Yoon, David., Sharma, Sanat., Bui, Trung., Gupta, Ashok., Vatsa, Tushar., Suresha, Suhas., Verma, Ishita., Belavadi, Vibha., Chen, Cheng., Friedrich, Michael. (Mar. 4, 2025)

AAAI 2025 Workshop on Document Understanding and Intelligence

PDFTriage: Question Answering over Long, Structured Documents

Saad-Falcon, Jon., Barrow, Joe., Siu, Alexa., Nenkova, Ani., Yoon, David., Rossi, Ryan., Dernoncourt, Franck. (Nov. 16, 2024)

EMNLP 2024 Industry Track

Towards Enhancing Coherence in Extractive Summarization: Dataset and Experiments with LLMs

Parmar, Mihir., Deilamsalehy, Hanieh., Dernoncourt, Franck., Yoon, David., Rossi, Ryan., Bui, Trung. (Nov. 16, 2024)

EMNLP 2024

FIZZ: Factual Inconsistency Detection by Zoom-in Summary and Zoom-out Document

Yang, Joonho., Yoon, David., Kim, ByeongJeong., Lee, Hwanhee. (Nov. 16, 2024)

EMNLP 2024

HerO at AVeriTeC: The Herd of Open Large Language Models for Verifying Real-World Claims

Yoon, Yejun., Jung, Jaeyoon., Yoon, David., Park, Kunwoo. (Nov. 16, 2024)

Won 2nd place at the main challenge

EMNLP 2024 Workshop on Fact Extraction and VERification (FEVER)

MVMR: A New Framework for Evaluating Faithfulness of Video Moment Retrieval against Multiple Distractors

Yang, Nakyeong., Kim, Minsung., Yoon, David., Shin, Joongbo., Jung, Kyomin. (Oct. 21, 2024)

CIKM 2024

Identifying Speakers in Dialogue Transcripts: A Text-based Approach Using Pretrained Language Models

Van Nguyen, Minh., Dernoncourt, Franck., Yoon, David., Deilamsalehy, Hanieh., Tan, Hao., Rossi, Ryan., Tran, Quan., Bui, Trung., Nguyen, Thien. (Sep. 5, 2024)

Interspeech 2024

Multi-hop Database Reasoning with Virtual Knowledge Graph

Son, Juhee., Seonwoo, Yeon., Oh, Alice., Thorne, James., Yoon, David. (Aug. 16, 2024)

ACL 2024 Workshop on Knowledge Graphs and Large Language Models

KaPQA: Knowledge-Augmented Product Question-Answering

Eppalapally, Swetha., Dangi, Daksh., Bhat, Chaithra., Gupta, Ankita., Zhang, Ruiyi., Bagga, Karishma., Yoon, David., Lipka, Nedim., Rossi, Ryan., Dernoncourt, Franck. (Aug. 16, 2024)

ACL 2024 Workshop on Knowledge Augmented Methods for NLP

Understanding News Thumbnail Representativeness by Counterfactual Text-Guided Contrastive Language-Image Pretraining

Yoon, Yejun., Yoon, David., Park, Kunwoo. (Aug. 12, 2024)

ACL 2024 Findings

Multilingual Meta-Distillation Alignment for Semantic Retrieval

M'hamdi, Meryem., May, Jonathan., Dernoncourt, Franck., Bui, Trung., Yoon, David. (Jul. 18, 2024)

SIGIR 2024

Scaling Up Video Summarization Pretraining with Large Language Models

Argaw, Dawit., Yoon, David., Heilbron, Fabian., Deilamsalehy, Hanieh., Bui, Trung., Wang, Zhaowen., Dernoncourt, Franck., Chung, Joon. (Jun. 21, 2024)

CVPR 2024

PEEB: Part-based Image Classifiers with an Explainable and Editable Language Bottleneck

Pham, Thang., Chen, Peijie., Nguyen, Tin., Yoon, David., Bui, Trung., Nguyen, Anh. (Jun. 16, 2024)

NAACL 2024 Findings

Fine-tuning CLIP Text Encoders with Two-step Paraphrasing

Kim, Hyunjae., Yoon, David., Bui, Trung., Zhao, Handong., Tran, Quan., Dernoncourt, Franck., Kang, Jaewoo. (Mar. 22, 2024)

EACL 2024 Findings

Retrieval Augmented Generation for Domain-specific Question Answering

Sharma, Sanat., Yoon, David., Dernoncourt, Franck., Sultania, Dewang., Bagga, Karishma., Zhang, Mengjiao., Bui, Trung., Kotte, Varun. (Feb. 26, 2024)

AAAI 2024 Workshop on Scientific Document Understanding

Multi-Modal Video Topic Segmentation with Dual-Contrastive Domain Adaptation

Xing, Linzi., Tran, Quan., Heilbron, Fabian., Dernoncourt, Franck., Yoon, David., Wang, Zhaowen., Bui, Trung., Carenini, Giuseppe. (Feb. 2, 2024)

Multimedia Modelling 2024

Aspect-based Meeting Transcript Summarization: A Two-Stage Approach with Weak Supervision on Sentence Classification

Deng, Zhongfen., Yoon, David., Bui, Trung., Dernoncourt, Franck., Tran, Quan., Liu, Shuaiqi., Zhao, Wenting., Zhang, Tao., Wang, Yibo., Yu, Philip. (Dec. 18, 2023)

2023 IEEE International Conference on Big Data

Perturbation Robust Metric for Multi-Lingual Image Captioning

Kim, Yongil., Hwang, Yerin., Yun, Hyeongu., Yoon, David., Bui, Trung., Jung, Kyomin. (Dec. 10, 2023)

EMNLP 2023 Findings

Moment Detection in Long Tutorial Videos

Croitoru, Ioana., Bogolin, Simion-Vlad., Albanie, Samuel., Liu, Yang., Wang, Zhaowen., Yoon, David., Dernoncourt, Franck., Jin, Hailin., Bui, Trung. (Oct. 6, 2023)

ICCV 2023

Boosting Punctuation Restoration with Data Generation and Reinforcement Learning

Lai, Viet., Salinas, Abel., Tan, Hao., Bui, Trung., Tran, Quan., Yoon, David., Deilamsalehy, Hanieh., Dernoncourt, Franck., Nguyen, Thien. (Aug. 24, 2023)

Interspeech 2023

Automatic Creation of Named Entity Recognition Datasets by Querying Phrase Representations

Kim, Hyunjae., Yoo, Jaehyo., Yoon, David., Kang, Jaewoo. (Jul. 10, 2023)

ACL 2023

MeetingQA: Extractive Question-Answering on Meeting Transcripts

Prasad, Archiki., Bui, Trung., Yoon, David., Deilamsalehy, Hanieh., Dernoncourt, Franck., Bansal, Mohit. (Jul. 10, 2023)

ACL 2023

PiC: A Phrase-in-Context Dataset for Phrase Understanding and Semantic Search

Pham, Thang., Yoon, David., Bui, Trung., Nguyen, Anh. (May. 3, 2023)

EACL 2023

Factual Error Correction for Abstractive Summaries Using Entity Retrieval

Lee, Hwanhee., Park, Cheoneum., Yoon, David., Bui, Trung., Dernoncourt, Franck., Kim, Juae., Jung, Kyomin. (Dec. 11, 2022)

EMNLP 2022 GEM Workshop

Simple Questions Generate Named Entity Recognition Datasets

Kim, Hyunjae., Yoo, Jaehyo., Yoon, David., Lee, Jinhyuk., Kang, Jaewoo. (Dec. 11, 2022)

EMNLP 2022

Improving cross-modal attention via object detection

Kim, Yongil., Hwang, Yerin., Yoon, David., Yun, Hyeongu., Jung, Kyomin. (Dec. 2, 2022)

NeurIPS 2022 Workshop on All Things Attention

Medical Question Understanding and Answering with Knowledge Grounding and Semantic Self-Supervision

Mrini, Khalil., Singh, Harpreet., Dernoncourt, Franck., Yoon, David., Bui, Trung., Chang, Walter., Farcas, Emilia., Nakashole, Ndapa. (Oct. 17, 2022)

COLING 2022

Offensive Content Detection Via Synthetic Code-Switched Text

Salaam, Cesa., Dernoncourt, Franck., Bui, Trung., Rawat, Danda., Yoon, David. (Oct. 17, 2022)

COLING 2022

Virtual Knowledge Graph Construction for Zero-Shot Domain-Specific Document Retrieval

Seonwoo, Yeon., Yoon, David., Dernoncourt, Franck., Bui, Trung., Oh, Alice. (Oct. 17, 2022)

COLING 2022

MACRONYM: A Large-Scale Dataset for Multilingual and Multi-Domain Acronym Extraction

Veyseh, Amir., Meister, Nicole., Yoon, David., Jain, Rajiv., Dernoncourt, Franck., Nguyen, Thien. (Oct. 17, 2022)

COLING 2022

Keyphrase Prediction from Video Transcripts: New Dataset and Directions

Veyseh, Amir., Tran, Quan., Yoon, David., Manjunatha, Varun., Deilamsalehy, Hanieh., Jain, Rajiv., Bui, Trung., Chang, Walter., Dernoncourt, Franck., Nguyen, Thien. (Oct. 17, 2022)

COLING 2022

Multimodal Intent Discovery from Livestream Videos

Maharana, Adyasha., Tran, Quan., Yoon, David., Dernoncourt, Franck., Bui, Trung., Chang, Walter., Bansal, Mohit. (Jul. 11, 2022)

NAACL 2022 Findings

Fine-grained Image Captioning with CLIP Reward

Cho, Jaemin., Yoon, David., Kale, Ajinkya., Dernoncourt, Franck., Bui, Trung., Bansal, Mohit. (Jul. 11, 2022)

NAACL 2022 Findings

How does fake news use a thumbnail? CLIP-based Multimodal Detection on the Unrepresentative News Image

Choi, Hyewon., Yoon, Yejun., Yoon, David., Park, Kunwoo. (May. 22, 2022)

ACL 2022 Workshop on CONSTRAINT

CAISE: Conversational Agent for Image Search and Editing

Kim, Hyounghun., Kim, Doo., Yoon, David., Dernoncourt, Franck., Bui, Trung., Bansal, Mohit. (Feb. 28, 2022)

AAAI 2022

Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning

Zhang, Jianguo., Bui, Trung., Yoon, David., Chen, Xiang., Liu, Zhiwei., Xia, Congying., Tran, Quan., Chang, Walter., Yu, Philip. (Nov. 9, 2021)

EMNLP 2021

QACE: Asking Questions to Evaluate an Image Caption

Lee, Hwanhee., Scialom, Thomas., Yoon, David., Dernoncourt, Franck., Jung, Kyomin. (Nov. 9, 2021)

EMNLP 2021 Findings

A Gradually Soft Multi-Task and Data-Augmented Approach to Medical Question Understanding

Mrini, Khalil., Dernoncourt, Franck., Yoon, David., Bui, Trung., Chang, Walter., Farcas, Emilia., Nakashole, Ndapa. (Aug. 4, 2021)

ACL 2021

UMIC: An Unreferenced Metric for Image Captioning via Contrastive Learning

Lee, Hwanhee., Yoon, David., Dernoncourt, Franck., Bui, Trung., Jung, Kyomin. (Aug. 4, 2021)

ACL 2021

UCSD-Adobe at MEDIQA 2021: Transfer Learning and Answer Sentence Selection for Medical Summarization

Mrini, Khalil., Dernoncourt, Franck., Yoon, David., Bui, Trung., Chang, Walter., Farcas, Emilias., Nakashole, Ndapa. (Jun. 11, 2021)

NAACL BioNLP 2021

KPQA: A Metric for Generative Question Answering Using Keyphrase Weights

Lee, Hwanhee., Yoon, David., Dernoncourt, Franck., Kim, Doo., Bui, Trung., Shin, Joongbo., Jung, Kyomin. (Jun. 11, 2021)

NAACL 2021

Learning to Detect Incongruence in News Headline and Body Text via a Graph Neural Network

Yoon, David., Park, Kunwoo., Lee, Minwoo., Kim, Taegyun., Cha, Meeyoung., Jung, Kyomin. (Feb. 24, 2021)

IEEE Access

Collaborative Training of GANs in Continuous and Discrete Spaces for Text Generation

Kim, Yanghoon., Won, Seungpil., Yoon, David., Jung, Kyomin. (Dec. 16, 2020)

IEEE Access

ViLBERTScore: Evaluating Image Caption Using Vision-and-Language BERT

Lee, Hwanhee., Yoon, David., Dernoncourt, Franck., Kim, Doo., Bui, Trung., Jung, Kyomin. (Nov. 20, 2020)

EMNLP 2020 Eval4NLP

Propagate-Selector: Detecting Supporting Sentences for Question Answering via Graph Neural Networks

Yoon, David., Dernoncourt, Franck., Kim, Doo., Bui, Trung., Jung, Kyomin. (May. 12, 2020)

LREC 2020

Attentive Modality Hopping Mechanism for Speech Emotion Recognition

Yoon, David., Dey, Subhadeep., Lee, Hwanhee., Jung, Kyomin. (May. 4, 2020)

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

DSTC8-AVSD: Multimodal Semantic Transformer Network with Retrieval Style Word Generator

Lee, Hwanhee., Yoon, David., Dernoncourt, Franck., Kim, Doo., Bui, Trung., Jung, Kyomin. (Feb. 8, 2020)

AAAI 2020 Dialog System Technology Challenge (DSTC8)

A Compare-Aggregate Model with Latent Clustering for Answer Selection

Yoon, David., Dernoncourt, Franck., Kim, Doo., Bui, Trung., Jung, Kyomin. (Nov. 7, 2019)

CIKM 2019