David Seunghyun Yoon

Research Scientist

San Jose

David Seunghyun Yoon is a research scientist at Adobe Research. He received his Ph.D. in Electrical and Computer Engineering from Seoul National University. His research interests are in the areas of machine learning and natural language processing (NLP). He is particularly interested in question-answering systems, dialog systems, learning language representation, and multimodal representation (i.e., text, audio, and visual).

Additional information can be found on the personal website.

He is looking for interns and research collaborators with strong NLP backgrounds working on QA/Dialog system with external knowledge, and unsupervised language representation. Feel free to contact him at syoon@adobe.com anytime.

Publications

Domain-specific Question Answering with Hybrid Search

Sultania, D., Lu, Z., Naik, T., Dernoncourt, F., Yoon, D., Sharma, S., Bui, T., Gupta, A., Vatsa, T., Suresha, S., Verma, I., Belavadi, V., Chen, C., Friedrich, M. (Mar. 4, 2025)

AAAI 2025 Workshop on Document Understanding and Intelligence

PDFTriage: Question Answering over Long, Structured Documents

Saad-Falcon, J., Barrow, J., Siu, A., Nenkova, A., Yoon, D., Rossi, R., Dernoncourt, F. (Nov. 16, 2024)

EMNLP 2024 Industry Track

FIZZ: Factual Inconsistency Detection by Zoom-in Summary and Zoom-out Document

Yang, J., Yoon, D., Kim, B., Lee, H. (Nov. 16, 2024)

EMNLP 2024

Towards Enhancing Coherence in Extractive Summarization: Dataset and Experiments with LLMs

Parmar, M., Deilamsalehy, H., Dernoncourt, F., Yoon, D., Rossi, R., Bui, T. (Nov. 16, 2024)

EMNLP 2024

MVMR: A New Framework for Evaluating Faithfulness of Video Moment Retrieval against Multiple Distractors

Yang, N., Kim, M., Yoon, D., Shin, J., Jung, K. (Oct. 21, 2024)

CIKM 2024

Identifying Speakers in Dialogue Transcripts: A Text-based Approach Using Pretrained Language Models

Van Nguyen, M., Dernoncourt, F., Yoon, D., Deilamsalehy, H., Tan, H., Rossi, R., Tran, Q., Bui, T., Nguyen, T. (Sep. 5, 2024)

Interspeech 2024

Multi-hop Database Reasoning with Virtual Knowledge Graph

Son, J., Seonwoo, Y., Oh, A., Thorne, J., Yoon, D. (Aug. 16, 2024)

ACL 2024 Workshop on Knowledge Graphs and Large Language Models

KaPQA: Knowledge-Augmented Product Question-Answering

Eppalapally, S., Dangi, D., Bhat, C., Gupta, A., Zhang, R., Bagga, K., Yoon, D., Lipka, N., Rossi, R., Dernoncourt, F. (Aug. 16, 2024)

ACL 2024 Workshop on Knowledge Augmented Methods for NLP

Understanding News Thumbnail Representativeness by Counterfactual Text-Guided Contrastive Language-Image Pretraining

Yoon, Y., Yoon, D., Park, K. (Aug. 12, 2024)

ACL 2024 Findings

Multilingual Meta-Distillation Alignment for Semantic Retrieval

M'hamdi, M., May, J., Dernoncourt, F., Bui, T., Yoon, D. (Jul. 18, 2024)

SIGIR 2024

Scaling Up Video Summarization Pretraining with Large Language Models

Argaw, D., Yoon, D., Heilbron, F., Deilamsalehy, H., Bui, T., Wang, Z., Dernoncourt, F., Chung, J. (Jun. 21, 2024)

CVPR 2024

PEEB: Part-based Image Classifiers with an Explainable and Editable Language Bottleneck

Pham, T., Chen, P., Nguyen, T., Yoon, D., Bui, T., Nguyen, A. (Jun. 16, 2024)

NAACL 2024 Findings

Fine-tuning CLIP Text Encoders with Two-step Paraphrasing

Kim, H., Yoon, D., Bui, T., Zhao, H., Tran, Q., Dernoncourt, F., Kang, J. (Mar. 22, 2024)

EACL 2024 Findings

Retrieval Augmented Generation for Domain-specific Question Answering

Sharma, S., Yoon, D., Dernoncourt, F., Sultania, D., Bagga, K., Zhang, M., Bui, T., Kotte, V. (Feb. 26, 2024)

AAAI 2024 Workshop on Scientific Document Understanding

Multi-Modal Video Topic Segmentation with Dual-Contrastive Domain Adaptation

Xing, L., Tran, Q., Heilbron, F., Dernoncourt, F., Yoon, D., Wang, Z., Bui, T., Carenini, G. (Feb. 2, 2024)

Multimedia Modelling 2024

Aspect-based Meeting Transcript Summarization: A Two-Stage Approach with Weak Supervision on Sentence Classification

Deng, Z., Yoon, D., Bui, T., Dernoncourt, F., Tran, Q., Liu, S., Zhao, W., Zhang, T., Wang, Y., Yu, P. (Dec. 18, 2023)

2023 IEEE International Conference on Big Data

Perturbation Robust Metric for Multi-Lingual Image Captioning

Kim, Y., Hwang, Y., Yun, H., Yoon, D., Bui, T., Jung, K. (Dec. 10, 2023)

EMNLP 2023 Findings

Moment Detection in Long Tutorial Videos

Croitoru, I., Bogolin, S., Albanie, S., Liu, Y., Wang, Z., Yoon, D., Dernoncourt, F., Jin, H., Bui, T. (Oct. 6, 2023)

ICCV 2023

Boosting Punctuation Restoration with Data Generation and Reinforcement Learning

Lai, V., Salinas, A., Tan, H., Bui, T., Tran, Q., Yoon, D., Deilamsalehy, H., Dernoncourt, F., Nguyen, T. (Aug. 24, 2023)

Interspeech 2023

Automatic Creation of Named Entity Recognition Datasets by Querying Phrase Representations

Kim, H., Yoo, J., Yoon, D., Kang, J. (Jul. 10, 2023)

ACL 2023

MeetingQA: Extractive Question-Answering on Meeting Transcripts

Prasad, A., Bui, T., Yoon, D., Deilamsalehy, H., Dernoncourt, F., Bansal, M. (Jul. 10, 2023)

ACL 2023

PiC: A Phrase-in-Context Dataset for Phrase Understanding and Semantic Search

Pham, T., Yoon, D., Bui, T., Nguyen, A. (May. 3, 2023)

EACL 2023

Simple Questions Generate Named Entity Recognition Datasets

Kim, H., Yoo, J., Yoon, D., Lee, J., Kang, J. (Dec. 11, 2022)

EMNLP 2022

Factual Error Correction for Abstractive Summaries Using Entity Retrieval

Lee, H., Park, C., Yoon, D., Bui, T., Dernoncourt, F., Kim, J., Jung, K. (Dec. 11, 2022)

EMNLP 2022 GEM Workshop

Improving cross-modal attention via object detection

Kim, Y., Hwang, Y., Yoon, D., Yun, H., Jung, K. (Dec. 2, 2022)

NeurIPS 2022 Workshop on All Things Attention

Keyphrase Prediction from Video Transcripts: New Dataset and Directions

Veyseh, A., Tran, Q., Yoon, D., Manjunatha, V., Deilamsalehy, H., Jain, R., Bui, T., Chang, W., Dernoncourt, F., Nguyen, T. (Oct. 17, 2022)

COLING 2022

MACRONYM: A Large-Scale Dataset for Multilingual and Multi-Domain Acronym Extraction

Veyseh, A., Meister, N., Yoon, D., Jain, R., Dernoncourt, F., Nguyen, T. (Oct. 17, 2022)

COLING 2022

Virtual Knowledge Graph Construction for Zero-Shot Domain-Specific Document Retrieval

Seonwoo, Y., Yoon, D., Dernoncourt, F., Bui, T., Oh, A. (Oct. 17, 2022)

COLING 2022

Medical Question Understanding and Answering with Knowledge Grounding and Semantic Self-Supervision

Mrini, K., Singh, H., Dernoncourt, F., Yoon, D., Bui, T., Chang, W., Farcas, E., Nakashole, N. (Oct. 17, 2022)

COLING 2022

Offensive Content Detection Via Synthetic Code-Switched Text

Salaam, C., Dernoncourt, F., Bui, T., Rawat, D., Yoon, D. (Oct. 17, 2022)

COLING 2022

Multimodal Intent Discovery from Livestream Videos

Maharana, A., Tran, Q., Yoon, D., Dernoncourt, F., Bui, T., Chang, W., Bansal, M. (Jul. 11, 2022)

NAACL 2022 Findings

Fine-grained Image Captioning with CLIP Reward

Cho, J., Yoon, D., Kale, A., Dernoncourt, F., Bui, T., Bansal, M. (Jul. 11, 2022)

NAACL 2022 Findings

How does fake news use a thumbnail? CLIP-based Multimodal Detection on the Unrepresentative News Image

Choi, H., Yoon, Y., Yoon, D., Park, K. (May. 22, 2022)

ACL 2022 Workshop on CONSTRAINT

CAISE: Conversational Agent for Image Search and Editing

Kim, H., Kim, D., Yoon, D., Dernoncourt, F., Bui, T., Bansal, M. (Feb. 28, 2022)

AAAI 2022

QACE: Asking Questions to Evaluate an Image Caption

Lee, H., Scialom, T., Yoon, D., Dernoncourt, F., Jung, K. (Nov. 9, 2021)

EMNLP 2021 Findings

Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning

Zhang, J., Bui, T., Yoon, D., Chen, X., Liu, Z., Xia, C., Tran, Q., Chang, W., Yu, P. (Nov. 9, 2021)

EMNLP 2021

A Gradually Soft Multi-Task and Data-Augmented Approach to Medical Question Understanding

Mrini, K., Dernoncourt, F., Yoon, D., Bui, T., Chang, W., Farcas, E., Nakashole, N. (Aug. 4, 2021)

ACL 2021

UMIC: An Unreferenced Metric for Image Captioning via Contrastive Learning

Lee, H., Yoon, D., Dernoncourt, F., Bui, T., Jung, K. (Aug. 4, 2021)

ACL 2021

UCSD-Adobe at MEDIQA 2021: Transfer Learning and Answer Sentence Selection for Medical Summarization

Mrini, K., Dernoncourt, F., Yoon, D., Bui, T., Chang, W., Farcas, E., Nakashole, N. (Jun. 11, 2021)

NAACL BioNLP 2021

KPQA: A Metric for Generative Question Answering Using Keyphrase Weights

Lee, H., Yoon, D., Dernoncourt, F., Kim, D., Bui, T., Shin, J., Jung, K. (Jun. 11, 2021)

NAACL 2021

Learning to Detect Incongruence in News Headline and Body Text via a Graph Neural Network

Yoon, D., Park, K., Lee, M., Kim, T., Cha, M., Jung, K. (Feb. 24, 2021)

IEEE Access

Collaborative Training of GANs in Continuous and Discrete Spaces for Text Generation

Kim, Y., Won, S., Yoon, D., Jung, K. (Dec. 16, 2020)

IEEE Access

ViLBERTScore: Evaluating Image Caption Using Vision-and-Language BERT

Lee, H., Yoon, D., Dernoncourt, F., Kim, D., Bui, T., Jung, K. (Nov. 20, 2020)

EMNLP 2020 Eval4NLP

Propagate-Selector: Detecting Supporting Sentences for Question Answering via Graph Neural Networks

Yoon, D., Dernoncourt, F., Kim, D., Bui, T., Jung, K. (May. 12, 2020)

LREC 2020

Attentive Modality Hopping Mechanism for Speech Emotion Recognition

Yoon, D., Dey, S., Lee, H., Jung, K. (May. 4, 2020)

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

DSTC8-AVSD: Multimodal Semantic Transformer Network with Retrieval Style Word Generator