David Seunghyun Yoon is a research scientist at Adobe Research. He received his Ph.D. in Electrical and Computer Engineering from Seoul National University. His research interests are in the areas of machine learning and natural language processing (NLP). He is particularly interested in question-answering systems, dialog systems, learning language representation, and multimodal representation (i.e., text, audio, and visual).

Additional information can be found on the personal website

He is looking for interns and research collaborators with strong NLP backgrounds working on QA/Dialog system with external knowledge, and unsupervised language representation. Feel free to contact him at syoon@adobe.com anytime. 

Publications

Identifying Speakers in Dialogue Transcripts: A Text-based Approach Using Pretrained Language Models

Van Nguyen, M., Dernoncourt, F., Yoon, D., Deilamsalehy, H., Tan, H., Rossi, R., Tran, Q., Bui, T., Nguyen, T. (Sep. 5, 2024)

Interspeech 2024

KaPQA: Knowledge-Augmented Product Question-Answering

Eppalapally, S., Dangi, D., Bhat, C., Gupta, A., Zhang, R., Bagga, K., Yoon, D., Lipka, N., Rossi, R., Dernoncourt, F. (Aug. 16, 2024)

ACL 2024 Workshop on Knowledge Augmented Methods for NLP

Multilingual Meta-Distillation Alignment for Semantic Retrieval

M'hamdi, M., May, J., Dernoncourt, F., Bui, T., Yoon, D. (Jul. 18, 2024)

SIGIR 2024

Scaling Up Video Summarization Pretraining with Large Language Models

Argaw, D., Yoon, D., Heilbron, F., Deilamsalehy, H., Bui, T., Wang, Z., Dernoncourt, F., Chung, J. (Jun. 21, 2024)

CVPR 2024

PEEB: Part-based Image Classifiers with an Explainable and Editable Language Bottleneck

Pham, T., Chen, P., Nguyen, T., Yoon, D., Bui, T., Nguyen, A. (Jun. 16, 2024)

NAACL 2024 Findings

Fine-tuning CLIP Text Encoders with Two-step Paraphrasing

Kim, H., Yoon, D., Bui, T., Zhao, H., Tran, Q., Dernoncourt, F., Kang, J. (Mar. 22, 2024)

EACL 2024 Findings

Retrieval Augmented Generation for Domain-specific Question Answering

Sharma, S., Yoon, D., Dernoncourt, F., Sultania, D., Bagga, K., Zhang, M., Bui, T., Kotte, V. (Feb. 26, 2024)

AAAI 2024 Workshop on Scientific Document Understanding

Multi-Modal Video Topic Segmentation with Dual-Contrastive Domain Adaptation

Xing, L., Tran, Q., Heilbron, F., Dernoncourt, F., Yoon, D., Wang, Z., Bui, T., Carenini, G. (Feb. 2, 2024)

Multimedia Modelling 2024

Aspect-based Meeting Transcript Summarization: A Two-Stage Approach with Weak Supervision on Sentence Classification

Deng, Z., Yoon, D., Bui, T., Dernoncourt, F., Tran, Q., Liu, S., Zhao, W., Zhang, T., Wang, Y., Yu, P. (Dec. 18, 2023)

2023 IEEE International Conference on Big Data

Perturbation Robust Metric for Multi-Lingual Image Captioning

Kim, Y., Hwang, Y., Yun, H., Yoon, D., Bui, T., Jung, K. (Dec. 10, 2023)

EMNLP 2023 Findings

Moment Detection in Long Tutorial Videos

Croitoru, I., Bogolin, S., Albanie, S., Liu, Y., Wang, Z., Yoon, D., Dernoncourt, F., Jin, H., Bui, T. (Oct. 6, 2023)

ICCV 2023

Boosting Punctuation Restoration with Data Generation and Reinforcement Learning

Lai, V., Salinas, A., Tan, H., Bui, T., Tran, Q., Yoon, D., Deilamsalehy, H., Dernoncourt, F., Nguyen, T. (Aug. 24, 2023)

Interspeech 2023

MeetingQA: Extractive Question-Answering on Meeting Transcripts

Prasad, A., Bui, T., Yoon, D., Deilamsalehy, H., Dernoncourt, F., Bansal, M. (Jul. 10, 2023)

ACL 2023

PiC: A Phrase-in-Context Dataset for Phrase Understanding and Semantic Search

Pham, T., Yoon, D., Bui, T., Nguyen, A. (May. 3, 2023)

EACL 2023

Factual Error Correction for Abstractive Summaries Using Entity Retrieval

Lee, H., Park, C., Yoon, D., Bui, T., Dernoncourt, F., Kim, J., Jung, K. (Dec. 11, 2022)

EMNLP 2022 GEM Workshop

Simple Questions Generate Named Entity Recognition Datasets

Kim, H., Yoo, J., Yoon, D., Lee, J., Kang, J. (Dec. 11, 2022)

EMNLP 2022

Improving cross-modal attention via object detection

Kim, Y., Hwang, Y., Yoon, D., Yun, H., Jung, K. (Dec. 2, 2022)

NeurIPS 2022 Workshop on All Things Attention

MACRONYM: A Large-Scale Dataset for Multilingual and Multi-Domain Acronym Extraction

Veyseh, A., Meister, N., Yoon, D., Jain, R., Dernoncourt, F., Nguyen, T. (Oct. 17, 2022)

COLING 2022

Keyphrase Prediction from Video Transcripts: New Dataset and Directions

Veyseh, A., Tran, Q., Yoon, D., Manjunatha, V., Deilamsalehy, H., Jain, R., Bui, T., Chang, W., Dernoncourt, F., Nguyen, T. (Oct. 17, 2022)

COLING 2022

Virtual Knowledge Graph Construction for Zero-Shot Domain-Specific Document Retrieval

Seonwoo, Y., Yoon, D., Dernoncourt, F., Bui, T., Oh, A. (Oct. 17, 2022)

COLING 2022

Medical Question Understanding and Answering with Knowledge Grounding and Semantic Self-Supervision

Mrini, K., Singh, H., Dernoncourt, F., Yoon, D., Bui, T., Chang, W., Farcas, E., Nakashole, N. (Oct. 17, 2022)

COLING 2022

Offensive Content Detection Via Synthetic Code-Switched Text

Salaam, C., Dernoncourt, F., Bui, T., Rawat, D., Yoon, D. (Oct. 17, 2022)

COLING 2022

Multimodal Intent Discovery from Livestream Videos

Maharana, A., Tran, Q., Yoon, D., Dernoncourt, F., Bui, T., Chang, W., Bansal, M. (Jul. 11, 2022)

NAACL 2022 Findings

Fine-grained Image Captioning with CLIP Reward

Cho, J., Yoon, D., Kale, A., Dernoncourt, F., Bui, T., Bansal, M. (Jul. 11, 2022)

NAACL 2022 Findings

How does fake news use a thumbnail? CLIP-based Multimodal Detection on the Unrepresentative News Image

Choi, H., Yoon, Y., Yoon, D., Park, K. (May. 22, 2022)

ACL 2022 Workshop on CONSTRAINT

CAISE: Conversational Agent for Image Search and Editing

Kim, H., Kim, D., Yoon, D., Dernoncourt, F., Bui, T., Bansal, M. (Feb. 28, 2022)

AAAI 2022

Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning

Zhang, J., Bui, T., Yoon, D., Chen, X., Liu, Z., Xia, C., Tran, Q., Chang, W., Yu, P. (Nov. 9, 2021)

EMNLP 2021

QACE: Asking Questions to Evaluate an Image Caption

Lee, H., Scialom, T., Yoon, D., Dernoncourt, F., Jung, K. (Nov. 9, 2021)

EMNLP 2021 Findings

A Gradually Soft Multi-Task and Data-Augmented Approach to Medical Question Understanding

Mrini, K., Dernoncourt, F., Yoon, D., Bui, T., Chang, W., Farcas, E., Nakashole, N. (Aug. 4, 2021)

ACL 2021

UMIC: An Unreferenced Metric for Image Captioning via Contrastive Learning

Lee, H., Yoon, D., Dernoncourt, F., Bui, T., Jung, K. (Aug. 4, 2021)

ACL 2021

UCSD-Adobe at MEDIQA 2021: Transfer Learning and Answer Sentence Selection for Medical Summarization

Mrini, K., Dernoncourt, F., Yoon, D., Bui, T., Chang, W., Farcas, E., Nakashole, N. (Jun. 11, 2021)

NAACL BioNLP 2021

KPQA: A Metric for Generative Question Answering Using Keyphrase Weights

Lee, H., Yoon, D., Dernoncourt, F., Kim, D., Bui, T., Shin, J., Jung, K. (Jun. 11, 2021)

NAACL 2021

Learning to Detect Incongruence in News Headline and Body Text via a Graph Neural Network

Yoon, D., Park, K., Lee, M., Kim, T., Cha, M., Jung, K. (Feb. 24, 2021)

IEEE Access

Collaborative Training of GANs in Continuous and Discrete Spaces for Text Generation

Kim, Y., Won, S., Yoon, D., Jung, K. (Dec. 16, 2020)

IEEE Access

ViLBERTScore: Evaluating Image Caption Using Vision-and-Language BERT

Lee, H., Yoon, D., Dernoncourt, F., Kim, D., Bui, T., Jung, K. (Nov. 20, 2020)

EMNLP 2020 Eval4NLP

Propagate-Selector: Detecting Supporting Sentences for Question Answering via Graph Neural Networks

Yoon, D., Dernoncourt, F., Kim, D., Bui, T., Jung, K. (May. 12, 2020)

LREC 2020

Attentive Modality Hopping Mechanism for Speech Emotion Recognition

Yoon, D., Dey, S., Lee, H., Jung, K. (May. 4, 2020)

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

DSTC8-AVSD: Multimodal Semantic Transformer Network with Retrieval Style Word Generator

Lee, H., Yoon, D., Dernoncourt, F., Kim, D., Bui, T., Jung, K. (Feb. 8, 2020)

AAAI 2020 Dialog System Technology Challenge (DSTC8)

A Compare-Aggregate Model with Latent Clustering for Answer Selection

Yoon, D., Dernoncourt, F., Kim, D., Bui, T., Jung, K. (Nov. 7, 2019)

CIKM 2019