International Conference

Multimodal Knowledge Alignment with Reinforcement Learning
Youngjae Yu*, Jiwan Chung*, Heeseung Yun, Jack Hessel, Jae Sung Park, Ximing Lu, Prithviraj Ammanabrolu, Rowan Zellers, Ronan Le Bras, Gunhee Kim, Yejin Choi (* equal contribution)
Arxiv, Link

PROSOCIALDIALOG:A Prosocial Backbone for Conversational Agents
Hyunwoo Kim*, Youngjae Yu*, Liwei Jiang, Ximing Lu, Daniel Khashabi, Gunhee Kim, Yejin Choi, Maarten Sap (* equal contribution)
Arxiv, Link

MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound
Rowan Zellers, Jiasen Lu, Ximing Lu, Youngjae Yu, Yanpeng Zhao, Mohammadreza Salehi, Aditya Kusupati, Jack Hessel, Ali Farhadi, Yejin Choi
In CVPR 2022, Link

Connecting the Dots between Audio and Text without Parallel Data through Visual Knowledge Transfer
Yanpeng Zhao, Jack Hessel, Youngjae Yu, Ximing Lu, Rowan Zellers, Yejin Choi
In NAACL 2022, Link

NeuroLogic A* esque Decoding: Constrained Text Generation with Lookahead Heuristics
Ximing Lu, Sean Welleck, Peter West, Liwei Jiang, Jungo Kasai, Daniel Khashabi, Ronan Le Bras, Lianhui Qin, Youngjae Yu, Rowan Zellers, Noah A Smith, Yejin Choi
In NAACL 2022, Link

MERLOT: Multimodal Neural Script Knowledge Models
Rowan Zellers*, Ximing Lu*, Jack Hessel*, Youngjae Yu, Jae Sung Park, Jize Cao, Ali Farhadi, Yejin Choi (* equal contribution)
In NeurIPS 2021, Link

Automatic Curation of Large-Scale Datasets for Audio-Visual Representation Learning
Sangho Lee*, Jiwan Chung*, Youngjae Yu, Gunhee Kim, Thomas Breuel, Gal Chechik, Yale Song (* equal contribution)
In ICCV 2021, Link

Pano-AVQA: Grounded Audio-Visual Question Answering on 360° Videos
Heeseung Yun, Youngjae Yu, Wonsuk Yang and Gunhee Kim
In ICCV 2021, Link

Transitional Adaptation of Pretrained Models for Visual Storytelling
Youngjae Yu*, Jiwan Chung*, Jongseok Kim, Heeseung Yun and Gunhee Kim (* equal contribution)
In CVPR 2021, Link

Self-Supervised Learning of Compressed Video Representations
Youngjae Yu, Sangho Lee, Gunhee Kim, Yale Song
In ICLR 2021, Link

Parameter Efficient Multimodal Transformers for Video Representation Learning
Sangho Lee, Youngjae Yu, Thomas Breuel, Jan Kautz, Gunhee Kim, Yale Song
In ICLR 2021, Link

Dual Compositional Learning in Interactive Image Retrieval
Jongseok Kim, Youngjae Yu, Hoeseong Kim, Gunhee Kim
In AAAI 2021, Link

Character Grounding and Re-Identification in Story of Videos and Text Descriptions
Youngjae Yu, Jongseok Kim, Heeseung Yun, Jiwan Chung, Gunhee Kim
In ECCV 2020 (Spotlight), Link

A Joint Sequence Fusion Model for Video Question Answering and Retrieval
Youngjae Yu, Jongseok Kim, Gunhee Kim
In ECCV 2018, Link

A Memory Network Approach for Story-based Temporal Summarization of 360° Videos
Sangho Lee, Jinyoung Sung Youngjae Yu, Gunhee Kim
In CVPR 2018, Link

A Deep Ranking Model for Spatio-Temporal Highlight Detection from a 360° Video
Youngjae Yu,Sangho Lee, Joonil Na, Jaeyun Kang, Gunhee Kim
In AAAI 2018, Link

Supervising Neural Attention Models for Video Captioning by Human Gaze Data
Youngjae Yu,Jongwook Choi, Yeonhwa Kim, Kyoung Yu, Sang-Hun Lee, Gunhee Kim
In CVPR 2017, Link

End-to-end Concept Word Detection for Video Captioning, Retrieval, and Question Answering
Youngjae Yu,Hyungjin Ko, Jongwook Choi, Gunhee Kim
In CVPR 2017 (Spotlight), Link

TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answering
Yunseok Jang, Yale Song, Youngjae Yu, Youngjin Kim, Gunhee Kim
In CVPR 2017 (Spotlight), Link

TimesVector: A Vectorized Clustering Approach to the Analysis of Time Series Transcriptome Data from Multiple Phenotypes
Inuk Jung, Kyuri Jo, Hyejin Kang, Hongryul Ahn, Youngjae Yu, Sun Kim
In GIW 2016

International Journal

Video Question Answering with Spatio-Temporal Reasoning
Yunseok Jang, Yale Song, Chris Dongju Kim, Youngjae Yu, Youngjin Kim, Gunhee Kim
In IJCV 2019, Link

TimesVector: A Vectorized Clustering Approach to the Analysis of Time Series Transcriptome Data from Multiple Phenotypes
Inuk Jung, Kyuri Jo, Hyejin Kang, Hongryul Ahn, Youngjae Yu, Sun Kim
In Bioinformatics 2017, Link

Workshop

Cycled Compositional Learning between Images and Text
Jongseok Kim *, Youngjae Yu * , Seunghwan Lee, Gunhee Kim
In CVPR 2020, Third Workshop on Computer Vision for Fashion, Art and Design , Link

Augmenting Data for Sarcasm Detection with Unlabeled Conversation Context
Hankyol Lee, Youngjae Yu, Gunhee Kim
In ACL 2020, Second Workshop on Figurative Language Processing, Link

CurlingNet: Compositional Learning between Images and Text for Fashion IQ Data
Youngjae Yu, Seunghwan Lee, Yuncheol Choi, Gunhee Kim
In ICCV 2019, Second Workshop on Computer Vision for Fashion, Art and Design , Link

Encoding Video and Label Priors for Multi-label Video Classification on YouTube-8M dataset
Seil Na, Youngjae Yu, Sangho Lee, Jisung Kim, Gunhee Kim
In CVPR 2017, YouTube-8M Large-Scale Video Understanding, Link

Video Captioning and Retrieval Models with Semantic Attention
Youngjae Yu,Hyungjin Ko, Jongwook Choi, Gunhee Kim
In ECCV 2016, LSMDC & VisStory, Link

Domestic

Correlation Based Feature Selection and Pattern Clustering Method for Time Series Gene Expression Data of Drought Stressed Rice
Youngjae Yu, Sun Kim