yj.yu@vision.snu.ac.kr
Curriculum Vitae

Research Interest

Computer Vision

Visual Saliency, Image Recognition

Natural Language Processing

Language Generation Model, Story Generation

Visual Storytelling

Story based Summarization, Automatic Videography

Video understanding

Video to Language, Video Question and Answering

Virtual/Mixed Reality

Learning User Experience on VR/AR System

Medical AI

Bioinformatics, Medical Vision

Publication

International Conference

A Memory Network Approach for Story-based Temporal Summarization of 360° Videos
Sangho Lee, Jinyoung Sung Youngjae Yu, Gunhee Kim
In CVPR 2018

A Deep Ranking Model for Spatio-Temporal Highlight Detection from a 360° Video
Youngjae Yu,Sangho Lee, Joonil Na, Jaeyun Kang, Gunhee Kim
In AAAI 2018

Supervising Neural Attention Models for Video Captioning by Human Gaze Data
Youngjae Yu,Jongwook Choi, Yeonhwa Kim, Kyoung Yu, Sang-Hun Lee, Gunhee Kim
In CVPR 2017, PDF

End-to-end Concept Word Detection for Video Captioning, Retrieval, and Question Answering
Youngjae Yu,Hyungjin Ko, Jongwook Choi, Gunhee Kim
In CVPR 2017 (Spotlight), PDF

TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answering
Yunseok Jang, Yale Song, Youngjae Yu, Youngjin Kim, Gunhee Kim
In CVPR 2017 (Spotlight), PDF

TimesVector: A Vectorized Clustering Approach to the Analysis of Time Series Transcriptome Data from Multiple Phenotypes
Inuk Jung, Kyuri Jo, Hyejin Kang, Hongryul Ahn, Youngjae Yu, Sun Kim
In GIW 2016


International Journal

TimesVector: A Vectorized Clustering Approach to the Analysis of Time Series Transcriptome Data from Multiple Phenotypes
Inuk Jung, Kyuri Jo, Hyejin Kang, Hongryul Ahn, Youngjae Yu, Sun Kim
In Bioinformatics 2017, PDF


Workshop

Encoding Video and Label Priors for Multi-label Video Classification on YouTube-8M dataset
Seil Na, Youngjae Yu, Sangho Lee, Jisung Kim, Gunhee Kim
In CVPR 2017, YouTube-8M Large-Scale Video Understanding, PDF

Video Captioning and Retrieval Models with Semantic Attention
Youngjae Yu,Hyungjin Ko, Jongwook Choi, Gunhee Kim
In ECCV 2016, LSMDC & VisStory, PDF


Domestic

Correlation Based Feature Selection and Pattern Clustering Method for Time Series Gene Expression Data of Drought Stressed Rice
Youngjae Yu, Sun Kim

Projects

Industrial/Academic project experience portfolio

360 Video Highlight

Deep ranking model for spatio-temporal summarization of panoramic video.

Visual Attentive Script

Human gaze prediction and video description generation

TGIF-QA Project

New Video QA framework based on TGIF web gif dataset

TimesVector

Analysis of Time Series Transcriptome Data from Multiple Phenotypes


CodeWar Project

Low-power optimized embedded system design

About Me

Timeline for my career path

  • 2015-current

    SNU Vision & Learning Lab

    Graduate Researcher. Studying video understanding and vision to language.

  • March 2014 - Aug 2014

    SNU Bio & Health Informatics Lab

    Undergraduate research intern (Medical Machine Learning and Drought-stressed rice RNA expression). Advisor : Sun Kim

  • June 2013 - Dec 2013

    SNU Embedded Low-Power Lab (Now, CAD4X Lab in KAIST)

    Undergraduate research intern (Low power optimization design) Advisor : Naehyuk Chang

  • June 2010 - Dec 2011

    Volunteer for Marine Corp

    2 year Compulsory Military Service. Served as a sergeant in R.O.K Marine Corp

  • Mar 2009-2015

    Seoul Nation University B.S. Degree

    Bachelor studies in Dept of Computer Science & Engineering, Seoul Nation University(SNU) @ Korea

  • My
    Story
    Begins!

Teaching

Teaching Assistant Experience and Public Lecture.

2017. Teaching Assistant, Big Data Academy : Introduction to RNN

2016. Teaching Assistant, 4190.773 : Probabilistic Graphical Model

2015. Teaching Assistant, 4190.307 : Operating System

2015. Teaching Assistant, M1522.001000 : Computer Vision