Avatar

Jaemin Cho

UNC NLP Group

I’m a first-year PhD student at UNC NLP group, advised by Prof. Mohit Bansal. Prior to UNC, I did machine learning research at AI2, Naver, and SNU.

I do research on sequence modeling with machine learning. In particular, I’m interested in developing reliable generative models for language, music and dance.

News

Interests

  • Machine Learning
  • Sequence Modeling
  • Generative Model
  • Multimodal Learning

Education

  • B.S. in Industrial Engineering, 2018

    Seoul National University

Publications

VidLanKD: Improving Language Understanding via Video-Distilled Knowledge Transfer

Video-based grounding can improve diverse NLU tasks
Preprint Code

Unifying Vision-and-Language Tasks via Text Generation

Tackle different V&L tasks via text generation with a single unified architecture - ICML 2021
Preprint Code

X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers

Generate image from text by predicting masked patches with multi-modal transformers - EMNLP 2020
Preprint Code Project

Mixture Content Selection for Diverse Sequence Generation

Separate Diversification from Generation to improve both diversity and accuracy in sequence generation - EMNLP 2019
Preprint Code

A Hierarchical Latent Structure for Variational Conversation Modeling

Propose a hierarchical VAE model and utterance drop regularization to mitigate posterior collapse problem - NAACL 2018 (Oral)
Preprint Code Video

Experience

 
 
 
 
 

PhD Student

UNC NLP Group

Aug 2020 – Present Chapel Hill, NC

Publications

Working on

  • Vision and Language

Advisor

 
 
 
 
 

Predoctoral Young Investigator

Allen Institute for AI

Sep 2019 – Jul 2020 Seattle, WA

Publications

Worked on

  • Vision and Language

Advisor

 
 
 
 
 

Visiting Scholar

SNU Music & Audio Research Group

Jun 2019 – Jul 2019 Seoul, Korea

Worked on

  • Human Pose Estimation
  • Music / Dance Understanding

Advisor

 
 
 
 
 

AI Residency

NAVER Clova

Jul 2018 – Mar 2019 Seongnam, Korea

Publications

Worked on

  • Generative Model
  • Question Answering / Generation
  • Summarization

Advisor

 
 
 
 
 

Research Internship

SNU Vision & Learning Lab

Mar 2017 – May 2018 Seoul, Korea

Publications

Worked on

  • Conversation Modeling
  • Image Captioning
  • Generative Model
  • Uncertainty Estimation

Advisor

 
 
 
 
 

Research Internship

HKUST

Jan 2017 – Feb 2017 Hong Kong

Worked on

  • AST-based Python-Pseudocode Translation

Advisor

 
 
 
 
 

NLP Engineer

DataNada

Aug 2016 – Dec 2016 Seoul, Korea

Developed

  • ADA, Chatbot for 8Percent, the first Chatbot in the FinTech industry in Korea
  • Korean Dependency Parser

Advisor

 
 
 
 
 

Research Internship

Polytechnique Montréal

Jan 2015 – May 2015 Montreal, Canada

Worked on

  • Mixed Integer Programming
  • Patient Classification
  • Nursing Assignment

Advisor