Seongsu Ha

I am a deep learning researcher interested in computer vision and machine learning. Specifically my research interest lies in improving the quality of multi-modal representations and their interactions for various downstream applications, such as video understanding, video corpus moment retrieval, video scene boundary segmentation and visual grounding. Previously, I received Master's degree in Data Science at Seoul National University Visual Information Processing Lab, advised by Prof. Joonseok Lee. I also received Bachelor's degree in Computer Science, Engineering at University of Illinois at Urbana-Champaign.

Email / LinkedIn

News

09/2023: Started working at Twelve Labs as research scientist
06/2023: Started working at Twelve Labs as research intern
05/2023: Paper on talking head generation was accepted to Sight and Sound, CVPR Workshop 2023
06/2022: Paper on scene boundary segmentation was accepted to ACCV 2022
01/2022: Started working at KakaoBrain as research intern
03/2021: Started MS in Data Science at Seoul National University Graduate School of Data Science

Research

Disentangled Audio-Driven NeRF: Talking Head Generation with Detailed Identity-Specific Micro expressions
Seoyoung Lee*, Seongsu Ha*, Joonseok Lee
CVPRW, 2023
paper

Boundary-aware Self-supervised Learning for Video Scene Segmentation
Jonghwan Mun, Minchul Shin, Gunsoo Han, Sangho Lee, Seongsu Ha, Joonseok Lee, Eun-Sol Kim
ACCV, 2022
paper

Experience

	ML Research Scientist, Twelve Labs. Sep.2023 ~ Present ML Research Intern, Twelve Labs. June.2023 ~ Sep.2023
	Graduate Researcher, Visual Information Processing Lab. Mar.2021 ~ Jun. 2023
	Research Intern, Kakaobrain Jan.2022 ~ Mar.2022
	Research Assistant, Perform Research Group Jun.2018 ~ Sep.2018

Source code credit to Dr. Jon Barron