Jae Shin Yoon

   

   I am a Ph.D. candidate in Computer Science and Engineering at the University of Minnesota (UMN), Twin Cities, advised by Prof. Hyun Soo Park.  I received MS degree in Department of Robotics from Korea Advanced Institute of Science and Technology (KAIST) under the supervision of Prof. In So Kweon. I received my bachelor degree in Electrical Engineering from Hanyang University under the supervision of Prof. Yong Ho Song. I was an exchange student at Kobe University. My general research interest lies in computer&robot vision and machine learning.


Email: jsyoon [at] umn.edu, jsyoon4325 [at] gmail.com
CV [03/13/2020] | Google Scholar | Human Behavioral Imaging Dataset


Research Highlight


Dynamic Scenes Novel View Synthesis (CVPR 2020) HUMBI: A Large Multiview Human Behavioral Imaging Dataset (CVPR 2020) [Project page] Monocular 3D Face Performance Tracking (CVPR 2019)   [Project page]

3D Semantic Trajectory Reconstruction in the Pixel Continuum (CVPR 2018)   [Project page]
Pixel-level Matching for Video Object Segmentation (ICCV 2017)   [Project page]
Vanishing Point Guided Visual Perception for Autonomous Driving (ICCV 2017)  [Project page]

KAIST Multi-spectral Recognition Dataset in Day and Night (T-ITS 2018)  [Project page]
Thermal-Infrared based Drivable Region Detection
(IV 2016)  [Project page]
Robust Road Marking Detection to Illumination Changes (WACV 2017)

Publications

2020
Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Camera
Jae Shin Yoon, Kihwan Kim, Orazio Gallo, Hyun Soo Park, and Jan Kautz
IEEE Computer Vision and Pattern Recognition (CVPR) 2020
[PDF] [PDF_supple] [Video] [Video_supple] [Project Page] [BibTeX]
HUMBI: HUMBI: A Large Multiview Dataset of Human Body Expressions
Zhixuan Yu*, Jae Shin Yoon*, In Kyu Lee, Prashanth Venkatesh, Jaesik Park, Jihun Yu, and Hyun Soo Park
*indicates joint first author
IEEE Computer Vision and Pattern Recognition (CVPR) 2020
[PDF] [Video] [Project Page] [BibTeX]
2019
Self-Supervised Adaptation of High-Fidelity Face Models for Monocular Performance Tracking
Jae Shin Yoon, Takaaki Shiratori, Shoou-I Yu, and Hyun Soo Park
IEEE Computer Vision and Pattern Recognition (CVPR) 2019 [Oral presentation]
[PDF] [Supple] [Video] [Project Page] [Poster] [BibTeX]
2018
3D Semantic Trajectory Reconstruction from 3D Pixel Continuum
Jae Shin Yoon, Ziwei Li, Hyun Soo Park
IEEE Computer Vision and Pattern Recognition (CVPR) 2018
[PDF] [Video] [Project Page] [BibTeX]
KAIST Multi-spectral Day/Night Dataset for Autonomous and Assisted Driving
Yukyung Choi, Namil Kim, Soonmin Hwang, Kibaek Park, Jae Shin Yoon, Kyounghwan An, and In So Kweon
Transactions on Intelligent Transportation Systems (T-ITS)
[PDF] [Project Page] [BibTeX]
2017
Pixel-level Matching for Video Object Segmentation using Convolutional Neural Networks
Jae Shin Yoon, Francois Rameau, Junsik Kim, Seokju Lee, Seunghak Shin, and In So Kweon
IEEE International Conference on Computer Vision (ICCV) 2017
[PDF] [Project Page] [Slide] [Poster] [BibTeX]
VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognition
Seokju Lee, Junsik Km, Jae Shin Yoon, Seunghak Shin, Oleksandr Bailo, Namil Kim, Tae-hee Lee, Hyun Seok Hong, Seung-Hoon Han, In So Kweon
IEEE International Conference on Computer Vision (ICCV) 2017
[PDF] [Project Page] [BibTeX]
Robust Road Marking Detection and Recognition Using Density-Based Grouping and Machine Learning Techniques
Oleksandr Bailo, Seokju Lee, Francois Rameau, Jae Shin Yoon, In So Kweon
IEEE Winter Conference on Application and Computer Vision (WACV) 2017
[PDF] [BibTeX]
2016
Thermal-Infrared based Drivable Region Detection
Jae Shin Yoon, Kibaek Park, Soonmin Hwang, Namil Kim, Yukyung Choi, Francois Rameau and In So Kweon
IEEE Intelligent Vehicle Symposium (IV) 2016
[PDF] [Project Page] [Dataset] [BibTeX]
2015
All-Day Visual Place Recognition: Benchmark Dataset and Baseline
Yukyung Choi, Namil Kim, Kibak Park, Soonmin Hwang, Jae Shin Yoon,In So Kweon
IEEE Computer Vision and Pattern Recognition Workshop 2015 on Visual Place Recognition in Changing Environments (CVPR-VPRICE) 2015
[PDF] [Project Page] [BibTeX]
Low-Cost Synchronization for Multispectral Cameras
Yukyung Choi, Namil Kim, Kibak Park, Soonmin Hwang, Jae Shin Yoon, In So Kweon
IEEE International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) 2015
[PDF] [BibTeX]
Geometrical calibration of multispectral calibration
Namil Kim, Yukyung Choi, Soonmin Hwang, Kibaek Park, Jae Shin Yoon, In So Kweon
IEEE International Conference on Ubiquitous Robots and Ambient Intelligence
[PDF] [BibTeX]

Dataset

  • Human Multiview Behavioral Imaging Dataset
    1.   - Multiview images captured from 107 synchronized cameras
        - 3D gaze, face, hand, body, clothing of 772 subjects
  • Dynamic Scene Multiview Dataset for Depth Estimation and View Synthesis
    1.   - 13 Dynamic scenes captured from synchronized 12 multi-views and cell-phone camera
        - Ground-truth for dynamic scene view synthesis and depth estimation
  • Multi-Tasking Recognition for Autonomous Driving Scene
    1.   - Ground-truth for classification, detection and segmentation of lanes, road markings, traffic signs, and vanishing point
        - A variety of driving scene images captured from day and night in sunny, cloudy, and rainy days
  • Multi-Sensor Imaging Dataset for Autonomous Driving Day and Night
    1.   - Driving scene dataset of the calibrated stereo-vision, thermal camera, velodyne, gps, imu
        - Large-scale day and night multi-sensor dataset
  • Thermal-RGB Road Segmentation Dataset
    1.   - Synchronized and aligned thermal-rgb imaging dataset for road segmentation
        - 5941 thermal-rgb image pairs with road mask annotation

    Research Internship

  • NVIDIA Research, Santa Clara, USA | 2019 (Feb. - Aug.)
  • Facebook Reality Labs, Oculus, Pittsburgh, USA | 2018 (June. - Aug.)
  • Korea Institute of Science and Technology (KIST), Korea | 2017 (Mar. - Aug.)
  • Academic Activities

  • Reviewer
    1.   - IEEE Conference on Computer Vision Pattern Recognition (CVPR) | 2018, 2019, 2020
        - IEEE European Conference on Computer Vision (ECCV) | 2020
        - IEEE International Conference on Computer Vision (ICCV) | 2019
        - AAAI Conference on Artificial Intelligence (AAAI) | 2020
        - IEEE Winter Conference on Applications of Computer Vision (WACV) | 2020, 2021
        - IEEE Asian Conference on Computer Vision (ACCV) | 2018, 2020
        - IEEE Intelligent Vehicle Symposium (IV) | 2016
        - Autonomous Robots | 2020
        - IEEE Geoscience and Remote Sensing Letters | 2020
        - IEEE Transactions on Multimedia | 2018

    Invited Talk

  • Novel View Synthesis from Dynamic Scenes
    1.   - CVPR Tutorial on Novel View Synthesis: From Depth-Based Warping to Multi-Plane Images and Beyond [Link, Slide] | 2020
        - CVPR Workshop on 3D Scene Understanding for Vision, Graphics, and Robotics (Oral Presentation) [Link] | 2020
  • Self-Supervised Adaptation of High-Fidelity Face Models for Monocular Performance Tracking
    1.   - CVPR oral presentation [Video] | 2019
        - Think Tank Team at Samsung Research America in Mountain View, hosted by Dr. Abhijit Bendale | 2019
        - UofM 50th Anniversary Research Showcase (Poster) | 2019
  • 3D Human Behavioral Imaging
    1.   - University of Minnesota (UMN) Graduate Research and Discussion Seminars (GRaDS) | 2019
        - Seoul National Univeristy (SNU) Vision Seminar, hosted by Prof. Bohyung Han | 2019
        - Pohang University of Science and Technology (POSTECH) Computer Vision group, hosted by Prof. Minsu Cho | 2019
        - Korea Institute of Science and Technology (KIST), hosted by Dr. Hwasup Lim | 2019
  • 3D Semantic Trajectory Reconstruction from 3D Pixel Continuum
    1.   - Amazon Graduate Research Symposium (poster) | 2019
        - University of Minnesota (UMN) VCAI Seminar | 2018
  • Semantics on the Road for All-day Autonomous Driving
    1.   - Hyundai Top Talent Forum | 2018

    Honors & Awards

  • Top Graduate Research Award, UofM Graduate Research and Discussion Seminar (GRaDS) [Article] | 2019
  • Summa Cum Laude, Hanyang University (GPA: 4.08/4.5) (94.6 %), Dept. of EE, Hanyang University | 2015
  • Hanyang Brain scholarship, Dept. of EE, Hanyang University ($1,440) | 2014
  • Prize for the top first percentile GPA, Hanyang University ($3,740)
  • Miraeasset Park Hyeon-Joo foundation scholarship for exchange student ($8,565) [Certificate] | 2012
  • Qualcomm Scholarship for outstanding engineer, Qualcomm corp ($3,740) [Certificate] | 2011
  • Patent

  • Vanishing-Guided Lane and Road Marking Detection via Multi-Task Network
    1.     Application date: Oct. 31, 2016 (US Provisional Application 52/414,951)



    Web
Analytics