Hailin Jin

Senior Principal Scientist

San Jose

Hailin is a senior principal scientist at Adobe. He received his Master of Science and Doctor of Science degrees in electrical engineering from Washington University in Saint Louis in 2000 and 2003, respectively. Between fall 2003 and fall 2004, he was a postdoctoral researcher at the Computer Science Department, University of California at Los Angeles.

His current research interests include: deep learning, natural language processing, computer vision, video, image search, 3D reconstruction, structure and motion estimation, optical flow, stereo, and image-based modeling and rendering. His work can be found in several Adobe products including Photoshop, After Effects, Premiere Pro, Photoshop Lightroom, and Photoshop Elements.

For more information and a complete list of publications, please visit his personal page at https://sites.google.com/view/hailinjin or his Google Scholar profile at https://scholar.google.com/citations?user=DQOT0OMAAAAJ.

Publications

Moment Detection in Long Tutorial Videos

Croitoru, I., Bogolin, S., Albanie, S., Liu, Y., Wang, Z., Yoon, D., Dernoncourt, F., Jin, H., Bui, T. (Oct. 6, 2023)

ICCV 2023

LiveSeg: Unsupervised Multimodal Temporal Segmentation of Long Livestream Videos

Qiu, J., Dernoncourt, F., Bui, T., Wang, Z., Zhao, D., Jin, H. (Jan. 6, 2023)

WACV 2023

StyleBabel: Artistic Style Tagging and Captioning

Ruta, D., Gilbert, A., Aggarwal, P., Marri, N., Kale, A., Briggs, J., Speed, C., Jin, H., Faieta, B., Filipkowski, A., Collomosse, J. (Oct. 23, 2022)

European Conference on Computer Vision (ECCV)

StreamHover: Livestream Transcript Summarization and Annotation

Cho, S., Dernoncourt, F., Ganter, T., Bui, T., Lipka, N., Chang, W., Jin, H., Brandt, J., Foroosh, H., Liu, F. (Nov. 9, 2021)

Empirical Methods in Natural Language Processing (EMNLP)

ALADIN: All Layer Adaptive Instance Normalization for Fine-grained Style Similarity

Ruta, D., Motiian, S., Faeita, B., Lin, Z., Jin, H., Filipkowski, A., Gilbert, A., Collomosse, J. (Oct. 17, 2021)

International Conference on Computer Vision (ICCV)

Deep Image Comparator: Learning to Visualize Editorial Change

Black, A., Bui, T., Jin, H., Swaminathan, V., Collomosse, J. (Jun. 20, 2021)

CVPR Workshop on Media Forensics (CVPRW)

Magic Layouts: Structural Prior for Component Detection in User Interface Designs

Manandhar, D., Jin, H., Collomosse, J., Collomosse, J. (Jun. 6, 2021)

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Compositional Sketch Search

Black, A., Bui, T., Mai, L., Jin, H., Collomosse, J. (Jan. 1, 2021)

International Conference on Image Processing (ICIP)

Neural Architecture Search for Deep Image Prior

Ho, K., Gilbert, A., Jin, H., Collomosse, J. (Jan. 1, 2021)

Elsevier Computers & Graphics (CAG)

Geo-PIFu: Geometry and Pixel Aligned Implicit Functions for Single-view Human Reconstruction

He, T., Collomosse, J., Jin, H., Soatto, S. (Dec. 1, 2020)

Advances in Neural Information Processing Systems (NeurIPS)

DeepVoxels++: Enhancing the Fidelity of Novel View Synthesis from 3D Voxel Embeddings

He, T., Collomosse, J., Jin, H., Soatto, S. (Dec. 1, 2020)

Asian Conference on Computer Vision (ACCV)

An Internal Learning Approach to Video Inpainting

Zhang, H., Mai, L., Xu, N., Wang, Z., Collomosse, J., Jin, H. (Oct. 28, 2019)

International Conference on Computer Vision (ICCV) 2019

LiveSketch: Query Perturbation for Guided Sketch-based Visual Search

Collomosse, J., Bui, T., Jin, H. (Jun. 18, 2019)

Conference on Computer Vision and Pattern Recognition (CVPR) 2019

Interactive Boundary Prediction for Object Selection

Le, H., Mai, L., Price, B., Cohen, S., Jin, H., Liu, F. (Sep. 8, 2018)

European Conference on Computer Vision 2018

Disentangling Structure and Aesthetics for Content-aware Image Completion

Gilbert, A., Collomosse, J., Jin, H., Price, B. (Jun. 18, 2018)

Conference on Computer Vision and Pattern Recognition (CVPR) 2018

Sketching with Style: Visual Search with Sketches and Aesthetic Context

Collomosse, J., Bui, T., Wilber, M., Fang, C., Jin, H. (Oct. 22, 2017)

International Conference on Computer Vision (ICCV). 2017.

BAM! The Behance Artistic Media Dataset for Recognition Beyond Photography

Wilber, M., Fang, C., Jin, H., Hertzmann, A., Collomosse, J., Belongie, S. (Oct. 22, 2017)

International Conference on Computer Vision (ICCV). 2017.

Spatial-Semantic Image Search by Visual Feature Synthesis

Mai, L., Jin, H., Lin, Z., Fang, C., Brandt, J., Liu, F. (Jul. 28, 2017)

Spotlight Presentation

Computer Vision and Pattern Recognition (2017)

Composition-preserving Deep Photo Aesthetics Assessment

Mai, L., Jin, H., Liu, F. (Jun. 27, 2016)

Computer Vision and Pattern Recognition (2016)

Rating Image Aesthetics Using Deep Learning

Lu, X., Lin, Z., Jin, H., Yang, J., Wang, J. (Nov. 1, 2015)

IEEE Transactions on Multimedia 17(11): 2021-2034

DeepFont: A System for Font Recognition and Similarity

Wang, Z., Yang, J., Jin, H., Brandt, J., Shechtman, E., Agarwala, A., Wang, Z., Song, Y., Hseih, J., Kong, S., Huang, T. (Oct. 1, 2015)

ACM International Conference on Multimedia (MM'15)

DeepFont: Identify Your Font from an Image

Wang, Z., Yang, J., Jin, H., Shechtman, E., Agarwala, A., Brandt, J., Huang, T. (Oct. 1, 2015)

ACM International Conference on Multimedia (MM'15)

Real-World Font Recognition Using Deep Network and Domain Adaptation

Wang, Z., Yang, J., Jin, H., Shechtman, E., Agarwala, A., Brandt, J., Huang, T. (May. 7, 2015)

ICLR 2015

Selective Pooling Vector for Fine-Grained Recognition

Chen, G., Yang, J., Jin, H., Shechtman, E., Brandt, J., Han, T. (Jan. 1, 2015)

IEEE Winter Conference on Applications of Computer Vision (WACV'15)

Large-scale visual font recognition

Chen, G., Yang, J., Jin, H., Brandt, J., Shechtman, E., Agarwala, A., Han, T. (Jun. 1, 2014)

IEEE International Conference on Computer Vision and Pattern Recognition (CVPR)

GPU Asynchronous Stochastic Gradient Descent to Speed Up Neural Network Training

Jin, H., Lin, Z., Yang, J. (Apr. 1, 2014)

Proceedings of the 2nd International Conference on Learning Representations (ICLR 2014), April 2014

Automatic scene inference for 3D object compositing

Karsch, K., Sunkavalli, K., Hadap, S., Carr, N., Jin, H., Fonte, R., Sittig, M., Forsyth, D. (Apr. 1, 2014)

ACM Transactions on Graphics

Joint Subspace Stabilization for Stereoscopic Video

Liu, F., Niu, Y., Jin, H. (Dec. 1, 2013)

Proceedings of the IEEE International Conference on Computer Vision (ICCV 2013), December 2013

Large Displacement Optical Flow from Nearest Neighbor Fields

Chen, Z., Jin, H., Lin, Z., Cohen, S., Wu, Y. (Jun. 25, 2013)

Proceedings of IEEE conference on Computer Vision and Pattern Recognition (CVPR), June 2013.

Plane-Based Content-Preserving Warps for Video Stabilization

Zhou, Z., Jin, H., Ma, Y. (Jun. 25, 2013)

Proceedings of IEEE conference on Computer Vision and Pattern Recognition (CVPR), June 2013.

Specular Reflection Separation using Dark Channel Priors

Kim, H., Jin, H., Hadap, S., Kweon, I. (Jun. 25, 2013)

Proceedings of IEEE conference on Computer Vision and Pattern Recognition (CVPR), June 2013.

Causal Stereoscopic Photo Authoring

Liu, F., Niu, Y., Jin, H. (Jan. 30, 2013)

In IEEE Transactions on Multimedia, Vol. 15, No. 1, January 2013, pp. 129-140

Subspace video stabilization

Lui, F., Gleicher, M., Wang, J., Jin, H., Agarwala, A. (Aug. 6, 2011)

ACM Transactions on Graphics, 30(1)

Subspace video stabilization

Lui, F., Gleicher, M., Wang, J., Jin, H., Agarwala, A. (Feb. 1, 2010)

ACM Transactions on Graphics , 30(1)

Multiple View Image Denoising

Zhang, L., Vaddadi, S., Jin, H., Nayar, S. (Oct. 26, 2009)

In CVPR 2009: IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Content-Preserving Warps for Video Stabilization

Liu, F., Gleicher, M., Jin, H., Agarwala, A. (Aug. 1, 2009)

ACM Transactions on Graphics (Proc. SIGGRAPH), 28(3)

Content-Preserving Warps for 3D Video Stabilization

Liu, F., Gleicher, M., Jin, H., Agarwala, A. (Apr. 27, 2009)

ACM Transactions on Graphics (Proc.SIGGRAPH)

Stereo Matching with Nonparametric Smoothness Priors in Feature Space

Smith, B., Zhang, L., Jin, H. (Feb. 16, 2009)

In CVPR 2009: IEEE Computer Society Conference on Computer Vision and Pattern Recognition

GroupSAC: Efficient Consensus in the Presence of Groupings

Ni, K., Jin, H., Dellaert, F. (Feb. 14, 2009)

In Proceedings of the Twelfth International Conference on Computer Vision

Light-Field Video Stabilization

Smith, B., Zhang, L., Jin, H., Agarwala, A. (Feb. 14, 2009)

In Proceedings of the Twelfth International Conference on Computer Vision

a-three-point-minimal-solution-for-panoramic-stitching-with-lens-distortion

Jin, H. (Nov. 13, 2008)

In CVPR 2008: IEEE Computer Society conference on Computer Vision and Pattern Recognition

Stereoscopic Inpainting: Joint Color and Depth Completion from Stereo Images

Wang, L., Jin, H., Yang, R., Gong, M. (Sep. 22, 2008)

In CVPR 2008: IEEE Computer Socitey conference on Computer Vision and Pattern Recognition

3-D Reconstruction of Shaded Objects from Multiple Images under Known Illumination

Jin, H., Cremers, D., Wang, D., Prados, E., Yezzi, A., Soatto, S. (Jul. 27, 2008)

In International Journal of Computer Vision , 76(3), 245-256

Search Space Reduction for MRF Stereo

Wang, L., Jin, H., Yang, R. (Jan. 31, 2008)

In Proceedings of the 10th European Conference on Computer Vision

GIL Design Guide

Bourdev, L., Jin, H. (Sep. 14, 2007)

-

GIL Tutorial

Bourdev, L., Jin, H. (Sep. 14, 2007)

-

GIL Video Tutorial

Bourdev, L., Jin, H. (Sep. 14, 2007)

-

Mumford-Shah on the move: Region-based Segmentation on Deforming Manifolds with Application to 3-D Reconstruction of Shape and Appearance from Multi-view Images

Jin, H., Yezzi, A., Soatto, S. (Feb. 20, 2007)

Journal of Mathematical Imaging and Vision , 29(2-3), 219-234

Multi-view stereo reconstruction of dense shape and complex appearance

Jin, H., Soatto, S., Yezzi, A. (Dec. 29, 2005)

International Journal on Computer Vision , 63(3), 175–189

KALMANSAC: Robust filtering of concensus

Vedaldi, A., Jin, H., Favaro, P., Soatto, S. (Dec. 19, 2005)

In Proceedings of the International Conference on Computer Vision , 633–640

Visual tracking in the presence of motion blur

Jin, H., Favaro, P., Cipolla, R. (Apr. 20, 2005)

In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition , 18–25

Region-based segmentation on evolving surfaces with application to 3D reconstruction of shape and piecewise constant radiance

Jin, H., Yezzi, A., Soatto, S. (Feb. 1, 2004)

In Proceedings of the European Conference on Computer Vision , 114–125

Shedding light on stereoscopic segmentation

Jin, H., Cremers, D., Yezzi, A., Soatto, S. (Feb. 1, 2004)

In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition , 36–42

Estimation of 3D surface shape and smooth radiance from 2D images: A level set approach

Jin, H., Yezzi, A., Tsai, Y., Cheng, L., Soatto, S. (Oct. 22, 2003)

Journal of Scientific Computing , 19(1-3), 267–292

A semi-direct approach to structure from motion

Jin, H., Favaro, P., Soatto, S. (Feb. 1, 2003)

The Visual Computer , 19(6), 377–394

Multi-view stereo beyond Lambert

Jin, H., Soatto, S., Yezzi, A. (Feb. 1, 2003)

In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition , 171–178

Tales of shape and radiance in multi-view stereo

Soatto, S., Yezzi, A., Jin, H. (Feb. 1, 2003)

In Proceedings of the International Conference on Computer Vision , 171–178

Variational methods for shape reconstruction in Computer Vision

Jin, H. (Feb. 1, 2003)

PhD Thesis, Washington University in Saint Louis

A variational approach to shape from defocus

Jin, H., Favaro, P. (Feb. 1, 2002)

In Proceedings of the European Conference on Computer Vision , 18–30

Structure from motion causally integrated over time

Chiuso, A., Favaro, P., Jin, H., Soatto, S. (Feb. 1, 2002)

IEEE Transactions on Pattern Analysis and Machine Intelligence , 24(4), 523–535

Variational multiframe stereo in the presence of specular reflections

Jin, H., Yezzi, A., Soatto, S. (Feb. 1, 2002)

In Proceedings of the first International Symposium on 3D Data Processing Visualization and Transmission , 626–630

A semi-direct approach to structure from motion

Favaro, P., Jin, H., Soatto, S. (Feb. 1, 2001)

In Proceedings of the International Conference on Image Analysis and Processing , 250–255

Real-time feature tracking and outlier rejection with changes in illumination

Jin, H., Favaro, P., Soatto, S. (Feb. 1, 2001)

In Proceedings of the International Conference on Computer Vision , 684–689

Stereoscopic shading: Integrating multi-frame shape cues in a variational framework

Jin, H., Yezzi, A., Soatto, S. (Feb. 1, 2000)

In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition , 169–176

3-D motion and structure causally integrated over time: Implementation

Chiuso, A., Favaro, P., Jin, H., Soatto, S. (Feb. 1, 2000)

In Proceedings of the European Conference on Computer Vision , 778–779

News