Hailin Jin

Senior Principal Scientist

Creative Intelligence Lab, San Jose

Hailin is a senior principal scientist at Adobe. He received his Master of Science and Doctor of Science degrees in electrical engineering from Washington University in Saint Louis in 2000 and 2003, respectively. Between fall 2003 and fall 2004, he was a postdoctoral researcher at the Computer Science Department, University of California at Los Angeles.

His current research interests include: deep learning, natural language processing, computer vision, video, image search, 3D reconstruction, structure and motion estimation, optical flow, stereo, and image-based modeling and rendering. His work can be found in several Adobe products including Photoshop, After Effects, Premiere Pro, Photoshop Lightroom, and Photoshop Elements.

For more information and a complete list of publications, please visit his personal page at https://sites.google.com/view/hailinjin or his Google Scholar profile at https://scholar.google.com/citations?user=DQOT0OMAAAAJ.

My Projects

Panoramic Image Stitching

Subspace Video Stabilization

Content-Preserving Warps for Video Stabilization

Generic Image Library

My Publications

Interactive Boundary Prediction for Object Selection

Le, H., Mai, L., Price, B., Cohen, S., Jin, H., Liu, F. (Sep. 8, 2018)
European Conference on Computer Vision 2018

Disentangling Structure and Aesthetics for Content-aware Image Completion

Gilbert, A., Collomosse, J., Jin, H., Price, B. (Jun. 18, 2018)
Conference on Computer Vision and Pattern Recognition (CVPR) 2018

Spatial-Semantic Image Search by Visual Feature Synthesis

Mai, L., Jin, H., Lin, Z., Fang, C., Brandt, J., Liu, F. (Jul. 28, 2017)
Spotlight Presentation Computer Vision and Pattern Recognition (2017)

Composition-preserving Deep Photo Aesthetics Assessment

Mai, L., Jin, H., Liu, F. (Jun. 27, 2016)
Computer Vision and Pattern Recognition (2016)

Rating Image Aesthetics Using Deep Learning

Lu, X., Lin, Z., Jin, H., Yang, J., Wang, J. (Nov. 1, 2015)
IEEE Transactions on Multimedia 17(11): 2021-2034

DeepFont: Identify Your Font from an Image

Wang, Z., Yang, J., Jin, H., Shechtman, E., Agarwala, A., Brandt, J., Huang, T. (Jul. 1, 2015)
To appear in ACM International Conference on Multimedia (ACM MM'15)

Selective Pooling Vector for Fine-Grained Recognition

Chen, G., Yang, J., Jin, H., Shechtman, E., Brandt, J., Han, T. (Jan. 1, 2015)
IEEE Winter Conference on Applications of Computer Vision (WACV'15)

Large-scale visual font recognition

Chen, G., Yang, J., Jin, H., Brandt, J., Shechtman, E., Agarwala, A., Han, T. (Jun. 1, 2014)
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR)

GPU Asynchronous Stochastic Gradient Descent to Speed Up Neural Network Training

Jin, H., Lin, Z., Yang, J. (Apr. 1, 2014)
Proceedings of the 2nd International Conference on Learning Representations (ICLR 2014), April 2014

Automatic scene inference for 3D object compositing

Karsch, K., Sunkavalli, K., Hadap, S., Carr, N., Jin, H., Fonte, R., Sittig, M., Forsyth, D. (Apr. 1, 2014)
ACM Transactions on Graphics

Joint Subspace Stabilization for Stereoscopic Video

Liu, F., Niu, Y., Jin, H. (Dec. 1, 2013)
Proceedings of the IEEE International Conference on Computer Vision (ICCV 2013), December 2013

Large Displacement Optical Flow from Nearest Neighbor Fields

Chen, Z., Jin, H., Lin, Z., Cohen, S., Wu, Y. (Jun. 25, 2013)
Proceedings of IEEE conference on Computer Vision and Pattern Recognition (CVPR), June 2013.

Plane-Based Content-Preserving Warps for Video Stabilization

Zhou, Z., Jin, H., Ma, Y. (Jun. 25, 2013)
Proceedings of IEEE conference on Computer Vision and Pattern Recognition (CVPR), June 2013.

Specular Reflection Separation using Dark Channel Priors

Kim, H., Jin, H., Hadap, S., Kweon, I. (Jun. 25, 2013)
Proceedings of IEEE conference on Computer Vision and Pattern Recognition (CVPR), June 2013.

Causal Stereoscopic Photo Authoring

Liu, F., Niu, Y., Jin, H. (Jan. 30, 2013)
In IEEE Transactions on Multimedia, Vol. 15, No. 1, January 2013, pp. 129-140

Subspace video stabilization

Lui, F., Gleicher, M., Wang, J., Jin, H., Agarwala, A. (Aug. 6, 2011)
ACM Transactions on Graphics, 30(1)

Subspace video stabilization

Lui, F., Gleicher, M., Wang, J., Jin, H., Agarwala, A. (Feb. 1, 2010)
ACM Transactions on Graphics , 30(1)

Multiple View Image Denoising

Zhang, L., Vaddadi, S., Jin, H., Nayar, S. (Oct. 26, 2009)
In CVPR 2009: IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Content-Preserving Warps for Video Stabilization

Liu, F., Gleicher, M., Jin, H., Agarwala, A. (Aug. 1, 2009)
ACM Transactions on Graphics (Proc. SIGGRAPH), 28(3)

Content-Preserving Warps for 3D Video Stabilization

Liu, F., Gleicher, M., Jin, H., Agarwala, A. (Apr. 27, 2009)
ACM Transactions on Graphics (Proc.SIGGRAPH)

Stereo Matching with Nonparametric Smoothness Priors in Feature Space

Smith, B., Zhang, L., Jin, H. (Feb. 16, 2009)
In CVPR 2009: IEEE Computer Society Conference on Computer Vision and Pattern Recognition

GroupSAC: Efficient Consensus in the Presence of Groupings

Ni, K., Jin, H., Dellaert, F. (Feb. 14, 2009)
In Proceedings of the Twelfth International Conference on Computer Vision

Light-Field Video Stabilization

Smith, B., Zhang, L., Jin, H., Agarwala, A. (Feb. 14, 2009)
In Proceedings of the Twelfth International Conference on Computer Vision

a-three-point-minimal-solution-for-panoramic-stitching-with-lens-distortion

Jin, H. (Nov. 13, 2008)
In CVPR 2008: IEEE Computer Society conference on Computer Vision and Pattern Recognition

Stereoscopic Inpainting: Joint Color and Depth Completion from Stereo Images

Wang, L., Jin, H., Yang, R., Gong, M. (Sep. 22, 2008)
In CVPR 2008: IEEE Computer Socitey conference on Computer Vision and Pattern Recognition

3-D Reconstruction of Shaded Objects from Multiple Images under Known Illumination

Jin, H., Cremers, D., Wang, D., Prados, E., Yezzi, A., Soatto, S. (Jul. 27, 2008)
In International Journal of Computer Vision , 76(3), 245-256

Search Space Reduction for MRF Stereo

Wang, L., Jin, H., Yang, R. (Jan. 31, 2008)
In Proceedings of the 10th European Conference on Computer Vision

GIL Design Guide

Bourdev, L., Jin, H. (Sep. 14, 2007)

GIL Tutorial

Bourdev, L., Jin, H. (Sep. 14, 2007)

GIL Video Tutorial

Bourdev, L., Jin, H. (Sep. 14, 2007)

Mumford-Shah on the move: Region-based Segmentation on Deforming Manifolds with Application to 3-D Reconstruction of Shape and Appearance from Multi-view Images

Jin, H., Yezzi, A., Soatto, S. (Feb. 20, 2007)
Journal of Mathematical Imaging and Vision , 29(2-3), 219-234

Multi-view stereo reconstruction of dense shape and complex appearance

Jin, H., Soatto, S., Yezzi, A. (Dec. 29, 2005)
International Journal on Computer Vision , 63(3), 175–189

KALMANSAC: Robust filtering of concensus

Vedaldi, A., Jin, H., Favaro, P., Soatto, S. (Dec. 19, 2005)
In Proceedings of the International Conference on Computer Vision , 633–640

Visual tracking in the presence of motion blur

Jin, H., Favaro, P., Cipolla, R. (Apr. 20, 2005)
In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition , 18–25

Region-based segmentation on evolving surfaces with application to 3D reconstruction of shape and piecewise constant radiance

Jin, H., Yezzi, A., Soatto, S. (Feb. 1, 2004)
In Proceedings of the European Conference on Computer Vision , 114–125

Shedding light on stereoscopic segmentation

Jin, H., Cremers, D., Yezzi, A., Soatto, S. (Feb. 1, 2004)
In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition , 36–42

Estimation of 3D surface shape and smooth radiance from 2D images: A level set approach

Jin, H., Yezzi, A., Tsai, Y., Cheng, L., Soatto, S. (Oct. 22, 2003)
Journal of Scientific Computing , 19(1-3), 267–292

A semi-direct approach to structure from motion

Jin, H., Favaro, P., Soatto, S. (Feb. 1, 2003)
The Visual Computer , 19(6), 377–394

Multi-view stereo beyond Lambert

Jin, H., Soatto, S., Yezzi, A. (Feb. 1, 2003)
In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition , 171–178

Tales of shape and radiance in multi-view stereo

Soatto, S., Yezzi, A., Jin, H. (Feb. 1, 2003)
In Proceedings of the International Conference on Computer Vision , 171–178

Variational methods for shape reconstruction in Computer Vision

Jin, H. (Feb. 1, 2003)
PhD Thesis, Washington University in Saint Louis

A variational approach to shape from defocus

Jin, H., Favaro, P. (Feb. 1, 2002)
In Proceedings of the European Conference on Computer Vision , 18–30

Structure from motion causally integrated over time

Chiuso, A., Favaro, P., Jin, H., Soatto, S. (Feb. 1, 2002)
IEEE Transactions on Pattern Analysis and Machine Intelligence , 24(4), 523–535

Variational multiframe stereo in the presence of specular reflections

Jin, H., Yezzi, A., Soatto, S. (Feb. 1, 2002)
In Proceedings of the first International Symposium on 3D Data Processing Visualization and Transmission , 626–630

A semi-direct approach to structure from motion

Favaro, P., Jin, H., Soatto, S. (Feb. 1, 2001)
In Proceedings of the International Conference on Image Analysis and Processing , 250–255

Real-time feature tracking and outlier rejection with changes in illumination

Jin, H., Favaro, P., Soatto, S. (Feb. 1, 2001)
In Proceedings of the International Conference on Computer Vision , 684–689

3-D motion and structure causally integrated over time: Implementation

Chiuso, A., Favaro, P., Jin, H., Soatto, S. (Feb. 1, 2000)
In Proceedings of the European Conference on Computer Vision , 778–779

Stereoscopic shading: Integrating multi-frame shape cues in a variational framework

Jin, H., Yezzi, A., Soatto, S. (Feb. 1, 2000)
In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition , 169–176