Hugo icon Linode icon
I'm Utkarsh Sinha and this is my blog. I currently work at Google on Project Starline. In the past, I worked at Microsoft, studied at Carnegie Mellon University in Pittsburgh and made movies at DreamWorks Animation. If you're curious, find out more about me.


Recent projects
  • Nov 25, 2020
    Deformable NeRF
    We present the first method capable of photorealistically reconstructing a non-rigidly deforming scene using photos/videos captured casually from mobile phones.
  • All projects
News
  • Sep 1, 2021
    Paper
    HyperNeRF: A Higher-Dimensional Representation for Topologically Varying NeRFs

    By applying ideas from level set methods, we can represent topologically changing scenes with NeRFs. HyperNeRF handles topological variations by modeling a family of shapes in a higher-dimensional space, thereby producing more realistic renderings and more accurate geometric reconstructions. This paper was published at SIGGRAPH Asia 2021.

    Paper Website Github
  • Jul 1, 2021
    Paper
    Nerfies: Deformable Neural Radiance Fields

    We present the first method capable of photorealistically reconstructing a non-rigidly deforming scene using photos/videos captured casually from mobile phones. Nerfies turns selfie videos from your phone into free-viewpoint portraits. This project was published at ICCV 2021 and was covered by several online magazines: Gizmodo, Two minute papers, Wired

    Paper Website Github
  • Dec 3, 2019
    Paper
    Real-time burst photo selection using a light-head adversarial network

    Our paper describing the core technology behind automatically picking the best quality image from a burst of captures was accepted at IEEE Transactions on Image Processing. This is used in the Microsft Pix app.

    Paper
  • Oct 15, 2019
    Patent
    Deep learning on image frames to generate a summary

    Our patent describing a technique to create a summary seqeuence of images from a video was approved! This technique was used in Microsoft Pix’s comic strip feature and is the result of us winning an internal hackathon at Microsoft!

    Paper Website
  • Nov 15, 2015
    Book
    OpenCV 3 Blueprints

    Our book titled OpenCV 3 Blueprints is now public. I contributed a book chapter on video image stabilization using computer vision signals in the form of feature matches across frames, using motion estimation using the camera’s built-in gyroscope and rolling shutter estimation.

    Website Github
  • Mar 27, 2015
    Movie
    Home

    My last movie working as a Technical Director in the surfacing department at DreamWorks Animation!

    Website
  • Nov 26, 2014
    Movie
    Penguins of Madagascar

    The Penguins of Madagascar return as I worked in the surfacing department!

    Website
  • Jun 13, 2014
    Movie
    How to train your dragon 2

    The second How to train your Dragon was released where I worked as a Technical Director in the surfacing department!

    Website
  • Mar 7, 2014
    Movie
    Mr. Peabody and Sherman

    My second Hollywood movie credit working as a Technical director in the surfacing department.

    Website
  • Jun 8, 2012
    Movie
    Madagascar 3: Europe's most wanted

    My very first Hollywood movie credit! I worked as a Technical Director in the surfacing department.

    Website