Country
Full text data for US,EP,CN
Type
Legal Validity
Legal Status
Filing Date
Publication Date
Inventor
Assignee
Click to expand
IPC(Section)
IPC(Class)
IPC(Subclass)
IPC(Group)
IPC(Subgroup)
Agent
Agency
Claims Number
Figures Number
Citation Number of Times
Assignee Number
No. Publication Number Title Publication/Patent Number Publication/Patent Number Publication Date Publication Date
Application Number Application Number Filing Date Filing Date
Inventor Inventor Assignee Assignee IPC IPC
1
EP3791356A1
PERSPECTIVE DISTORTION CORRECTION ON FACES
Publication/Patent Number: EP3791356A1 Publication Date: 2021-03-17 Application Number: 18727518.5 Filing Date: 2018-05-07 Inventor: Shih, Yichang   Liang chia kai   Assignee: Google LLC   IPC: G06T3/00
2
EP3777119A1
STABILIZING VIDEO TO REDUCE CAMERA AND FACE MOVEMENT
Publication/Patent Number: EP3777119A1 Publication Date: 2021-02-17 Application Number: 19723253.1 Filing Date: 2019-04-17 Inventor: Liang chia kai   Shi, Fuhao   Assignee: Google LLC   IPC: H04N5/232
3
US2021110142A1
Perspective Distortion Correction on Faces
Publication/Patent Number: US2021110142A1 Publication Date: 2021-04-15 Application Number: 17/050,262 Filing Date: 2018-05-07 Inventor: Shih, Yichang   Liang chia kai   Assignee: Google LLC   IPC: G06K9/00 Abstract: Apparatus and methods related to image processing are provided. A computing device can determine a first image area of an image, such as an image captured by a camera. The computing device can determine a warping mesh for the image with a first portion of the warping mesh associated with the first image area. The computing device can determine a cost function for the warping mesh by: determining first costs associated with the first portion of the warping mesh that include costs associated with face-related transformations of the first image area to correct geometric distortions, and determining second costs associated with the warping mesh that include costs of edge-related transformations for preserving straightness of edges of the image. The computing device can determine an optimized mesh based on optimizing the cost function. The computing device can modify the first image area based on the optimized mesh.
4
US10897608B2
Capturing light-field images with uneven and/or incomplete angular sampling
Publication/Patent Number: US10897608B2 Publication Date: 2021-01-19 Application Number: 16/032,261 Filing Date: 2018-07-11 Inventor: Pitts, Colvin   Liang chia kai   Akeley, Kurt   Assignee: GOOGLE LLC   IPC: H04N13/229 Abstract: A light-field camera may generate four-dimensional light-field data indicative of incoming light. The light-field camera may have an aperture configured to receive the incoming light, an image sensor, and a microlens array configured to redirect the incoming light at the image sensor. The image sensor may receive the incoming light and, based on the incoming light, generate the four-dimensional light-field data, which may have first and second spatial dimensions and first and second angular dimensions. The first angular dimension may have a first resolution higher than a second resolution of the second angular dimension.
5
US2021035307A1
Real Time Perspective Correction on Faces
Publication/Patent Number: US2021035307A1 Publication Date: 2021-02-04 Application Number: 16/591,104 Filing Date: 2019-10-02 Inventor: Shih, Yichang   Liang chia kai   Lai, Wei-sheng   Yang, Ming-hsuan   Pisarchyk, Siargey   Karpiak, Ryhor   Assignee: Google LLC   IPC: G06T7/174 Abstract: Apparatus and methods related to image processing are provided. A computing device can determine a first image area of an image, such as an image captured by a camera. The computing device can determine a warping mesh for the image with a first portion of the warping mesh associated with the first image area. The computing device can determine a cost function for the warping mesh by: determining first costs associated with the first portion of the warping mesh that include costs associated with face-related transformations of the first image area to correct geometric distortions. The computing device can determine an optimized mesh based on optimizing the cost function. The computing device can modify the first image area based on the optimized mesh.
6
EP3777121A1
CAMERA AREA LOCKING
Publication/Patent Number: EP3777121A1 Publication Date: 2021-02-17 Application Number: 19732191.2 Filing Date: 2019-06-04 Inventor: Juang, Radford   Liang chia kai   Hong, Wei   Hu, Senpo   Lin, Shengyi   Gross, Erik   Assignee: Google LLC   IPC: H04N5/232
7
US10531082B2
Predictive light-field compression
Publication/Patent Number: US10531082B2 Publication Date: 2020-01-07 Application Number: 15/621,128 Filing Date: 2017-06-13 Inventor: Liang chia kai   Assignee: GOOGLE LLC   IPC: G06K9/46 Abstract: According to various embodiments, a light-field image may be compressed and/or decompressed to facilitate storage, transmission, or other functions related to the light-field image. A light-field image may be captured by a light-field image capture device having an image sensor and a microlens array. The light-field image may be received in a data store. A processor may generate a first refocus image pool with a plurality of refocus images based on the light-field image. The processor may further use the first refocus image pool to compress the light-field image to generate a bitstream, smaller than the light-field image, which is representative of the light-field image. The processor or a different processor may also be used to generate a second refocus image pool with a second plurality of images based on the bitstream. The second refocus image pool may be used to decompress the bitstream to generate a reconstructed light-field image.
8
US2020374460A1
Stabilizing Video by Accounting for a Location of a Feature in a Stabilized View of a Frame
Publication/Patent Number: US2020374460A1 Publication Date: 2020-11-26 Application Number: 16/989,566 Filing Date: 2020-08-10 Inventor: Liang chia kai   Shi, Fuhao   Assignee: Google LLC   IPC: H04N5/232 Abstract: The subject matter described in this disclosure can be embodied in methods and systems for stabilizing video. A computing system determines a stabilized location of a facial feature in a frame of video accounting for its location in a previous frame. The computing system determines a physical camera pose in virtual space and maps the frame into virtual space. The computing system determines an optimized virtual camera pose using an optimization process that determines (1) a difference between the stabilized location of the facial feature and a location of the facial feature when viewed from a potential virtual camera pose, (2) a difference between the potential virtual camera pose and a previous virtual camera pose, and (3) a difference between the potential virtual camera pose and the physical camera pose. The computing system generates the stabilized view of the frame using the optimized virtual camera pose.
9
US10812717B2
Stabilizing video by accounting for a location of a feature in a stabilized view of a frame
Publication/Patent Number: US10812717B2 Publication Date: 2020-10-20 Application Number: 16/235,037 Filing Date: 2018-12-28 Inventor: Liang chia kai   Shi, Fuhao   Assignee: Google LLC   IPC: H04N5/232 Abstract: The subject matter described in this disclosure can be embodied in methods and systems for stabilizing video. A computing system determines a stabilized location of a facial feature in a frame of video accounting for its location in a previous frame. The computing system determines a physical camera pose in virtual space and maps the frame into virtual space. The computing system determines an optimized virtual camera pose using an optimization process that determines (1) a difference between the stabilized location of the facial feature and a location of the facial feature when viewed from a potential virtual camera pose, (2) a difference between the potential virtual camera pose and a previous virtual camera pose, and (3) a difference between the potential virtual camera pose and the physical camera pose. The computing system generates the stabilized view of the frame using the optimized virtual camera pose.
10
US2020007770A1
Video Stabilization
Publication/Patent Number: US2020007770A1 Publication Date: 2020-01-02 Application Number: 16/568,931 Filing Date: 2019-09-12 Inventor: Shi, Fuhao   Liang chia kai   Tu, Xue   Assignee: Google LLC   IPC: H04N5/232 Abstract: Methods, systems, and apparatus, including computer programs stored on a computer-readable storage medium, for video stabilization. In some implementations, a computer system obtains frames of a video captured by a recording device using an optical image stabilization (OIS) system. The computing system receives (i) OIS position data indicating positions of the OIS system during capture of the frames, and (ii) device position data indicating positions of the recording device during capture of the frames. The computing system determines a first transformation for a particular frame based on the OIS position data for the particular frame and device position data for the particular frame. The computing system determines a second transformation for the particular frame based on the first transformation and positions of the recording device occurring after capture of the particular frame. The computing system generates a stabilized version of the particular frame using the second transformation.
11
EP3603049A1
VIDEO STABILIZATION
Publication/Patent Number: EP3603049A1 Publication Date: 2020-02-05 Application Number: 18762179.2 Filing Date: 2018-07-31 Inventor: Shi, Fuhao   Liang chia kai   Tu, Xue   Assignee: Google LLC   IPC: H04N5/232
12
US202007770A1
Video Stabilization
Publication/Patent Number: US202007770A1 Publication Date: 2020-01-02 Application Number: 20/191,656 Filing Date: 2019-09-12 Inventor: Liang chia kai   Tu, Xue   Shi, Fuhao   Assignee: GOOGLE LLC   IPC: H04N5/232 Abstract: Methods, systems, and apparatus, including computer programs stored on a computer-readable storage medium, for video stabilization. In some implementations, a computer system obtains frames of a video captured by a recording device using an optical image stabilization (OIS) system. The computing system receives (i) OIS position data indicating positions of the OIS system during capture of the frames, and (ii) device position data indicating positions of the recording device during capture of the frames. The computing system determines a first transformation for a particular frame based on the OIS position data for the particular frame and device position data for the particular frame. The computing system determines a second transformation for the particular frame based on the first transformation and positions of the recording device occurring after capture of the particular frame. The computing system generates a stabilized version of the particular frame using the second transformation.
13
US2020154053A1
CAMERA AREA LOCKING
Publication/Patent Number: US2020154053A1 Publication Date: 2020-05-14 Application Number: 16/743,795 Filing Date: 2020-01-15 Inventor: Juang, Radford   Liang chia kai   Hong, Wei   Hu, Senpo   Lin, Shengyi   Gross, Erik   Assignee: Google LLC   IPC: H04N5/232 Abstract: Implementations generally relate to locking a camera onto a sub-region to capture images of the sub-region with a moving camera. In some implementations, a method includes determining a first region in a scene detected by a camera while the camera is in a first physical position. The method further includes receiving user input to target a sub-region within the first capture region of the scene and capturing the first image of the sub-region while the camera is in the first physical position. The first image is displayed in a fixed orientation on a preview portion of a display screen. The camera is moved to a second physical position and a second capture region of the scene is detected. The method further includes capturing a second image is of the sub-region and displaying it in the fixed orientation on the preview portion of the display screen. The second image is effective to inform a user of whether capture of the sub-region is altered by camera movement.
14
US10552947B2
Depth-based image blurring
Publication/Patent Number: US10552947B2 Publication Date: 2020-02-04 Application Number: 15/824,574 Filing Date: 2017-11-28 Inventor: Liang chia kai   Oberheu, Kent   Akeley, Kurt   Girod, Garrett   Karnad, Nikhil   Benevides, Francis A.   Assignee: GOOGLE LLC   IPC: G06K9/00 Abstract: An image such as a light-field image may be processed to provide depth-based blurring. The image may be received in a data store. At an input device, first and second user input may be received to designate a first focus depth and a second focus depth different from the first focus depth, respectively. A processor may identify one or more foreground portions of the image that have one or more foreground portion depths, each of which is less than the first focus depth. The processor may also identify one or more background portions of the image that have one or more background portion depths, each of which is greater than the second focus depth. The processor may also apply blurring to the one or more foreground portions and the one or more background portions to generate a processed image, which may be displayed on a display device.
15
US10547790B2
Camera area locking
Publication/Patent Number: US10547790B2 Publication Date: 2020-01-28 Application Number: 16/008,697 Filing Date: 2018-06-14 Inventor: Juang, Radford   Liang chia kai   Hong, Wei   Hu, Senpo   Lin, Shengyi   Gross, Erik   Assignee: GOOGLE LLC   IPC: H04N5/232 Abstract: Implementations generally relate to locking a camera onto a sub-region to capture images of the sub-region with a moving camera. In some implementations, a method includes determining a first region in a scene detected by a camera while the camera is in a first physical position. The method further includes receiving user input to target a sub-region within the first capture region of the scene and capturing the first image of the sub-region while the camera is in the first physical position. The first image is displayed in a fixed orientation on a preview portion of a display screen. The camera is moved to a second physical position and a second capture region of the scene is detected. The method further includes capturing a second image is of the sub-region and displaying it in the fixed orientation on the preview portion of the display screen. The second image is effective to inform a user of whether capture of the sub-region is altered by camera movement.
16
US2019342497A1
Stabilizing Video to Reduce Camera and Face Movement
Publication/Patent Number: US2019342497A1 Publication Date: 2019-11-07 Application Number: 16/235,037 Filing Date: 2018-12-28 Inventor: Liang chia kai   Shi, Fuhao   Assignee: Google LLC   IPC: H04N5/232 Abstract: The subject matter described in this disclosure can be embodied in methods and systems for stabilizing video. A computing system determines a stabilized location of a facial feature in a frame of video accounting for its location in a previous frame. The computing system determines a physical camera pose in virtual space and maps the frame into virtual space. The computing system determines an optimized virtual camera pose using an optimization process that determines (1) a difference between the stabilized location of the facial feature and a location of the facial feature when viewed from a potential virtual camera pose, (2) a difference between the potential virtual camera pose and a previous virtual camera pose, and (3) a difference between the potential virtual camera pose and the physical camera pose. The computing system generates the stabilized view of the frame using the optimized virtual camera pose.
17
US10171738B1
Stabilizing video to reduce camera and face movement
Publication/Patent Number: US10171738B1 Publication Date: 2019-01-01 Application Number: 15/972,044 Filing Date: 2018-05-04 Inventor: Liang chia kai   Shi, Fuhao   Assignee: Google LLC   IPC: G06K9/00 Abstract: The subject matter described in this disclosure can be embodied in methods and systems for stabilizing video. A computing system determines a stabilized location of a facial feature in a frame of video accounting for its location in a previous frame. The computing system determines a physical camera pose in virtual space and maps the frame into virtual space. The computing system determines an optimized virtual camera pose using an optimization process that determines (1) a difference between the stabilized location of the facial feature and a location of the facial feature when viewed from a potential virtual camera pose, (2) a difference between the potential virtual camera pose and a previous virtual camera pose, and (3) a difference between the potential virtual camera pose and the physical camera pose. The computing system generates the stabilized view of the frame using the optimized virtual camera pose.
18
US10205896B2
Automatic lens flare detection and correction for light-field images
Publication/Patent Number: US10205896B2 Publication Date: 2019-02-12 Application Number: 15/967,076 Filing Date: 2018-04-30 Inventor: Kuang, Jiangtao   Liang chia kai   Assignee: GOOGLE LLC   IPC: H04N5/217 Abstract: According to various embodiments, the system and method disclosed herein process light-field image data so as to mitigate lens flare effects. A light-field image may be captured with a light-field image capture device with a microlens array and received in a data store. A plurality of flare-affected pixels may be identified in the light-field image. The flare-affected pixels may have flare-affected pixel values. Flare-corrected pixel values may be generated for the flare-affected pixels. Relative to the flare-affected pixel values, the flare-corrected pixel values may at least partially remove the lens flare effects. The flare-corrected pixel values may be used to generate a corrected light-field image in which the lens flare effects are at least partially corrected. The corrected light-field image may be displayed on a display screen.
19
WO2019212749A1
STABILIZING VIDEO TO REDUCE CAMERA AND FACE MOVEMENT
Publication/Patent Number: WO2019212749A1 Publication Date: 2019-11-07 Application Number: 2019027934 Filing Date: 2019-04-17 Inventor: Liang chia kai   Shi, Fuhao   Assignee: GOOGLE LLC   IPC: H04N5/232 Abstract: The subject matter described in this disclosure can be embodied in methods and systems for stabilizing video. A computing system determines a stabilized location of a facial feature in a frame of video accounting for its location in a previous frame. The computing system determines a physical camera pose in virtual space and maps the frame into virtual space. The computing system determines an optimized virtual camera pose using an optimization process that determines (1) a difference between the stabilized location of the facial feature and a location of the facial feature when viewed from a potential virtual camera pose, (2) a difference between the potential virtual camera pose and a previous virtual camera pose, and (3) a difference between the potential virtual camera pose and the physical camera pose. The computing system generates the stabilized view of the frame using the optimized virtual camera pose.
20
US2019124318A1
CAPTURING LIGHT-FIELD IMAGES WITH UNEVEN AND/OR INCOMPLETE ANGULAR SAMPLING
Publication/Patent Number: US2019124318A1 Publication Date: 2019-04-25 Application Number: 16/032,261 Filing Date: 2018-07-11 Inventor: Pitts, Colvin   Liang chia kai   Akeley, Kurt   Assignee: Google LLC   IPC: H04N13/229 Abstract: A light-field camera may generate four-dimensional light-field data indicative of incoming light. The light-field camera may have an aperture configured to receive the incoming light, an image sensor, and a microlens array configured to redirect the incoming light at the image sensor. The image sensor may receive the incoming light and, based on the incoming light, generate the four-dimensional light-field data, which may have first and second spatial dimensions and first and second angular dimensions. The first angular dimension may have a first resolution higher than a second resolution of the second angular dimension.
Total 6 pages