Country
Full text data for US,EP,CN
Type
Legal Validity
Legal Status
Filing Date
Publication Date
Inventor
Assignee
Click to expand
IPC(Section)
IPC(Class)
IPC(Subclass)
IPC(Group)
IPC(Subgroup)
Agent
Agency
Claims Number
Figures Number
Citation Number of Times
Assignee Number
No. Publication Number Title Publication/Patent Number Publication/Patent Number Publication Date Publication Date
Application Number Application Number Filing Date Filing Date
Inventor Inventor Assignee Assignee IPC IPC
1 US10531073B2
Method and apparatus for automatic calibration of RGBZ sensors utilizing epipolar geometry and scanning beam projector
Publication/Patent Number: US10531073B2 Publication Date: 2020-01-07 Application Number: 15/157,389 Filing Date: 2016-05-17 Inventor: Ovsiannikov ilia   Assignee: SAMSUNG ELECTRONICS CO., LTD.   IPC: H04N13/246 Abstract: Using one or more patterned markers inside the projector module of a three-dimensional (3D) camera to facilitate automatic calibration of the camera's depth sensing operation. The 3D camera utilizes epipolar geometry-based imaging in conjunction with laser beam point-scans in a triangulation-based approach to depth measurements. A light-sensing element and one or more reflective markers inside the projector module facilitate periodic self-calibration of camera's depth sensing operation. To calibrate the camera, the markers are point-scanned using the laser beam and the reflected light is sensed using the light-sensing element. Based on the output of the light-sensing element, the laser's turn-on delay is adjusted to perfectly align a laser light spot with the corresponding reflective marker. Using reflective markers, the exact direction and speed of the scanning beam over time can be determined as well. The marker-based automatic calibration can periodically run in the background without interfering with the normal camera operation.
2 US2020097823A1
NON-UNIFORM QUANTIZATION OF PRE-TRAINED DEEP NEURAL NETWORK
Publication/Patent Number: US2020097823A1 Publication Date: 2020-03-26 Application Number: 16/181,326 Filing Date: 2018-11-05 Inventor: Chen, Hui   Ovsiannikov ilia   Assignee: Samsung Electronics Co., Ltd.   IPC: G06N3/08 Abstract: A system and a method of quantizing a pre-trained neural network, includes determining by a layer/channel bit-width determiner for each layer or channel of the pre-trained neural network a minimum quantization noise for the layer or the channel for each master bit-width value in a predetermined set of master bit-width values; and selecting by a bit-width selector for the layer or the channel the master bit-width value having the minimum quantization noise for the layer or the channel. In one embodiment, the minimum quantization noise for the layer or the channel is based on a square of a range of weights for the layer or the channel that is multiplied by a constant to a negative power of a current master bit-width value.
3 US2020234099A1
NEURAL PROCESSOR
Publication/Patent Number: US2020234099A1 Publication Date: 2020-07-23 Application Number: 16/842,700 Filing Date: 2020-04-07 Inventor: Wang, Lei   Ovsiannikov ilia   Assignee: Samsung Electronics Co., Ltd.   IPC: G06N3/04 Abstract: A processor includes a register, a non-zero weight value selector and a multiplier. The register holds a first group of weight values and a second group of weight values. Each group of weight values includes at least one weight value, and each weight value in the first group of weight values corresponding to a weight value in the second group of weight values. The non-zero weight value selector selects a non-zero weight value from a weight value in the first group of weight values or a non-zero weight value in the second group of weight values that corresponds to the weight value in the first group of weight values. The multiplier multiplies the selected non-zero weight value and an activation value that corresponds to the selected non-zero weight value to form an output product value.
4 US202033456A1
TIME-RESOLVING IMAGE SENSOR FOR RANGE MEASUREMENT AND 2D GREYSCALE IMAGING
Publication/Patent Number: US202033456A1 Publication Date: 2020-01-30 Application Number: 20/181,614 Filing Date: 2018-09-24 Inventor: Ovsiannikov ilia   Shi, Lilong   Wang, Yibing Michelle   Assignee: Samsung Electronics Co., Ltd.   IPC: G04F10/00 Abstract: An image sensor includes a time-resolving sensor and a processor. The time-resolving sensor outputs a first signal and a second signal pair in response detecting one or more photons that have been reflected from an object. A first ratio of a magnitude of the first signal to a sum of the magnitude of the first signal and a magnitude of the second signal is proportional to a time of flight of the one or more detected photons. A second ratio of the magnitude of the second signal to the sum of the magnitude of the first signal and the magnitude of the second signal is proportional to the time of flight of the one or more detected photons. The processor determines a surface reflectance of the object where the light pulse has been reflected based on the first signal and the second signal pair and may generate a grayscale image.
5 DE102019107807A1
ZEITAUFLÖSENDER BILDSENSOR ZUR ENTFERNUNGSMESSUNG UND 2D-GRAUSKALENBILDGEBUNG
Publication/Patent Number: DE102019107807A1 Publication Date: 2020-01-30 Application Number: 102019107807 Filing Date: 2019-03-27 Inventor: Ovsiannikov ilia   Wang, Yibing Michelle   Shi, Lilong   Assignee: Samsung Electronics Co., Ltd.   IPC: H04N13/20 Abstract: Ein Bildsensor umfasst einen zeitauflösenden Sensor und einen Prozessor (19). Der zeitauflösende Sensor gibt ein Paar eines ersten Signals und eines zweiten Signals aus, nachdem ein oder mehrere Photonen detektiert wurden, die von einem Objekt (26) reflektiert wurden. Ein erstes Verhältnis einer Größe des ersten Signals zu einer Summe der Größe des ersten Signals und einer Größe des zweiten Signals ist zu einer Laufzeit (Time of Flight) des einen oder der mehreren detektierten Photonen proportional. Ein zweites Verhältnis der Größe des zweiten Signals zur Summe der Größe des ersten Signals und der Größe des zweiten Signals ist zur Laufzeit des einen oder der mehreren detektierten Photonen proportional. Der Prozessor (19) bestimmt ein Oberflächenreflexionsvermögen des Objekts (26), wo der Lichtimpuls (28, 29) reflektiert wurde, auf der Basis des Paares eines ersten Signals und eines zweiten Signals und kann ein Grauskalenbild generieren.
6 US2020033456A1
TIME-RESOLVING IMAGE SENSOR FOR RANGE MEASUREMENT AND 2D GREYSCALE IMAGING
Publication/Patent Number: US2020033456A1 Publication Date: 2020-01-30 Application Number: 16/140,529 Filing Date: 2018-09-24 Inventor: Wang, Yibing Michelle   Shi, Lilong   Ovsiannikov ilia   Assignee: Samsung Electronics Co., Ltd.   IPC: G01S7/486 Abstract: An image sensor includes a time-resolving sensor and a processor. The time-resolving sensor outputs a first signal and a second signal pair in response detecting one or more photons that have been reflected from an object. A first ratio of a magnitude of the first signal to a sum of the magnitude of the first signal and a magnitude of the second signal is proportional to a time of flight of the one or more detected photons. A second ratio of the magnitude of the second signal to the sum of the magnitude of the first signal and the magnitude of the second signal is proportional to the time of flight of the one or more detected photons. The processor determines a surface reflectance of the object where the light pulse has been reflected based on the first signal and the second signal pair and may generate a grayscale image.
7 US10735714B2
Time-resolving sensor using shared PPD+SPAD pixel and spatial-temporal correlation for range measurement
Publication/Patent Number: US10735714B2 Publication Date: 2020-08-04 Application Number: 16/422,944 Filing Date: 2019-05-24 Inventor: Wang, Yibing Michelle   Shi, Lilong   Ovsiannikov ilia   Assignee: SAMSUNG ELECTRONICS CO., LTD.   IPC: H04N13/254 Abstract: A Time-of-Flight (TOF) technique is combined with analog amplitude modulation within each pixel in a pixel array using multiple Single Photon Avalanche Diodes (SPADs) in conjunction with a single Pinned Photo Diode (PPD) in each pixel. A SPAD may be shared among multiple neighboring pixels. The TOF information is added to the received light signal by the analog domain-based single-ended to differential converter inside the pixel itself. The spatial-temporal correlation among outputs of multiple, adjacent SPADs in a pixel is used to control the operation of the PPD to facilitate recording of TOF values and range of an object. Erroneous range measurements due to ambient light are prevented by stopping the charge transfer from the PPD—and, hence, recording a TOF value—only when two or more SPADs in the pixel are triggered within a pre-defined time interval. An autonomous navigation system with multi-SPAD pixels provides improved vision for drivers under difficult driving conditions.
8 US10557925B2
Time-of-flight (TOF) image sensor using amplitude modulation for range measurement
Publication/Patent Number: US10557925B2 Publication Date: 2020-02-11 Application Number: 15/340,972 Filing Date: 2016-11-01 Inventor: Wang, Yibing Michelle   Lee, Tae-yon   Ovsiannikov ilia   Assignee: SAMSUNG ELECTRONICS CO., LTD.   IPC: G01C3/08 Abstract: The Time-of-Flight (TOF) technique is combined with analog amplitude modulation within each pixel in an image sensor. The pixel may be a two-tap pixel or a one-tap pixel. Two photoelectron receiver circuits in the pixel receive respective analog modulating signals. The distribution of the received photoelectron charge between these two circuits is controlled by the difference (or ratio) of the two analog modulating voltages. The differential signals generated in this manner within the pixel are modulated in time domain for TOF measurement. Thus, the TOF information is added to the received light signal by the analog domain-based single-ended to differential converter inside the pixel itself. The TOF-based measurement of range and its resolution are controllable by changing the duration of modulation. An autonomous navigation system with these features may provide improved vision for drivers under difficult driving conditions like low light, fog, bad weather, or strong ambient light.
9 US2020162721A1
APPARATUS FOR AND METHOD OF ILLUMINATION CONTROL FOR ACQUIRING IMAGE INFORMATION AND DEPTH INFORMATION SIMULTANEOUSLY
Publication/Patent Number: US2020162721A1 Publication Date: 2020-05-21 Application Number: 16/773,505 Filing Date: 2020-01-27 Inventor: Ovsiannikov ilia   Wang, Yibing Michelle   Deane, Peter   Assignee: Samsung Electronics Co., Ltd.   IPC: H04N13/254 Abstract: An apparatus and a method are provided. The apparatus includes a light source configured to project light in a changing pattern that reduces the light's noticeability; collection optics through which light passes and forms an epipolar plane with the light source; and an image sensor configured to receive light passed through the collection optics to acquire image information and depth information simultaneously. The method includes projecting light by a light source in a changing pattern that reduces the light's noticeability; passing light through collection optics and forming an epipolar plane between the collection optics and the light source; and receiving in an image sensor light passed through the collection optics to acquire image information and depth information simultaneously.
10 US10547830B2
Apparatus for and method of illumination control for acquiring image information and depth information simultaneously
Publication/Patent Number: US10547830B2 Publication Date: 2020-01-28 Application Number: 14/989,554 Filing Date: 2016-01-06 Inventor: Ovsiannikov ilia   Wang, Yibing Michelle   Deane, Peter   Assignee: Samsung Electronics Co., Ltd   IPC: H04N13/257 Abstract: An apparatus and a method are provided. The apparatus includes a light source configured to project light in a changing pattern that reduces the light's noticeability; collection optics through which light passes and forms an epipolar plane with the light source; and an image sensor configured to receive light passed through the collection optics to acquire image information and depth information simultaneously. The method includes projecting light by a light source in a changing pattern that reduces the light's noticeability; passing light through collection optics and forming an epipolar plane between the collection optics and the light source; and receiving in an image sensor light passed through the collection optics to acquire image information and depth information simultaneously.
11 US2020150924A1
SIGNED MULTIPLICATION USING UNSIGNED MULTIPLIER WITH DYNAMIC FINE-GRAINED OPERAND ISOLATION
Publication/Patent Number: US2020150924A1 Publication Date: 2020-05-14 Application Number: 16/276,582 Filing Date: 2019-02-14 Inventor: Ovsiannikov ilia   Shafiee, Ardestani Ali   Hassoun, Joseph   Wang, Lei   Assignee: Samsung Electronics Co., Ltd.   IPC: G06F7/487 Abstract: An N×N multiplier may include a N/2×N first multiplier, a N/2×N/2 second multiplier, and a N/2×N/2 third multiplier. The N×N multiplier receives two operands to multiply. The first, second and/or third multipliers are selectively disabled if an operand equals zero or has a small value. If the operands are both less than 2N/2, the second or the third multiplier are used to multiply the operands. If one operand is less than 2N/2 and the other operand is equal to or greater than 2N/2, the first multiplier is used or the second and third multipliers are used to multiply the operands. If both operands are equal to or greater than 2N/2, the first, second and third multipliers are used to multiply the operands.
12 US2020043196A1
MULTISCALE WEIGHTED MATCHING AND SENSOR FUSION FOR DYNAMIC VISION SENSOR TRACKING
Publication/Patent Number: US2020043196A1 Publication Date: 2020-02-06 Application Number: 16/597,846 Filing Date: 2019-10-09 Inventor: Ji, Zhengping   Shi, Lilong   Wang, Yibing Michelle   Ryu, Hyun Surk   Ovsiannikov ilia   Assignee: Samsung Electronics Co., Ltd.   IPC: G06T7/73 Abstract: A Dynamic Vision Sensor (DVS) pose-estimation system includes a DVS, a transformation estimator, an inertial measurement unit (IMU) and a camera-pose estimator based on sensor fusion. The DVS detects DVS events and shapes frames based on a number of accumulated DVS events. The transformation estimator estimates a 3D transformation of the DVS camera based on an estimated depth and matches confidence-level values within a camera-projection model such that at least one of a plurality of DVS events detected during a first frame corresponds to a DVS event detected during a second subsequent frame. The IMU detects inertial movements of the DVS with respect to world coordinates between the first and second frames. The camera-pose estimator combines information from a change in a pose of the camera-projection model between the first frame and the second frame based on the estimated transformation and the detected inertial movements of the DVS.
13 US202043196A1
MULTISCALE WEIGHTED MATCHING AND SENSOR FUSION FOR DYNAMIC VISION SENSOR TRACKING
Publication/Patent Number: US202043196A1 Publication Date: 2020-02-06 Application Number: 20/191,659 Filing Date: 2019-10-09 Inventor: Ovsiannikov ilia   Ryu, Hyun Surk   Wang, Yibing Michelle   Ji, Zhengping   Shi, Lilong   Assignee: Samsung Electronics Co., Ltd.   IPC: G06T7/73 Abstract: A Dynamic Vision Sensor (DVS) pose-estimation system includes a DVS, a transformation estimator, an inertial measurement unit (IMU) and a camera-pose estimator based on sensor fusion. The DVS detects DVS events and shapes frames based on a number of accumulated DVS events. The transformation estimator estimates a 3D transformation of the DVS camera based on an estimated depth and matches confidence-level values within a camera-projection model such that at least one of a plurality of DVS events detected during a first frame corresponds to a DVS event detected during a second subsequent frame. The IMU detects inertial movements of the DVS with respect to world coordinates between the first and second frames. The camera-pose estimator combines information from a change in a pose of the camera-projection model between the first frame and the second frame based on the estimated transformation and the detected inertial movements of the DVS.
14 US10733760B2
Multiscale weighted matching and sensor fusion for dynamic vision sensor tracking
Publication/Patent Number: US10733760B2 Publication Date: 2020-08-04 Application Number: 16/597,846 Filing Date: 2019-10-09 Inventor: Ji, Zhengping   Shi, Lilong   Wang, Yibing Michelle   Ryu, Hyun Surk   Ovsiannikov ilia   Assignee: SAMSUNG ELECTRONICS CO., LTD.   IPC: G06K9/00 Abstract: A Dynamic Vision Sensor (DVS) pose-estimation system includes a DVS, a transformation estimator, an inertial measurement unit (IMU) and a camera-pose estimator based on sensor fusion. The DVS detects DVS events and shapes frames based on a number of accumulated DVS events. The transformation estimator estimates a 3D transformation of the DVS camera based on an estimated depth and matches confidence-level values within a camera-projection model such that at least one of a plurality of DVS events detected during a first frame corresponds to a DVS event detected during a second subsequent frame. The IMU detects inertial movements of the DVS with respect to world coordinates between the first and second frames. The camera-pose estimator combines information from a change in a pose of the camera-projection model between the first frame and the second frame based on the estimated transformation and the detected inertial movements of the DVS.
15 US202026980A1
NEURAL PROCESSOR
Publication/Patent Number: US202026980A1 Publication Date: 2020-01-23 Application Number: 20/191,655 Filing Date: 2019-08-27 Inventor: Hassoun, Joseph H.   Wang, Yibing Michelle   Song, Joonho   Jang, Jun-woo   Lee, Sehwan   Ovsiannikov ilia   Shafiee, Ardestani Ali   Li, Yuecheng   Wang, Lei   Assignee: Samsung Electronics Co., Ltd.   IPC: G06N3/08 Abstract: A neural processor. In some embodiments, the processor includes a first tile, a second tile, a memory, and a bus. The bus may be connected to the memory, the first tile, and the second tile. The first tile may include: a first weight register, a second weight register, an activations buffer, a first multiplier, and a second multiplier. The activations buffer may be configured to include: a first queue connected to the first multiplier and a second queue connected to the second multiplier. The first queue may include a first register and a second register adjacent to the first register, the first register being an output register of the first queue. The first tile may be configured: in a first state: to multiply, in the first multiplier, a first weight by an activation from the output register of the first queue, and in a second state: to multiply, in the first multiplier, the first weight by an activation from the second register of the first queue.
16 US2020026978A1
NEURAL PROCESSOR
Publication/Patent Number: US2020026978A1 Publication Date: 2020-01-23 Application Number: 16/552,619 Filing Date: 2019-08-27 Inventor: Ovsiannikov ilia   Shafiee, Ardestani Ali   Hassoun, Joseph H.   Wang, Lei   Lee, Sehwan   Song, Joonho   Jang, Jun-woo   Wang, Yibing Michelle   Li, Yuecheng   Assignee: Samsung Electronics Co., Ltd.   IPC: G06N3/04 Abstract: A neural processor. In some embodiments, the processor includes a first tile, a second tile, a memory, and a bus. The bus may be connected to the memory, the first tile, and the second tile. The first tile may include: a first weight register, a second weight register, an activations buffer, a first multiplier, and a second multiplier. The activations buffer may be configured to include: a first queue connected to the first multiplier and a second queue connected to the second multiplier. The first queue may include a first register and a second register adjacent to the first register, the first register being an output register of the first queue. The first tile may be configured: in a first state: to multiply, in the first multiplier, a first weight by an activation from the output register of the first queue, and in a second state: to multiply, in the first multiplier, the first weight by an activation from the second register of the first queue.