Omnivision, Nvidia Demo Humanoid Robots with Multi-Camera Sensing

The robots are engineered to imitate human expressions, interactions and movements.

Omnivision's company office building.
Omnivision's company office building.
iStock/Robert Way

Omnivision, a developer of semiconductor solutions, including advanced digital imaging, analog, and touch & display technology, today announced that its total camera solution, comprising the OG02B10 color global shutter (GS) image sensor and OAX4000 ASIC image signal processor (ISP), is now verified and available with the Nvidia Holoscan sensor processing platform and the Nvidia Jetson platform for edge AI and robotics.

Humanoid robots, which resemble and act like humans, represent a growing sector that was valued at $1.8 billion in 2023 and is predicted to increase to more than $13 billion by 2028, according to research firm MarketsandMarkets. The robots are engineered to imitate human expressions, interactions and movements; to do this, they require an array of cameras, sensors, and artificial intelligence (AI) and machine learning (ML) technologies.

Nvidia Holoscan is a full-stack AI sensor processing platform for low-latency sensor and network connectivity that includes optimized libraries for data processing, AI and core microservices to run streaming, imaging and other applications, from embedded, to edge, to cloud. It can be used to build streaming AI pipelines for a variety of domains, including medical devices, high-performance computing at the edge, industrial inspection and more.

Nvidia Jetson is a platform for robotics and embedded edge AI applications. It offers compact, yet high-performance compute, supported by the Nvidia JetPack software development kit for accelerated software development and Nvidia application frameworks like Nvidia Holoscan, Nvidia Metropolis and Nvidia Isaac for faster time to market.

Omnivision’s high-performance 2-megapixel (MP) OG02B10 GS sensor uses advanced 3 x 3-micron OmniPixel 3-GS pixel technology. This technology eliminates motion artifacts and blurring and dramatically improves low-light sensitivity. Omnicision’s OAX4000 companion ISP is capable of processing up to four camera modules with 140 dB high dynamic range (HDR), reducing design complexity and space and improving overall reliability.

More in Automation