Orbbec Inc

What Orbbec Inc. Does

Orbbec's core business revolves around creating the foundational technology that enables machines and devices to perceive and understand the world in three dimensions. Their activities encompass the entire lifecycle of 3D vision solutions:

1. Advanced 3D Sensing Technology Development: Orbbec invests heavily in research and development across various 3D sensing modalities. This includes:
   • Structured Light: Projecting a known light pattern onto a scene and analyzing its deformation to calculate depth.
   • Stereo Vision: Mimicking human binocular vision by using two or more cameras to perceive depth through image disparity. Orbbec develops both active stereo (with an IR projector) and passive stereo solutions.
   • Time-of-Flight (ToF): Measuring the time it takes for light (often infrared) to travel from the sensor to an object and back. This includes both indirect ToF (iToF) and direct ToF (dToF) technologies.
   • LiDAR (Light Detection and Ranging): Although a newer area for them, they have started to introduce LiDAR products.
2. ASIC and Algorithm Design: Orbbec designs its own Application-Specific Integrated Circuits (ASICs) for depth processing. This custom hardware, combined with their proprietary computer vision algorithms (including AI-driven algorithms), allows for optimized performance, power efficiency, and enhanced features in their 3D cameras.
3. Hardware Product Manufacturing: The company operates state-of-the-art manufacturing facilities, enabling them to produce a wide range of 3D cameras, sensors, and vision processors. This vertical integration gives them control over quality and supply chain management.
4. Software Development Kits (SDKs) and Tools: Orbbec provides comprehensive SDKs that support various operating systems (Windows, Linux, Android, macOS) and programming languages/platforms (C/C++, Python, ROS, Unity). These SDKs allow developers to easily integrate Orbbec's 3D cameras into their applications and access depth data, RGB imagery, point clouds, and other sensor information.
5. Customization and ODM/OEM Services: Recognizing that off-the-shelf products don't always meet specific customer needs, Orbbec offers Original Design Manufacturer (ODM) and Original Equipment Manufacturer (OEM) services. This includes customizing existing products or developing entirely new 3D vision solutions tailored to unique application requirements.
6. Ecosystem Development and Partnerships: Orbbec actively collaborates with technology partners, including compute platform providers like NVIDIA (Jetson) and AMD (Kria), and software companies like Microsoft (Azure Kinect technology). They are also expanding their global distribution network to make their products more accessible.

Products and Services Offered

Orbbec's product portfolio is extensive, covering various types of 3D cameras and related technologies, designed to serve different application needs in terms of range, accuracy, field of view, and environmental conditions.

Key Product Categories and Series:

1. Structured Light Cameras:

   • Astra Series: Orbbec's foundational family of structured light 3D cameras, designed for indoor use. The series includes models like Astra, Astra S (short-range), and Astra Pro Plus (with higher resolution RGB), offering a balance of performance and affordability for applications like 3D modeling, fall prevention, and fitness smart mirrors. These often use Orbbec's custom ASIC for depth processing and support USB 2.0.

2. Stereo Vision Cameras:

   • Gemini Series: A versatile lineup of active and passive stereo vision cameras.
     • Gemini 2 / Gemini 2 XL: These cameras offer long-range depth perception (up to 20m for XL) and good performance in various lighting conditions, including outdoors. They feature global shutters for RGB and IR, and options for USB and PoE connectivity. The Gemini 2 XL uses a proprietary OBox computing module for complex deep learning algorithms.
     • Gemini 330/335/336 Series (including L, Le, Lg variants): These cameras often combine active and passive stereo technologies for robust performance indoors and outdoors. They are designed for robotics (AMRs, AGVs), logistics, and industrial automation. Variants like the Gemini 335Le offer Ethernet connectivity, and the Gemini 335Lg supports GMSL/FAKRA interfaces for longer cable runs and embedded applications.
     • Gemini 435Le: An industrial-grade stereo vision camera designed for enhanced precision and adaptability in complex industrial scenarios, offering features suitable for larger robots like forklifts for navigation and object recognition.

3. Time-of-Flight (ToF) Cameras:

   • Femto Series: This series leverages ToF technology, often developed in collaboration with Microsoft based on Azure Kinect technology.
     • Femto Mega / Femto Mega I: Designed as a reliable alternative to the Microsoft Azure Kinect DK, it offers depth and RGB sensing, an IMU, and is suitable for applications requiring high-quality depth data, such as robotics, logistics, and healthcare. It supports the Orbbec SDK and an Orbbec SDK K4A Wrapper for easier migration for Azure Kinect users.
     • Femto Bolt: Another ToF camera offering compact design and robust performance for various 3D vision applications.

4. Camera Computers / Smart Cameras:

   • Persee+: A 3D camera with integrated processing capabilities (e.g., built-in neural network processing), allowing for on-device AI and computer vision tasks without needing a separate host computer.

5. LiDAR:

   • Pulsar Series (e.g., Pulsar SL450): Marking Orbbec's entry into the LiDAR market, these sensors are designed for applications like long-range object detection and mapping.

6. Development Boards and Accessories:

   • Orbbec provides development boards and accessories like sync hubs to facilitate multi-camera setups and system integration.

Software and SDKs:

• Orbbec SDK: A comprehensive, cross-platform (Windows, Linux, Android, macOS) software development kit that supports most of Orbbec's mainstream cameras. It provides APIs for device configuration, data stream access (depth, IR, RGB, point cloud), frame synchronization, and more. An open-source version of the Orbbec SDK is available for many newer products.
• Orbbec SDK K4A Wrapper: Specifically for the Femto Mega, this wrapper allows developers familiar with the Microsoft Azure Kinect Sensor SDK to transition their applications with minimal code changes.
• Human Skeleton Tracking SDK: Compatible with cameras like the Femto Mega, often utilizing underlying Microsoft body tracking algorithms.
• Support for ROS/ROS2, Python, Unity, C/C++, etc.: The SDKs provide wrappers and examples for various popular development environments.

Services:

• ODM/OEM Customization: Orbbec offers extensive customization services, from modifying standard products to co-developing entirely new 3D vision solutions based on customer-specific requirements. This includes design, manufacturing, and integration support.
• Technical Support and Community: Orbbec provides technical support for its products and maintains a developer community forum for users to share knowledge and solutions.
• System Integration Support: While primarily a hardware and SDK provider, Orbbec works with partners to facilitate system integration for end-to-end solutions.

Target Markets and Applications

Orbbec's 3D vision technology is applied across a wide array of industries:

• Robotics: Autonomous Mobile Robots (AMRs), Automated Guided Vehicles (AGVs), industrial robots (for picking, placing, inspection), collaborative robots, service robots (navigation, obstacle avoidance, object recognition).
• Logistics and Warehousing: Dimensioning of packages, pallet detection, automated loading/unloading, inventory management.
• Manufacturing: Quality control, defect inspection, assembly guidance, metrology.
• Retail and Consumer: People counting, gesture recognition, interactive displays, self-checkout systems, 3D scanning for virtual try-on, facial recognition payment systems.
• Healthtech and Fitness: Patient monitoring, fall detection, rehabilitation systems, fitness smart mirrors for exercise tracking and form analysis, contactless vital signs monitoring.
• 3D Scanning and Modeling: Creating 3D models of objects and environments for various applications, including reverse engineering, cultural heritage preservation, and content creation.
• Security and Surveillance: Enhanced surveillance with depth perception, access control with facial recognition.
• Automotive: In-cabin monitoring, gesture control (though not a primary focus compared to other areas).
• Media and Entertainment: Motion capture, interactive installations.

Orbbec Inc. continues to innovate and expand its product offerings and partnerships, striving to make advanced 3D vision technology more accessible and powerful for developers and solution providers globally. Their focus on providing a full-stack platform, from core sensor technology to comprehensive SDKs and customization services, positions them as a significant enabler of the next generation of intelligent devices and automated systems.