Introduction

System Overview

The system can be seen as follows:

• Rounded boxes are the component that perform some computation/produce some data
• Rectangular boxes provide a way to communicate between modules
• The “cloudy” box is a component that is only computed once at the startup of the system

The Basics

The basics are divided into the modules to compute produce something and the communications

Modules

Cameras

The Basler a2A1920-165g5cBAS 5GigE camera, 6.1 is a high-performance imaging device designed for various industrial applications. (Basler ace 2 a2A1920-165g5cBAS - Area Scan Camera (baslerweb.com)

We also used pylon viewer to simulate the real cameras (https://www.baslerweb.com/en/products/basler-pylon-camera-software-suite/pylon-viewer/)

The images provided to openpose in the virtual environment were rendered through unreal engine

Openpose

Openpose is a library that provides real-time multi-person keypoints detection and multi-threading processing for body and hand tracking. It can capture and analyze the human body in real-time from multiple viewpoints using only RGB input. The library is written in C++ with a Python API, and it is compatible with Windows, Linux, and macOS. More information can be found at https://cmu-perceptual-computing-lab.github.io/openpose/web/html/doc/index.html.

DataMerger