README.md

hardware-video-streaming meta repository

This repository groups libraries, programs and examples related to video and point cloud streaming.

Before diving in

If you have no specific needs use gstreamer or FFmpeg command line streaming.

Repositories

HVD Hardware Video Decoder

Multiple technologies hardware decoding wrapped in a simple zero-copy interface to FFmpeg.

HVE Hardware Video Encoder

VAAPI/NVENC hardware encoding wrapped in a simple zero-copy interface to FFmpeg.

MLSP Minimal Latency Streaming Protocol

A simple zero buffering UDP blaster.

NHVD Network Hardware Video Decoder

Network hardware decoder on top of HVD and MLSP.

NHVE Network Hardware Video Encoder

Network hardware encoder on top of HVE and MLSP wrapped in a simple zero-copy interface.

realsense-ir-to-vaapi-h264

Example of Realsense camera infrared stream H.264 encoding with HVE.

realsense-depth-to-vaapi-hevc10

Example of Realsense camera depth stream HEVC Main10 encoding with HVE.

RNHVE Realsense Network Hardware Video Encoder

Example of Realsense camera color/ir H.264 and color/ir/depth HEVC network streaming with NHVE.

UNHVD Unity Network Hardware Video Decoder

Unity rendering example of unhvd-native hardware decoded H.264/HEVC network video/depth stream.

unhvd-native

Native library for video, streaming, hardware decoding and depth to point cloud unprojection on top of NHVD and HDU.

HDU Hardware Depth Unprojector

Compute, vertex and pixel shaders for unprojection and rendering of point clouds.

Additional information

The top level solution built on top of libraries forms:

• 100 ms order latency Realsense Camera to Unity WiFi streaming
• measured between LattePanda Alpha and i7-7820HK laptop