PoC Device for Wide-Range Video Recording

Merging two camera feeds in real time

  • C/C++
  • Linux
  • DSP
  • AWS
  • NXP Semiconductors
  • Amazon Alexa
  • OmniVision
Solution System for real-time video processing
Industry Automotive, Consumer Electronics
ENGAGEMENT MODEL

T&M

Methodology Agile
Team
  • Firmware Developers
  • Hardware Engineer
1
2
3
4
5
6

Client

Case Highlights

Softeq created a proof-of-concept solution for real-time video stitching

  • NXP-based solution
  • Real-time video processing using synchronous exposure, white balance corrections, stitching, and squeezing algorithms
  • Covers a 200+ degree field of view
  • Wi-Fi and LTE connectivity

Problem

The client addressed Softeq to develop a PoC solution capable of real-time video stitching. They wanted to develop a smart driver assistance solution—a dashcam-like device installed on the windshield. The solution needed to detect accidents, check on the driver, and call emergency services if required.

The solution also had to record HD videos for car insurance claims, and store them on the device’s SD card. In the event of an accident, the system needed to automatically send the video files to the cloud.

Solution

Real-Time Video Stitching

Softeq developed a PoC solution that combines two video feeds to create a single panoramic video. Due to the apparent difference in the object position caused by different camera angles, simply merging the feeds without additional processing was not enough to create a seamless video. For this reason, we developed a Linux board support package that enables the solution to apply the necessary video corrections in real time. The solution is based on the NXP processor and supports Wi-Fi and LTE connectivity for sending data to the AWS cloud.

How it Works

1. Applies synchronous exposure and white balance corrections to video footage obtained from both cameras

2. Projects the videos on a 3D sphere

3. Merges the feeds using a smooth stitching algorithm

4. Maps the merged video on to a two-dimensional plane

5. Removes the fish-eye effect using the squeezing and stretching algorithms

Results

Wide range video recording with real-time processing

Softeq developed a PoC solution that helps create panoramic videos by merging two camera feeds in real time. The solution is able to cover a field of view of more than 200 degrees. 

Currently, we are working on an MVP version of the driver assistance solution, which will also support Alexa. Next, we will develop a geofencing function that notifies drivers when they enter an unsafe area.

Our solution could serve as a basis providing data needed for further analysis should the client decide to create an ADAS system that helps drivers avoid on-road collisions.