Dual Image Sensor Design: Lattice's Embedded Vision Dev Kit Makes It Happen

By Len WegnerOctober 22, 2017

The Embedded Vision Development Kit, introduced by Lattice Semiconductor, is aimed at enabling embedded system designers to create best-in-class environment for software-hardware prototyping, enabling dual image sensor design capabilities.

What’s included?

Lattice’s Application Engineer Chris Robinson has specified that the product contain three boards, namely:

  • ECP5 video interface platform (VIP) Processor Board
  • CrossLink VIP Input Bridge Board
  • High-Definition Multimedia Interface (HDMI) VIP Output Bridge Board

How the Lattice Embedded Vision Kit Helps with HDMI Output

The CrossLink bridge board is used for interfacing two Sony IMX 214 cameras, featuring high-speed MIPI D-PHY. The CrossLink LIF-MD6000 is attributed with the capability to convert high-speed video data to 8-bit parallel data. The video data is processed through a first-in, first-out (FIFO) operation so that the image captured by both camera sensors can be brought to the same ‘Read Byte Clock’ domain. The byte-data is then converted into pixel data alongside line and frame valid signals and then transferred into the pixel clock domain.

The images captured by two IMX cameras are merged by using half of the LIF from the first camera sensor and the second half LIF from the second camera. The complete image is then transferred to the ECP5-85 processor board, which is instrumental in optimizing the speed of image signal processing. ECP5-85 ensures that the video, received from CrossLink, passes through several stages, such as Pixel Correction, White Balance, Bebayer, Color Space Converter and Gamma Correction before it is received by SiI1136 HDMI output bridge. The SiI1136 HDMI transfers the video data in 1080p 60fps to HDMI.

Applications of the Lattice Embedded Vision Development Kit

Lattice’s proprietary Embedded Vision Development Kit has been designed to enable OEMs in developing an array of enabled vision applications, such as machine vision, robotic vision, 3D stereoscopic video, security surveillance and automotive driver assistance.

One of the major factors boosting the chance of adoption of Lattice’s Embedded Vision Development Kit is its ability to lower the production cost of applications. Both cameras of the Vision Development Kit require support from one Image Signal Processor (ISP).

A popular application of the Embedded Vision Kit is driver assistance, where one camera is directed at the front portion of the vehicle and the other points to the driver. The recorded video can either be stored locally on an SD card or transmitted wirelessly to a centralized vehicle controlling and monitoring system.

Based on the information that the Embedded Vision Kit contains, one can easily determine the exact location an accident took place and better understand why it occurred.