Skip to content

Infinite-ISP v1.4

Latest
Latest
Compare
Choose a tag to compare
@mfaizan-10xe mfaizan-10xe released this 11 Sep 12:18
v1.4
3fc5343

Infinite-ISP FPGA Release v1.4 for Kria KV260 Vision AI Starter Kit

What's New

  • Added Sharpening block that enhance edges and produce sharp and crisp images.

Image Sensor support:

IMX219 image sensor module

  • IMX219 image sensor module to be attached to Kria KV260 RPi port (15-pin Raspberry Pi CSI-2 connector)
  • can use Raspberry Pi Camera Module Rev 2.x

AR1335 IAS module

  • included in Xilinx Kria KV260 Accessory Pack)
  • AR1335 IAS module to be attached to Kria KV260 IAS1 port

OV5647 image sensor module

  • OV5647 image sensor module to be attached to Kria KV260 RPi port (15-pin Raspberry Pi CSI-2 connector)
  • can use Raspberry Pi Camera Module Rev 1.3

Infinite-ISP Features (Infinite-ISP_v1.4-IMX219.bin):

  • 10-bit ISP pipeline
  • 5M 2592x1944 input RAW image
  • Supported output resolutions at 20 fps:
    • 1920x1080 (16:9 cropped, no downscaling)
    • 640x480 (4:3 downscaled from 1920x1080)
    • 640x360 (16:9 downscaled from 1920x1080)
    • 1920x1440 (4:3 cropped, no downscaling)
    • 960x720 (4:3 downscaled from 1920x1440)
    • 640x480 (4:3 downscaled from 1920x1440)
  • 20 fps frame rate supported (as sourced by image sensor)
  • YUV output (YUV444) from ISP configured
  • HDMI video output support for 1080p resolution
  • External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
  • External video visualization scripts provided (video_creation.py)
  • 2A Algorithms (AE, AWB) supported in this version
  • By default, the ISP is tuned for indoor applications
  • Serial terminal based Infinite-ISP configuration menu added in this version, the menu provides support for:
    • ISP Parameter Configuration; DPC, BLC, CCM CSC, IRC and SCALE
    • Sensor Analog Gain, Digital Gain & Exposure Control
    • Sensor RAW & ISPout Burst Capture Pairs with programmable post-trigger delay
    • Fully configurable downscaled output stream with both 16:9 and 4:3 aspect ratios
  • User guide for Infinite ISP configuration menu can be found at link

Infinite-ISP Features (Infinite-ISP_v1.4-AR1335.bin):

  • 10-bit ISP pipeline
  • 3M 2048x1536 input RAW image
  • Supported output resolutions at 30 fps:
    • 1920x1080 (16:9 cropped, no downscaling)
    • 640x480 (4:3 downscaled from 1920x1080)
    • 640x360 (16:9 downscaled from 1920x1080)
    • 1920x1440 (4:3 cropped, no downscaling)
    • 960x720 (4:3 downscaled from 1920x1440)
    • 640x480 (4:3 downscaled from 1920x1440)
  • 30 fps frame rate supported
  • RGB output from ISP configured
  • HDMI video output support for 1080p resolution
  • External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
  • External video visualization scripts provided (video_creation.py)
  • 2A Algorithms (AE, AWB) supported in this release
  • By default, the ISP is tuned for indoor applications
  • Serial terminal based Infinite-ISP configuration menu added in this version, the menu provides support for:
    • ISP Parameter Configuration
    • Sensor Analog Gain, Digital Gain & Exposure Control
    • Sensor RAW & ISPout Burst Capture Pairs with programmable post-trigger delay
    • Fully configurable downscaled output stream with both 16:9 and 4:3 aspect ratios
  • User guide for Infinite ISP configuration menu can be found at link

Infinite-ISP Features (Infinite-ISP_v1.4-OV5647.bin):

  • 10-bit ISP pipeline
  • 5M 2592x1944 input RAW image
  • Supported output resolutions at 15 fps:
    • 1920x1080 (16:9 cropped, no downscaling)
    • 640x480 (4:3 downscaled from 1920x1080)
    • 640x360 (16:9 downscaled from 1920x1080)
    • 1920x1440 (4:3 cropped, no downscaling)
    • 960x720 (4:3 downscaled from 1920x1440)
    • 640x480 (4:3 downscaled from 1920x1440)
  • 15 fps frame rate supported (as sourced by image sensor)
  • YUV output (YUV444) from ISP configured
  • HDMI video output support for 1080p resolution
  • External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
  • External video visualization scripts provided (video_creation.py)
  • 2A Algorithms (AE, AWB) supported in this version
  • By default, the ISP is tuned for indoor applications
  • Serial terminal based Infinite-ISP configuration menu added in this version, the menu provides support for:
    • ISP Parameter Configuration; DPC, BLC, CCM CSC, IRC and SCALE
    • Sensor Analog Gain, Digital Gain & Exposure Control
    • Sensor RAW & ISPout Burst Capture Pairs with programmable post-trigger delay
    • Fully configurable downscaled output stream with both 16:9 and 4:3 aspect ratios
  • User guide for Infinite ISP configuration menu can be found at link
Scripts Description
sensor_bin_to_sensor_raw.py converts the image sensor memory dump (.bin) data from the FPGA Platform to Bayer RAW frame (.raw) containing valid pixel data.
isp_output_bin_to_isp_output_png.py converts the ISP output memory dump (.bin) data from the FPGA Platform to output image frame (.png) as well as output pixel data frame (.bin) for verification.
sensor_bin_to_sensor_raw_burst_capture.py converts the image sensor memory dumps (.bin) of RAW Burst Capture from the FPGA Platform to Bayer RAW frames (.raw) containing valid pixel data. It also converts the Bayer RAW frames to equivalent grayscale .png for visualization.
video_creation.py converts multiple ISP output memory dumps (.bin) from the FPGA Platform to corresponding output image frames (.png) and stitches them together into a .mp4 video.

For ISP tuning, features and further information, please open a GitHub Issue or Contact: [email protected]

Assets 2
Loading