Skip to content

Infinite-ISP v1.1

Compare
Choose a tag to compare
@taimur-10xe taimur-10xe released this 27 Nov 15:23
· 13 commits to main since this release
0de929f

Infinite-ISP FPGA Release v1.1 for Kria KV260 Vision AI Starter Kit

Image Sensor support:

AR1335 IAS module

  • included in Xilinx Kria KV260 Accessory Pack)
  • AR1335 IAS module to be attached to Kria KV260 IAS1 port

OV5647 image sensor module

  • OV5647 image sensor module to be attached to Kria KV260 RPi port (15-pin Raspberry Pi CSI-2 connector)
  • can use Raspberry Pi Camera Module Rev 1.3

Infinite-ISP Features (Infinite-ISP_v1.1-AR1335-1080p.bin):

  • 10-bit ISP pipeline
  • 3M 2048x1536 input RAW image
  • 2M 1920x1080 output RGB image (16:9 cropped image, no downscaling), 4:3 output image not supported in this version
  • 30 fps frame rate supported
  • RGB output from ISP configured
  • 1080p HDMI video output
  • Single RAW-ISPout image pair dumped in SD card for external image visualization
  • Burst Capture RAW: 250 consecutive RAW images dumped in SD card
  • External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
  • 2A Algorithms (AE, AWB) supported in this version
  • ISP tuned for indoor applications

Infinite-ISP Features (Infinite-ISP_v1.1-OV5647-1080p.bin):

  • 10-bit ISP pipeline
  • 5M 2592x1944 input RAW image
  • 1920x1080 output YUV image (16:9 cropped image, no downscaling), 4:3 output image not supported in this version
  • 15 fps frame rate supported(as sourced by image sensor)
  • YUV output (YUV444) from ISP configured
  • ISP output available as 1080p HDMI video output
  • Single RAW-ISPout image pair dumped in SD card for external image visualization
  • Burst Capture ISPout: 250 consecutive YUV images (ISP output) dumped in SD card
  • External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
  • External video visualization scripts provided (video_creation.py)
  • 2A Algorithms (AE, AWB) supported in this version
  • ISP tuned for indoor applications
Scripts Description
sensor_bin_to_sensor_raw.py converts the image sensor memory dump (.bin) data from the FPGA Platform to Bayer RAW frame (.raw) containing valid pixel data.
isp_output_bin_to_isp_output_png.py converts the ISP output memory dump (.bin) data from the FPGA Platform to output image frame (.png) as well as output pixel data frame (.bin) for verification.
sensor_bin_to_sensor_raw_burst_capture.py converts the image sensor memory dumps (.bin) of RAW Burst Capture from the FPGA Platform to Bayer RAW frames (.raw) containing valid pixel data. It also converts the Bayer RAW frames to equivalent grayscale .png for visualization.
video_creation.py converts multiple ISP output memory dumps (.bin) from the FPGA Platform to corresponding output image frames (.png) and stitches them together into a .mp4 video.

For ISP tuning, features and further information, please open a GitHub Issue or Contact: [email protected]