Releases: 10x-Engineers/Infinite-ISP_FPGABinaries
Releases · 10x-Engineers/Infinite-ISP_FPGABinaries
Infinite-ISP v1.4
Infinite-ISP FPGA Release v1.4 for Kria KV260 Vision AI Starter Kit
What's New
- Added Sharpening block that enhance edges and produce sharp and crisp images.
Image Sensor support:
IMX219 image sensor module
- IMX219 image sensor module to be attached to Kria KV260 RPi port (15-pin Raspberry Pi CSI-2 connector)
- can use Raspberry Pi Camera Module Rev 2.x
AR1335 IAS module
- included in Xilinx Kria KV260 Accessory Pack)
- AR1335 IAS module to be attached to Kria KV260 IAS1 port
OV5647 image sensor module
- OV5647 image sensor module to be attached to Kria KV260 RPi port (15-pin Raspberry Pi CSI-2 connector)
- can use Raspberry Pi Camera Module Rev 1.3
Infinite-ISP Features (Infinite-ISP_v1.4-IMX219.bin):
- 10-bit ISP pipeline
- 5M 2592x1944 input RAW image
- Supported output resolutions at 20 fps:
- 1920x1080 (16:9 cropped, no downscaling)
- 640x480 (4:3 downscaled from 1920x1080)
- 640x360 (16:9 downscaled from 1920x1080)
- 1920x1440 (4:3 cropped, no downscaling)
- 960x720 (4:3 downscaled from 1920x1440)
- 640x480 (4:3 downscaled from 1920x1440)
- 20 fps frame rate supported (as sourced by image sensor)
- YUV output (YUV444) from ISP configured
- HDMI video output support for 1080p resolution
- External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
- External video visualization scripts provided (video_creation.py)
- 2A Algorithms (AE, AWB) supported in this version
- By default, the ISP is tuned for indoor applications
- Serial terminal based Infinite-ISP configuration menu added in this version, the menu provides support for:
- ISP Parameter Configuration; DPC, BLC, CCM CSC, IRC and SCALE
- Sensor Analog Gain, Digital Gain & Exposure Control
- Sensor RAW & ISPout Burst Capture Pairs with programmable post-trigger delay
- Fully configurable downscaled output stream with both 16:9 and 4:3 aspect ratios
- User guide for Infinite ISP configuration menu can be found at link
Infinite-ISP Features (Infinite-ISP_v1.4-AR1335.bin):
- 10-bit ISP pipeline
- 3M 2048x1536 input RAW image
- Supported output resolutions at 30 fps:
- 1920x1080 (16:9 cropped, no downscaling)
- 640x480 (4:3 downscaled from 1920x1080)
- 640x360 (16:9 downscaled from 1920x1080)
- 1920x1440 (4:3 cropped, no downscaling)
- 960x720 (4:3 downscaled from 1920x1440)
- 640x480 (4:3 downscaled from 1920x1440)
- 30 fps frame rate supported
- RGB output from ISP configured
- HDMI video output support for 1080p resolution
- External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
- External video visualization scripts provided (video_creation.py)
- 2A Algorithms (AE, AWB) supported in this release
- By default, the ISP is tuned for indoor applications
- Serial terminal based Infinite-ISP configuration menu added in this version, the menu provides support for:
- ISP Parameter Configuration
- Sensor Analog Gain, Digital Gain & Exposure Control
- Sensor RAW & ISPout Burst Capture Pairs with programmable post-trigger delay
- Fully configurable downscaled output stream with both 16:9 and 4:3 aspect ratios
- User guide for Infinite ISP configuration menu can be found at link
Infinite-ISP Features (Infinite-ISP_v1.4-OV5647.bin):
- 10-bit ISP pipeline
- 5M 2592x1944 input RAW image
- Supported output resolutions at 15 fps:
- 1920x1080 (16:9 cropped, no downscaling)
- 640x480 (4:3 downscaled from 1920x1080)
- 640x360 (16:9 downscaled from 1920x1080)
- 1920x1440 (4:3 cropped, no downscaling)
- 960x720 (4:3 downscaled from 1920x1440)
- 640x480 (4:3 downscaled from 1920x1440)
- 15 fps frame rate supported (as sourced by image sensor)
- YUV output (YUV444) from ISP configured
- HDMI video output support for 1080p resolution
- External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
- External video visualization scripts provided (video_creation.py)
- 2A Algorithms (AE, AWB) supported in this version
- By default, the ISP is tuned for indoor applications
- Serial terminal based Infinite-ISP configuration menu added in this version, the menu provides support for:
- ISP Parameter Configuration; DPC, BLC, CCM CSC, IRC and SCALE
- Sensor Analog Gain, Digital Gain & Exposure Control
- Sensor RAW & ISPout Burst Capture Pairs with programmable post-trigger delay
- Fully configurable downscaled output stream with both 16:9 and 4:3 aspect ratios
- User guide for Infinite ISP configuration menu can be found at link
| Scripts | Description |
|---|---|
| sensor_bin_to_sensor_raw.py | converts the image sensor memory dump (.bin) data from the FPGA Platform to Bayer RAW frame (.raw) containing valid pixel data. |
| isp_output_bin_to_isp_output_png.py | converts the ISP output memory dump (.bin) data from the FPGA Platform to output image frame (.png) as well as output pixel data frame (.bin) for verification. |
| sensor_bin_to_sensor_raw_burst_capture.py | converts the image sensor memory dumps (.bin) of RAW Burst Capture from the FPGA Platform to Bayer RAW frames (.raw) containing valid pixel data. It also converts the Bayer RAW frames to equivalent grayscale .png for visualization. |
| video_creation.py | converts multiple ISP output memory dumps (.bin) from the FPGA Platform to corresponding output image frames (.png) and stitches them together into a .mp4 video. |
For ISP tuning, features and further information, please open a GitHub Issue or Contact: [email protected]
v1.3 (CVPR2024 demo)
Infinite-ISP FPGA Release v1.3 (CVPR2024 demo) for Kria KV260 Vision AI Starter Kit
What's New
- New Sensor Support: IMX219 (Raspberry Pi Camera Module v2)
- Added OSD with logo overlay, position can be changed on runtime via user interface
- Enhanced ISP Configuration Menu for user control of almost entire ISP pipeline blocks at run-time
Image Sensor support:
IMX219 image sensor module
- IMX219 image sensor module to be attached to Kria KV260 RPi port (15-pin Raspberry Pi CSI-2 connector)
- can use Raspberry Pi Camera Module Rev 2.x
AR1335 IAS module
- included in Xilinx Kria KV260 Accessory Pack)
- AR1335 IAS module to be attached to Kria KV260 IAS1 port
OV5647 image sensor module
- OV5647 image sensor module to be attached to Kria KV260 RPi port (15-pin Raspberry Pi CSI-2 connector)
- can use Raspberry Pi Camera Module Rev 1.3
Infinite-ISP Features (Infinite-ISP_v1.3-IMX219.bin):
- 10-bit ISP pipeline
- 5M 2592x1944 input RAW image
- Supported output resolutions at 20 fps:
- 1920x1080 (16:9 cropped, no downscaling)
- 640x480 (4:3 downscaled from 1920x1080)
- 640x360 (16:9 downscaled from 1920x1080)
- 1920x1440 (4:3 cropped, no downscaling)
- 960x720 (4:3 downscaled from 1920x1440)
- 640x480 (4:3 downscaled from 1920x1440)
- 20 fps frame rate supported (as sourced by image sensor)
- YUV output (YUV444) from ISP configured
- HDMI video output support for 1080p resolution
- External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
- External video visualization scripts provided (video_creation.py)
- 2A Algorithms (AE, AWB) supported in this version
- By default, the ISP is tuned for indoor applications
- Serial terminal based Infinite-ISP configuration menu added in this version, the menu provides support for:
- ISP Parameter Configuration; DPC, BLC, CCM CSC, IRC and SCALE
- Sensor Analog Gain, Digital Gain & Exposure Control
- Sensor RAW & ISPout Burst Capture Pairs with programmable post-trigger delay
- Fully configurable downscaled output stream with both 16:9 and 4:3 aspect ratios
- User guide for Infinite ISP configuration menu can be found at link
Infinite-ISP Features (Infinite-ISP_v1.3-AR1335.bin):
- 10-bit ISP pipeline
- 3M 2048x1536 input RAW image
- Supported output resolutions at 30 fps:
- 1920x1080 (16:9 cropped, no downscaling)
- 640x480 (4:3 downscaled from 1920x1080)
- 640x360 (16:9 downscaled from 1920x1080)
- 1920x1440 (4:3 cropped, no downscaling)
- 960x720 (4:3 downscaled from 1920x1440)
- 640x480 (4:3 downscaled from 1920x1440)
- 30 fps frame rate supported
- RGB output from ISP configured
- HDMI video output support for 1080p resolution
- External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
- External video visualization scripts provided (video_creation.py)
- 2A Algorithms (AE, AWB) supported in this release
- By default, the ISP is tuned for indoor applications
- Serial terminal based Infinite-ISP configuration menu added in this version, the menu provides support for:
- ISP Parameter Configuration
- Sensor Analog Gain, Digital Gain & Exposure Control
- Sensor RAW & ISPout Burst Capture Pairs with programmable post-trigger delay
- Fully configurable downscaled output stream with both 16:9 and 4:3 aspect ratios
- User guide for Infinite ISP configuration menu can be found at link
Infinite-ISP Features (Infinite-ISP_v1.3-OV5647.bin):
- 10-bit ISP pipeline
- 5M 2592x1944 input RAW image
- Supported output resolutions at 15 fps:
- 1920x1080 (16:9 cropped, no downscaling)
- 640x480 (4:3 downscaled from 1920x1080)
- 640x360 (16:9 downscaled from 1920x1080)
- 1920x1440 (4:3 cropped, no downscaling)
- 960x720 (4:3 downscaled from 1920x1440)
- 640x480 (4:3 downscaled from 1920x1440)
- 15 fps frame rate supported (as sourced by image sensor)
- YUV output (YUV444) from ISP configured
- HDMI video output support for 1080p resolution
- External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
- External video visualization scripts provided (video_creation.py)
- 2A Algorithms (AE, AWB) supported in this version
- By default, the ISP is tuned for indoor applications
- Serial terminal based Infinite-ISP configuration menu added in this version, the menu provides support for:
- ISP Parameter Configuration; DPC, BLC, CCM CSC, IRC and SCALE
- Sensor Analog Gain, Digital Gain & Exposure Control
- Sensor RAW & ISPout Burst Capture Pairs with programmable post-trigger delay
- Fully configurable downscaled output stream with both 16:9 and 4:3 aspect ratios
- User guide for Infinite ISP configuration menu can be found at link
| Scripts | Description |
|---|---|
| sensor_bin_to_sensor_raw.py | converts the image sensor memory dump (.bin) data from the FPGA Platform to Bayer RAW frame (.raw) containing valid pixel data. |
| isp_output_bin_to_isp_output_png.py | converts the ISP output memory dump (.bin) data from the FPGA Platform to output image frame (.png) as well as output pixel data frame (.bin) for verification. |
| sensor_bin_to_sensor_raw_burst_capture.py | converts the image sensor memory dumps (.bin) of RAW Burst Capture from the FPGA Platform to Bayer RAW frames (.raw) containing valid pixel data. It also converts the Bayer RAW frames to equivalent grayscale .png for visualization. |
| video_creation.py | converts multiple ISP output memory dumps (.bin) from the FPGA Platform to corresponding output image frames (.png) and stitches them together into a .mp4 video. |
For ISP tuning, features and further information, please open a GitHub Issue or Contact: [email protected]
Infinite-ISP v1.2
Infinite-ISP FPGA Release v1.2 for Kria KV260 Vision AI Starter Kit
Image Sensor support:
AR1335 IAS module
- included in Xilinx Kria KV260 Accessory Pack)
- AR1335 IAS module to be attached to Kria KV260 IAS1 port
OV5647 image sensor module
- OV5647 image sensor module to be attached to Kria KV260 RPi port (15-pin Raspberry Pi CSI-2 connector)
- can use Raspberry Pi Camera Module Rev 1.3
Infinite-ISP Features (Infinite-ISP_v1.2-AR1335.bin):
- 10-bit ISP pipeline
- 3M 2048x1536 input RAW image
- Supported output resolutions at 30 fps:
- 1920x1080 (16:9 cropped, no downscaling)
- 640x480 (4:3 downscaled from 1920x1080)
- 640x360 (16:9 downscaled from 1920x1080)
- 1920x1440 (4:3 cropped, no downscaling)
- 960x720 (4:3 downscaled from 1920x1440)
- 640x480 (4:3 downscaled from 1920x1440)
- 30 fps frame rate supported
- RGB output from ISP configured
- HDMI video output support for 1080p resolution
- External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
- External video visualization scripts provided (video_creation.py)
- 2A Algorithms (AE, AWB) supported in this release
- By default, the ISP is tuned for indoor applications
- Serial terminal based Infinite-ISP configuration menu added in this version, the menu provides support for:
- ISP Parameter Configuration; DPC, BLC, CCM CSC, IRC and SCALE
- Sensor Analog Gain, Digital Gain & Exposure Control
- Sensor RAW & ISPout Burst Capture Pairs with programmable post-trigger delay
- Fully configurable downscaled output stream with both 16:9 and 4:3 aspect ratios
- User guide for Infinite ISP configuration menu can be found at link
Infinite-ISP Features (Infinite-ISP_v1.2-OV5647.bin):
- 10-bit ISP pipeline
- 5M 2592x1944 input RAW image
- Supported output resolutions at 30 fps:
- 1920x1080 (16:9 cropped, no downscaling)
- 640x480 (4:3 downscaled from 1920x1080)
- 640x360 (16:9 downscaled from 1920x1080)
- 1920x1440 (4:3 cropped, no downscaling)
- 960x720 (4:3 downscaled from 1920x1440)
- 640x480 (4:3 downscaled from 1920x1440)
- 15 fps frame rate supported (as sourced by image sensor)
- YUV output (YUV444) from ISP configured
- HDMI video output support for 1080p resolution
- External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
- External video visualization scripts provided (video_creation.py)
- 2A Algorithms (AE, AWB) supported in this version
- By default, the ISP is tuned for indoor applications
- Serial terminal based Infinite-ISP configuration menu added in this version, the menu provides support for:
- ISP Parameter Configuration; DPC, BLC, CCM CSC, IRC and SCALE
- Sensor Analog Gain, Digital Gain & Exposure Control
- Sensor RAW & ISPout Burst Capture Pairs with programmable post-trigger delay
- Fully configurable downscaled output stream with both 16:9 and 4:3 aspect ratios
- User guide for Infinite ISP configuration menu can be found at link
| Scripts | Description |
|---|---|
| sensor_bin_to_sensor_raw.py | converts the image sensor memory dump (.bin) data from the FPGA Platform to Bayer RAW frame (.raw) containing valid pixel data. |
| isp_output_bin_to_isp_output_png.py | converts the ISP output memory dump (.bin) data from the FPGA Platform to output image frame (.png) as well as output pixel data frame (.bin) for verification. |
| sensor_bin_to_sensor_raw_burst_capture.py | converts the image sensor memory dumps (.bin) of RAW Burst Capture from the FPGA Platform to Bayer RAW frames (.raw) containing valid pixel data. It also converts the Bayer RAW frames to equivalent grayscale .png for visualization. |
| video_creation.py | converts multiple ISP output memory dumps (.bin) from the FPGA Platform to corresponding output image frames (.png) and stitches them together into a .mp4 video. |
For ISP tuning, features and further information, please open a GitHub Issue or Contact: [email protected]
Infinite-ISP v1.1
Infinite-ISP FPGA Release v1.1 for Kria KV260 Vision AI Starter Kit
Image Sensor support:
AR1335 IAS module
- included in Xilinx Kria KV260 Accessory Pack)
- AR1335 IAS module to be attached to Kria KV260 IAS1 port
OV5647 image sensor module
- OV5647 image sensor module to be attached to Kria KV260 RPi port (15-pin Raspberry Pi CSI-2 connector)
- can use Raspberry Pi Camera Module Rev 1.3
Infinite-ISP Features (Infinite-ISP_v1.1-AR1335-1080p.bin):
- 10-bit ISP pipeline
- 3M 2048x1536 input RAW image
- 2M 1920x1080 output RGB image (16:9 cropped image, no downscaling), 4:3 output image not supported in this version
- 30 fps frame rate supported
- RGB output from ISP configured
- 1080p HDMI video output
- Single RAW-ISPout image pair dumped in SD card for external image visualization
- Burst Capture RAW: 250 consecutive RAW images dumped in SD card
- External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
- 2A Algorithms (AE, AWB) supported in this version
- ISP tuned for indoor applications
Infinite-ISP Features (Infinite-ISP_v1.1-OV5647-1080p.bin):
- 10-bit ISP pipeline
- 5M 2592x1944 input RAW image
- 1920x1080 output YUV image (16:9 cropped image, no downscaling), 4:3 output image not supported in this version
- 15 fps frame rate supported(as sourced by image sensor)
- YUV output (YUV444) from ISP configured
- ISP output available as 1080p HDMI video output
- Single RAW-ISPout image pair dumped in SD card for external image visualization
- Burst Capture ISPout: 250 consecutive YUV images (ISP output) dumped in SD card
- External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
- External video visualization scripts provided (video_creation.py)
- 2A Algorithms (AE, AWB) supported in this version
- ISP tuned for indoor applications
| Scripts | Description |
|---|---|
| sensor_bin_to_sensor_raw.py | converts the image sensor memory dump (.bin) data from the FPGA Platform to Bayer RAW frame (.raw) containing valid pixel data. |
| isp_output_bin_to_isp_output_png.py | converts the ISP output memory dump (.bin) data from the FPGA Platform to output image frame (.png) as well as output pixel data frame (.bin) for verification. |
| sensor_bin_to_sensor_raw_burst_capture.py | converts the image sensor memory dumps (.bin) of RAW Burst Capture from the FPGA Platform to Bayer RAW frames (.raw) containing valid pixel data. It also converts the Bayer RAW frames to equivalent grayscale .png for visualization. |
| video_creation.py | converts multiple ISP output memory dumps (.bin) from the FPGA Platform to corresponding output image frames (.png) and stitches them together into a .mp4 video. |
For ISP tuning, features and further information, please open a GitHub Issue or Contact: [email protected]
Infinite-ISP v1.0
Infinite-ISP v1.0 FPGA Release for Kria KV260 Vision AI Starter Kit
Image Sensor support:
- AR1335 IAS module (included in Xilinx Kria KV260 Accessory Pack)
- AR1335 IAS module to be attached to Kria KV260 IAS1 port
Infinite-ISP Features (Infinite-ISP_v1.0-1080p.bin):
- 10-bit ISP pipeline
- 3M 2048x1536 input RAW image
- 2M 1920x1080 output RGB image (16:9 cropped image, no downscaling), 4:3 output image not supported in this version
- 30 fps frame rate supported
- RGB output only, YUV not supported in this version
- 1080p HDMI video output
- Single RAW-RGB image pair dumped in SD card for external image visualization
- 300 consecutive RGB images dumped in SD card for external video visualization
- External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
- External video visualization script provided (video_creation.ipynb)
- 2A Algorithms (AE, AWB) supported in this version
- ISP tuned for indoor applications
Infinite-ISP Features (Infinite-ISP_v1.0-360p.bin):
- 10-bit ISP pipeline
- 3M 2048x1536 input RAW image
- 640x360 output RGB image (cropped & downscaled image)
- 30 fps frame rate supported
- RGB output only, YUV not supported in this version
- HDMI video output not supported in this version
- Single RAW-RGB image pair dumped in SD card for external image visualization
- External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
- 2A Algorithms (AE, AWB) supported in this version
- ISP tuned for indoor applications
For ISP tuning, features and further information, please open a Github Issue or Contact: [email protected]