Add CUDA option to use the max release threshold for the default memory pool#5429

Draft

YavorGIvanov wants to merge 1 commit intoggerganov:masterfrom YavorGIvanov:cuda-backend/memory-pool-max-release-threshold

+26-3

Commits on Feb 9, 2024

Add CUDA option to use the memory pool max release threshold
YavorGIvanov
committed