TFlite: GPU delegate: ability to limit amount of GPU memory used by TFlite?

[andy-tai]

Tensorflow can impose a limit on the amount of memory used by Tensorflow on a GPU:

tf.config.LogicalDeviceConfiguration(memory_limit=1024)]

Is it possible to have similar functionality for TFlite on GPU?

Thanks

[pkgoogle]

Hi @andy-tai,

Thanks for raising this issue. Are you aware of the migration to LiteRT? This transition is aimed at enhancing our project's capabilities and providing improved support and focus for our users. As we believe this issue is still relevant to LiteRT we are moving your issue there. Please follow progress here.

Let us know if you have any questions. Thanks.