[Question] Does HugeCTR support all P-series GPUs? and does it support tfserving as inference?

[Shu-HowTing]

Does HugeCTR support all P-series GPUs? and does it support tfserving as inference?

[yingcanw]

Thanks for your question. The computing compatibility of the data center product supported by HugeCTR can be found here (CC>=6.0).

The native models trained with HugeCTR cannot be deployed directly through tfs. For the trained embedding table, it can be deployed on the tf-related inference platform through the customized HPS plug-in for TensorFlow.

[minseokl]

Hi @Shu-HowTing even if the HugeCTR supports CC>=6.0 for now, please note that we will deprecate their support in a future release.