Add model TFServing deployment example

[piotrlaczkowski]

Hi There!

It would be a great help if you could provide an example (docs or notebook) of how to deploy this kind of model (step by step) using TFServing (on AWS Sagemaker or similar). I guess we will need some custom pre and post-processing functions to be set up in order to make it work with .i.e. Sagemaker Endpoints?

THNX!

[giranntu]

Would be great to have the model containerized and using the kfserving/ tfserving/ TRITON ..etc serving framework to run on GCP Vertex AI model deploy :)

[piotrlaczkowski]

I am really looking for a way to deploy a saved similarity model using TFServing itself. The way to do it is not clear since we need a custom object + index loading when loading method for inference. Anyone can help ?