[ENHANCEMENT] More descriptive get_loaded_models
endpoint
#635
Labels
enhancement
New feature or request
get_loaded_models
endpoint
#635
Is your feature request related to a problem? Please describe.
Currently,
get_loaded_models
returnsmodel_device
andmodel_name
, which is based on the alias given asmodel
in index defaults by a user. This is good when the model is in the registry, as themodel
alias usually matches themodel_properties["name"]
, however this isn't always the case. Especially when users use custom models, it may be worth it to return more information inget_loaded_models
.For example, if an index is defined with:
Currently
get_loaded_models
will only give you:Describe the solution you'd like
We should return other valuable info about the model, including:
memory size
model_properties["name"]
, as it's usually more useful than justmodel
The text was updated successfully, but these errors were encountered: