update codetrans model

Signed-off-by: Xinyao Wang <[email protected]>
opea-project · Oct 23, 2024 · b8389dc · b8389dc
1 parent a3f9811
commit b8389dc
Show file tree

Hide file tree

Showing 11 changed files with 11 additions and 11 deletions.
diff --git a/CodeTrans/README.md b/CodeTrans/README.md
@@ -28,7 +28,7 @@ By default, the LLM model is set to a default value as listed below:
 
 | Service | Model                         |
 | ------- | ----------------------------- |
-| LLM     | HuggingFaceH4/mistral-7b-grok |
+| LLM     | mistralai/Mistral-7B-Instruct-v0.3 |
 
 Change the `LLM_MODEL_ID` in `docker_compose/set_env.sh` for your needs.
 

diff --git a/CodeTrans/docker_compose/intel/cpu/xeon/README.md b/CodeTrans/docker_compose/intel/cpu/xeon/README.md
@@ -59,7 +59,7 @@ By default, the LLM model is set to a default value as listed below:
 
 | Service | Model                         |
 | ------- | ----------------------------- |
-| LLM     | HuggingFaceH4/mistral-7b-grok |
+| LLM     | mistralai/Mistral-7B-Instruct-v0.3 |
 
 Change the `LLM_MODEL_ID` below for your needs.
 

diff --git a/CodeTrans/docker_compose/intel/hpu/gaudi/README.md b/CodeTrans/docker_compose/intel/hpu/gaudi/README.md
@@ -51,7 +51,7 @@ By default, the LLM model is set to a default value as listed below:
 
 | Service | Model                         |
 | ------- | ----------------------------- |
-| LLM     | HuggingFaceH4/mistral-7b-grok |
+| LLM     | mistralai/Mistral-7B-Instruct-v0.3 |
 
 Change the `LLM_MODEL_ID` below for your needs.
 

diff --git a/CodeTrans/docker_compose/set_env.sh b/CodeTrans/docker_compose/set_env.sh
@@ -4,7 +4,7 @@
 # SPDX-License-Identifier: Apache-2.0
 
 
-export LLM_MODEL_ID="HuggingFaceH4/mistral-7b-grok"
+export LLM_MODEL_ID="mistralai/Mistral-7B-Instruct-v0.3"
 export TGI_LLM_ENDPOINT="http://${host_ip}:8008"
 export MEGA_SERVICE_HOST_IP=${host_ip}
 export LLM_SERVICE_HOST_IP=${host_ip}

diff --git a/CodeTrans/kubernetes/intel/README.md b/CodeTrans/kubernetes/intel/README.md
@@ -14,7 +14,7 @@ By default, the LLM model is set to a default value as listed below:
 
 |Service  |Model                    |
 |---------|-------------------------|
-|LLM      |HuggingFaceH4/mistral-7b-grok|
+|LLM      |mistralai/Mistral-7B-Instruct-v0.3|
 
 Change the `MODEL_ID` in `codetrans.yaml` for your needs.
 

diff --git a/CodeTrans/kubernetes/intel/README_gmc.md b/CodeTrans/kubernetes/intel/README_gmc.md
@@ -13,7 +13,7 @@ By default, the LLM model is set to a default value as listed below:
 
 |Service  |Model                    |
 |---------|-------------------------|
-|LLM      |HuggingFaceH4/mistral-7b-grok|
+|LLM      |mistralai/Mistral-7B-Instruct-v0.3|
 
 Change the `MODEL_ID` in `codetrans_xeon.yaml` for your needs.
 

diff --git a/CodeTrans/kubernetes/intel/cpu/xeon/gmc/codetrans_xeon.yaml b/CodeTrans/kubernetes/intel/cpu/xeon/gmc/codetrans_xeon.yaml
@@ -29,6 +29,6 @@ spec:
         internalService:
           serviceName: tgi-service
           config:
-            MODEL_ID: HuggingFaceH4/mistral-7b-grok
+            MODEL_ID: mistralai/Mistral-7B-Instruct-v0.3
             endpoint: /generate
           isDownstreamService: true
diff --git a/CodeTrans/kubernetes/intel/cpu/xeon/manifest/codetrans.yaml b/CodeTrans/kubernetes/intel/cpu/xeon/manifest/codetrans.yaml
@@ -64,7 +64,7 @@ metadata:
     app.kubernetes.io/version: "2.1.0"
     app.kubernetes.io/managed-by: Helm
 data:
-  MODEL_ID: "HuggingFaceH4/mistral-7b-grok"
+  MODEL_ID: "mistralai/Mistral-7B-Instruct-v0.3"
   PORT: "2080"
   HF_TOKEN: "insert-your-huggingface-token-here"
   http_proxy: ""

diff --git a/CodeTrans/kubernetes/intel/hpu/gaudi/gmc/codetrans_gaudi.yaml b/CodeTrans/kubernetes/intel/hpu/gaudi/gmc/codetrans_gaudi.yaml
@@ -29,6 +29,6 @@ spec:
         internalService:
           serviceName: tgi-gaudi-svc
           config:
-            MODEL_ID: HuggingFaceH4/mistral-7b-grok
+            MODEL_ID: mistralai/Mistral-7B-Instruct-v0.3
             endpoint: /generate
           isDownstreamService: true
diff --git a/CodeTrans/kubernetes/intel/hpu/gaudi/manifest/codetrans.yaml b/CodeTrans/kubernetes/intel/hpu/gaudi/manifest/codetrans.yaml
@@ -64,7 +64,7 @@ metadata:
     app.kubernetes.io/version: "2.1.0"
     app.kubernetes.io/managed-by: Helm
 data:
-  MODEL_ID: "HuggingFaceH4/mistral-7b-grok"
+  MODEL_ID: "mistralai/Mistral-7B-Instruct-v0.3"
   PORT: "2080"
   HF_TOKEN: "insert-your-huggingface-token-here"
   http_proxy: ""

diff --git a/supported_examples.md b/supported_examples.md
@@ -73,7 +73,7 @@ This document introduces the supported examples of GenAIExamples. The supported
 
 | Framework                                                                      | LLM                                                                                   | Serving                                                         | HW          | Description      |
 | ------------------------------------------------------------------------------ | ------------------------------------------------------------------------------------- | --------------------------------------------------------------- | ----------- | ---------------- |
-| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [HuggingFaceH4/mistral-7b-grok](https://huggingface.co/HuggingFaceH4/mistral-7b-grok) | [TGI](https://github.com/huggingface/text-generation-inference) | Xeon/Gaudi2 | Code Translation |
+| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [mistralai/Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3) | [TGI](https://github.com/huggingface/text-generation-inference) | Xeon/Gaudi2 | Code Translation |
 
 ### DocSum