Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SearchQnA App - Adding files to deploy SearchQnA application on AMD GPU #1193

Open
wants to merge 9 commits into
base: main
Choose a base branch
from

Conversation

chyundunovDatamonsters
Copy link
Contributor

Description

Adding files to deploy SearchQnA application on AMD GPU.
Added files:

SearchQnA/docker_compose/amd/gpu/rocm/compose.yaml - Docker compose file for deploy application SearchQnA on AMD GPU
SearchQnA/docker_compose/amd/gpu/rocm/set_env.sh - script for set environments
SearchQnA/docker_compose/amd/gpu/rocm/README.md - readme file for deploying SearchQnA on AMD GPU
SearchQnA/tests/test_compose_on_rocm.sh - script for testing SearchQnA application services on AMD GPU

Issues

It is required to provide the ability to deploy the SearchQnA application based on AMD GPU

Type of change

  • [*] New feature (non-breaking change which adds new functionality)

Dependencies

Tests

Testing was performed manually and by running a script SearchQnA/tests/test_compose_on_rocm.sh This script is similar to the script that runs SearchQnA testing on an Intel CPU.

Chingis Yundunov added 8 commits November 26, 2024 23:52
Signed-off-by: Chingis Yundunov <[email protected]>
@joshuayao joshuayao added this to the v1.2 milestone Dec 3, 2024
@joshuayao joshuayao linked an issue Dec 3, 2024 that may be closed by this pull request
5 tasks
Copy link
Collaborator

@letonghan letonghan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @chyundunovDatamonsters, please check the comments here and modify this pr as well. Thanks.

ports:
- "3001:80"
volumes:
- "/var/lib/GenAI/search/data:/data"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The volume here should be './data' by default, since we don't offer default data folder.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Feature] Examples on AMD ROCm for OPEA v1.2
4 participants