Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

musa: add docker image support #9685

Merged
merged 2 commits into from
Oct 10, 2024
Merged

musa: add docker image support #9685

merged 2 commits into from
Oct 10, 2024

Conversation

yeahdongcn
Copy link
Contributor

@yeahdongcn yeahdongcn commented Sep 29, 2024

This PR introduces Dockerfiles for musa, allowing the build of 3 Docker images: local/llama.cpp:full-musa, local/llama.cpp:light-musa, and local/llama.cpp:server-musa.

Testing done

  • Successfully built musa images.
  • Verified each Docker image runs with mt-container-toolkit and Llama 3.2 1B Instruct.

Logs

server-musa.log
light-musa.log
full-musa.log

@github-actions github-actions bot added documentation Improvements or additions to documentation devops improvements to build systems and github actions labels Sep 29, 2024
@yeahdongcn yeahdongcn changed the title mtgpu: support docker musa: add docker image support Sep 30, 2024
@yeahdongcn yeahdongcn marked this pull request as ready for review September 30, 2024 01:02
docs/docker.md Show resolved Hide resolved
@yeahdongcn yeahdongcn marked this pull request as draft September 30, 2024 03:25
@yeahdongcn yeahdongcn force-pushed the docker branch 3 times, most recently from e1d085f to c4f906c Compare October 8, 2024 01:44
@yeahdongcn yeahdongcn marked this pull request as ready for review October 8, 2024 01:47
@yeahdongcn
Copy link
Contributor Author

Everything is set now. @slaren, could you please take a look? Thanks!

@yeahdongcn yeahdongcn requested a review from slaren October 10, 2024 07:30
@slaren slaren merged commit cf8e0a3 into ggerganov:master Oct 10, 2024
53 checks passed
dsx1986 pushed a commit to dsx1986/llama.cpp that referenced this pull request Oct 29, 2024
* mtgpu: add docker image support

Signed-off-by: Xiaodong Ye <[email protected]>

* mtgpu: enable docker workflow

Signed-off-by: Xiaodong Ye <[email protected]>

---------

Signed-off-by: Xiaodong Ye <[email protected]>
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Nov 15, 2024
* mtgpu: add docker image support

Signed-off-by: Xiaodong Ye <[email protected]>

* mtgpu: enable docker workflow

Signed-off-by: Xiaodong Ye <[email protected]>

---------

Signed-off-by: Xiaodong Ye <[email protected]>
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Nov 18, 2024
* mtgpu: add docker image support

Signed-off-by: Xiaodong Ye <[email protected]>

* mtgpu: enable docker workflow

Signed-off-by: Xiaodong Ye <[email protected]>

---------

Signed-off-by: Xiaodong Ye <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
devops improvements to build systems and github actions documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants