Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support running Qwen1.5-0.5B on Wormhole(n150/n300) #125

Open
liji0276 opened this issue Sep 29, 2024 · 1 comment
Open

Support running Qwen1.5-0.5B on Wormhole(n150/n300) #125

liji0276 opened this issue Sep 29, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@liji0276
Copy link

liji0276 commented Sep 29, 2024

we have wanted to run qwen1.5 on our existing wormhole cards for some days. Happy to see Qwen1.5 appeared in the supported model list of the pybuda-0.19.3 just released,but it still only supports running qwen on e75/e150.
I would like to ask if the qwen adaptation on wormhole is planned and going smoothly? btw, compared with Grayskull, Which modules of Wormhole architecture generally need to be specially adapted?

@milank94 milank94 added the enhancement New feature or request label Oct 1, 2024
@milank94
Copy link
Collaborator

milank94 commented Oct 4, 2024

Qwen is being worked on through the TT-Metalium stack. I encourage you to track progress here: https://github.com/tenstorrent/tt-metal

Moving forward, TT-Buda support for new model bring up and optimizations will be limited as we transition to the TT-Forge stack.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants