Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WebLLM always processes on Intel UHD Graphics, not on NVIDIA T1200 #609

Open
b521f771d8991e6f1d8e65ae05a8d783 opened this issue Oct 10, 2024 · 4 comments

Comments

@b521f771d8991e6f1d8e65ae05a8d783

Hi!

I could not find any other forum to post this, so I will write it here: I am trying to use WebLLM via a Chromium-based Browser (I am developing an Add-In for Outlook, which uses Blink WebView under the hood). So far, the Web-LLM works, but it always processes on my Graphic Chip and leaves my GPU untouched. How could this behaviour be configured?

Thank you so far for your effort!

@ReneLH
Copy link

ReneLH commented Oct 24, 2024

I have the exact same question.

@tqchen
Copy link
Contributor

tqchen commented Oct 24, 2024

would be great if you can check https://webgpureport.org/ and send a screen shot, it may have to do with how we order adapters

@Iternal-JBH4
Copy link

You can force Chrome in windows to use the more powerful GPU by going to the Display>Graphics>Apps page, adding chrome, clicking options, and setting to use dedicated GPU.

Not an ideal outcome but how it works right now

@StevenHanbyWilliams
Copy link

Also ran into this on Windows 10 and 11, Chrome, Edge, and Brave all only give the low power gpu, even if you request with the high-performance powerPreference. You can verify this from the js console by opening DevTools and running

const adapter = await navigator.gpu.requestAdapter({powerPreference: 'high-performance'})

and inspecting the result.

Note: The powerPreference IS honored on Mac OSX

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants