New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[js/webgpu] Optimize Expand #22752

Open

qjia7 wants to merge 1 commit into microsoft:main from qjia7:opt_expand

+63 −5

Contributor

qjia7 commented Nov 7, 2024

Use components = 4 if possible.

llama3.2-1B becomes 20 tokens/s from 18 tokens/s on my iGPUs.


          [js/webgpu] Optimize Expand

717ac31

Use components = 4 if possible.

llama3.2-1B becomes 20 tokens/s from 18 tokens/s on my iGPUs.

Contributor Author

qjia7 commented Nov 7, 2024

@guschmue @fs-eire Please take a look, thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet