Spaces:
Running
Running
It keeps Loading Model
#5
by
ThanhHuyLe
- opened
Hi Xenova,
I'm using OS Windows 11, GPU RTX 2080Ti, Chrome up-to-date.
The utilization of GPU is around 10-20%.
The Whisper WebGPU keeps Loading Model.
Could you please suggest the way that I could fix it?
Ultimately, I must say thank you for your work. It helps me skip the Python coding that I used to do myself in the past.
Can you check your browser console for any errors? (F12 on Chrome)
Here it is, Xenova:
Download the React DevTools for a better development experience: https://reactjs.org/link/react-devtools
No available adapters.Understand this warning
localhost/:1 No available adapters.Understand this warning
@huggingface_transformers.js?v=d6a12b99:17036 Uncaught (in promise) Error: The device (webgpu) does not support fp16.
at getSession (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=d6a12b99:17036:17)
at async http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=d6a12b99:17092:49
at async Promise.all (index 0)
at async constructSessions (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=d6a12b99:17090:35)
at async Promise.all (index 0)
at async WhisperForConditionalGeneration.from_pretrained (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=d6a12b99:17441:20)
at async AutoModelForSpeechSeq2Seq.from_pretrained (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=d6a12b99:20697:20)
at async http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=d6a12b99:23439:27Understand this error
No available adapters.Understand this warning
localhost/:1 No available adapters.
After I set up High performance to use GPU for Chrome, it has this error:
@huggingface_transfo….js?v=d6a12b99:3819 Uncaught (in promise) Error: no available backend found. ERR: [webgpu] Error: Failed to get GPU adapter.
You may need to enable flag "--enable-unsafe-webgpu" if you are using Chrome.
at vr (@huggingface_transfo…?v=d6a12b99:3819:25)
at async e.create (@huggingface_transfo…?v=d6a12b99:4250:26)
After I turn on "--enable-unsafe-webgpu", it has this error:
Uncaught (in promise) Error: A listener indicated an asynchronous response by returning true, but the message channel closed before a response was received
I found out the solution.
We must turn on these settings in Chrome:
chrome://settings/system --> Use graphics acceleration when available.
And:
chrome://flags/#enable-unsafe-webgpu
Now it works smoothly.
Great - thanks for sending your solution here too!
Xenova
changed discussion status to
closed