It keeps Loading Model

#5
by ThanhHuyLe - opened

Hi Xenova,

I'm using OS Windows 11, GPU RTX 2080Ti, Chrome up-to-date.
The utilization of GPU is around 10-20%.
The Whisper WebGPU keeps Loading Model.

Could you please suggest the way that I could fix it?
Ultimately, I must say thank you for your work. It helps me skip the Python coding that I used to do myself in the past.

Owner

Can you check your browser console for any errors? (F12 on Chrome)

Here it is, Xenova:

Download the React DevTools for a better development experience: https://reactjs.org/link/react-devtools
No available adapters.Understand this warning
localhost/:1 No available adapters.Understand this warning
@huggingface_transformers.js?v=d6a12b99:17036 Uncaught (in promise) Error: The device (webgpu) does not support fp16.
    at getSession (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=d6a12b99:17036:17)
    at async http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=d6a12b99:17092:49
    at async Promise.all (index 0)
    at async constructSessions (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=d6a12b99:17090:35)
    at async Promise.all (index 0)
    at async WhisperForConditionalGeneration.from_pretrained (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=d6a12b99:17441:20)
    at async AutoModelForSpeechSeq2Seq.from_pretrained (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=d6a12b99:20697:20)
    at async http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=d6a12b99:23439:27Understand this error
No available adapters.Understand this warning
localhost/:1 No available adapters.

After I set up High performance to use GPU for Chrome, it has this error:

@huggingface_transfo….js?v=d6a12b99:3819 Uncaught (in promise) Error: no available backend found. ERR: [webgpu] Error: Failed to get GPU adapter. 
You may need to enable flag "--enable-unsafe-webgpu" if you are using Chrome.
    at vr (@huggingface_transfo…?v=d6a12b99:3819:25)
    at async e.create (@huggingface_transfo…?v=d6a12b99:4250:26)

After I turn on "--enable-unsafe-webgpu", it has this error:

Uncaught (in promise) Error: A listener indicated an asynchronous response by returning true, but the message channel closed before a response was received

I found out the solution.
We must turn on these settings in Chrome:

chrome://settings/system -->  Use graphics acceleration when available.

And:

chrome://flags/#enable-unsafe-webgpu 

Now it works smoothly.

Owner

Great - thanks for sending your solution here too!

Xenova changed discussion status to closed

Sign up or log in to comment