Added parallel worker threads

#10
by ysharma HF staff - opened

Limited max queue size to 10 and set the number of concurrent worker threads to 40. This should help in negotiating the long (>4000) queues and in improving User experience.

Muennighoff changed pull request status to merged

Sign up or log in to comment