Inference server recommandation
#4
by
DeltaWhiplash
- opened
Hello I have an amd APU with ubuntu 24.04LTS
What inference software do you recommands for Q8 ?
People like using ollama: https://ollama.com/
Oh I didn't see it's avaiable
Thanks