Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Some of the major vendors _do_ create the GGUFs for their models, but often they have the wrong parameter settings, need changes in the inference code, or don't include the correct prompt template. We (i.e. Ollama) have our own conversion scripts and we try to work with the model vendors to get everything working ahead of time, but unfortunately Mistral doesn't usually give us a heads up before they release.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: