Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I'm building this for myself because I want it too. I recommend you do the same, because it's been really fun to build and teaches you a lot about what LLMs can and cannot do well.

I plan to share it on Github, but waiting for my employer's internal review process to let me open source it as my own project, since they can legally claim all IP developed by me while employed there.



I also built this for myself, and I really do suggest it as a good project to get a grounded idea of what models can handle.

Mainly - tool calling support just merged in llama.cpp (https://github.com/ggerganov/llama.cpp/pull/9639) this week, and it's been a fun exercise to put local LLMs through the wringer to see how they do at handling it.

It's been a mixture of "surprisingly well" and "really badly".




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: