Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

They should work towards making repetitive prompts be free or much cheaper because they don't have to generate it token by token and can be cached.


As a customer of course I would want that, but they really shouldn't from their perspective. The customer is getting the value it wants and is willing to pay for this is where a lot of the profit will come from.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: