They all tokenize a little differently so they are not exactly 1-1. However I pl... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		alexellman 4 months ago \| parent \| context \| favorite \| on: Show HN: Price Per Token – LLM API Pricing Data They all tokenize a little differently so they are not exactly 1-1. However I plan on addressing this by having each model complete a test task and getting the actual price from each api + token count to make a real 1-1 comparison.

esafak 4 months ago | [–]

And please timestamp the benchmarks, and rerun them periodically, so vendors can't quietly cost optimize the model when no-one's looking.

nisegami 4 months ago | [–]

Ah, that's a great idea and would be a welcome addition to the site.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact