Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Ask HN: Anyone know any OpenAI API hosted alternatives?
10 points by thomasfromcdnjs on May 25, 2023 | hide | past | favorite | 8 comments
I am explicitly looking for API alternatives (not guis) to call GPT-3 models (don't necessarily need ChatGPT memory behavior)

Unfortunately, OpenAI's api offering has slowed down a lot and is extremely inconsistent in response times. (I'm assuming they are struggling to scale and/or sometimes you get session-ed up with a congested data centre)

This is a pretty common theme for the past few months in their community forums -> https://community.openai.com/t/api-gpt-3-5-turbo-sucks-slow/147230/8

If anyone knows a less congested alternative I would greatly appreciate it (don't mind if it's of lesser quality responses)



Yes that is the truth the open AI API is indeed very slow and inconsistent. Have heard people say that Azure open AI integration is a little better ?

Claude is also under limited preview right now.

Also waiting for some reliable API which can be used in customer facing applications


Claude isn't super fast either. It's about a third or so.



claude is under limited preview right ?


1. Claude by Anthropic (but, expect to wait weeks/months before getting off the waitlist, which makes their offering pretty uncompelling)

2. Cohere

3. https://inferkit.com or https://textsynth.com/pricing.html



You might want to try NLP Cloud: https://nlpcloud.com


What do people think about a self hosted gpt-j 6b model?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: