Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Running and storing 3M LLM AI requests without spending $100k (boyter.org)
5 points by todsacerdoti 6 months ago | hide | past | favorite | 1 comment


I increasingly think that as people use AI more and more as part of their workflows, they will realize it makes more sense to use self hosted models.

Open models will probably never be as good as the priced models so they will not always be useful. But I think at the scale we will be using AI models eventually, using API's will stop making sense.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: