Do you have a package for calling LLM services we can use? This service is neat,... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		causal 6 months ago \| parent \| context \| favorite \| on: Phoenix.new – Remote AI Runtime for Phoenix Do you have a package for calling LLM services we can use? This service is neat, but I don't need another LLM IDE built in Elixir but I COULD really use a way to call LLMs from Elixir.

chrismccord 6 months ago [–]

Req.post to /chat/completions, streaming the tokens through a parser and doing regular elixir messages. It's really not more complicated than that :)

throwawaymaths 6 months ago | [–]

even less complicated, just set stream: false in your json :)

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact