Trying to implement their gRPC api from their specs and protobufs for Live is an exercise in immense frustration and futility. I wanted to call it from Elixir, even with our strong AI I wasted days then gave up.

We are updating the API to be REST centric. Very fair feedback, see the new Interactions API we just shipped, very REST centric and all future work we do will be REST centric : )

The way the models behave in Vertex AI Studio vs the API is unforgivable. Totally different.

If you’ve spent any time with the vertex LLM apis you wouldn’t be so enthusiastic about using Google’s platform (I say this as someone who prefers GCP to aws for compute and networking).

been using it for years, no idea what you are getting at

I've never had the downtime or service busy situations I've heard others complain about with other vendors.

They did pricing based on chars back in the day, but now they are token based like everyone else.

I like that they are building custom hardware that is industry leading in terms of limiting how much my AI usage impacts the environment.

What do you think I shouldn't be enthusiastic about?

Then you actually use it! I dare someone to try and get Gemini live vertex app working.

Getting downvotes for this, but genuinely laughing over here

Moving from Python to Node for per-process fully-fleshed out async and share-nothing concurrency however is perfectly sane.

Using any of them for backend is insane, but what do I know, I have to suck it up and use Next.js for some SaaS extension SDKs, while I would rather be using JVM, CLR, or even Go with its spartan design.

JS haters could stand to understand the language has strengths even if it has well known warts.

That's the main reason to move. Same reason people moved from Java to Kotlin, except that might change now with vthreads.

Very long OR insufficient. Ah yes, the goldilocks Claude.md

Yes. What they've shown me is that I don't like code. Hate it, actually. But I like building things, and can still read and reason about problems and code. So I chose the best stack for what we're doing, but I don't get bogged down in arcania. It's great.

Or the thing that ranks the term based result. That’s the fun these days: it’s all whatever fits your problem.