Next really doesn’t add a giant layer of anything, it’s almost vanilla React aside from their own routing and the server side functions (which you can start out not using)

Have you tried writing a sample project? It took me a few tries to really understand the problem that these framework solve.

When you're working on a larger scale (be that app complexity or number of users) these things make more sense.