If you have a spouse/partner/SO who is willing to be the fulltime caregiver while you're "at work", you can make it work, just like it would work if you were at the office.

If not, though... yeah, it's going to hurt somewhere.