Absolutely agreed. There is likely a much higher proportion of unfit parents vs unfit teachers (though the latter category is a non zero number). There is also an economic element to this scenario. My spouse can stay home with the kids while I go to work, this is not at all common in our modern day and age. There are tremendous sacrifices that a family must make to do this and I think that anyone wanting to homeschool because it will be 'easier' is setting themselves up for hurt. Much like the folks who get into programming because the pay is good... It won't be what you think.
Even if the parents are quite good, I think most humans require a wide variety of inputs and relationships to form their judgement and sense around. No family is capable of providing the broad range of experiences required to form good judgement and sense: that requires some unconstrained experience with the world, seeing much more than what a curated family experience can make happen.
That largely depends on the parents. Many are _wildly_ unfit for this.