This question is similar to the following ones:
'Marriage: Yes or No?'; and 'Children: Yes or No?'; 'To homeschool your kids: Yes or No?
People are different in personality type, tolerance of stress, skill levels/intelligence, etc. etc. - and then throw in the individual variables of: finances available, circumstances like time available, energy levels, stickability, enthusiasm, stamina, the ability to dream & make the dreams reality, etc. Then throw in extra variables like - marriages/pregnancies/injuries/caring for an elderly parent/stability of relationships, etc. that can change your circumstances in every way, overnight.
It is totally an individual thing, really - and evidently what can be one of the most satisfying work/creative activities of a lifetime for some, can be the biggest nightmare for others.
Do your homework - on every factor, and with every part of the project, and make sure you have access to an additional 10 - 20% of your original (well researched & detailed, based on quotes) financial estimate. Building smaller, in stages, is sometimes the better option for some people.
There are those who love the challenge and have the skills to do every legal part of the project, and others who would be better to get the pro's in. You need to know what is best for you as an individual/couple.
For me, I am happily building away (alongside my husband) on our second home. For us, it works, but I totally understand that for others, it doesn't. Each to their own.
Cheers,
Jill