Why is it that a lot of American construction workers have the skills to build buildings, but do not build homes for their own families?

Over a 30 year period, I have noticed that most construction workers here in America have the skills to build buildings, but will not build a home for their families to live in. Why is that? I have known at least maybe three who actually used their skills for their family to thrive.