How long should you intend to live in a (new) house to make it a worthwhile purchase financially?

The house is being built this year, but eventually my husband and I want to move in a different subdivision. I know that this is a lifetime investment, but we dont want to be in this particular house for 30 years! I was thinking about 5 years?