It depends on your county, but frost heave affects every barn either way. Some counties exempt qualifying agricultural buildings from the building permit, but conditions apply and an exempt building may still need to meet code requirements. El Paso County, for example, offers an agricultural structure exemption and uses such as personal vehicle storage or commercial activity generally do not qualify. Check with your county before you dig.