When choosing a horse pole barn, it is important to consider factors such as stall size and layout, ventilation, natural lighting, durable siding materials, sliding doors for easy access, and a well-designed tack room for storing horse equipment and supplies.