Skipping your daily walk might be harming your health more than you realize.