Piddington votes to leave UK over migrant housing plan